Commit Graph

88282 Commits

Author SHA1 Message Date
Nathan Cutler
9aa1d49583 mgr: replace iteritems with six.iteritems (crash)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:18 +02:00
Nathan Cutler
ab001e1342 mgr: replace iteritems with six.iteritems (telegraf)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:18 +02:00
Nathan Cutler
5866377ec3 mgr: replace iteritems with six.iteritems (status)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:18 +02:00
Nathan Cutler
c02c660175 mgr: replace iteritems with six.iteritems (restful)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:18 +02:00
Nathan Cutler
a62ab8ae8c mgr: replace iteritems with six.iteritems (influx)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:18 +02:00
Nathan Cutler
962f0c416c mgr: replace iteritems with six.iteritems (balancer)
Fixes: http://tracker.ceph.com/issues/24779
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 17:40:15 +02:00
Igor Fedotov
643192e715
Merge pull request #22874 from ddiss/bluestore_docs
doc/bluestore: fix minor typos in compression section

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-07-05 17:51:00 +03:00
Igor Fedotov
0f04d4484c os/bluestore: fix incomplete faulty range marking when doing compression
GC.

Under some scenarios GC might process an extent range where some inner extents are left untouched by GC (as there is no need for that). Hence GC doesn't invaliate these inner extents with fault_range call. If untouched extents are mapped to unloaded shards it results in subsequent assertion on o->extent_map.dirty_range() call.
The solution is to invalidate the whole extent range when doing GC.

Fixes: https://tracker.ceph.com/issues/23540

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-07-05 17:47:37 +03:00
Casey Bodley
3c6797c974
Merge pull request #22617 from tianshan/fix_http_err_return
rgw: set cr state if aio_read err return in RGWCloneMetaLogCoroutine

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-07-05 09:48:57 -04:00
Nathan Cutler
7467777429
Merge pull request #22793 from kshtsk/wip-add-opensuse-leap
Add new OpenSUSE Leap id for install-deps.sh

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2018-07-05 15:39:26 +02:00
Orit Wasserman
14d25dca34 rgw: radogw-admin reshard status command should print text for reshard status
Fixes: http://tracker.ceph.com/issues/23257
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2018-07-05 15:58:19 +03:00
David Disseldorp
fbc3330102 doc/bluestore: fix minor typos in compression section
Signed-off-by: David Disseldorp <ddiss@suse.de>
2018-07-05 13:41:35 +02:00
Lenz Grimmer
54037e5214
Merge pull request #22829 from tspmelo/fix-24757
mgr/dashboard: Fix regression on rbd form component

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-07-05 12:46:28 +02:00
Lenz Grimmer
bc1743e732
Merge pull request #22762 from ricardoasmarques/wip-toolbar-text
mgr/dashboard: Remove top-right actions text and add "About" page

Reviewed-by: Kanika Murarka <murarkakanika@gmail.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-07-05 12:44:52 +02:00
Kefu Chai
e53bb2c5a3 deb/rpm: add python-six as build-time and run-time dependency
python-six is used by dashboard's controllers. please note,
${python:Depends} is able to fill the installation dependencies for
debian package. so python-six is not added to Requires of ceph-mgr.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-05 18:42:57 +08:00
Kefu Chai
0e76e87d35
Merge pull request #20133 from smithfarm/wip-redundant-recommends
build/ops: deb: drop redundant ceph-common recommends

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-07-05 14:45:24 +08:00
liaoxin01
afc3b1ab1f rgw: fix gc may cause a large number of read traffic
fix http://tracker.ceph.com/issues/24767

Signed-off-by: Xin Liao <liaoxin01@baidu.com>
2018-07-05 14:24:21 +08:00
Kefu Chai
9e08278907
Merge pull request #22847 from ErwanAliasr1/evelu-ccache2
run-make-check.sh: Adding ccache tuning for the CI

Reviewed-by: Sébastien Han <seb@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-07-05 11:39:18 +08:00
Patrick Donnelly
73fa0efcbb
qa: create common conf for all cephfs suites
This will be followed by removing common CephFS configurations in the
ceph.conf.template in teuthology.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-04 13:08:10 -07:00
Sage Weil
6dbf8ad2ec Merge PR #22703 into master
* refs/pull/22703/head:
	doc/mgr: add doc for crash mgr module
	qa/suites/rados/mgr: Add test_crash
	qa/tasks/mgr: add test_crash, call from test_module_selftest
	qa/tasks/{ceph_manager.py,vstart_runner.py}: allow kwargs in raw_*
	mgr/pybind/crash: handle crashdumps

Reviewed-by: John Spray <john.spray@redhat.com>
2018-07-04 14:22:18 -05:00
Sage Weil
c5b449865f Merge PR #22704 into master
* refs/pull/22704/head:
	osd/PG: do not send notify to empty peer
	osd/PG: do not assume delete event means found_missing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-07-04 14:22:13 -05:00
Sage Weil
7895d5b746 Merge PR #22733 into master
* refs/pull/22733/head:
	os/bluestore: set correctly shard for existed Collection.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-07-04 14:22:08 -05:00
Sage Weil
0cb7b47d4a Merge PR #22738 into master
* refs/pull/22738/head:
	mgr/status: add exabytes unit

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-07-04 14:22:00 -05:00
Sage Weil
b12dfc15b2 Merge PR #22534 into master
* refs/pull/22534/head:
	msg/Messenger: use safe_item_history<> for my_addrs
	msg/simple: fix set_myaddrs()
	msg/Messenger: use mutable_item_history<> for my_addrs
	common/item_history: container to support lockless reads, infrequent updates
	msg/simple/Accepter: fix my_addr == my_addrs.v[0] constraint
	msg/async: track target_addr for each connection
	msg/async: mark accepted connections with addr type (legacy or msgr2)
	msg/async: mark AsyncConnection with msgr2 flag
	msg/async: track connections by addrvec
	mon/Session: inst -> name and addrs
	osd/OSDMap: don't print hb addrs
	msg/DispatchQueue: myaddr -> myaddrs
	mgr: myaddr -> myaddrs
	msg: make set_addr_unknowns take an addrvec
	mon/LogMonitor: myaddr -> myaddrs
	librados: myaddr -> myaddrs
	common/LogClient: myaddr -> myaddrs
	client: myaddr -> myaddrs
	osd/OSDMap: is_blacklisted() for addrvecs
	osd: populate metadata with all addrs
	mds: addr -> addrvec
	mon/MonClient: get_myaddrs()
	mon/OSDMonitor: addrvec blacklist helper
	mds: use new pick_addresses
	ceph-osd: use new bindv()
	msg/async: bind to multiple addresses
	msg/async: (legacy) handshake using legacy addr
	msg/async: fix some debug prefixes
	msg/async: multiple listening ServerSockets
	osd/OSDMap: make cluster addrs addrvecs too
	msg/Messenger: my_addr -> my_addrs
	msg/Connection: peer_addr -> peer_addrs
	msg/msg_types: hash<> for entity_addrvec_t
	mgr/DaemonServer: use new bindv() and pick_addresses()
	msg/Messenger: new bindv() that takes an addrvec
	common/pick_address: fill in ipv4/6 and msgr1/msgr2 via config options
	common/pick_addresses: new addrvec-based pick_addresses()
	common/pick_addresses: add filtering by ipv4 and ipv6
	CEPH_MON_PORT -> CEPH_MON_PORT_LEGACY; define CEPH_MON_PORT_IANA
	osd: kill osd_heartbeat_addr option
	common/options: add addrvec option type

Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-07-04 14:20:27 -05:00
Sage Weil
0a0f8d5e6f osd/PrimaryLogPG: rebuild attrs from clients
Ensure that buffers coming in via client ops are rebuilt before populating
the PGTransaction.  This ensures that we don't pin the raw buffers for
the entire incoming message in memory.

In the past we've addressed this issue at the ObjectStore layer, but we
did not consider the attr_cache in ObjectContext.  Rebuilding the buffers
at this point will sanitize any incoming attribute before it reaches
either PGBackend or ObjectContext object_cache or the ObjectStore
implementation.

Fixes: http://tracker.ceph.com/issues/24768
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-04 14:19:04 -05:00
Tiago Melo
0d152ea698 mgr/dashboard: Fix regression on rbd form component
'decodeURIComponent' method was decoding an undefined variable to the string
'undefined', which would later cause problems.

This regression was introduced in057d6025894800c1b4a422b081fe02ab82b044fe.

Fixes: http://tracker.ceph.com/issues/24757

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-07-04 18:25:32 +01:00
John Spray
3222aa9c5a
Merge pull request #22852 from ceph/jcsp-cephfs-exp-doc
doc/cephfs: remove lingering "experimental" note about multimds

Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-07-04 17:00:11 +01:00
John Spray
361896bbb6 doc/cephfs: remove lingering "experimental" note about multimds
Signed-off-by: John Spray <john.spray@redhat.com>
2018-07-04 14:13:40 +01:00
Lenz Grimmer
5864722eae
Merge pull request #22830 from ricardoasmarques/fix-24756
mgr/dashboard: Fix RBD object size dropdown options

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-07-04 13:47:42 +02:00
Erwan Velu
4cb5a59053 run-make-check.sh: Adding ccache tuning for the CI
When run-make-check is run by the CI, some tuning can be performed to
speedup the build.

This commit :
- Detect jenkins by searching JENKINS_HOME env variable
- Defines the SOURCE_DATE_EPOCH to enforce a stable date across builds
- Ask cmake not to use the git versioning which adds useless entropy for a temporary build (ENABLE_GIT_VERSION=OFF)
- Define the ccache slopiness to increase efficiency
- Increase the ccache size to save multiple builds to maximise cache hit between PRs
- Print ccache statistics to evaluate ccache efficiency

Signed-off-by: Erwan Velu <erwan@redhat.com>
2018-07-04 11:55:43 +02:00
Lenz Grimmer
d95269773f
Merge pull request #22644 from Devp00l/wip-forms-helper-service
mgr/dashboard: CdFormGroup

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-07-04 11:30:16 +02:00
Ricardo Marques
30d034fb9b mgr/dashboard: Fix RBD object size dropdown options
Fixes: https://tracker.ceph.com/issues/24756

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-07-04 10:27:28 +01:00
Lenz Grimmer
9d8f378642
Merge pull request #22461 from tspmelo/wip-osd-flags-ui
mgr/dashboard: Add UI for Cluster-wide OSD Flags configuration

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-07-04 10:55:15 +02:00
Ricardo Marques
6c33d7f57a mgr/dashboard: Add "About" modal
Fixes: https://tracker.ceph.com/issues/24646

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-07-04 09:51:27 +01:00
Ricardo Marques
5dc5822a4f mgr/dashboard: Usage of 'BehaviorSubject' in summary
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-07-04 09:51:27 +01:00
Ricardo Marques
c7c2432c34 mgr/dashboard: Remove text from top-right actions
Fixes: https://tracker.ceph.com/issues/24624

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-07-04 09:51:27 +01:00
Lenz Grimmer
297a428699
Merge pull request #22757 from votdev/improve_str_to_bool
mgr/dashboard: Improve str_to_bool

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-07-04 09:30:06 +02:00
Jianpeng Ma
42cd25b794 os/bluestore: set correctly shard for existed Collection.
For existed Collection, the constructor of Collection will be called in _open_collections.
But m_finisher_num can't setup when enable bluestore_shard_finishers.

So move m_finisher_num setup before _open_collections && _kv_start.

Fixes: http://tracker.ceph.com/issues/24761

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-07-04 15:12:55 +08:00
Patrick Donnelly
6c7e09568d
qa: fix ffsb cd argument
Avoid potential failures relating to HEAD^.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-03 23:08:15 -07:00
Patrick Donnelly
fe62ea36d4
qa: fix cd argument during iogen unpack
Fixes: http://tracker.ceph.com/issues/24680

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-03 23:07:55 -07:00
David Zafman
32169723a7
Merge pull request #22837 from dzafman/wip-fix-timeout
test: test_get_timeout_delays() fix

Reviewed-by: Erwan Velu <erwan@redhat.com>
2018-07-03 18:05:47 -04:00
David Zafman
fbc8bcfe05 test: test_get_timeout_delays() fix
Caused by: 7b0d1c8b8a

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-07-03 14:01:36 -07:00
Sage Weil
73c4d4a9b3 msg/Messenger: use safe_item_history<> for my_addrs
Mutating the item in place is not safe.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:24 -05:00
Sage Weil
2c174e21ee msg/simple: fix set_myaddrs()
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:24 -05:00
Sage Weil
aa81f93537 msg/Messenger: use mutable_item_history<> for my_addrs
We read this without a lock.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:24 -05:00
Sage Weil
c5708c2156 common/item_history: container to support lockless reads, infrequent updates
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:24 -05:00
Sage Weil
9d1284d7be msg/simple/Accepter: fix my_addr == my_addrs.v[0] constraint
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:24 -05:00
Sage Weil
d1a783a5f7 msg/async: track target_addr for each connection
The target_addr is item from peer_addrs that we are using for the
connection.  On accept, we learn it during the handshake.  On connect,
we choose it early on (first item in addrvec that we understand).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:24 -05:00
Sage Weil
ccad66390f msg/async: mark accepted connections with addr type (legacy or msgr2)
We have to note the addr type we are listening for in the ServerSocketImpl
and pass that on to any AsyncConnections that result.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:24 -05:00
Sage Weil
9247562e32 msg/async: mark AsyncConnection with msgr2 flag
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:24 -05:00