Commit Graph

76459 Commits

Author SHA1 Message Date
Casey Bodley
0debf4dc6e qa/rgw: disable lifecycle tests because of expiration failures
lifecycle expiration tests are too reliant on timing, and have been
failing consistently for a long time

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-02 11:06:35 -04:00
Patrick Donnelly
56cf8cbca3
mds: add inter-mds operations to PerfCounter
Fixes: http://tracker.ceph.com/issues/20760

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-02 07:48:22 -07:00
Sage Weil
afd9d94781 Merge pull request #16758 from ceph/luminous
sync luminous tag back to master
2017-08-02 09:46:37 -05:00
Sage Weil
e27a78c9ed Merge pull request #16535 from liewegas/wip-osd-shard-init
osd: initialize waiting_for_pg_osdmap on startup

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-08-02 09:10:54 -05:00
Sage Weil
8714c70ac9 Merge pull request #16684 from tchaikov/wip-pybind-replace-deprecated-apis
pybind/rados: use new APIs instead of deprecated ones

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-08-02 09:10:26 -05:00
Sage Weil
cae3a58c72 Merge pull request #16735 from dillaman/wip-20869
common: avoid statically allocating configuration options

Reviewed-by: John Spray <john.spray@redhat.com>
2017-08-02 09:08:40 -05:00
Sage Weil
9bd7b70aa3 ceph: wait for maps before doing 'ceph tell ... help'
If we don't have a mgrmap yet (usually we do, but it's racy) MgrClient
will assume EACCES if we try to send a command.  This can lead to
EACCES from 'ceph tell mgr help'.

The mon sends maps in alphanumeric order, so waiting for osdmap will
include mgrmap and fsmap.  That's everything (current) except servicemap,
but we can't 'tell' those anyway.

Fixes: http://tracker.ceph.com/issues/20113
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-02 09:34:00 -04:00
Sage Weil
aadc5c1a85 Merge pull request #16747 from tchaikov/wip-doc-fixes
doc: document bluestore compression settings

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-02 08:11:41 -05:00
Kefu Chai
da1a60ced1 qa: refactor suites/rados/rest/mgr-restful
- use "ceph restful restart" to restart the restful API server instead
of restarting the ceph-mgr
- test "ceph restful delete-key"
- test "ceph restful list-keys"

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-02 18:20:56 +08:00
Kefu Chai
868420e421 mgr: handle "module.set_config(.., None)" correctly
otherwise "ceph restful delete-key foo" would fail:

TypeError: ceph_config_set() argument 3 must be string, not None

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-02 18:18:08 +08:00
Kefu Chai
f273712e1b doc: document bluestore compression settings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-02 16:42:08 +08:00
Kefu Chai
f27d76400a doc/man/8/radosgw-admin: document --compression option
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-02 16:36:02 +08:00
Josh Durgin
63693779fc qa: timeout when waiting for mgr to be available
Otherwise during upgrades we wait forever.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2017-08-02 02:18:28 -04:00
Kefu Chai
31cd44fd8c Merge pull request #16741 from liewegas/wip-more-doc-links
doc/release-notes: fix links, formatting; add crush device class docs

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-02 13:52:38 +08:00
Kefu Chai
1ff1f836da Merge pull request #16722 from tchaikov/wip-qa-fixes
qa/suites: escape the parenthesis of the whitelist text

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-02 13:00:01 +08:00
Kefu Chai
9d4e7ec97b Merge pull request #16474 from shun-s/wip-fix-deactive
ceph-disk: do not remove mount point if deactive --once

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-02 12:58:34 +08:00
Kefu Chai
a70be4e00c qa/suites: more whitelisting
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-02 10:00:57 +08:00
Sage Weil
a367854011 doc/release-notes: clean up links
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-01 18:08:44 -04:00
Sage Weil
20d2921194 doc/rados/operations/crush-map: more device class docs
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-01 18:08:43 -04:00
Sage Weil
47df377aca crush/CrushTreeDumper: sort tree items by (class, name)
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-01 16:39:12 -04:00
Sage Weil
1e757ded33 osd/crush/CrushWrapper: include CLASS column in 'osd crush tree'
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-01 16:05:03 -04:00
Sage Weil
c955bf528f qa/suites/rados/singleton-nomsgr/all/multi-backfill-reject: sleep longer
I saw a failure where the 30% backfill probability was enough that we
just didn't manage to backfill all of the pgs during the 5 minute recovery
timeout during ceph.py shutdown.  Build in some additional time for the
test to recover.

http://pulpito.ceph.com/sage-2017-08-01_15:32:10-rados-wip-sage-testing-distro-basic-smithi/1469184

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-01 15:50:47 -04:00
Sage Weil
41cff36e66 os/bluestore: fix dirty_range on _do_clone_range
If we are cloning several extents that start from logical offset 0, we may
need to dirty those extents on the source object if they are being made
shared.  However, if there are two or more such extents, and the first
starts at 0, the current code will adjust dirty_range_start to the
second extent because the second time around the loop dirty_range_begin
is still 0.

Fix by adjusting the condition to be dirty_range_begin and dirty_range_end
== 0 so that it only triggers on the first pass.

Fixes: http://tracker.ceph.com/issues/20810
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-01 15:47:37 -04:00
Casey Bodley
0094e9ebd9 rgw: policy uses ceph::not_fn instead of std::not2
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-01 15:42:24 -04:00
Casey Bodley
a0f36e128a common: add std::not_fn to backport14.h and unit tests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-01 15:42:24 -04:00
Casey Bodley
def8296a8f test/rgw: add missing object tagging actions to policy tests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-01 15:42:24 -04:00
Casey Bodley
3559a3b846 test/rgw: add tests for match_wildcards, match_policy
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-01 15:42:24 -04:00
Casey Bodley
8837cf46e5 test/rgw: rename ceph_test_rgw_iam_policy to unittest_
tagging this as a unittest will make it run during 'make check'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-01 15:42:24 -04:00
Casey Bodley
5bd7462f3a rgw: match wildcards in StringLike policy conditions
Fixes: http://tracker.ceph.com/issues/20308

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-01 15:42:24 -04:00
Casey Bodley
f3391c2dd4 rgw: split match into match_policy, match_wildcards
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-01 15:41:49 -04:00
Sage Weil
3e21fd6134 Merge pull request #16700 from jcsp/wip-20803
osd/mon/mds: fix `config set` tell command

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-01 14:13:00 -05:00
Sage Weil
cdac962461 Merge pull request #16701 from jcsp/wip-health-format
mon: extensible output format for health checks

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-01 14:12:28 -05:00
Sage Weil
90d2fc2bb5 Merge pull request #16706 from jdurgin/wip-20850
osd: do not try to set device class before luminous

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-01 14:12:01 -05:00
Sage Weil
d62716b264 Merge pull request #16712 from gregsfortytwo/wip-20808
osd: pg: be more careful with locking around forced pg recovery

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-08-01 14:11:29 -05:00
Gregory Farnum
65e11540aa Merge pull request #16688 from amitkumar50/cov-1395347-1
os: Argument cannot be negative

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-08-01 11:25:20 -07:00
Jenkins Build Slave User
b661348f15 12.1.2 2017-08-01 17:55:40 +00:00
Casey Bodley
14aed80ac2 Merge pull request #15801 from zhangsw/feature-bucket-sync
rgw multisite: feature of bucket sync enable/disable

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-08-01 13:13:18 -04:00
Jason Dillaman
1d54951e47 common: avoid statically allocating configuration options
This was resulting in seg faults within rbd-fuse during shutdown. This also
fixes the "variable tracking size limit exceeded with -fvar-tracking-assignments,
retrying without" compiler warning".

Fixes: http://tracker.ceph.com/issues/20869
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-08-01 12:04:02 -04:00
Sage Weil
67e770e05b Merge pull request #16616 from tchaikov/wip-doc-cleanup
doc: remove docs on non-existant command
2017-08-01 11:01:09 -05:00
Jason Dillaman
dd4a912fa3 rbd-fuse: remove dependency on ceph-common
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-08-01 11:54:34 -04:00
Kefu Chai
69c6402bbd Merge pull request #16727 from jcsp/wip-doc-config-hel
doc/qa: cover `config help` command

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-01 23:38:28 +08:00
Kefu Chai
ffbf113fa0 Merge pull request #16707 from ivancich/wip-more-dmclock-docs
doc: Describe mClock's use within Ceph in great detail.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-01 23:37:53 +08:00
Sage Weil
527a3f77db Merge pull request #16730 from liewegas/wip-more-doc-links
doc/release-notes: fix upmap and osd replacement links; add fixme

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-01 10:21:39 -05:00
Sage Weil
71307945bf doc/release-notes: fix a few doc links
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-01 11:06:21 -04:00
Jos Collin
8669a70fcb Merge pull request #16653 from amitkumar50/Coverity-1409697
rgw: Use comparison instead of assignment

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2017-08-01 14:47:54 +00:00
amitkuma
1b62ee5cb4 os: Argument cannot be negative
Fixed:

** CID 1395347 (#1 of 1): Argument cannot be negative (NEGATIVE_RETURNS)
3. negative_returns: fd is passed to a parameter that cannot be negative

Signed-off-by: Amit Kumar amitkuma@redhat.com
2017-08-01 20:13:06 +05:30
Jason Dillaman
2589f57ecd Merge pull request #16656 from idryomov/wip-qa-newer-fio
qa/tasks/rbd_fio: bump default fio version to 2.21

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-01 10:14:46 -04:00
John Spray
b34c2655cf mds: refine "Scrub error" cluster log message
Fixes: http://tracker.ceph.com/issues/20246
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-01 15:06:42 +01:00
John Spray
59c9ba17c6 mds: polish clog messages
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-01 15:06:42 +01:00
John Spray
ea37145131 doc: developer logging guidance
Signed-off-by: John Spray <john.spray@redhat.com>
2017-08-01 15:06:41 +01:00