Commit Graph

73549 Commits

Author SHA1 Message Date
Sage Weil
cb1f57c5c3 common/LogEntry: make LogEntryKey opaque and cache its hash value
This avoids recalculating.  We eliminate the default ctor at the same
time and make the type totally opaque (so that its fields cannot be
modified except by the ctor and decode).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-06 14:50:46 -04:00
Sage Weil
d010971700 Merge pull request #15390 from liewegas/wip-osdmap-state
osd/OSDMap: make osd_state 32 bits wide

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-06-06 13:19:18 -05:00
Dan Mick
845fc3ecb1 Merge pull request #15515 from tchaikov/wip-crc32-aarch64
crc32c: include acconfig.h to fix ceph_crc32c_aarch64()

Reviewed-by: Dan Mick <dmick@redhat.com>
2017-06-06 11:01:53 -07:00
Sage Weil
5cfe4cfa13 ceph-disk: add --filestore argument, default to --bluestore
Signed-off-by: Sage Weil <sage@redhat.com>
Signed-off-by: Loic Dachary <loic@dachary.org>
2017-06-06 19:45:24 +02:00
Kefu Chai
67d3049b02 crc32c: include acconfig.h to fix ceph_crc32c_aarch64()
HAVE_ARMV8_CRC is defined by "acconfig.h". so we need to include it for
the definition.

it's a regresssion introduced by 2a3382f. in that change,
crc32c_intel_baseline.h was removed from crc32.cc, and that header
includes accconfig.h indirectly. that's why we will have a dummy
ceph_crc32c_aarch64() which always returns 0. the dummy implementation
was intended to please the compiler. but we can probably just drop it in
future as a cleanup.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-06-06 23:31:38 +08:00
Kefu Chai
e38ca14914 Merge pull request #15511 from tchaikov/wip-doc-cartesian-product
doc: update sample explaning "%" operator in test suites

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Loic Dachary <loic@dachary.org>
2017-06-06 21:57:49 +08:00
Sage Weil
daa5126ed9 Merge pull request #14074 from jecluis/wip-mon-osd-replacement
mon: replace osds with `osd destroy` and `osd new`

Reviewed-by: Sage Weil <sage@redhat.com>
2017-06-06 08:25:15 -05:00
Sage Weil
5c2b3cd47a Merge pull request #15487 from liewegas/wip-no-more-stat-spam
mgr/DaemonServer: stop spamming log with pg stats

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-06-06 08:24:48 -05:00
Sage Weil
162440c700 Merge pull request #15494 from liewegas/wip-20187
qa/workunits/cephtool/test.sh: fix osd full health detail grep

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-06-06 08:24:08 -05:00
Sage Weil
f37ab313fe pybind/ceph_argparse: fix no arg check
This fixes breakage from commit a1214a702c
that caused a [] to be appended to some json argument lists.

Fixes: http://tracker.ceph.com/issues/20135
Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-06 09:23:32 -04:00
Fabian Grünbichler
90c1a82fc1 ceph-mgr: fix package description
Signed-off-by: Fabian Grünbichler <f.gruenbichler@proxmox.com>
2017-06-06 15:21:55 +02:00
liuchang0812
08cb697a1d tool/ceph: print return code when json_command failed
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-06-06 20:55:12 +08:00
Kefu Chai
b85bf0e61e doc: update sample explaning "%" operator in tes suites
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-06-06 20:49:51 +08:00
John Spray
7e5799b03b mon: don't prefix mgr summary with epoch number
Missed this one when culling the various epochs
from the human readable ceph status output.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-06-06 13:17:00 +01:00
John Spray
b1d06a6b54 Merge pull request #15499 from jcsp/wip-doc-whitespace
doc: fix syntax on code snippets in cephfs/multimds

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-06-06 12:36:05 +01:00
Mykola Golub
e5c46aa878 Merge pull request #15492 from dillaman/wip-20185
rbd: properly decode features when using image name optional

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-06-06 13:49:29 +03:00
Mykola Golub
d3fa8f391c Merge pull request #15483 from dillaman/wip-20182
librbd: filter expected error codes from is_exclusive_lock_owner

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-06-06 13:48:51 +03:00
Mykola Golub
4db1ee39c0 rbd-mirror A/A: coordinate image syncs with leader
Fixes: http://tracker.ceph.com/issues/18789
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-06-06 10:49:42 +02:00
Boris Ranto
c65b68715b Merge pull request #15490 from ceph/wip-fix-selinux
selinux: Install ceph-base before ceph-selinux

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-06-06 10:47:29 +02:00
Mykola Golub
55f9c625bd rbd-mirror: resolve potential recursive lock
Would have been possible when release_image had lead to cancel
sync (i.e. cancel_sync_request).

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-06-06 10:42:25 +02:00
Mykola Golub
def50d0479 rbd-mirror: make sync throttler per pool
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-06-06 10:42:25 +02:00
Mykola Golub
b074260922 test/rbd_mirror: TestMockImageReplayer cleanup
Remove unnecessary ImageSyncThrottler dependency.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-06-06 10:42:25 +02:00
Mykola Golub
7ce058fb12 Merge pull request #15415 from dillaman/wip-rbd-valgrind
librbd: fix valgrind errors and ensure tests detect future leaks

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-06-06 10:38:34 +03:00
Mykola Golub
9c0dbfa25d Merge pull request #15140 from dillaman/wip-18963
rbd-mirror: permit release of local image exclusive lock after force promotion

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-06-06 10:37:56 +03:00
xie xingguo
a00b6c30db os/bluestore: reduce overhead when trying to unshard blobs
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-06 13:36:58 +08:00
xie xingguo
7005bbf754 os/bluestore: atomic deferred_batch_ops
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-06 10:41:55 +08:00
xie xingguo
71561a784d os/bluestore: avoid overloading of extents during reshard
This is potentially big stuff...

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-06 10:41:41 +08:00
Haomai Wang
282f8d4caf Merge pull request #15484 from Adirl/wip
msg/async/rdma: Add DSCP support

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-06-06 09:22:52 +08:00
Yehuda Sadeh
ef65defe71 Merge pull request #15493 from yehudasa/wip-rgw-dynamic-sharding
rgw: dynamic resharding

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 17:10:04 -07:00
Yehuda Sadeh
014a4d07b7 cls/rgw: add missing members initialization
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 15:01:40 -07:00
Sage Weil
080f3433af Merge pull request #14239 from liewegas/wip-bluestore-ec-clone
os/bluestore: try to unshare blobs for EC overwrite workload

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-06-05 16:39:32 -05:00
Sage Weil
7eb4959c12 Merge pull request #15299 from joscollin/wip-cleanup-redundant-headers-6
common: Remove redundant includes - 6

Reviewed-by: Sage Weil <sage@redhat.com>
2017-06-05 16:39:05 -05:00
Sage Weil
3c52569ffb Merge pull request #15429 from jcsp/wip-nuke-rest
pybind/mgr: Delete `rest` module

Reviewed-by: Sage Weil <sage@redhat.com>
2017-06-05 16:36:36 -05:00
Yehuda Sadeh
93b8e83489 rgw: fix a race
We referred to complete_op_data after aio call that could have released
it.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 13:18:04 -07:00
Yehuda Sadeh
13f2f36e81 test/cli/radosgw-admin: update reference help.t
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 13:18:04 -07:00
Yehuda Sadeh
b2a6f0e3e1 rgw: fix index completion
Was missing bucket complete op, only had the guard (bad merge?).
Pass zones_trace as pointer and treat it as optional param (which
it is).

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 13:18:03 -07:00
Yehuda Sadeh
93106dac32 rgw: increase max shard prime, consolidate logic
Handle larger num of shards (max ~64k now). Use the same hash logic for shard ids
everywhere.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 13:18:03 -07:00
Yehuda Sadeh
ba1138d7a8 rgw: new num shards proportional to number of objects per shard
and also limit number of shards to not exceed the max.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 13:18:03 -07:00
Yehuda Sadeh
3b7fd0ffd5 rgw: handle zones_trace in bi async completion handler
needed following a rebase

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 13:18:02 -07:00
Yehuda Sadeh
ef48cc4134 rgw: remove debug helper code
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 13:18:02 -07:00
Yehuda Sadeh
2417c2c0c6 rgw: ignore -ENOENT on bi_list()
just treat it as success with empty result

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 13:18:02 -07:00
Orit Wasserman
dc04b20f1d rgw: run resharding thread only on master zone
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:18:01 -07:00
Orit Wasserman
6c0611136d rgw: add check to see if out is null
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:18:01 -07:00
Orit Wasserman
246c78ebfc rgw: update entry in resharding log when resharding has started
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:18:01 -07:00
Orit Wasserman
9b3c91cbd9 rgw: start resharding theard
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:18:00 -07:00
Yehuda Sadeh
f2b0eb0863 rgw: replace reshard blocking sleep with interruptible condition wait
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 13:18:00 -07:00
Orit Wasserman
45ad93ddee rgw: add bucket to resharding queue if needs resharding
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-06-05 13:18:00 -07:00
Yehuda Sadeh
c6dc81cf4f rgw-admin: radosgw-admin reshard execute -> reshard process
to be in line with other radosgw-admin commands.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 13:17:59 -07:00
Yehuda Sadeh
07b21866a1 rgw: update bucket instance with resharding details
can be useful info for later in a cross zone sync

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 13:17:59 -07:00
Yehuda Sadeh
40faa8d952 radosgw-admin: reshard execute output adjustments
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-05 13:17:59 -07:00