Commit Graph

80640 Commits

Author SHA1 Message Date
Jason Dillaman
260a4226e4 test/librbd: eliminate sleeps within deep-copy mock tests
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-15 15:35:22 -05:00
Casey Bodley
297cd6cc4c
Merge pull request #18883 from cbodley/wip-22083+
rgw: set num_shards on 'radosgw-admin data sync init'

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-11-15 14:51:14 -05:00
Casey Bodley
90e860c25b rgw: set num_shards on 'radosgw-admin data sync init'
Fixes: http://tracker.ceph.com/issues/22083

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-15 14:02:13 -05:00
Casey Bodley
662b02489c dencoder/rgw: expose rgw sync status types
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-11-15 14:02:12 -05:00
Jason Dillaman
0ccd26f998 librbd: added missing locks for snap rollback and rename
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-15 13:25:36 -05:00
Jason Dillaman
abd2e0ac94
Merge pull request #18940 from trociny/wip-valgrind-DeadLockOwner
test/librbd: valgrind warning in TestMockManagedLockBreakRequest.DeadLockOwner

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-15 12:57:30 -05:00
Yuri Weinstein
c9dbb86dc4
Merge pull request #17761 from cbodley/wip-rgw-bilog-trim
rgw multisite: automated trimming for bucket index logs

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-11-15 09:04:50 -08:00
Yuri Weinstein
cb478558f3
Merge pull request #18811 from oritwas/wip-rgw-22046
tenant fixes for dynamic resharding

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-15 09:04:05 -08:00
Yuri Weinstein
d1c0777470
Merge pull request #18920 from yaozongyou/wip-ceph-dencoder-add-types
ceph-dencoder: add support for cls_rgw_lc_obj_head

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-15 09:03:26 -08:00
Casey Bodley
b761a17409
Merge pull request #18946 from joscollin/wip-add-cbodley
.githubmap: Add cbodley

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-15 11:24:19 -05:00
Casey Bodley
71a8f8deff
Merge pull request #18900 from qrGitHub/master
rgw.iam: change '1' to '1ULL' in function print_actions

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-15 11:04:59 -05:00
Jason Dillaman
6a335481d2 librbd: invalidating the cache shouldn't hold write lock
This can cause deadlock when readahead is in-progress since neither
can make forward progress.

Fixes: http://tracker.ceph.com/issues/22131
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-15 10:35:16 -05:00
Jason Dillaman
db13e47574 rbd-nbd: rescan partition table after image resize event
Fixes: http://tracker.ceph.com/issues/22131
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-15 10:34:32 -05:00
Jos Collin
80d36a1132 .githubmap: Add cbodley
Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-11-15 21:01:45 +05:30
Jos Collin
e2d9d81f86
Merge pull request #18921 from Leeshine/wip-data-sync-cmd
rgw: add metadata and data sync related cmd into radosgw-admin usage

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-11-15 20:58:58 +05:30
lvshanchun
8f56897c43 rgw: add data sync related cmd into radosgw-admin help info
+ radosgw-admin data sync status
+ radosgw-admin data sync init
+ radosgw-admin data sync run

Signed-off-by: lvshanchun <lvshanchun@gmail.com>
2017-11-15 10:52:20 -05:00
Leeshine
677bd52b4a rgw: add metadata sync related cmd into radosgw-admin help info
+ radosgw-admin metadata sync status
+ radosgw-admin metadata sync init
+ radosgw-admin metadata sync run

Signed-off-by: lvshanchun <lvshanchun@gmail.com>
2017-11-15 10:49:24 -05:00
Jason Dillaman
3effd324db librbd: prevent overflow of discard API result code
Prevent discard/writesame lengths larger than 2GB.

Fixes: http://tracker.ceph.com/issues/21966
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-15 09:20:26 -05:00
Mykola Golub
beda1e8239 test/librbd: valgrind warning in TestMockManagedLockBreakRequest.DeadLockOwner
When running with 'debug_rbd >= 20':

  Conditional jump or move depends on uninitialised value(s)
    by 0x94277B: operator<< (ostream:167)
    by 0x94277B: librbd::managed_lock::BreakRequest<librbd::(anonymous namespace)::MockTestImageCtx>::handle_get_watchers(int) (BreakRequest.cc:101)

Signed-off-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-15 10:20:58 +02:00
Tianshan Qu
46657a0f72 rgw: fix cls_bucket_head result order consistency
headers's key is string but bucket_instance_ids's key is int
looked around and found no one use header's key, so change
header from map to vector

Signed-off-by: Tianshan Qu <tianshan@xsky.com>
2017-11-15 15:08:59 +08:00
Kefu Chai
8ce46e4aef
Merge pull request #18905 from ifed01/wip-bluestore-recalc-alloc
os/bluestore: remove ineffective BlueFS fnode extent calculation.

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-15 12:30:11 +08:00
Kefu Chai
78c7505b69
Merge pull request #18903 from jan--f/jan-mgr-prometheus-unkown-pgstate
pybind/mgr/prometheus: don't crash when encountering an unknown PG state

Reviewed-by: John Spray <john.spray@redhat.com>
2017-11-15 12:20:16 +08:00
Kefu Chai
730b2d9388
Merge pull request #18885 from dzafman/wip-22112
ceph-objectstore-tool: Fix set-size to clear data_digest if changing …

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-15 12:18:58 +08:00
Kefu Chai
267b97ea67
Merge pull request #18622 from majianpeng/bluestore-opseq
os/bluestore: OpSequencer: reduce kv_submitted_waiters if _is_all_kv_submitted() return true.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2017-11-15 12:17:05 +08:00
Jason Dillaman
09070016f5 Merge pull request #17032 from yangdongsheng/rbd_qos
rbd: implement image qos in tokenbucket algorithm

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-14 19:58:13 -05:00
Jason Dillaman
16715eccdc
Merge pull request #18483 from Songweibin/wip-list-children2
rbd: fix rbd children listing when child is in trash

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-14 16:14:14 -05:00
Yehuda Sadeh
6b764a90c2
Merge pull request #18007 from yehudasa/wip-rgw-config-desc
options.cc: document rgw config options

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Abhishek Lekshmanan <alekshmanan@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-14 15:31:28 -05:00
Abhishek Lekshmanan
e0116fa420 rgw: set sync_from_all as true when no value is seen
In order to support jewel-luminous multisite scenarios where when a
jewel cluster is the master, the sync-from-all json field wouldn't be
set leading to the secondary not syncing data as this value can't be
overriden to true, so defaulting the value of sync_from_all to true when
we don't encounter it in the json

Fixes: http://tracker.ceph.com/issues/22062
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-11-14 19:42:13 +01:00
Sage Weil
3aacde07fa
Merge pull request #18894 from liewegas/wip-fix-balancer
mgr/balancer: skip CRUSH_ITEM_NONE

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2017-11-14 11:01:46 -06:00
Yuri Weinstein
21574aedd3
Merge pull request #18763 from cfanz/master
rgw: don't write bucket_header when it is not changed in rgw_bucket_prepare_op

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-14 08:19:06 -08:00
Yuri Weinstein
d45fdd7885
Merge pull request #18852 from theanalyst/wip-22083
rgw: data sync: set num_shards when building full maps

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-11-14 08:17:42 -08:00
Yuri Weinstein
f8b7c3e3ae
Merge pull request #18866 from cbodley/wip-22101
rgw: RGWEnv::set() takes std::string

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2017-11-14 08:16:38 -08:00
Yuri Weinstein
dc11821c66
Merge pull request #18875 from yaozongyou/rgw-cleanup
rgw: remove unused disable_signal_fd

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-14 08:15:36 -08:00
Yuri Weinstein
b28aa2a7cd
Merge pull request #18895 from cooboos/wip-opt-maperase
rgw: optimize the rgw-attr del code logic

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-14 08:15:19 -08:00
Casey Bodley
ccfc3a2374
Merge pull request #18845 from yaozongyou/wip-lifecycle-log-level
rgw: update life cycle related log level

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-14 10:34:03 -05:00
Jason Dillaman
90b7ecd8a8 librbd: possible deadlock with synchronous maintenance operations
Fixes: http://tracker.ceph.com/issues/22120
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-14 09:16:34 -05:00
Yao Zongyou
10d2514fb4 ceph-dencoder: adding support for cls_rgw_lc_obj_head
After adding cls_rgw_lc_obj_head, we can using the following command
to look into lc processing related information:
rados -p default.rgw.log getomapheader lc.0 ./header.bin --namespace=lc
ceph-dencoder type cls_rgw_lc_obj_head import ./header.bin decode dump_json

Signed-off-by: Yao Zongyou <yaozongyou@vip.qq.com>
2017-11-14 21:42:25 +08:00
Kefu Chai
e8df19197e
Merge pull request #18873 from tchaikov/wip-bluestore-aio-log
os/bluestore: print aio in batch

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2017-11-14 15:03:56 +08:00
Kefu Chai
75baa10d19
Merge pull request #18888 from tchaikov/wip-osx
common,test,cmake: various changes to re-enable build on osx

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-14 15:02:33 +08:00
Kefu Chai
800234a96d
Merge pull request #16369 from bspark8/wip_dmc2_client_tracker
dmclock: Delivery of the dmclock delta, rho and phase parameter + Enabling the client service tracker

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-14 14:59:52 +08:00
Kefu Chai
c7df576dd1
Merge pull request #18798 from cbodley/wip-str-list-view
common: add for_each_substr() for cheap string split

Reviewed-by: Adam Emerson <aemerson@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-14 14:58:46 +08:00
songweibin
9d9a27652f librbd: add new API methods and expand the rbd CLI to list trashed images
implement librbd::RBD::list_children2 and rbd_list_children2
methods and expand the rbd CLI to list trashed images

Signed-off-by: songweibin <song.weibin@zte.com.cn>
2017-11-14 14:17:03 +08:00
Dongsheng Yang
bf4e454a22 librbd: limit IO per second by TokenBucketThrottle
Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2017-11-14 09:19:00 +08:00
Jason Dillaman
8ed65d24d4
Merge pull request #18663 from dragonylffly/wip-rbd-nbd-fix
rbd-nbd: bug fix when running in container

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-13 14:46:15 -05:00
Alfredo Deza
6fb8d566aa ceph-volume lvm.prepare add example of raw device or partition in help menu
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-13 14:28:32 -05:00
Sage Weil
a26a693016
Merge pull request #18713 from liewegas/wip-snapset-snaps
osd/PrimaryLogPG: do not pull-up snapc to snapset

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-13 13:27:54 -06:00
Alfredo Deza
89236ee3f8 ceph-volume lvm.prepare allow partition or raw device as input for --data in filestore
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-11-13 14:26:44 -05:00
Andrew Schoen
8fa17e8ad6
Merge pull request #18882 from ceph/wip-cv-simple-testing
ceph-volume add functional tests for simple, rearrange lvm tests

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2017-11-13 11:26:08 -06:00
Jan Fajerski
67a1b66b06 pybind/mgr/prometheus: don't crash when encountering an unknown PG state
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-11-13 17:24:03 +01:00
Kefu Chai
7a9e7ee72c
Merge pull request #18617 from tchaikov/wip-mon-cleanup
mon: remove unused waiting_for_commit

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-13 22:27:28 +08:00