Kefu Chai
9486206f5a
Merge pull request #34429 from xxhdx1985126/wip-crimson-recovery-pr
...
crimson: pglog based recovery ---- part 1
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-28 17:22:06 +08:00
Lenz Grimmer
56a2a9ab9f
Merge pull request #34656 from rhcs-dashboard/44935-custom-cherryPy-header
...
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen <nia@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-04-28 10:52:53 +02:00
Xiubo Li
028e214c97
qa/tasks/vstart_runner: fix TypeError of string argument expected, got 'bytes'
...
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-28 01:30:25 -04:00
Xiubo Li
e3b314a898
qa/tasks/cephfs/mount.py: run_shell to use StringIO as default
...
Fixes: https://tracker.ceph.com/issues/45299
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-28 01:12:36 -04:00
Tim Serong
df201823b5
cephadm: minor osd_type cleanup in OSD adopt
...
This addresses a couple of the comments in
https://github.com/ceph/ceph/pull/34565
Signed-off-by: Tim Serong <tserong@suse.com>
2020-04-28 13:36:08 +10:00
Tim Serong
6afa31d1f9
cephadm: Add chown
to unit.run for adoped simple OSDs
...
We're not using `ceph-volume simple activate` anymore, so need to
add `chown ceph:ceph` for each of block, block.db and block.wal
to ensure old-style simple OSDs are able to start.
Fixes: https://tracker.ceph.com/issues/45129
Signed-off-by: Tim Serong <tserong@suse.com>
2020-04-28 13:36:08 +10:00
Yuri Weinstein
c272749ed4
Merge pull request #34748 from neha-ojha/wip-jewel-cleanup
...
qa/suites/rados: jewel cleanup
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-27 17:05:59 -07:00
Yuri Weinstein
975cb62796
Merge pull request #34602 from neha-ojha/wip-45075
...
qa/standalone/scrub/osd-scrub-repair.sh: fix race in TEST_auto_repair_bluestore_failed
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-27 17:04:45 -07:00
Gregory Farnum
0a9612bcde
Merge pull request #34595 from rishabh-d-dave/fs-move-run_shell
...
qa/cephfs: move run_shell to mount.py and add methods for negative testing
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2020-04-27 16:35:20 -07:00
Michael Fritch
c60ec03e47
qa/workunits/cephadm/test_cephadm.sh: wait longer for monitoring stack
...
Give the monitoring stack (node-exporter, prom, grafana) a few more
retries to become available before giving up
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-04-27 16:08:10 -06:00
lixiaoy1
64df70cf8c
librbd: Return read request early
...
Finish read requests if the total length is 0.
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
2020-04-27 12:50:39 -04:00
Laura Paduano
63d690fcc5
Merge pull request #34705 from bk201/wip-45149
...
mgr/dashboard: fixing RBD purge error in backend
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-04-27 10:09:55 +02:00
Shilpa Jagannath
0270dc4aaa
qa/rgw: some basic reshard tests
...
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-27 13:16:09 +05:30
Shilpa Jagannath
40e232ad06
minor fix: pass bucket_info as const ref in bi_list()
...
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-27 13:16:09 +05:30
Shilpa Jagannath
48cae3f866
rgw: parameterized bucket_index_layout_generation in BucketShard::init()
...
for better flexibility.
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-27 13:16:08 +05:30
Shilpa Jagannath
3f6e071f65
rgw: more multisite dynamic resharding pieces.
...
rados object names of bi shard to take a unique id called
generation number.
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-27 13:16:08 +05:30
Volker Theile
f88fb46d68
mgr/dashboard: monitoring menu entry should indicate firing alerts
...
Fixes: https://tracker.ceph.com/issues/43081
Signed-off-by: Volker Theile <vtheile@suse.com>
2020-04-27 09:43:25 +02:00
Kefu Chai
d8084806fb
Merge pull request #34752 from tchaikov/fix-test-perf-counters-mgr-get
...
mgr/dashboard: fix API tests to be py3 compatible
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2020-04-27 12:00:40 +08:00
Kefu Chai
d9ca5e5d7b
Merge pull request #34292 from cbodley/wip-bufferlist-comparison
...
bufferlist: use iterators for comparison operators
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-27 11:38:16 +08:00
Kefu Chai
f0a4fc14f0
Merge pull request #34090 from trociny/wip-ceph-erasure-code-tool
...
tools/erasure-code: new tool to encode/decode files
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-27 11:37:00 +08:00
Kefu Chai
fcf8bd7c4d
Merge pull request #34683 from ifed01/wip-ifed-fix-freelist-label
...
os/bluestore: fix freelist's meta usage when bdev label is unsupported
Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2020-04-27 11:35:37 +08:00
Kefu Chai
a8733598ed
Merge pull request #34588 from ifed01/wip-ifed-lower-spinner-mas
...
os/bluestore: set bluestore_min_alloc_size to 4K for spinners
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-04-27 11:34:14 +08:00
Kefu Chai
b76f4d0687
Merge pull request #34006 from aclamk/wip-rocksdb-sharding
...
kv/RocksDBStore,os/blustore: shard rocksdb database using column families
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-27 11:31:53 +08:00
Kefu Chai
6ad027c63e
Merge pull request #33790 from bstillwell/add_conf_option_zstd_compression_level
...
compressor: Add a config option to specify Zstd compression level
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-27 11:28:05 +08:00
Kefu Chai
8ae1c578b5
Merge pull request #34635 from tchaikov/wip-mgr-py3
...
mgr: drop python2 support
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-04-27 11:27:19 +08:00
Kiefer Chang
6a62748102
mgr/dashboard: displaying Service detail inside table
...
Adapt the changes in https://github.com/ceph/ceph/pull/32747 .
Fixes: https://tracker.ceph.com/issues/45106
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-04-27 10:58:31 +08:00
Yuan Lu
7bf24ff590
librbd: add aio_read test cases
...
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-27 10:26:06 +08:00
Yuan Lu
3d63bde4a4
librbd: add aio_read
...
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-27 10:25:54 +08:00
Zac Dover
4571ee26a0
doc/cephadm/install.rst: Add troubleshooting for 'CIDR' error
...
add troubleshooting for 'failed to infer CIDR network...' error
See also
https://tracker.ceph.com/issues/44828
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2020-04-27 00:35:37 +08:00
Xuehan Xu
6439714927
crimson: prevent PG::schedule_event_after from creating daggling future
...
Signed-off-by: Xuehan Xu <xxhdx1985126@163.com>
2020-04-26 15:46:35 +08:00
Xuehan Xu
ff08cb6b36
crimson/osdmap_gate: sort the blockers in ascending order of map epoch
...
When the osdmap_gate got a new map, it's supposed to release blocked ops on
all previous maps section of which is represented by [waiting_peering.begin(),
waiting_peering.upper_bound(epoch)]. So it's essentail that waiting_peering is
ordered in ascending order of the map epoch
Signed-off-by: Xuehan Xu <xxhdx1985126@163.com>
2020-04-26 15:46:35 +08:00
Xuehan Xu
8ff09f2da9
crimson: keep track of clean_regions/dirty_regions of modifications
...
Signed-off-by: Xuehan Xu <xxhdx1985126@163.com>
2020-04-26 15:46:35 +08:00
Xuehan Xu
b39d6e03b3
crimson: add osd interface for recovery messages
...
Signed-off-by: Xuehan Xu <xxhdx1985126@163.com>
2020-04-26 15:46:35 +08:00
Xuehan Xu
7b0462fce7
crimson: add recovery operations oriented request ---- "RecoverySubRequest"
...
Signed-off-by: Xuehan Xu <xxhdx1985126@163.com>
2020-04-26 15:46:35 +08:00
Xuehan Xu
566cd75748
crimson: add pg log based recovery machinery
...
Signed-off-by: Xuehan Xu <xxhdx1985126@163.com>
2020-04-26 15:46:35 +08:00
Xuehan Xu
7f26f70114
crimson/os: add readv method to futurized_store
...
Signed-off-by: Xuehan Xu <xxhdx1985126@163.com>
2020-04-26 15:46:35 +08:00
Samuel Just
60dd721fe3
crimson: add background recovery request and necessary interfaces for recover/backfill
...
Signed-off-by: Samuel Just <sjust@redhat.com>
Signed-off-by: Xuehan Xu <xxhdx1985126@163.com>
2020-04-26 15:46:35 +08:00
Samuel Just
3ae73f0fb9
osd: add some clean ups
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-04-26 15:46:35 +08:00
Samuel Just
12a19749e3
crimson/osd/osd_operation: add support for AggregateBlocker
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-04-26 15:46:35 +08:00
Samuel Just
12d57c9cc0
crimson/osd: introduce scheduler implementations and operation throttler
...
Signed-off-by: Samuel Just <sjust@redhat.com>
Signed-off-by: Xuehan Xu <xxhdx1985126@163.com>
2020-04-26 15:46:35 +08:00
Samuel Just
3fe103b3e8
crimson/osd: wire up local and remote async reservers
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-04-26 15:46:35 +08:00
Samuel Just
ce659e3fd7
common/AsyncReserver: template out the finisher type
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-04-26 15:46:35 +08:00
Samuel Just
0becb44ef4
osd/PeeringState: eliminate unused cct from PGPool
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-04-26 15:46:34 +08:00
Samuel Just
6723922b4e
osd/PrimaryLogPG: move earliest_backfill to PeeringState
...
We'll want this in crimson as well.
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-04-26 15:46:34 +08:00
Yuan Lu
ca6adb238e
librbd: add WriteLogMap test cases
...
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-26 10:55:50 +08:00
Yuan Lu
956316c04a
librbd: add LogMap class
...
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-26 10:55:43 +08:00
Yuan Lu
aa88a3f431
librbd: add ReadRequest to handle read
...
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-26 10:55:36 +08:00
Kefu Chai
28c7ba68ae
Merge pull request #34732 from lxbsz/fs_fix_new
...
qa: misc fixes to run for cephfs qa test
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-26 01:46:30 +08:00
Kefu Chai
dea86fd3a0
Merge pull request #31912 from zjcmszh/cmpext
...
pybind/rados: add Ioctx::cmpext()
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-04-25 22:29:57 +08:00
zhangjiao
5838730828
test/pybind/test_rados.py: test Ioctx::cmpext()
...
Signed-off-by: Zhang Jiao <zhangjiao@cmss.chinamobile.com>
2020-04-25 18:53:50 +05:30