Commit Graph

101213 Commits

Author SHA1 Message Date
Patrick Donnelly
f68c087e37
Merge PR #29572 into master
* refs/pull/29572/head:
	mds: Reorganize class members in FSMap header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-23 16:06:51 -07:00
Jason Dillaman
5bb807d1ae
Merge pull request #29796 from trociny/wip-journal-player-handle_cache_rebalanced2
journal: fix race between player shut down and cache rebalance

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-08-23 13:40:15 -04:00
Jason Dillaman
4e8a825777
Merge pull request #29775 from trociny/wip-41229
librbd: always try to acquire exclusive lock when removing image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-08-23 13:39:37 -04:00
Jason Dillaman
648b649848
Merge pull request #29459 from zy751713126/config_set
pybind/rbd: add config_set/get/remove api in rbd.pyx

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-08-23 13:39:07 -04:00
Patrick Donnelly
d30af45a54
Merge PR #29715 into master
* refs/pull/29715/head:
	qa: fix broken ceph.restart marking of OSDs down
	qa: add debugging failed osd-release setting

Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-23 10:09:17 -07:00
Patrick Donnelly
b82e87bda4
Merge PR #29821 into master
* refs/pull/29821/head:
	qa: stop DaemonWatchdog for each cluster in daemon roles

Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-08-23 10:00:52 -07:00
Sage Weil
af4500be86 Merge PR #29575 into master
* refs/pull/29575/head:
	objclass, osd: improve const-correctness of PGLSFilter.
	common: add bl::contents_equal() override for void* + size_t.
	osd: refactor manufacturing of PGLSFilter.
	osd: don't carry PGLSFilter between multiple ops in MOSDOp.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-23 11:26:28 -05:00
Sage Weil
1f39b36b8e Merge PR #28727 into master
* refs/pull/28727/head:
	test/crimson: resolve name collision
	test: switch to ldout; let users specify mon debug level
	test: add new ElectionLogic unit test framework
	elector: const-ify a bunch of functions
	elector: swap order of parameters in ElectionLogic::receive_propose
	elector: Update Elector and ElectionLogic function documentation
	elector: persist the epoch in bump_epoch()
	elector: make some more ElectionLogic members private
	elector: fix privacy and restore dout in Elector
	elector: don't clear peer_info in bump_epoch()
	elector: split ElectionLogic into its own compilation unit
	elector: move all the elector callouts into the Elector
	elector: make ElectionLogic private to Elector; undo most public shenanigans
	elector: create declare_standlone_victory in Elector/Logic for Monitor
	elector: make ElectionLogic::declare_victory private
	elector: route _bump_epoch through the interface-to-be
	elector: rename handle_propose_logic -> receive_propose
	elector: hoist handle_victory into ElectionLogic
	elector: hoist handle_ack into ElectionLogic
	elector: hoist victory into ElectionLogic
	elector: hoist expire into ElectionLogic
	elector: hoist start into ElectionLogic
	elector: hoist participating into ElectionLogic
	elector: hoist init into ElectionLogic
	elector: hoist defer into ElectionLogic
	elector: split handle_propose in two and hoist into ElectionLogic
	elector: hoist bump_epoch into ElectionLogic
	elector: store accessors for ElectionLogic
	elector: hoist Elector data bits out into a new ElectionLogic class
	mon: Rearrange Paxos::dispatch to be a little cleaner

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-23 11:25:28 -05:00
Sage Weil
8876cf36c2 Merge PR #15183 into master
* refs/pull/15183/head:
	kv/rocksdb: support rmrange unconditionally
	cls/rgw: rgw_bi_log_trim() uses cls_cxx_map_remove_range()
	cls/log: cls_log_trim() uses cls_cxx_map_remove_range()
	test/cls: add cls_log.trim_by_marker test
	test/cls: test_cls_log doesn't allocate ObjectOperations
	test/cls: test_cls_log uses fixture for temporary pool
	test/cls: add cls_rgw.bi_log_trim test
	cls/rgw: expose cls_rgw_bilog_list/trim() for single shard
	test/cls: test_cls_rgw uses cls_rgw_obj_key
	test/cls: test_cls_rgw doesn't allocate ObjectOperations
	test/cls: test_cls_rgw uses fixture for temporary pool
	objclass: add cls_cxx_map_remove_range()
	librados: add rados_write_op_omap_rm_range2()
	osdc: add Objecter omap_rm_range()
	osd: add CEPH_OSD_OP_OMAPRMKEYRANGE to do_osd_ops()
	osd: add omap_rmkeyrange() to PGTransaction
	os: add bufferlist overload for omap_rmkeyrange()
	tracing: add do_osd_op_pre_omaprmkeyrange
	rados: add CEPH_OSD_OP_OMAPRMKEYRANGE

Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-23 10:46:33 -05:00
Casey Bodley
6b0f3ce4cb
Merge pull request #29778 from cbodley/wip-41212
vstart: move [client.rgw] config into [client]

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2019-08-23 10:24:41 -04:00
Lenz Grimmer
862876d900
mgr/dashboard: User Management E2E tests (#29641)
mgr/dashboard: User Management E2E tests 

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-08-23 14:00:16 +00:00
Lenz Grimmer
d373178c43
mgr/dashboard: run-backend-api-tests.sh CI improvements (#29504)
mgr/dashboard: run-backend-api-tests.sh CI improvements

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-08-23 09:11:39 +00:00
Kefu Chai
e909031d3c
Merge pull request #29590 from Aran85/fix_proc_replica_log
osd: merge replica log on primary need according to replica log's crt

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-23 14:59:02 +08:00
Kefu Chai
1116362118
Merge pull request #29747 from liewegas/wip-39546
osd/PeeringState: do not complain about past_intervals constrained by oldest epoch

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-23 13:28:52 +08:00
Kefu Chai
25ed83e14a
Merge pull request #29624 from NancySu05/osdmonitor_markmedown
mon:C_AckMarkedDown has not handled the Callback Arguments

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-23 13:23:46 +08:00
Kefu Chai
5e5eca2834
Merge pull request #29738 from ifed01/wip-ifed-alloc-cleanup
os/bluestore: minor improvements/cleanup around allocator

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2019-08-23 13:22:52 +08:00
Kefu Chai
ed8a0fb3c6
Merge pull request #29614 from votdev/issue_41205
mgr/dashboard: Access control database does not restore disabled users correctly

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
2019-08-23 13:20:52 +08:00
Kefu Chai
4deb2b90b5
Merge pull request #29146 from badone/wip-tracker-40835-OSDCap.PoolClassRNS-abort
osd/OSDCap: Check for empty namespace

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-23 13:16:22 +08:00
Kefu Chai
263a78c3dd
Merge pull request #25697 from Aran85/fix-onode-trim
os/bluestore: more aggressive deferred submit when onode trim skipping

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-08-23 13:15:27 +08:00
Kefu Chai
b3c1c4c1cd
Merge pull request #28488 from liuchang0812/show-pool-id-in-pool-ls-cmd
mon: show pool id in pool ls command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-23 13:13:32 +08:00
Kefu Chai
0bbaa185a5
Merge pull request #24636 from rzarzynski/wip-denc-container_base
denc: slightly optimize container_base::bound_encode

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-23 13:12:04 +08:00
Kefu Chai
bfce110511
Merge pull request #29756 from Aran85/fix-repair-object
osd: clear PG_STATE_CLEAN when repair object

Reviewed-by: David Zafman <dzafman@redhat.com>
2019-08-23 13:08:49 +08:00
Sage Weil
f61b0a21d6 Merge PR #29806 into master
* refs/pull/29806/head:
	mgr/BaseMgrModule: tolerate Int or Long for health 'count'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-22 14:07:49 -05:00
Ali Maredia
79eb107a14
Merge pull request #29298 from zhangsw/rgw-fix-bug-listobjv2-startafter
rgw: continuationToken or startAfter shouldn't be returned if not specified
2019-08-22 14:12:30 -04:00
Sage Weil
d850edf0f9 Merge PR #29780 into master
* refs/pull/29780/head:
	osd/PeeringState: semi-colon after DECLARE_LOCALS
	osd/PeeringState: on_new_interval on child PG after split

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-08-22 12:52:16 -05:00
Sage Weil
2dca76ac84 Merge PR #29774 into master
* refs/pull/29774/head:
	qa/standalone/scrub/osd-scrub-snaps: snapmapper omap is now 'm'

Reviewed-by: David Zafman <dzafman@redhat.com>
2019-08-22 12:27:26 -05:00
Sage Weil
b7134f4ea9 Merge PR #29807 into master
* refs/pull/29807/head:
	mgr/pg_autoscaler: fix race with pool deletion

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-22 12:26:11 -05:00
Patrick Donnelly
231f79030b
qa: stop DaemonWatchdog for each cluster in daemon roles
Fixes: https://tracker.ceph.com/issues/41398
Introduced-by: 08b99eef27
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-22 09:00:49 -07:00
Patrick Donnelly
73c7d14eab
qa: fix broken ceph.restart marking of OSDs down
Sage noticed `osd down` was not being performed. Bug was that the role
format had changed so splitting no longer worked correctly.

Fixes: https://tracker.ceph.com/issues/40773
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-22 08:55:52 -07:00
Casey Bodley
e131d6f496
Merge pull request #17719 from mikulely/fix-usage-stats
rgw: distinguish different get_usage for usage log

Reviewed-by: Robin H. Johnson <rjohnson@digitalocean.com>
2019-08-22 11:04:38 -04:00
Patrick Donnelly
aba296aab8
qa: add debugging failed osd-release setting
See-also: https://tracker.ceph.com/issues/40773
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-22 07:19:51 -07:00
alfonsomthd
7563f8b6d6 mgr/dashboard: run-backend-api-tests.sh CI improvements
As there is now a jenkins job to run this script
(see https://github.com/ceph/ceph-build/pull/1351),
this refactoring adapt the script to be run in a jenkins job as well as locally.

Signed-off-by: alfonsomthd <almartin@redhat.com>
2019-08-22 15:33:02 +02:00
Kefu Chai
aab5c451e1
Merge pull request #29544 from tchaikov/wip-doc-search-CSP
doc: always load resources via HTTPS

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-22 17:56:58 +08:00
Kefu Chai
eb247c943a doc: always load resources via HTTPS
Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-08-22 16:19:17 +08:00
zhengyin
29617368e2 pybind/rbd: add config_image_set/get/remove test case
Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>
2019-08-22 02:04:57 -04:00
zhengyin
6eb39dbb64 pybind/rbd: add config_image_set/get/remove api in rbd.pyx
Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>
2019-08-22 01:53:22 -04:00
Xie Xingguo
ea216e52f6
Merge pull request #29755 from xiexingguo/wip-inc-recovery-4
osd: do not invalidate clear_regions of missing item at boot

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-22 13:48:15 +08:00
Sage Weil
69a712ad4b mgr/BaseMgrModule: tolerate Int or Long for health 'count'
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-21 17:06:32 -05:00
Andrew Schoen
f0e2c59e8c
Merge pull request #29804 from alfredodeza/wip-rm41378
ceph-volume tests set the noninteractive flag for Debian

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2019-08-21 16:59:18 -05:00
Sage Weil
4e7f6b4088 Merge PR #29744 into master
* refs/pull/29744/head:
	qa/run-standalone.sh: fix python path
	qa/standalone/mon/health-mute.sh: fix up rachet test
	qa/standalone/mon/health-mute.sh: s/kill daemons/kill_daemons/

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-08-21 15:02:27 -05:00
Sage Weil
e6b0f2ab0a Merge PR #29749 into master
* refs/pull/29749/head:
	mon/HealthMonitor: remove unused label

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-21 15:02:14 -05:00
Sage Weil
d405167fa1 Merge PR #29757 into master
* refs/pull/29757/head:
	osd: always initialize local variable

Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-21 15:02:01 -05:00
Sage Weil
617cdb619e Merge PR #29763 into master
* refs/pull/29763/head:
	qa/suites/rados: whitelist POOL_APP_NOT_ENABLED warning

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-21 15:01:50 -05:00
Sage Weil
9d45bd9cc9 mgr/pg_autoscaler: fix race with pool deletion
The pool_stats map comes from a get('df') that may not include a pool
because it was just deleted.

Fixes: https://tracker.ceph.com/issues/41386
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-21 14:56:43 -05:00
Alfredo Deza
89231c9a60 ceph-volume tests set the noninteractive flag for Debian, to avoid prompts in apt
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2019-08-21 14:15:32 -04:00
Patrick Donnelly
dad94db7ae
Merge PR #28378 into master
* refs/pull/28378/head:
	qa/tasks: introduce Thrasher base class
	qa/tasks: Fix typo
	qa/tasks: manage thrashers
	qa/tasks: start DaemonWatchdog when ceph starts
	qa/tasks: make watch and bark handle more daemons
	qa/tasks: move DaemonWatchdog to new file

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-21 10:57:15 -07:00
Mykola Golub
e867804fe7
Merge pull request #29773 from dillaman/wip-41352
pybind/mgr/rbd_support: fix missing variable in error path

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-08-21 17:26:01 +03:00
Mykola Golub
adf1715d95 journal: fix race between player shut down and cache rebalance
25a23364 was supposed to fix this race, but it was not enough:
there was still a window between `prefetch` is queued for
execution in handle_cache_rebalanced and is actually executed,
during which shut_down can be called and completed.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-08-21 15:18:54 +01:00
Jan Fajerski
88662a4e31
Merge pull request #29659 from jan--f/c-v-simple-functional-no-lvm-zap
ceph-volume: don't try to test lvm zap on simple tests
2019-08-21 09:17:30 +02:00
Jos Collin
f31791e35d
qa/tasks: introduce Thrasher base class
* Introduced a Thrasher base class.
* Updated thrashers to inherit from Thrasher.
* Replaced the magic variable e with Thrasher.exception as per the discussion.
  Now the exception variable sets by default as the thrashers are inheriting
  from the Thrasher class.

Fixes: https://github.com/ceph/ceph/pull/28378#discussion_r309337928
Fixes: https://tracker.ceph.com/issues/41133
Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-08-21 10:49:46 +05:30