Commit Graph

113690 Commits

Author SHA1 Message Date
Kefu Chai
cdf73b874b crimson/common: add ConfigProxy::inject_args()
prepare for the "injectargs" tell command.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-03 00:54:55 +08:00
Kefu Chai
00fda0bbe4
Merge pull request #36406 from tchaikov/wip-pg-stat-seq
crimson/osd: send pg_stat with correct seq

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-08-02 10:19:47 +08:00
Sebastian Wagner
bd0b900325
Merge pull request #36348 from votdev/cephadm_tox_pylint
mgr/cephadm: Introduce tox and autopep8

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-01 22:36:16 +02:00
Kefu Chai
6a20c7ffdd crimson/osd: send pg_stat with correct seq
* set the osd_stat in pg_stat message sent to mgr, otherwise the seq id
  in the message would be always 0.
* return the seq id composed of up_epoch and osd_stat_seq when serving
  "flush_pg_stats" tell command.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-02 00:35:58 +08:00
Kefu Chai
7b258091b4 crimson/osd: remove unused #include
these messages are handled by osd/PeeringState

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-02 00:35:58 +08:00
Mykola Golub
7fa354e30d
Merge pull request #36395 from dillaman/wip-46679
test/librbd: unquiesce notifications are handled lazily

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-08-01 10:16:59 +03:00
Mykola Golub
0812bcf875
Merge pull request #36309 from dillaman/wip-46694
librbd:  global and pool-level config overrides require image refresh to apply

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-08-01 10:15:56 +03:00
zdover23
2343ea4baf
Merge pull request #32410 from zdover23/wip-doc-pg-repair
doc/rados/operations: document pg repairing practices
2020-08-01 12:07:12 +10:00
Patrick Donnelly
5b47e4e414
Merge PR #36364 into master
* refs/pull/36364/head:
	client: clean up the unnecessary client_lock for _conf->client_trace

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-31 14:19:46 -07:00
Patrick Donnelly
73fc236088
Merge PR #36359 into master
* refs/pull/36359/head:
	mds: place MDSGatherBuilder on the stack

Reviewed-by: Zheng Yan <zyan@redhat.com>
2020-07-31 14:18:52 -07:00
Patrick Donnelly
80839658c6
Merge PR #36358 into master
* refs/pull/36358/head:
	mds: resolve SIGSEGV in waiting for uncommitted fragments

Reviewed-by: Zheng Yan <zyan@redhat.com>
2020-07-31 14:18:09 -07:00
Patrick Donnelly
3f5a28609c
Merge PR #36257 into master
* refs/pull/36257/head:
	client: move client_lock to _unmount()
	client: add timer_lock support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-31 14:16:59 -07:00
Patrick Donnelly
bc7571cc7e
Merge PR #36155 into master
* refs/pull/36155/head:
	qa: Fix traceback during fs cleanup between tests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-07-31 14:15:22 -07:00
Patrick Donnelly
ca7be68eff
Merge PR #35944 into master
* refs/pull/35944/head:
	qa: defer cleaning the mountpoint's netnses and the bridge
	qa/tasks/cephfs/mount.py: remove the stale netnses and bridge
	qa/tasks/cephfs/mount.py: try to flush the stale ceph-brx dev info
	qa/tasks/cephfs/mount.py: switch to run_shell_payload() helper
	qa/tasks/cephfs/mount.py: clean up the none used code

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-07-31 14:12:53 -07:00
Patrick Donnelly
cd8457cbfd
Merge PR #35647 into master
* refs/pull/35647/head:
	mgr/volumes: Add documentation regarding --retain-snapshots option
	mgr/volumes: Avoid trashing retained subvolume on create errors
	mgr/volumes: Add subvolume v2 test cases
	mgr/volumes: Derive v2 from v1 to leverage common methods
	mgr/volumes: Introduce v2 subvolumes
	mgr/volumes: Use operation type during subvolume open

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
2020-07-31 14:11:27 -07:00
Patrick Donnelly
293ec44e46
Merge PR #35096 into master
* refs/pull/35096/head:
	cephfs-journal-tool: fix wrong read_offset when get missing objects

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2020-07-31 14:10:08 -07:00
Patrick Donnelly
107b8cbd92
Merge PR #32120 into master
* refs/pull/32120/head:
	client: periodically forward metrics to session MDSs
	client: track cap hits and misses globally
	client: minor cleanup to MetaSession class

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-31 14:08:41 -07:00
Jason Dillaman
f67930b1ce test/librbd: unquiesce notifications are handled lazily
The quiesce unit tests were expecting that the unquiesce notification
would be processed by the time the snapshot create command completed.
Since the RPC is immediately ACKed, there is a potential for a race
if the test doesn't wait for the unquiesce to process.

Fixes: https://tracker.ceph.com/issues/46679
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-07-31 13:08:41 -04:00
Kefu Chai
ec472b7b56
Merge pull request #32780 from petrutlucian94/windows.5
Windows support [part 5] 

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-07-31 20:36:59 +08:00
Kefu Chai
9ebc514398
Merge pull request #36065 from trociny/wip-46445
monclient: schedule first tick using mon_client_hunt_interval

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-07-31 20:36:25 +08:00
Volker Theile
7d8a3b6032 mgr/cephadm: Introduce tox and autopep8
This PR introduces tox and autopep8 to format the Python code according to PEP8. It does NOT include any lint related things.

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-07-31 14:35:09 +02:00
Kefu Chai
f6f3f27e01
Merge pull request #36002 from david-z/wip-fix-slow-req
mgr: don't update osd stat which is already out

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-07-31 20:34:33 +08:00
Kefu Chai
cfb6475155
Merge pull request #36101 from ifed01/wip-ifed-fix-store-test-with-db
test/objectstore_store_test: fix test cases broken due to additional …

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2020-07-31 20:33:24 +08:00
Kefu Chai
47d2822969
Merge pull request #36337 from tchaikov/wip-qa-ceph-waiting
qa/tasks/ceph: do not print out empty list of pg

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-07-31 20:32:13 +08:00
Sebastian Wagner
230c0d927a
Merge pull request #36360 from matthewoliver/cephadm_add_ipv6_unwrap
cephadm: add unwrap_ipv6 helper method

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-07-31 13:31:41 +02:00
Sebastian Wagner
5a15c730c2
Merge pull request #36151 from jschmid1/osd_support_reweight_impl
mgr/cephadm: rework osd removals/replacements

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-07-31 13:28:18 +02:00
Sebastian Wagner
d688926b8a
Merge pull request #36338 from pcuzner/fix-daemon-actions
mgr/cephadm: fix call to cephadm for daemon restarts etc

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
2020-07-31 13:05:18 +02:00
Sebastian Wagner
5c38185e94
Merge pull request #36284 from sebastian-philipp/cephadm_service_id_migration
mgr/cephadm: Add migration to keep the service names consistent

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-07-31 12:54:51 +02:00
Sebastian Wagner
a959023f38
Merge pull request #36374 from varshar16/wip-doc-orchestrator-update-create-osd
doc/mgr/orchestrator: Fix formatting and examples in create OSD

Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-07-31 12:41:33 +02:00
Kefu Chai
2225deb989
Merge pull request #36376 from tchaikov/wip-crimson-log
qa/tasks/ceph: redirect stderr to log file

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-07-31 17:45:35 +08:00
Joshua Schmid
8ff2824beb build/debian: remove osd_support
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-07-31 10:23:59 +02:00
Joshua Schmid
9606f4d602 doc/cephadm: adjust osd removal docs
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-07-31 10:23:59 +02:00
Joshua Schmid
e78f5c8fae mgr/cephadm: add tests for new remove/replace logic
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-07-31 10:23:59 +02:00
Joshua Schmid
a0f68c488f mgr/cephadm: implement osd remove/replace logic in cephadm
Fixes: https://tracker.ceph.com/issues/44548
Fixes: https://tracker.ceph.com/issues/45594

Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-07-31 10:13:56 +02:00
Joshua Schmid
a55c1dd0fa mgr/osd_support: remove module and all traces
Signed-off-by: Joshua Schmid <jschmid@suse.de>
2020-07-31 10:11:45 +02:00
Kefu Chai
1bdf288e81
Merge pull request #36367 from tchaikov/wip-46771
qa/tasks/ragweed: always set ragweed_repo

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-07-31 15:39:44 +08:00
Kefu Chai
87e61e1d6e qa/tasks/ragweed: always set ragweed_repo
* extract get_ragweed_branch() out of download() task, for better
  readablity.
* use a loop for retry when the first clone fails
* drop the `raise ValueError()` clause as it never happens. we could use
  an assert() here, but i don't think it is necessary anyway.
* use sh() instead of run() for better readablity.
* always set ragweed_repo. before this change this variable is
  unbounded if `force-branch` is set.

Fixes: https://tracker.ceph.com/issues/46771
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-31 13:08:56 +08:00
Jason Dillaman
56d2912fee
Merge pull request #36159 from trociny/wip-46581
librbd: handle DNE from immutable-object-cache

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-07-30 15:43:20 -04:00
Patrick Donnelly
5f53076799
mds: place MDSGatherBuilder on the stack
This was not meant to be heap allocated; it's not freed via the Gather
machinery.

Fixes: https://tracker.ceph.com/issues/46766
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-30 12:28:58 -07:00
Jason Dillaman
546109d78e
Merge pull request #36319 from orozery/librados_test_stub_add_objver
test/librados_test_stub: add version tracking of objects

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-07-30 12:55:15 -04:00
Jason Dillaman
8394aef648
Merge pull request #36317 from orozery/librados_test_stub_exclusive_create
test/librados_test_stub: handle exclusive create

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-07-30 12:54:51 -04:00
Kefu Chai
da76f46461 qa/tasks/ceph: redirect stderr to log file
crimson write log to stderr, let's redirect it to log file for a more
peaceful teuthology.log.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-31 00:51:30 +08:00
Kefu Chai
70232e1f44
Merge pull request #36363 from sebastian-philipp/p-common-pyyaml
python-common, spec.in: Add missing pyyaml dependency

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-07-31 00:20:43 +08:00
Kefu Chai
fd67a9393a
Merge pull request #36344 from wjwithagen/wjw-fix-_1
test: fix ambiguous reference to _1

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-07-31 00:09:14 +08:00
Patrick Donnelly
f9e5868761
mds: resolve SIGSEGV in waiting for uncommitted fragments
The MDSGatherBuilder was not correctly used / wired up.

Fixes: https://tracker.ceph.com/issues/46765
Fixes: 77eb368d2d
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-30 08:59:01 -07:00
Kefu Chai
11d9ff4f17
Merge pull request #36370 from tchaikov/wip-crimson-scrub2
crimson/osd: handle MOSDScrub2

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-07-30 23:24:11 +08:00
Sebastian Wagner
6dbcd8f31d
Merge pull request #36286 from sebastian-philipp/cephadm-notify_config-ceph-conf-race
mgr/cephadm: revamp ceph.conf distribution scheduling 

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2020-07-30 16:20:44 +02:00
Kiefer Chang
52a8a11748
Merge pull request #36231 from tspmelo/wip-fix-overflow
mgr/dashboard: Configure overflow of popover in health page

Reviewed-by: Ni-Feng Chang <kiefer.chang@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-07-30 22:02:37 +08:00
Varsha Rao
195f28a614 doc/mgr/orchestrator: Fix formatting and examples in create OSDs
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-07-30 15:28:47 +02:00
Volker Theile
da9fcff364
Merge pull request #36243 from Devp00l/wip-46660
mgr/dashboard: Fix regression on table error handling

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-07-30 15:00:59 +02:00