Commit Graph

127769 Commits

Author SHA1 Message Date
Venky Shankar
3a4dd30a1e test: add cephfs_mirror thrasher
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-11-09 00:08:05 -05:00
Venky Shankar
087d7aa8ca tasks/cephfs_mirror: optionally run in foreground
cephfs mirror damon thrasher needs to send SIGTERM to mirror
daemons. The mirror daemon needs to run in foreground for
it to receive signal via `daemon.signal`.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-11-09 00:08:05 -05:00
Venky Shankar
e253f68538 mgr/mirroring: throttle directory reassigment to mirror daemons
This is to avoid over-shuffling directories when lots of mirror
daemons come and go.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-11-09 00:08:05 -05:00
Samuel Just
a3aed9540a
Merge pull request #43835 from xxhdx1985126/wip-segment-avail-bytes
crimson/os/seastore/segment_cleaner: initialize segments' avail_bytes…

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-11-08 15:22:05 -08:00
Samuel Just
5e56258a34
Merge pull request #43754 from cyx1231st/wip-seastore-fix-journal-committed-to
crimson/os/seastore: fix ordered updates to JournalSegmentManager::committed_to

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-11-08 12:59:40 -08:00
Sage Weil
df9988d94a Merge PR #43827 into master
* refs/pull/43827/head:
	qa/suites/orch/cephadm: add repave-all test case
	mgr/cephadm/services/osd: less noisy
	mgr/cephadm/services/osd: do not log ok-to-stop/safe-to-destroy failures
	mgr/orchestrator: clean up 'orch osd rm status'

Reviewed-by: Adam King <adking@redhat.com>
2021-11-08 14:43:25 -05:00
Yuri Weinstein
4d137d6ca7
Merge pull request #43699 from sebastian-philipp/qa-rados-mgr-random-objectstore
qa/suites/rados/mgr: use only one objectstore instead of all

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-08 09:51:27 -08:00
Yuri Weinstein
d59fa2ef99
Merge pull request #43621 from ifed01/wip-ifed-fix-53011
os/bluestore: use proper prefix when removing undecodable Share Blob.

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-11-08 09:50:33 -08:00
Sebastian Wagner
fb8671c573
Merge pull request #43635 from adk3798/agent-responsiveness
mgr/cephadm: improve agent responsiveness

Reviewed-by: Daniel Pivonka <dpivonka@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-08 17:15:55 +01:00
Guillaume Abrioux
daf008f536
Merge pull request #43574 from sabzco/ceph-volume-fix
ceph-volume: fix a typo causing AttributeError
2021-11-08 14:16:42 +01:00
Guillaume Abrioux
7f14846b40
Merge pull request #43679 from guits/cv_quick_update_tests
ceph-volume/tests: update setup_mixed_type playbook
2021-11-08 10:27:41 +01:00
Xuehan Xu
6d0e6288e8 crimson/os/seastore/segment_cleaner: initialize segments' avail_bytes with segments' sizes
Currently, we initialize segments' avail_bytes with "segment_size * num_segments". Both segment_size
and num_segments are 32 bits long, multiplying them would lead to overflow.

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-11-07 15:47:02 +08:00
Sage Weil
534fc6d936 Merge PR #43826 into master
* refs/pull/43826/head:
	mgr/cephadm: allow zapping devices from other clusters

Reviewed-by: Adam King <adking@redhat.com>
2021-11-06 12:29:53 -04:00
Sage Weil
4abe4c6a78 qa/suites/orch/cephadm: add repave-all test case
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-05 19:25:16 -04:00
Sage Weil
8c1e9c05f7 mgr/cephadm/services/osd: less noisy
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-05 19:25:16 -04:00
Sage Weil
5426f6b2a4 mgr/cephadm/services/osd: do not log ok-to-stop/safe-to-destroy failures
These failures are normal and expected; they should not pollute the log.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-05 19:25:16 -04:00
Sage Weil
ca767fc3a8 mgr/cephadm: allow zapping devices from other clusters
This is the 99% of the devices that ever get zapped.

Fixes: b7782084ac
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-05 14:45:44 -04:00
Neha Ojha
63cead9248
Merge pull request #43814 from neha-ojha/wip-more-cv
qa/suites/upgrade/octopus-x/stress-split-no-cephadm: exclude ceph-volume

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2021-11-05 11:37:57 -07:00
Sage Weil
d507e5479f mgr/orchestrator: clean up 'orch osd rm status'
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-05 14:33:21 -04:00
Ali Maredia
c3b5ca0fe0
Merge pull request #43808 from cbodley/wip-qa-rgw-java-master
qa/rgw: master branch targets ceph-master branch of java_s3tests
2021-11-05 12:34:53 -04:00
Sebastian Wagner
4f56c918e8
Merge pull request #43807 from sebastian-philipp/osd_memory_target_autotune-true
doc/cephadm: Recommend osd_memory_target_autotune

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@newdream.net>
2021-11-05 15:09:20 +01:00
Sebastian Wagner
41a487005c
doc/cephadm: Recommend osd_memory_target_autotune
In case the cluster runs on hardware that is used exclusively for
Ceph, let's recommend `osd_memory_target_autotune`

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-05 10:53:14 +01:00
Neha Ojha
1be081da02 qa/suites/upgrade/octopus-x/stress-split-no-cephadm: exclude ceph-volume
To address failures like

```
Command failed on smithi096 with status 100: 'sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.15-11-g5f8f263c-1focal ceph-mds=15.2.15-11-g5f8f263c-1focal ceph-mgr=15.2.15-11-g5f8f263c-1focal ceph-common=15.2.15-11-g5f8f263c-1focal ceph-fuse=15.2.15-11-g5f8f263c-1focal ceph-test=15.2.15-11-g5f8f263c-1focal ceph-volume=15.2.15-11-g5f8f263c-1focal radosgw=15.2.15-11-g5f8f263c-1focal python3-rados=15.2.15-11-g5f8f263c-1focal python3-rgw=15.2.15-11-g5f8f263c-1focal python3-cephfs=15.2.15-11-g5f8f263c-1focal python3-rbd=15.2.15-11-g5f8f263c-1focal libcephfs2=15.2.15-11-g5f8f263c-1focal librados2=15.2.15-11-g5f8f263c-1focal librbd1=15.2.15-11-g5f8f263c-1focal rbd-fuse=15.2.15-11-g5f8f263c-1focal'
```

Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-11-04 21:45:21 +00:00
Neha Ojha
2badd25cff
Merge pull request #43406 from ljflores/wip-telemetry-perf-improvements
mgr/telemetry: add mempool stats to telemetry perf report

Reviewed-by: Yaarit Hatuka <yaarit@redhat.com>
2021-11-04 14:27:48 -07:00
Sage Weil
b90c037457 Merge PR #42727 into master
* refs/pull/42727/head:
	mgr/orchestrator: improve usage string for 'orch daemon add osd'
	ceph-volume: activate: try simple mode too
	mgr/cephadm: identify and instantiate raw osds post-create
	mgr/orchestrator: accept --method arg to 'orch daemon add osd'
	python-common: drivegroup: add 'method' property
	cephadm: use generic ceph-volume activate
	ceph-volume: top-level 'activate' command
	ceph-volume: lvm activate: add --no-tmpfs
	ceph-volume: lvm activate: infer bluestore or filestore
	ceph-volume: raw activate: accept --osd-id and/or --osd-uuid instead of device

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
2021-11-04 17:14:19 -04:00
Yuri Weinstein
477d651850
Merge pull request #43705 from tchaikov/wip-no-more-python2
mgr: do not handle Python2

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2021-11-04 14:10:57 -07:00
Yuri Weinstein
5eb731e280
Merge pull request #43700 from liewegas/fix-24990
ceph_test_rados_api_watch_notify: extend Watch3Timeout test

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-04 14:08:07 -07:00
Yuri Weinstein
a9e4f539c5
Merge pull request #43664 from NUABO/tanchangzhi
osd: fix 'ceph osd stop <osd.nnn>' doesn't take effect

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2021-11-04 14:07:35 -07:00
Patrick Donnelly
9baf06d89b
Merge PR #43752 into master
* refs/pull/43752/head:
	client: remove usless _openat()
	client: remove optional for dirfd parameter

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-11-04 16:55:43 -04:00
Patrick Donnelly
93cdc800e2
Merge PR #43666 into master
* refs/pull/43666/head:
	qa/vstart_runner: add "managers" to LocalContext instances

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-04 16:54:14 -04:00
Patrick Donnelly
373b750bfe
Merge PR #43638 into master
* refs/pull/43638/head:
	qa: pass subdir arg when executing workunit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-04 16:53:20 -04:00
Patrick Donnelly
10d8c7a4a5
Merge PR #43613 into master
* refs/pull/43613/head:
	qa: lengthen health warning wait

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-11-04 16:52:23 -04:00
Patrick Donnelly
195af150c1
Merge PR #41667 into master
* refs/pull/41667/head:
	mds: do not trim cache when creating system file
	mds: fix the comment in add_inode

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-04 16:51:11 -04:00
Sage Weil
d87d2bd146 Merge PR #43611 into master
* refs/pull/43611/head:
	doc/mgr/nfs: document rgw user and bucket exports
	PendingReleaseNotes: add note about nfs CLI change(s)
	qa/suites/orch/cephadm/smoke-roleless: add rgw user nfs export case
	mgr/nfs: take user-id and/or bucket for 'nfs export create rgw'
	mgr/nfs: reorder 'nfs export creage rgw' arguments
	mgr/nfs: reorder 'nfs export create cephfs' arguments
	mgr/nfs: use keyword args for 'nfs export create rgw'
	mgr/nfs: document and use keyword args for 'nfs export create cephfs'
	qa/tasks/cephfs/test_nfs: use keyword args
	pybind/ceph_argparse: handle misordered keyword arguments

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2021-11-04 14:33:45 -04:00
Daniel Gryniewicz
843ab61edb
Merge pull request #43768 from Huber-ming/admin_mdlog_fetch
radosgw-admin: supplement help documents with 'mdlog autotrim'
2021-11-04 13:19:41 -04:00
Casey Bodley
cc839876ad
Merge pull request #43778 from adamemerson/wip-53132
rgw: Ensure buckets too old to decode a layout have layout logs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-11-04 12:56:26 -04:00
Casey Bodley
a25d1a70aa qa/rgw: master branch targets ceph-master branch of java_s3tests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-04 12:12:04 -04:00
Casey Bodley
79a784bde4
Merge pull request #37184 from ybwang0211/KMSMSMSMS_return_error_message
rgw:When KMS encryption is used and the key does not exist, we should…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2021-11-04 12:07:05 -04:00
Ernesto Puerta
f56baf291e
Merge pull request #43725 from rhcs-dashboard/nfs-export-form-fix
mgr/dashboard: NFS 'create export' form: fixes

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-11-04 17:00:13 +01:00
Sage Weil
b6d85e3975 doc/mgr/nfs: document rgw user and bucket exports
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-04 10:42:50 -04:00
Sage Weil
48ce4e9568 PendingReleaseNotes: add note about nfs CLI change(s)
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-04 10:42:50 -04:00
Sage Weil
d354baa82f qa/suites/orch/cephadm/smoke-roleless: add rgw user nfs export case
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-04 10:42:50 -04:00
Sage Weil
bd018541dc mgr/nfs: take user-id and/or bucket for 'nfs export create rgw'
- move the bucket / user position after the cluster_id and pseudo_path
(since they are optional)
- require bucket or user or both
- if bucket, use the bucket owner
- if bucket+user, use that user
- if user only, then export at top-level (all users buckets)

Fixes: https://tracker.ceph.com/issues/53134
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-04 10:42:50 -04:00
Sage Weil
816bacba35 mgr/orchestrator: improve usage string for 'orch daemon add osd'
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-04 10:07:14 -04:00
Alfonso Martínez
d817a24e34 mgr/dashboard: NFS 'create export' form: fixes
* Do not allow a pseudo that is already in use by another export.
* Create mode form: prefill dropdown selectors if options > 0.
* Edit mode form: do not reset the field values that depend on other values that are being edited (unlike Create mode).
* Fix broken link: cluster service.
* Fix error message style for non-existent cephfs path.
* nfs-service.ts: lsDir: thow error if volume is not provided.
* File renaming: nfsganesha.py => nfs.py; test_ganesha.py => test_nfs.py

Fixes: https://tracker.ceph.com/issues/53083
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2021-11-04 14:56:37 +01:00
Sebastian Wagner
884f89ea6f
Merge pull request #43737 from AndrewSharapov/master
mgr/cephadm: Fixed spawning ip addresses list for public network interface

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-04 10:45:56 +01:00
Ernesto Puerta
1317913087
Merge pull request #43797 from rhcs-dashboard/fix-53144-master
mgr/dashboard: fix missing alert rule details

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-11-04 10:17:57 +01:00
Deepika Upadhyay
229f5151ff
Merge pull request #43461 from CongMinYin/fix-flush-advance
librbd/cache/pwl: fix external flush dispatch in advance

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-11-04 13:15:42 +05:30
Yingxin Cheng
0ad74ec026 crimson/os/seastore: fix ordered updates to JournalSegmentManager::committed_to
Journal segment should not update committed_to during rolling as there
might be still pending writes from the previous segment.

A side-effect here is that committed_to now needs to include
segment_seq_t to point to a previous segment.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-11-04 13:34:23 +08:00
Samuel Just
bc458cd3bc
Merge pull request #43617 from cyx1231st/wip-seastore-batch-journal-records
crimson/os/seastore/journal: support both batching and concurrent writes

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-11-03 21:08:43 -07:00