Commit Graph

125252 Commits

Author SHA1 Message Date
Yuval Lifshitz
d81e27faa1 rgw/notifications: send correct size in case of delete marker creation
Fixes: https://tracker.ceph.com/issues/51681

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2021-07-16 14:12:10 +03:00
Sebastian Wagner
0a77eee518 doc/cephadm: Add RGW ssl
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-07-16 12:54:00 +02:00
Yuval Lifshitz
6a1688b57d rgw/http/notifications: support content type in HTTP POST messages
Fixes: https://tracker.ceph.com/issues/51530

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2021-07-16 12:06:41 +03:00
Venky Shankar
19a45c8d54 test: add test for checking readd after remove for a directory path
Fixes: http://tracker.ceph.com/issues/51666
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-07-16 01:08:23 -04:00
Venky Shankar
1a956be9ba cephfs-mirror: record directory path cancel in DirRegistry
When removing a directory path from mirroring, cephfs-mirror records
this state in a thread-local storage. The replayer thread backs-off
in midst of mirroring the directory snapshots for this directory path.
However, the state (canceled state) is never cleared causing the thread
to incorrectly assume that other directory paths (which are picked up
by this thread) need backing-off, hence, marking these directory paths
as failed (to synchronize snapshots).

Fix is to store this state in the directory specific store which is
allocated when a thread picks up a directory path for synchronization.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-07-16 01:08:23 -04:00
Venky Shankar
c49024c90a cephfs-mirror: complete context when a mirror instance is not failed or blocklisted
Without this, the updater thread can start processing othere queued
contexts when a mirror instance is failed or blocklisted resulting
in unexpected behavior.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-07-16 01:08:23 -04:00
Sage Weil
c79942df42 Merge PR #42338 into master
* refs/pull/42338/head:
	mon/LogMonitor: tolerate external_log_to in the future

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-07-16 00:47:41 -04:00
Anamika
03a9551ebd mgr/devicehealth:replace CLICommand with CLIReadCommand
Fixes: https://tracker.ceph.com/issues/51631
Signed-off-by: Anamika <cseanamika3@gmail.com>
2021-07-16 03:31:59 +05:30
Sage Weil
eee041f2f0 mon: allow a MON_DOWN grace period after cluster mkfs
During teuthology tests, the initial cluster bootstrap often starts up
the mon sbut doesn't include all mons in the initial quorum, due to
mon startup misalignment and random delays.  Provide a short grace period
where we will not raise a MON_DOWN alert even though the quorum is not
complete.

Fixes: https://tracker.ceph.com/issues/43584
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-15 15:17:23 -05:00
Patrick Donnelly
5ef5b74edf
Merge PR #42341 into master
* refs/pull/42341/head:
	doc/cephadm: operations.rst typo

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-15 12:41:56 -07:00
Casey Bodley
8fb203ebf2
Merge pull request #42200 from cbodley/wip-47781
rgw: RadosBucket::get_bucket_info() updates RGWBucketEnt

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-07-15 15:27:11 -04:00
Casey Bodley
84be9581dc
Merge pull request #36213 from joke-lee/BulkUpload_md5
rgw: fix md5 not match for RGWBulkUploadOp upload when enable rgw com…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-07-15 14:19:51 -04:00
Casey Bodley
c8c59c786e
Merge pull request #42126 from paulreece42/wip-copyobject-urldecode
rgw: url_decode before parsing copysource in copyobject

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-07-15 14:18:42 -04:00
Casey Bodley
61b112e12d
Merge pull request #41579 from trociny/wip-50932
rgw: allow to set ssl options and ciphers for beast frontend

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-07-15 14:17:41 -04:00
Casey Bodley
7587441efc
Merge pull request #42195 from xrmeng8756/master
rgw: fail as expected when set/delete-bucket-website attempted on a non-exis…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-07-15 14:17:04 -04:00
Casey Bodley
84909e7a50 qa/rgw: add failing tempest test to blocklist
Fixes: https://tracker.ceph.com/issues/49747

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-07-15 14:10:14 -04:00
Ilya Dryomov
67ec940702
Merge pull request #42359 from idryomov/wip-15.2.13-linkage
doc/releases: add linkage for 15.2.13

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2021-07-15 18:05:43 +02:00
Ilya Dryomov
c508f380d8 doc/releases: add linkage for 15.2.13
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-07-15 17:51:31 +02:00
Yuval Lifshitz
0b3b5ddffd rgw/notification: send current time in complete multipart upload event
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>

Fixes: https://tracker.ceph.com/issues/51687
2021-07-15 18:42:27 +03:00
Sage Weil
a07c24423a Merge PR #42343 into master
* refs/pull/42343/head:
	qa/suites/upgrade/pacific-x: do distro before tasks
	qa/suites/orch/cephadm/smoke: centos 8.2 -> 8.3

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-07-15 11:23:28 -04:00
Sage Weil
954abbe5e2 Merge PR #42073 into master
* refs/pull/42073/head:
	doc/mgr/nfs: fix 'export apply', pool name
	PendingReleaseNotes: document workaround for NFS storage change
	qa/tasks/mgr/test_orchestrator_cli: fix test
	qa/suites/orch/cephadm/mgr-nfs-upgrade: add test for nfs migration
	mgr/cephadm: migrate nfs grace file
	mgr/nfs: migrate pre-pacific nfs.ganesha-foo clusters to nfs.foo
	doc/cephfs/fs-nfs-exports: document new export apply capabilities
	qa/tasks/cephfs/test_nfs: define NFS_POOL_NAME
	mgr/nfs: use NFS_POOL_NAME in test_nfs.py
	mgr/nfs: test export apply on JSON list
	mgr/nfs: add test for ganesha conf apply/import
	qa/tasks/cephfs/test_nfs: retry mount a few times
	mgr/cephadm: migrate all legacy nfs exports to new .nfs pool
	mgr/nfs: adjust cephfs export caps if necessary
	python-common: don't accept pool/ns for NFSServiceSpec
	mgr/orchestrator: drop rados_config_location ServiceDescription property
	mgr/cephadm: move rados_config_location() out of NFSServiceSpec
	mgr/nfs: change nfs pool to .nfs
	mgr/nfs/export: accept a JSON or ganesha EXPORT config
	mgr/nfs: allow 'nfs export apply' to take a list of exports
	python-common: remove pool + namespace from NFSServiceSpec
	mgr/nfs: used fixed pool + ns
	mgr/rook: used fixed pool + ns
	mgr/dashboard: use fixed pool + ns
	mgr/cephadm: always use fixed pool and namespace
	mgr/nfs: adjust test to match pool name
	mgr/nfs: always create ganesha pool with well-defined name

Reviewed-by: Varsha Rao <varao@redhat.com>
2021-07-15 11:05:22 -04:00
Casey Bodley
cae189a504 cmake: add transitive dependency on legacy-option-headers
the legacy-option-headers target is only marked as a dependency of the
common-objs and common-common-objs. because those targets are OBJECT
libraries, their dependencies aren't inherited by the targets that link
common-objs or common-common-objs

this adds the dependencies manually, so that changes to the config
yaml files will cause legacy-option-headers to regenerate the headers

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-07-15 10:58:53 -04:00
Sebastian Wagner
6ffbe0b784
Merge pull request #42290 from javicacheiro/fix_cephadm_selinux
cephadm: fetch the real selinux status

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Daniel Pivonka <dpivonka@redhat.com>
2021-07-15 16:36:45 +02:00
Sebastian Wagner
17257018e3
Merge pull request #42220 from dsavineau/issue_51546
mgr/cephadm/iscsi: check if dashboard is enabled

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-07-15 16:23:38 +02:00
Sage Weil
62e4ea5ff1 doc/mgr/nfs: fix 'export apply', pool name
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-15 09:47:39 -04:00
Casey Bodley
07e32e17f6
Merge pull request #42339 from cbodley/wip-revert-vstart-system
Revert "src/vstart: create rgw user with system flag"

Reviewed-by: Varsha Rao <varao@redhat.com>
2021-07-15 09:25:47 -04:00
Ernesto Puerta
af80da7dc0
Merge pull request #41300 from rhcs-dashboard/force-maintenance-test-error
mgr/dashboard: Fix test_error force maintenance dashboard check

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-07-15 15:24:51 +02:00
Danny Abukalam
4eb7cc5ce2
qa: Add SoftIron Linux as valid debian-based distro in test scripts
Signed-off-by: Danny Abukalam <danny@softiron.com>
2021-07-15 07:16:59 -04:00
Danny Abukalam
38f3b0ac8c
build: Add SoftIron Linux as valid debian-based distro in install-deps
Signed-off-by: Danny Abukalam <danny@softiron.com>
2021-07-15 07:15:56 -04:00
Or Ozeri
6f8db0b9be common: optimize op_target_t and hobject_t constructors
Switch to passing on arguments by reference instead of copying them.

Signed-off-by: Or Ozeri <oro@il.ibm.com>
2021-07-15 09:17:46 +03:00
Kefu Chai
ac001cbd2e
Merge pull request #42334 from tchaikov/wip-crimson-logging
crimson/common/log: print out logger.debug() when log level >=6

Reviewed-by: Mark Nelson <mnelson@readhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2021-07-15 11:06:34 +08:00
Kefu Chai
de67d465d5
Merge pull request #42337 from rzarzynski/wip-crimson-alienstore-dedicated-subsys
crimson/os: give AlienStore its own debug subsystem.

Reviewed-by: Mark Nelson <mnelson@readhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-07-15 11:04:52 +08:00
Adam C. Emerson
d3d29ba747
Merge pull request #42251 from adamemerson/wip-robustly-invalidate
rgw: Robustly Invalidate

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2021-07-14 16:49:52 -04:00
Sage Weil
10cdb238d2 qa/suites/upgrade/pacific-x: do distro before tasks
Otherwise, we isntall new podman at the end, and the
container-selinux-policy package install triggers a bunch of selinux
errors.

Fixes: https://tracker.ceph.com/issues/50151
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 15:24:07 -05:00
Sage Weil
c100812bff PendingReleaseNotes: document workaround for NFS storage change
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
a1ee80fcf1 qa/tasks/mgr/test_orchestrator_cli: fix test
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
52f6989fff qa/suites/orch/cephadm/mgr-nfs-upgrade: add test for nfs migration
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
93bc85fc23 mgr/cephadm: migrate nfs grace file
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
bd85c678a5 mgr/nfs: migrate pre-pacific nfs.ganesha-foo clusters to nfs.foo
In octopus, the service is nfs.ganesha-$id instead of nfs.$id

Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
3cfd779e5b doc/cephfs/fs-nfs-exports: document new export apply capabilities
- import list
- import ganesha conf

Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
d41b60404d qa/tasks/cephfs/test_nfs: define NFS_POOL_NAME
We can't import from mgr_module.py from here, sadly.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
8026eb5e8e mgr/nfs: use NFS_POOL_NAME in test_nfs.py
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
bfd5ab3124 mgr/nfs: test export apply on JSON list
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
7760cb2aed mgr/nfs: add test for ganesha conf apply/import
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
1e6fd912f6 qa/tasks/cephfs/test_nfs: retry mount a few times
It may take a moment for a ganesha to (re)configure itself with a new
export.  If a mount fails, retry a couple times.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
c183bccdc6 mgr/cephadm: migrate all legacy nfs exports to new .nfs pool
Migrate all past NFS pools, whether they were created by mgr/nfs or by
the dashboard, to the new mgr/nfs .nfs pool.

Since this migrations relies on RADOS being available, we have to be a bit
careful here: we only attempt the migration from serve(), not during
module init.

After the exports are re-imported, we destroy existing ganesha daemons so
that new ones will get recreated.  This ensures the (new) daemons have
cephx keys to access the new pool.

Note that no attempt is made to clean up the old NFS pools.  This is out
of paranoia: if something goes wrong, the old NFS configuration data will
still be there.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
379a1fc4d7 mgr/nfs: adjust cephfs export caps if necessary
If we are importing an old export, we may find that the cephx user
existed but with the wrong caps.  Adjust caps in that case!

Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
d0d95db00d python-common: don't accept pool/ns for NFSServiceSpec
All users are now gone.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
75970ff806 mgr/orchestrator: drop rados_config_location ServiceDescription property
I'm not sure what this was intended to be used for...

Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
7cbd1fbce8 mgr/cephadm: move rados_config_location() out of NFSServiceSpec
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00