Commit Graph

137389 Commits

Author SHA1 Message Date
Adam King
5a46fd10ba
Merge pull request #50743 from phlogistonjohn/jjm-update-mypy
update pinned mypy version

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-04-04 13:15:33 -04:00
Soumya Koduri
1103966d81 rgw/gc: Check for RadosStore for radosgw-admin gc command
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-04-04 22:45:27 +05:30
Ilya Dryomov
76856d90e0 librbd: avoid generating ESHUTDOWN in ManagedLock
EBLOCKLISTED has a very special meaning but happens to be an alias for
ESHUTDOWN.  If the client gets blocklisted, we always want to propagate
EBLOCKLISTED error code since it's generated by the OSD.

For ManagedLock use case of indicating that an operation on the lock
raced with lock shut down, meaning that a higher level request can just
be restarted, ERESTART should do.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-04 17:58:36 +02:00
Ilya Dryomov
1d943f8c47 librbd: fix recursive locking on owner_lock in ImageDispatch
needs_exclusive_lock() calls acquire_lock() with owner_lock held.
If lock acquisiton races with lock shut down, ManagedLock completes
ImageDispatch context directly and dispatch is retried immediately on
the same thread (due to DISPATCH_RESULT_RESTART).  This results in
recursion into needs_exclusive_lock() and, barring locking issues, can
lead to unbounded stack growth if lock shut down takes its time.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-04 17:58:36 +02:00
Ilya Dryomov
a14498eff6 test/librados_test_stub: drop watches only after actually blocklisting
Eliminate a race where a client is able to submit an operation after
WatchCtx2::handle_error() is invoked on its watch due to blocklisting.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-04 17:58:36 +02:00
Ilya Dryomov
0dfe87d3b6 test/librados_test_stub: raise a watch error on blocklisting
Simulate getting MWatchNotify CEPH_WATCH_EVENT_DISCONNECT message after
the client is blocklisted.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-04 17:58:36 +02:00
Pedro Gonzalez Gomez
ddb22aa0b3
Merge pull request #50600 from rhcs-dashboard/delete-rgw-multisite
mgr/dashboard: delete rgw multisite


Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-04-04 16:43:16 +02:00
Guillaume Abrioux
2cd5eb5a36
Merge pull request #50279 from cfsnyder/wip-58857-ceph-volume-fast-allocs
ceph-volume: fix issue with fast device allocs when there are multiple PVs per VG
2023-04-04 15:08:52 +02:00
Anthony D'Atri
078bc30936
Merge pull request #50819 from bluikko/bluikko-cephfs-volumes-prompts
doc/cephfs: fix prompts in fs-volumes.rst
2023-04-04 07:45:01 -04:00
Nizamudeen A
832e1e9622
Merge pull request #50845 from rhcs-dashboard/update-grafana-version
monitoring/grafana: update the grafana version

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-04-04 11:31:23 +05:30
Anthony D'Atri
ad695a5c7e
Merge pull request #50851 from zdover23/wip-doc-2023-04-04-rados-operations-monitoring-ceph-medic-link
doc/rados/ops: add ceph-medic documentation
2023-04-03 17:19:32 -04:00
Zac Dover
b2a409da26 doc/rados/ops: add ceph-medic documentation
Add a link to the ceph-medic documentation to
doc/rados/operations/monitoring.rst.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-04 06:57:27 +10:00
zdover23
2dee65108f
Merge pull request #50834 from zdover23/wip-doc-2023-04-03-rados-operations-monitoring-2-of-3
doc/rados: edit ops/monitoring.rst (2 of 3)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-04-04 05:59:19 +10:00
Zac Dover
41684ebd33 doc/rados: edit ops/monitoring.rst (2 of 3)
Line-edit the second third of doc/rados/operations/monitoring.rst.

Follows https://github.com/ceph/ceph/pull/50670.

https://tracker.ceph.com/issues/58485

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-04 05:24:33 +10:00
Adam King
4a9540f672
Merge pull request #50548 from adk3798/incompatible-apply
cephadm: handle exceptions applying extra services during bootstrap

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-04-03 15:19:12 -04:00
Yuri Weinstein
a21a734a49
Merge pull request #50759 from ceph/wip-yuriw-fix-upgrades-main
qa/upgrade: consistently use the tip of the branch as the start version

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2023-04-03 11:30:56 -07:00
Redouane Kachach
99148b4a18
mgr/cephadm: use SFTP instead of SCP to copy cephadm remote files
fixes: https://tracker.ceph.com/issues/59298

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2023-04-03 18:42:21 +02:00
Nizamudeen A
fb4a2f2b4e monitoring/grafana: update the grafana version
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-04-03 21:53:39 +05:30
Patrick Donnelly
1814570b8f
qa: wait for MDSMonitor tick to replace daemons
Fixes: https://tracker.ceph.com/issues/59297
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2023-04-03 12:10:56 -04:00
Ilya Dryomov
436cc67a3f
Merge pull request #50404 from batrick/i58923
mon/MgrMonitor: plug PAXOS for batched MgrMap/OSDMap

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-03 17:53:03 +02:00
Pere Diaz Bou
80960387fb mgr/dashboard: fix displaying mirror image progress
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
2023-04-03 17:22:35 +02:00
Yuri Weinstein
d0381ed7e6 qa/upgrade: consistently use the tip of the branch as the start version
Also corrected line to use image: quay.ceph.io/ceph-ci/ceph:*
In order to make sure that latest versions of ceph is used as initial install

Fixes: https://tracker.ceph.com/issues/58914
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2023-04-03 08:19:11 -07:00
Soumya Koduri
aeb3a74618 rgw/sync-policy: Support disabling per-bucket replication
When the zones replicate, allow disabling replication
for specific buckets using sync policy.

These are the semantics to be followed while resolving the policy
conflicts -

==================================================
zonegroup		bucket		Result
==================================================
enabled			enabled		enabled
			allowed		enabled
			forbidden	disabled
allowed			enabled		enabled
			allowed		disabled
			forbidden	disabled
forbidden		enabled		disabled
			allowed		disabled
			forbidden	disabled

In case multiple group policies are set to reflect for any sync pair
(<source-zone,source-bucket>, <dest-zone,dest-bucket>), the following
rules are applied in the order -
1) Even if one policy status is FORBIDDEN, the sync will be disabled
2) Atleast one policy should be ENABLED for the sync to be allowed.

Various cases tested are outlined here -
https://docs.google.com/document/d/19oBQA-bYxLBR4BnekA2DTwJJaTFvjAfrqAk9G3RGU0I/edit#heading=h.4qac9dpc76m

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-04-03 19:44:57 +05:30
Mark Kogan
5846a9c267 rgw : fix python script using s3cmd with error code 403 ubuntu 20.04
Fixes: https://tracker.ceph.com/issues/54104

Signed-off-by: Mark Kogan <mkogan@redhat.com>
2023-04-03 15:18:55 +03:00
Ville Ojamo
e5355e3d66 doc/cephfs: fix prompts in fs-volumes.rst
Modernize prompts in example commands in file
fs-volume.rst and use a root prompt correctly instead
of using a non-privileged prompt when privileges
are needed.

Indent all JSON in example command outputs with
four spaces consistently instead of a mix of four and
two spaces.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2023-04-02 16:36:44 +07:00
Anthony D'Atri
66552a560f
Merge pull request #50818 from anthonyeleven/anthonyeleven/tweak-fs-volumes.rst
doc/cephfs: Improve fs-volumes.rst
2023-04-02 01:47:36 -04:00
Anthony D'Atri
c8e1f3ac3d doc/cephfs: Improve fs-volumes.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2023-04-01 01:05:20 -04:00
zdover23
b682861f86
Merge pull request #50670 from zdover23/wip-doc-2023-03-26-rados-operations-monitoring-1-of-3
doc/rados: edit ops/monitoring.rst (1 of 3)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-04-01 05:48:39 +10:00
Zac Dover
bc5f404a78 doc/rados: edit ops/monitoring.rst (1 of 3)
Line-edit the first third of doc/rados/operations/monitoring.rst.

https://tracker.ceph.com/issues/58485

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-01 05:23:01 +10:00
Rishabh Dave
989f7ecee5
Merge pull request #46905 from lxbsz/wip-quota
mds: align quota.max_bytes to 4MB or 4KB

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2023-04-01 00:12:19 +05:30
Rishabh Dave
75b12e4c00
Merge pull request #49882 from zhsgao/dump_resolve_status
mds: fix bug of dump_resolve_status

Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2023-04-01 00:10:05 +05:30
Rishabh Dave
0e1e26e27a
Merge pull request #50024 from kotreshhr/mds-unused-function-removal
mds: Remove unused declaration of the function

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2023-04-01 00:06:49 +05:30
Casey Bodley
6a46f9f2e9
Merge pull request #50746 from cbodley/wip-rgw-bucket-full-sync-compat
rgw: set init_check_compat when bucket sync status doesn't exist

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Reviewed-by: Mark Kogan <mkogan@redhat.com>
2023-03-31 14:34:42 -04:00
Ali Maredia
1d1672e854
Merge pull request #50644 from cbodley/wip-59135
qa/rgw: upgrade tests restrict supported distros
2023-03-31 14:27:26 -04:00
Pedro Gonzalez Gomez
dae8168e29 mgr/dashboard: delete rgw multisite
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2023-03-31 20:14:42 +02:00
Casey Bodley
01096e840a
Merge pull request #50690 from cbodley/wip-59174
rgw/admin: 'data sync status' formats binary error repo entries

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-03-31 13:48:52 -04:00
Casey Bodley
df21f6d37b
Merge pull request #50462 from matutter/main
sts: Fixes get_cert_url improper url path concatenation

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
2023-03-31 13:47:48 -04:00
Casey Bodley
12f9cb5e88
Merge pull request #50623 from VVoidV/fix-rgw_admin
[RGW]fix minor bug in rgw_admin

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2023-03-31 13:47:18 -04:00
Casey Bodley
8fb26b219d
Merge pull request #50648 from cbodley/wip-58035
rgw: fix CopyObj crash after admin override

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Mark Kogan <mkogan@redhat.com>
2023-03-31 13:43:01 -04:00
Anthony D'Atri
cf40777309
Merge pull request #50817 from bluikko/patch-10
doc/cephfs: refer to placement of MDS and not NFS in fs-volumes.rst
2023-03-31 09:18:15 -04:00
Ville Ojamo
d5343396aa
doc/cephfs: refer to MDS and not NFS in fs-volumes.rst
Placement should talk about MDS placement and not NFS Ganesha placement.

Signed-off-by: Ville Ojamo <14869000+bluikko@users.noreply.github.com>
2023-03-31 19:01:39 +07:00
Ilya Dryomov
e11097bc4c librbd: clear Image::list_watchers() list before populating it
The "append to the passed list" behavior is confusing and not what the
corresponding C API (rbd_watchers_list) or other similar C++ APIs (e.g.
list_lockers) do.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-03-31 12:23:45 +02:00
Ilya Dryomov
e1c5ea5420
Merge pull request #50793 from petrutlucian94/allperms
include: move ALLPERMS definition to compat.h

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-03-31 10:54:45 +02:00
Lucian Petrut
a2966c0817 include: move ALLPERMS definition to compat.h
The Windows CI job started to fail as some libcephfs tests that use
ALLPERMS have been moved [1] to a separate file which doesn't have
the ALLPERMS definition.

  /ceph/src/test/libcephfs/suidsgid.cc:240:36: error: ‘ALLPERMS’ was
  not declared in this scope
  240 |   ASSERT_EQ(stx.stx_mode & (mode_t)ALLPERMS, before_mode);

We'll move this definition to compat.h so that we won't have to
redefine it in each file that uses it.

Note that we're moving the Windows "fs_compat.h" include up,
ensuring that the constants used by ALLPERMS are defined.

[1] 254eeb2730

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2023-03-31 07:09:37 +00:00
Guillaume Abrioux
b538d6adb6
Merge pull request #49586 from mohan7427/mohan/batch_args-issue
ceph-volume: fix drive-group issue that expects the batch_args to be a string
2023-03-31 09:07:43 +02:00
zdover23
60195779a7
Merge pull request #50554 from zdover23/wip-doc-2023-03-16-rados-operations-pg-repair
doc/rados: line-edit pg-repair.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-03-31 16:45:06 +10:00
zdover23
f66bdb87f7
Merge pull request #45354 from dvanders/dualdoc
doc/msgr2: update dual stack status

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-03-31 16:25:31 +10:00
lichaochao
f9aae71af3 rgw: fix rgw cache invalidation after unregister_watch() error
When a metadata osd fails, an unregister_watch() error may occur,
resulting in an rgw cache invalidation.
By adding an unregister_done flag and when a register_watch() error ,
performing a reinit() operation again,
After the first reinit() failure, the register_watch() will be performed again

Fixes: https://tracker.ceph.com/issues/59217

Signed-off-by: lichaochao <lichaochao2_yewu@cmss.chinamobile.com>
2023-03-31 07:54:50 +02:00
Redouane Kachach
2c46c07419
mgr/cephadm: Adding extra arguments support for RGW frontend
Fixes: https://tracker.ceph.com/issues/57931

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2023-03-31 07:27:04 +02:00
Nizamudeen A
7a7ab80e42
Merge pull request #50426 from rhcs-dashboard/role-create
mgr/dashboard: creation of rgw roles

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-03-31 10:42:09 +05:30