Commit Graph

132794 Commits

Author SHA1 Message Date
Patrick Donnelly
b2c40cc07f
mon/MDSMonitor: fix check for standby reversion
A standby-replay daemon always has a rank, so this check is completely
wrong. If a beacon from a standby-replay daemon reaches
MDSMonitor::prepare_beacon, it will always be evicted/removed by the
mons. This is rare (usually a reply occurs directly from
MDSMonitor::preprocess_beacon) but can happen in certain circumstances,
like a health warning included in the beacon.

Fixes: https://tracker.ceph.com/issues/56666
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-07-25 09:57:15 -04:00
Patrick Donnelly
82d9030f5a
mds: update comment about standby-replay daemons holding a rank
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-07-25 09:57:15 -04:00
Patrick Donnelly
5495fe8c42
qa: test for standby-replay removal in MDSMonitor::prepare_beacon
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-07-25 09:57:15 -04:00
Patrick Donnelly
3ecb987dde
mds: add inject config for synthetic health message
This will be used to force the MDSMonitor to process a beacon in
MDSMonitor::prepare_beacon.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-07-25 09:57:15 -04:00
Kefu Chai
3c46dd64bb cmake: bump up required fmt version
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-25 20:58:59 +08:00
Avan Thakkar
ea770fd858 mgr/dashboard: add required validation for frontend and monitor port
Fixes: https://tracker.ceph.com/issues/56688
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2022-07-25 16:04:00 +05:30
Yingxin Cheng
725cda101f crimson/os/seastore/cache: write cleaner dirty tail if the oldest dirty extent is still pending
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-25 16:32:40 +08:00
Yingxin Cheng
1eb30662c3 crimson/os/seastore: drop journal_seq_t NO_DELTAS
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-25 16:32:40 +08:00
Yingxin Cheng
aec25bffb3 crimson/os/seastore: improve logs
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-25 16:32:32 +08:00
Anthony D'Atri
3833372791 doc/radosgw/operations: Document how to fix empty autoscale-status output
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-07-24 20:54:56 -07:00
Paul Cuzner
972fb0ab3c cephadm: Add tests for rescan function
Adds unittets for the rescan code

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2022-07-25 14:53:24 +12:00
Paul Cuzner
4525113fa1 docs: Add docs for new host rescan feature
Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2022-07-25 14:53:24 +12:00
Paul Cuzner
cc9eb1812e mgr/cephadm: Add new host rescan command
Adds a host rescan command to invoke cephadm's
rescan-disks subcommand

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2022-07-25 14:53:16 +12:00
Ilya Dryomov
a421cfc2aa
Merge pull request #47014 from ktdreyer/no-system-pmdk-s390x
ceph.spec.in: disable system_pmdk on s390x

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-07-24 09:37:55 +02:00
Ilya Dryomov
b4a66dec66
Merge pull request #47242 from idryomov/wip-56676
librbd: tweak misleading "image is still primary" error message

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-07-23 11:33:47 +02:00
chunmei-liu
7110e0e9fa crimson/test: add more list_objects test in test_seastore
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
Signed-off-by: Samuel Just <sjust@redhat.com>
2022-07-22 16:12:35 -07:00
chunmei-liu
4010c4f24d crimson/seastore: fix test_seastore
collection default has pool(0), and NO_SHARD,
so the ghobject_t should have the same setting.
and ghobject_t default hash not within 1<<(32-4),
so set collection bits to be 0.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-07-22 16:12:23 -07:00
chunmei-liu
16becf3157 crimson/seastore: fix list_onodes bug
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-07-22 16:12:23 -07:00
chunmei-liu
96c6f67a9c crimson/seastore: calculate list_objects ranges by coll_range_(temp)_start/end
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
Signed-off-by: Samuel Just <sjust@redhat.com>
2022-07-22 16:11:54 -07:00
J. Eric Ivancich
c35cfec82b
Merge pull request #46711 from 5cs/fix-backoff-retries
rgwlc: fix backoff retries counter

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-07-22 14:39:22 -04:00
J. Eric Ivancich
3e93ce0173
Merge pull request #47005 from 5cs/fix-rm-LCEntry
rgwlc: fix removing LCEntry

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-07-22 14:38:11 -04:00
J. Eric Ivancich
29d05a3093
Merge pull request #47078 from Huber-ming/nonexists_noaccounted
cls_rgw: nonexists object shoud not be accounted when check_index

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2022-07-22 14:37:41 -04:00
David Galloway
84f158f0bf
Merge pull request #47229 from kotreshhr/mgr-legacy-to-upgrade-config-fix
mgr/volumes: Fix subvolume discover during upgrade
2022-07-22 13:42:27 -04:00
David Galloway
40dc779049
Merge pull request #47244 from ceph/fix-release-order
doc/releases: Fix quincy order
2022-07-22 12:18:34 -04:00
Kefu Chai
b3151a9c37 test/encoding: refactor EncodingException::Macros
so it is more compacted

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-23 00:14:35 +08:00
Kefu Chai
0d9eec3c4f test/encoding: verify that e.what() starts with expected str
boost changes the way how it prints boost::system::system_error in
boost 1.79 -- it appends the stringified error_category at end of
exception::what(), and our buffer::malformed_input is a subclass
of boost::system::system_error.

so we cannot just compare the return value of what() with the
expected string, to be more future proof, let's check if i
starts with the expected string instead.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-23 00:14:35 +08:00
Kefu Chai
1a09e520bf common/win32,dokan: include bcrypt.h for NTSTATUS
to avoid the conflicting declaration of NTSTATUS from bcrypt.h and our
own typedef. as after switching to boost 1.79, we would have following compiling
failure:

In file included from ../src/dokan/options.cc:14:
../src/dokan/ceph_dokan.h:16:15: error: conflicting declaration 'typedef DWORD NTSTATUS'
   16 | typedef DWORD NTSTATUS;
      |               ^~~~~~~~
In file included from ../build.deps/mingw/boost/include/boost/asio/impl/connect_pipe.ipp:29,
                 from ../build.deps/mingw/boost/include/boost/asio/connect_pipe.hpp:79,
                 from ../build.deps/mingw/boost/include/boost/asio.hpp:64,
                 from ../src/include/win32/winsock_wrapper.h:20,
                 from <command-line>:
/usr/share/mingw-w64/include/bcrypt.h:27:16: note: previous declaration as 'typedef LONG NTSTATUS'
   27 |   typedef LONG NTSTATUS,*PNTSTATUS;
      |                ^~~~~~~~

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-23 00:14:35 +08:00
Kefu Chai
579a9fe32a
Merge pull request #47124 from tchaikov/spec-mibs
ceph.spec.in: correct "%files mib" section

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Justin Caratzas <jcaratza@redhat.com>
2022-07-22 23:54:03 +08:00
Kefu Chai
275593e441
Merge pull request #47243 from tchaikov/wip-gantt
doc/_ext: sort the release date

Reviewed-by: David Galloway <dgallowa@redhat.com>
2022-07-22 23:50:59 +08:00
David Galloway
97ffb2e25f doc/releases: Fix quincy order
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-07-22 11:08:05 -04:00
Adam C. Emerson
947ac23979 build: Bump Boost version to 1.79
Also remove bind_allocator, as Boost.Asio now provides this function.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2022-07-22 11:04:43 -04:00
Kefu Chai
1f59a511bd doc/_ext: sort the release date
so the release in reverse chronologically order, so that the newer
one is listed at the top.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-22 22:52:16 +08:00
Ilya Dryomov
95dd89b4d7 librbd: tweak misleading "image is still primary" error message
m_promotion_state == PROMOTION_STATE_NON_PRIMARY doesn't say anything
about the remote image.  It could still be primary but it could also be
demoted.

Fixes: https://tracker.ceph.com/issues/56676
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-07-22 16:21:49 +02:00
Kotresh HR
c8416c3f0e qa: Remove unused variable
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-22 19:20:33 +05:30
Kotresh HR
1d66216902 qa: validate subvolume discover on upgrade
Validate subvolume discover on upgrade from
legacy subvolume to v1. The handcrafted
`.meta' file on legacy subvolume root should
not be used for any subvolume apis like getpath,
authorize.

Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-22 19:20:09 +05:30
Kefu Chai
3c680578b4
Merge pull request #47237 from rosinL/fix-move
crimson/osd/osd: fix sigsegv caused by reusing the moved object

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-07-22 20:14:36 +08:00
Yingxin Cheng
caff72bf77 crimson/os/seastore/async_cleaner: clarify invariants
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-22 17:32:20 +08:00
Yingxin Cheng
945e7fc11f crimson/os/seastore: consider dirty tail during replay
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-22 17:32:20 +08:00
Yingxin Cheng
9942cad260 crimson/os/seastore/async_cleaner: decouple gc_trim_alloc() and gc_trim_dirty()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-22 17:32:20 +08:00
Yingxin Cheng
cc3ad28274 crimson/os/seastore: cleanup, consolidate alloc_tail/dirty_tail naming
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-22 17:32:20 +08:00
Yingxin Cheng
6f074b6c1e crimson/os/seastore: update journal tail when writting the segment header in mkfs
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-22 17:32:20 +08:00
luo rixin
0a80c68b90 crimson/osd/osd: fix sigsegv caused by reusing the moved objcect
In some case, `m` will be moved and setted nullptr before
`m->get_spg()` be called, causing a segmentation fault.

Signed-off-by: luo rixin <luorixin@huawei.com>
2022-07-22 16:48:32 +08:00
Yingxin
e12cec53fd
Merge pull request #47206 from cyx1231st/wip-seastore-cleaner-tail-committed
crimson/os/seastore: simplify journal tails

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2022-07-22 16:27:59 +08:00
Kotresh HR
d46513d309 mgr/volumes: V2 Fix for test_subvolume_retain_snapshot_invalid_recreate
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-22 13:25:18 +05:30
Kotresh HR
373a04cf73 mgr/volumes: Fix subvolume discover during upgrade
Fixes the subvolume discover to use the correct
metadata file after an upgrade from legacy subvolume
to v1. The fix makes sure, it doesn't use the
handcrafted metadata file placed in the subvolume
root of legacy subvolume.

Co-authored-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
Co-authored-by: Dan van der Ster <daniel.vanderster@cern.ch>
Co-authored-by: Ramana Raja <rraja@redhat.com>
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-22 13:23:39 +05:30
Yingxin Cheng
4fdc95b39f crimson/os/seastore: simplify journal tails
* append latest dirty tail as journal delta, in order to simplify and
  drop journal_tail_committed in the cleaner.
* simplify misc journal tails into alloc_tail and dirty_tail, with
  proper renaming.
* move journal-tail recovery logic from cleaner to journal.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-22 11:16:48 +08:00
Yingxin Cheng
d6d9d46cc9 crimson/os/seastore: misc cleanups
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-22 10:47:25 +08:00
Yingxin Cheng
d9ef633c95 crimson/os/seastore: store valid journal tail during mkfs
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-22 10:46:02 +08:00
Gregory Farnum
aea6200abd
Merge pull request #47219 from ceph/sec
16.2.10 and 17.2.2 Release Notes

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-07-21 19:28:07 -07:00
Kefu Chai
dcd0541bb2
Merge pull request #47212 from tchaikov/wip-aligned-free
include/compat: define aligned_free() as a function not a macro

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2022-07-22 07:08:53 +08:00