Commit Graph

132693 Commits

Author SHA1 Message Date
Nizamudeen A
42fd81f1bd
Merge pull request #46945 from rhcs-dashboard/rbd-e2e
mgr/dashboard: rbd-mirroring e2e tests

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-07-26 19:51:06 +05:30
Patrick Donnelly
889e332cf8
Merge PR #47218 into main
* refs/pull/47218/head:
	mon/MDSMonitor: fix check for standby reversion
	mds: update comment about standby-replay daemons holding a rank
	qa: test for standby-replay removal in MDSMonitor::prepare_beacon
	mds: add inject config for synthetic health message

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2022-07-26 08:59:56 -04:00
Deepika Upadhyay
93e5d787ef cmake: add rbd-mirror executable to run-make-check
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
(cherry picked from commit e2b46020317e4d4e37c281a6b1817711e0826a37)
2022-07-26 13:50:29 +05:30
Nizamudeen A
59ed661458 mgr/dashboard: rbd-mirroring e2e tests
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-07-26 13:50:23 +05:30
Guillaume Abrioux
882d7c0d12
Merge pull request #47168 from guits/get-devices-vgs-per-dev
ceph-volume: do not call get_device_vgs() per devices
2022-07-26 09:56:32 +02:00
Yingxin
226e206a31
Merge pull request #47239 from cyx1231st/wip-seastore-cleaner-alloc-trim
crimson/os/seastore: cleanups and improvements to trimming

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-07-26 15:18:22 +08:00
Kefu Chai
606ec517f7
Merge pull request #46554 from adamemerson/wip-up-the-boost
build: Bump Boost version to 1.79

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-07-26 07:39:10 +08:00
Liu-Chunmei
066204ed4c
Merge pull request #47003 from liu-chunmei/seastore-list-objects
crimson/seastore: fix list objects

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-07-25 16:14:59 -07:00
Kefu Chai
413969b376
Merge pull request #47217 from tchaikov/wip-ntstatus
common/win32,dokan: include bcrypt.h for NTSTATUS

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2022-07-26 06:56:36 +08:00
Adam King
4fffbca0d2
Merge pull request #47164 from Dazul/add-config-availability-drive-group
mgr/cephadm: add parsing for config on osd specs

Reviewed-by: Adam King <adking@redhat.com>
2022-07-25 16:19:33 -04:00
Casey Bodley
18d368332d
Merge pull request #47120 from yehudasa/wip-56576
rgw: bucket sync: fetch source bucket info

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-07-25 15:49:07 -04:00
Casey Bodley
1385f6bc96
Merge pull request #47083 from cbodley/wip-rgw-sysobjctx-rm
rgw: sysobj service cleanup

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2022-07-25 15:03:35 -04:00
Casey Bodley
9f226dd477
Merge pull request #35870 from soumyakoduri/json_fix
JSONFormattable incorrectly sets a string starting with digit as int

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-07-25 12:17:58 -04:00
Kefu Chai
f85f60f366
Merge pull request #47255 from tchaikov/wip-fmt-containers
include/types_fmt: use fmt::join() to format containers

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-07-25 23:41:03 +08:00
Yingxin Cheng
5aa8187d56 crimson/os/seastore/async_cleaner: fix and improve update_journal_tails()
* Accept JOURNAL_SEQ_NULL dirty_tail when it is pending.
* Enforce monotone increasing to the journal tails.
* Enforce journal tails to be always behind the journal head.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-25 22:23:00 +08:00
Yingxin Cheng
2c1e37d25b crimson/os/seastore/cache: add logs to debug alloc_tail trimming
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-25 22:21:16 +08:00
Anthony D'Atri
520496b349
Merge pull request #47256 from anthonyeleven/anthonyeleven/how-to-fix-pg-autoscaler-empty-output
doc/radosgw/operations: Document how to fix empty autoscale-status output
2022-07-25 07:17:18 -07:00
Kefu Chai
b7b7ff4cce include/types_fmt: use fmt::join() to format containers
* add formatter for classes with stream insertion operator.
  as in fmtlib v6.1.2, which is the one shipped with ubuntu focal,
  fmt::join() requires the printed element to have formatter.
  see https://github.com/fmtlib/fmt/issues/2040 and
  https://github.com/fmtlib/fmt/issues/1462
* use template parameter pack to represent container template argument,
  simpler this way. also, this enables us to print specialized
  classes which uses non-default template parameters.
* use fmt::join() to print container elements. see also
  https://fmt.dev/latest/api.html#_CPPv4I0EN3fmt4joinE9join_viewIN6detail10iterator_tI5RangeEEN6detail10sentinel_tI5RangeEEERR5Range11string_view

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-25 21:59:07 +08:00
Kefu Chai
b287fadde3 fmt: pickup v8.1.1
update fmt submodule so we can use fmt::join() without defining
formatter specialization for types which already have `operator<<()`.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-25 21:59:07 +08:00
Kefu Chai
aa5769ecf1 cmake: disable FMT_USE_TZSET for WIN32
otherwise we'd have following FTBFS with MinGW, like:

../src/fmt/include/fmt/chrono.h: In lambda function:
../src/fmt/include/fmt/chrono.h:952:5: error: '_tzset' was not declared
in this scope; did you mean 'tzset'?
  952 |     _tzset();
      |     ^~~~~~
      |     tzset

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-25 21:59:07 +08:00
Patrick Donnelly
b2c40cc07f
mon/MDSMonitor: fix check for standby reversion
A standby-replay daemon always has a rank, so this check is completely
wrong. If a beacon from a standby-replay daemon reaches
MDSMonitor::prepare_beacon, it will always be evicted/removed by the
mons. This is rare (usually a reply occurs directly from
MDSMonitor::preprocess_beacon) but can happen in certain circumstances,
like a health warning included in the beacon.

Fixes: https://tracker.ceph.com/issues/56666
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-07-25 09:57:15 -04:00
Patrick Donnelly
82d9030f5a
mds: update comment about standby-replay daemons holding a rank
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-07-25 09:57:15 -04:00
Patrick Donnelly
5495fe8c42
qa: test for standby-replay removal in MDSMonitor::prepare_beacon
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-07-25 09:57:15 -04:00
Patrick Donnelly
3ecb987dde
mds: add inject config for synthetic health message
This will be used to force the MDSMonitor to process a beacon in
MDSMonitor::prepare_beacon.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2022-07-25 09:57:15 -04:00
Kefu Chai
3c46dd64bb cmake: bump up required fmt version
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-25 20:58:59 +08:00
Yingxin Cheng
725cda101f crimson/os/seastore/cache: write cleaner dirty tail if the oldest dirty extent is still pending
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-25 16:32:40 +08:00
Yingxin Cheng
1eb30662c3 crimson/os/seastore: drop journal_seq_t NO_DELTAS
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-25 16:32:40 +08:00
Yingxin Cheng
aec25bffb3 crimson/os/seastore: improve logs
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-07-25 16:32:32 +08:00
Anthony D'Atri
3833372791 doc/radosgw/operations: Document how to fix empty autoscale-status output
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-07-24 20:54:56 -07:00
Ilya Dryomov
a421cfc2aa
Merge pull request #47014 from ktdreyer/no-system-pmdk-s390x
ceph.spec.in: disable system_pmdk on s390x

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-07-24 09:37:55 +02:00
Ilya Dryomov
b4a66dec66
Merge pull request #47242 from idryomov/wip-56676
librbd: tweak misleading "image is still primary" error message

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-07-23 11:33:47 +02:00
chunmei-liu
7110e0e9fa crimson/test: add more list_objects test in test_seastore
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
Signed-off-by: Samuel Just <sjust@redhat.com>
2022-07-22 16:12:35 -07:00
chunmei-liu
4010c4f24d crimson/seastore: fix test_seastore
collection default has pool(0), and NO_SHARD,
so the ghobject_t should have the same setting.
and ghobject_t default hash not within 1<<(32-4),
so set collection bits to be 0.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-07-22 16:12:23 -07:00
chunmei-liu
16becf3157 crimson/seastore: fix list_onodes bug
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-07-22 16:12:23 -07:00
chunmei-liu
96c6f67a9c crimson/seastore: calculate list_objects ranges by coll_range_(temp)_start/end
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
Signed-off-by: Samuel Just <sjust@redhat.com>
2022-07-22 16:11:54 -07:00
J. Eric Ivancich
c35cfec82b
Merge pull request #46711 from 5cs/fix-backoff-retries
rgwlc: fix backoff retries counter

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-07-22 14:39:22 -04:00
J. Eric Ivancich
3e93ce0173
Merge pull request #47005 from 5cs/fix-rm-LCEntry
rgwlc: fix removing LCEntry

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-07-22 14:38:11 -04:00
J. Eric Ivancich
29d05a3093
Merge pull request #47078 from Huber-ming/nonexists_noaccounted
cls_rgw: nonexists object shoud not be accounted when check_index

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2022-07-22 14:37:41 -04:00
David Galloway
84f158f0bf
Merge pull request #47229 from kotreshhr/mgr-legacy-to-upgrade-config-fix
mgr/volumes: Fix subvolume discover during upgrade
2022-07-22 13:42:27 -04:00
David Galloway
40dc779049
Merge pull request #47244 from ceph/fix-release-order
doc/releases: Fix quincy order
2022-07-22 12:18:34 -04:00
Kefu Chai
b3151a9c37 test/encoding: refactor EncodingException::Macros
so it is more compacted

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-23 00:14:35 +08:00
Kefu Chai
0d9eec3c4f test/encoding: verify that e.what() starts with expected str
boost changes the way how it prints boost::system::system_error in
boost 1.79 -- it appends the stringified error_category at end of
exception::what(), and our buffer::malformed_input is a subclass
of boost::system::system_error.

so we cannot just compare the return value of what() with the
expected string, to be more future proof, let's check if i
starts with the expected string instead.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-23 00:14:35 +08:00
Kefu Chai
1a09e520bf common/win32,dokan: include bcrypt.h for NTSTATUS
to avoid the conflicting declaration of NTSTATUS from bcrypt.h and our
own typedef. as after switching to boost 1.79, we would have following compiling
failure:

In file included from ../src/dokan/options.cc:14:
../src/dokan/ceph_dokan.h:16:15: error: conflicting declaration 'typedef DWORD NTSTATUS'
   16 | typedef DWORD NTSTATUS;
      |               ^~~~~~~~
In file included from ../build.deps/mingw/boost/include/boost/asio/impl/connect_pipe.ipp:29,
                 from ../build.deps/mingw/boost/include/boost/asio/connect_pipe.hpp:79,
                 from ../build.deps/mingw/boost/include/boost/asio.hpp:64,
                 from ../src/include/win32/winsock_wrapper.h:20,
                 from <command-line>:
/usr/share/mingw-w64/include/bcrypt.h:27:16: note: previous declaration as 'typedef LONG NTSTATUS'
   27 |   typedef LONG NTSTATUS,*PNTSTATUS;
      |                ^~~~~~~~

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-23 00:14:35 +08:00
Kefu Chai
579a9fe32a
Merge pull request #47124 from tchaikov/spec-mibs
ceph.spec.in: correct "%files mib" section

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Justin Caratzas <jcaratza@redhat.com>
2022-07-22 23:54:03 +08:00
Kefu Chai
275593e441
Merge pull request #47243 from tchaikov/wip-gantt
doc/_ext: sort the release date

Reviewed-by: David Galloway <dgallowa@redhat.com>
2022-07-22 23:50:59 +08:00
David Galloway
97ffb2e25f doc/releases: Fix quincy order
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-07-22 11:08:05 -04:00
Adam C. Emerson
947ac23979 build: Bump Boost version to 1.79
Also remove bind_allocator, as Boost.Asio now provides this function.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2022-07-22 11:04:43 -04:00
Kefu Chai
1f59a511bd doc/_ext: sort the release date
so the release in reverse chronologically order, so that the newer
one is listed at the top.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-07-22 22:52:16 +08:00
Ilya Dryomov
95dd89b4d7 librbd: tweak misleading "image is still primary" error message
m_promotion_state == PROMOTION_STATE_NON_PRIMARY doesn't say anything
about the remote image.  It could still be primary but it could also be
demoted.

Fixes: https://tracker.ceph.com/issues/56676
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-07-22 16:21:49 +02:00
Kotresh HR
c8416c3f0e qa: Remove unused variable
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-07-22 19:20:33 +05:30