Commit Graph

126945 Commits

Author SHA1 Message Date
Laura Flores
484126b988 mgr/dashboard: add unit test for telemetry replacer method
This unit test checks that the "replacer" method in telemetry.component.ts works as it should. The replacer method takes the telemetry report and changes the ranges and values of the 'osd_perf_histograms' field from arrays to strings, thereby making the report more readable in the Dashboard Telemetry Preview.

This unit test needs improvement since it currently uses a test report rather than the real one.

Signed-off-by: Laura Flores <lflores@redhat.com>
2021-09-22 18:49:57 +00:00
Radoslaw Zarzynski
9c3f51e99b crimson/os/alienstore: fix nullptr deref in OnCommit::finish().
`seastar::engine()` is available only for Seastar's threads;
it shouldn't be called outside of a reactor thread.
Unfortunately, this assumption is violated in `AlienStore`
where `OnCommit::finish()`, executed from a finisher thread
of `BlueStore`, calls `alien()` on `seastar::engine()`.
The net effect are crashes like the following one:

```
INFO  2021-09-22 14:26:33,214 [shard 0] osd - operator() writing superblock cluster_fsid 1d8f7908-2ebf-4a91-ae70-f445668c126b osd_fsid 4da9fe9a-1da5-4ea9-aa79-a1178165ede5         [381/1839]
Segmentation fault.
Backtrace:
 0# print_backtrace(std::basic_string_view<char, std::char_traits<char> >) at /home/rzarzynski/ceph1/build/../src/crimson/common/fatal_signal.cc:80
 1# FatalSignal::signaled(int, siginfo_t const&) at /opt/rh/gcc-toolset-9/root/usr/include/c++/9/ostream:570
 2# FatalSignal::install_oneshot_signal_handler<11>()::{lambda(int, siginfo_t*, void*)#1}::_FUN(int, siginfo_t*, void*) at /home/rzarzynski/ceph1/build/../src/crimson/common/fatal_signal.cc:
62
 3# 0x00007F16BBA13B30 in /lib64/libpthread.so.0
 4# (anonymous namespace)::OnCommit::finish(int) at /home/rzarzynski/ceph1/build/../src/crimson/os/alienstore/alien_store.cc:53
 5# Context::complete(int) at /home/rzarzynski/ceph1/build/../src/include/Context.h:100
 6# Finisher::finisher_thread_entry() at /home/rzarzynski/ceph1/build/../src/common/Finisher.cc:65
 7# 0x00007F16BBA0915A in /lib64/libpthread.so.0
 8# clone in /lib64/libc.so.6
Dump of siginfo:
  ...
  si_addr: 0x10
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-09-22 17:04:12 +00:00
Sébastien Han
d855dbb4d8
Merge pull request #40728 from guits/doc_fix_pattern_rgw_nfs
doc/rgw-nfs: use same pattern for keyring name
2021-09-22 17:08:31 +02:00
Samuel Just
e89ed326b5
Merge pull request #43254 from cyx1231st/wip-seastore-fix-onode-order
crimson/onode-staged-tree: convert hash to the reversed version

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-09-22 07:05:01 -07:00
Kefu Chai
143fa9b3f6
Merge pull request #43249 from cyx1231st/wip-seastore-fix-omap-hint
crimson/os/seastore: add missing hints in omap tree

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-09-22 21:47:37 +08:00
Daniel Gryniewicz
254bf8e883
Merge pull request #43055 from soumyakoduri/wip-skoduri-lua
rgw/lua: Install the packages only for RadosStore

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Daniel Gryniewicz <dang@redhat.com>
2021-09-22 08:12:23 -04:00
Daniel Gryniewicz
a5ffc44435
Merge pull request #43054 from soumyakoduri/wip-skoduri-dbstore-vstart
rgw: Add option to configure backend store

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-09-22 08:11:30 -04:00
Ernesto Puerta
9ff778cdaa
qa/mgr/dashboard: add extra wait to test
Fixes: https://tracker.ceph.com/issues/49344
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2021-09-22 14:11:23 +02:00
Daniel Gryniewicz
2bdef857fc
Merge pull request #42911 from soumyakoduri/wip-skoduri-dbstore-object
rgw/dbstore object APIs

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-09-22 08:10:52 -04:00
Sebastian Wagner
a2d9839f58
Merge pull request #43241 from sebastian-philipp/suites-orch-labelere
.github: fix path to cephadm suite

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-22 11:34:35 +02:00
Yingxin Cheng
0c1c972866 crimson/onode-staged-tree: consolidate laddr hint calculation
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-09-22 15:55:09 +08:00
Yingxin Cheng
179f826919 crimson/onode-staged-tree: convert hash to the reversed version
Store the reversed version of object hash to make sure that onodes in
the same PG are sorted together.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-09-22 15:55:09 +08:00
Yingxin Cheng
18bf246672 crimson/onode-staged-tree: print cursh-hash in hex mode
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-09-22 15:55:01 +08:00
Yingxin Cheng
30f22ecb02 crimson/os/seastore: add missing hints in omap tree
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-09-22 11:23:34 +08:00
wangyunqing
3ab2cddd77 doc/rbd/rbd-windows.rst: fix typos
Signed-off-by: wangyunqing <wangyunqing@inspur.com>
2021-09-22 11:17:48 +08:00
Samuel Just
86b9f03094
Merge pull request #43247 from rzarzynski/wip-crimson-ertr-safe_then_unpack
crimson/common: add safe_then_unpack() to errorated futures

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2021-09-21 17:12:58 -07:00
Radoslaw Zarzynski
710b928f9d crimson/common: implement singleton_ec.
Unfortunately, GCC explodes when it sees that.

```
[rzarzynski@o06 build]$ ninja crimson-osd vstart
[1/3] Building CXX object src/crimson/os/cyanstore/CMakeFiles/crimson-cyanstore.dir/cyan_store.cc.o
FAILED: src/crimson/os/cyanstore/CMakeFiles/crimson-cyanstore.dir/cyan_store.cc.o
/usr/bin/ccache /opt/rh/gcc-toolset-9/root/usr/bin/c++ -DBOOST_ASIO_DISABLE_THREAD_KEYWORD_EXTENSION -DBOOST_ASIO_USE_TS_EXECUTOR_AS_DEFAULT -DHAVE_CONFIG_H -DSEASTAR_API_LEVEL=6 -DWITH_SEASTAR=1 -D_FILE_OFFSET_BITS=64 -D_FORTIFY_SOURCE=2 -D_GNU_SOURCE -D_REENTRANT -D_THREAD_SAFE -D__CEPH__ -D__STDC_FORMAT_MACROS -D__linux__ -Isrc/include -I../src -I../src/seastar/include -Isrc/seastar/gen/include -isystem boost/include -isystem include -isystem ../src/xxHash -isystem ../src/rapidjson/include -O2 -g -DNDEBUG -fPIC   -U_FORTIFY_SOURCE -Wall -fno-strict-aliasing -fsigned-char -Wtype-limits -Wignored-qualifiers -Wpointer-arith -Werror=format-security -Winit-self -Wno-unknown-pragmas -Wnon-virtual-dtor -Wno-ignored-qualifiers -ftemplate-depth-1024 -Wpessimizing-move -Wredundant-move -Wstrict-null-sentinel -Woverloaded-virtual -fno-new-ttp-matching -fstack-protector-strong -fdiagnostics-color=auto -fno-builtin-malloc -fno-builtin-calloc -fno-builtin-realloc -fno-builtin-free -ftemplate-backtrace-limit=0 -Wno-non-virtual-dtor -std=gnu++17 -U_FORTIFY_SOURCE -Wno-maybe-uninitialized -DSEASTAR_SSTRING -Wno-error=unused-result -std=c++17 -MD -MT src/crimson/os/cyanstore/CMakeFiles/crimson-cyanstore.dir/cyan_store.cc.o -MF src/crimson/os/cyanstore/CMakeFiles/crimson-cyanstore.dir/cyan_store.cc.o.d -o src/crimson/os/cyanstore/CMakeFiles/crimson-cyanstore.dir/cyan_store.cc.o -c ../src/crimson/os/cyanstore/cyan_store.cc
during IPA pass: inline
../src/crimson/os/cyanstore/cyan_store.cc: In member function ‘std::string crimson::os::singleton_ec<MsgV>::this_error_category::message(int) const [with const char* MsgV = (& msg)]’:
../src/crimson/os/cyanstore/cyan_store.cc:97:17: internal compiler error: Segmentation fault
   97 |     std::string message([[maybe_unused]] const int ev) const final {
      |                 ^~~~~~~
Please submit a full bug report,
with preprocessed source if appropriate.
See <http://bugzilla.redhat.com/bugzilla> for instructions.
Preprocessed source stored into /tmp/ccFi4GGw.out file, please attach this to your bugreport.
ninja: build stopped: subcommand failed.
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-09-21 22:59:09 +00:00
Radoslaw Zarzynski
7f99a88ea9 crimson/common: add safe_then_unpack() to errorated futures.
It was a prerequisite for another commit I finally thrown
away. However, this little bit can be still be useful even
for the sake of compliance with the interruptible variant.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-09-21 21:34:00 +00:00
Radoslaw Zarzynski
06e19d817e crimson/common: assert_moveable() doesn't depend on 3rd party's always_false<>.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-09-21 21:28:02 +00:00
Samuel Just
2ec096b19c
Merge pull request #43243 from rzarzynski/wip-crimson-net-dangling-bindvec2
crimson/net: fix dangling addrvec in bind(), the repeat_until_value() part

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-09-21 11:56:12 -07:00
Samuel Just
ed9b233db0
Merge pull request #43209 from rzarzynski/wip-crimson-silent-check-bot
tests/crimson: don't be so verbose when run by the 'make check' bot.

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-09-21 11:55:30 -07:00
Patrick Donnelly
790b49a006 Merge PR #43219 into master
* refs/pull/43219/head:
	doc: clarify MDS failed state

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-09-21 14:03:08 -04:00
Sage Weil
6bf32314f7 Merge PR #43156 into master
* refs/pull/43156/head:
	qa/suites/orch/rook/smoke: add flannel back in

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-09-21 11:37:50 -04:00
Radoslaw Zarzynski
71626b4729 crimson/net: fix dangling addrvec in bind(), the repeat_until_value() part.
This is a follow-up to commit 4802730827.

`seastar::do_with()` doesn't extend the life-time of the callable's

```cpp
auto
do_with_impl(T1&& rv1, T2&& rv2, More&&... more) {
    // ...
    auto&& just_values = cherry_pick_tuple(idx(), std::move(all));
    auto&& just_func = std::move(std::get<nr>(std::move(all)));
    // ...
    auto task = std::apply(
        [](auto&&... x) {
            return std::make_unique<internal::do_with_state<value_tuple, ret_type>>(std::forward<decltype(x)>(x)...);
        },
        std::move(just_values));
    auto fut = std::apply(just_func, task->data());
    // ...
}
```

closure. This means the `addrs` needs to be captured by value also
by the lambda passed to `repeat_until_value()`.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-09-21 13:57:40 +00:00
Ilya Dryomov
be23d3cfbf
Merge pull request #43225 from guits/fix-iscsi-doc
doc/iscsi: fix some typos

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-09-21 14:35:59 +02:00
Sebastian Wagner
91a8b45fc8
.github: fix path to cepham suite
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-09-21 13:35:03 +02:00
Sebastian Wagner
cfae1cc08c
Merge pull request #43237 from javicacheiro/fix_upgrade_now_uses_quay.io
doc:  from v16.2.6 you have to point to the quay.io image

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-09-21 13:29:09 +02:00
Sebastian Wagner
7138738bfd
Merge pull request #43142 from sebastian-philipp/c-v-cephadm-osd-activate
doc/ceph-volume/activate: Users should call cephadm instead

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
2021-09-21 13:12:07 +02:00
Sebastian Wagner
e4eaacbb89
Merge pull request #43162 from sebastian-philipp/cephadm-service-mgmt-reoder
doc/cephadm/service-management: Move "Updating Service Specifications" 

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-09-21 13:03:08 +02:00
Ernesto Puerta
fef5ab7b04
Merge pull request #43210 from rhcs-dashboard/config-e2e-failure
mgr/dashboard: Fix failing config dashboard e2e check

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-09-21 11:53:41 +02:00
Javier Cacheiro
961a4fcffa doc: from v16.2.6 you have to point to the quay.io image if using docker
New images are no longer uploaded to the Docker Hub registry, so Docker users should point the upgrade
command to the quay.io image.

Fixes: https://tracker.ceph.com/issues/52683

Signed-off-by: Javier Cacheiro <javier.cacheiro.lopez@cesga.es>
2021-09-21 11:50:04 +02:00
Brad Hubbard
8de72972d7
Merge pull request #43233 from badone/wip-install-xmlstarlet
Revert "rpm, debian: drop xmlstarlet from build deps"

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-09-21 15:29:28 +10:00
Brad Hubbard
9630b2d8df Revert "rpm, debian: drop xmlstarlet from build deps"
This reverts commit 707edc0b2d.

This commit was somewhat premature in removing the xmlstarlet
dependency.

Fixes: https://tracker.ceph.com/issues/52681

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2021-09-21 13:20:13 +10:00
Patrick Donnelly
541cc173c6 Merge PR #43179 into master
* refs/pull/43179/head:
	qa: lengthen grace for fs map showing dead MDS

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-09-20 20:48:00 -04:00
Patrick Donnelly
de40c30b90 Merge PR #43164 into master
* refs/pull/43164/head:
	test/libcephfs: put inodes after lookup

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-09-20 20:47:19 -04:00
Patrick Donnelly
c8a900c6c6 Merge PR #42763 into master
* refs/pull/42763/head:
	mon/FSCommands: add 'recover' flag in `fs new` command

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-09-20 20:46:25 -04:00
Ilya Dryomov
fdcdeae2a2 rbd-mirror: fix a couple of brainos in log messages
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-09-20 22:52:30 +02:00
Ilya Dryomov
b02d3b0c5a rbd-mirror: unbreak one-way snapshot-based mirroring
Snapshot replayer needs the remote's mirror peer uuid to find its
snapshots in the remote image.  It is obtained by listing remote's
mirror peers but RemotePoolPoller::handle_mirror_peer_list() skips
tx-only (MIRROR_PEER_DIRECTION_TX) peers.  In effect only rx-tx
(MIRROR_PEER_DIRECTION_RX_TX) peers are considered for matching
and snapshot replayer always fails with "failed to retrieve mirror
peer uuid from remote pool" error.

Instead, skip rx-only (MIRROR_PEER_DIRECTION_RX) peers as we are
definitely not interested in anything having to do with mirroring
_to_ the remote cluster.

Fixes: https://tracker.ceph.com/issues/52675
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-09-20 22:52:30 +02:00
Soumya Koduri
be7ab7d24d rgw/dbstore: Update README
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-09-20 22:18:31 +05:30
Kefu Chai
ecd57a59df
Merge pull request #43222 from sebastian-philipp/rook-ceph-client-before-3.8
mgr/rook: update rook-client-python to 2737c7467b7

Reviewed-by: Joseph Sawaya <jsawaya@redhat.com>
2021-09-21 00:16:35 +08:00
Sage Weil
ee74472322 Merge PR #43213 into master
* refs/pull/43213/head:
	mon/OSDMonitor: make weight set create safer

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-09-20 11:00:23 -04:00
Sage Weil
34c483965f Merge PR #43211 into master
* refs/pull/43211/head:
	qa/suites/upgrade/pacific-x: skip c-v install on pacific start
	qa/packages: install ceph-volume

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-09-20 10:59:56 -04:00
Guillaume Abrioux
a715b3f15c doc/iscsi: fix some typos
This fixes some typos in the iscsi documentation.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2021-09-20 16:02:33 +02:00
Soumya Koduri
e05daafdb3 rgw/dbstore: Object APIs
Support for simple Put, Get, Delete, List Ops of Regular Objects on dbstore.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-09-20 18:45:27 +05:30
Soumya Koduri
44b7a56673 rgw/dbstore: Insert testid user on startup
Its temporary change to insert testid user while
starting up rgw server on dbstore.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-09-20 18:44:47 +05:30
Soumya Koduri
ebc9723cf3 rgw: Add option to configure backend store
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-09-20 18:44:47 +05:30
Soumya Koduri
880a5fee9e rgw: Install the lua packages only for RadosStore
Installation, remove and listing of lua packages is supported
only on RadosStore. Verify the same.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-09-20 18:43:54 +05:30
Daniel Gryniewicz
5907703adb
Merge pull request #43193 from dang/wip-dang-zipper-lifecycle
RGW Zipper - clean up and clarify lifecycle of s->object, s->bucket, and friends

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Soumya Koduri <skoduri@redhat.com>
2021-09-20 09:12:52 -04:00
Sage Weil
4e525127fb qa/suites/upgrade/pacific-x: skip c-v install on pacific start
Signed-off-by: Sage Weil <sage@newdream.net>
2021-09-20 08:47:45 -04:00
Kalpesh Pandya
6790c98ba3 src/test: Minor nit from PR #43025
Minor nit left to be chnaged before merging https://github.com/ceph/ceph/pull/43025

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-09-20 17:28:47 +05:30