Commit Graph

129899 Commits

Author SHA1 Message Date
Ilya Dryomov
5b3798626b mgr/rbd_support: fix a typo in the error message
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-22 13:16:14 +01:00
Redouane Kachach
1c5b3e86f9
mgr/cephadm: Adding AGE field to device ls cmd
Fixes: https://tracker.ceph.com/issues/53540

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-02-21 19:21:06 +01:00
Casey Bodley
146a92612b rgw/dbstore: DBOpPrepareInfo::query_str is a view
in `SQLiteDB::InitPrepareParams()`, `DBOpInfo::query_str` is assigned to
`DBOpPrepareInfo::query_str`:

  p_params.op.query_str = params->op.query_str;

by making `DBOpPrepareInfo::query_str` a view, we avoid allocating a
copy of the `std::string`

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-02-21 13:18:25 -05:00
Casey Bodley
673516826d rgw/dbstore: use const char* for sqlite3_bind_parameter_index()
all string constants passed to sqlite3_bind_parameter_index() are now
`static constexpr const char*` instead of `std::string`

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-02-21 13:18:25 -05:00
Casey Bodley
9730342d9e rgw/dbstore: Schema() functions are static
these functions only refer to static member variables, so can be static
themselves

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-02-21 13:18:24 -05:00
Casey Bodley
385860471c rgw/dbstore: remove unused 'string Op' argument to InitializeParams()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-02-21 13:18:24 -05:00
Redouane Kachach
db765bd806
mgr/cephadm: using MDSSPec instead of ServiceSpec
Fixes:  https://tracker.ceph.com/issues/54184

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-02-21 17:23:33 +01:00
Yuri Weinstein
66f198407b
Merge pull request #44985 from rhcs-dashboard/dashboard-turns-telemetry-off
mgr/dashboard: dashboard turns telemetry off when configuring report

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Yaarit Hatuka <yaarit@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-02-21 07:44:51 -08:00
Casey Bodley
9ddf7fa059
Merge pull request #45022 from kalebskeithley/54266
rgw: cmake configure error on fedora-37/rawhide

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Soumya Koduri <skoduri@redhat.com>
2022-02-21 10:41:19 -05:00
Adam King
a3ed8ddb4f
Merge pull request #44905 from mgfritch/cephadm-prom-chown
cephadm: chown the prometheus data dir during redeploy

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
2022-02-21 10:19:40 -05:00
Adam King
62d327cf93
Merge pull request #45054 from rkachach/fix_issue_46655
mgr/cephadm: Delete ceph.target if last cluster

Reviewed-by: Michael Fritch mfritch@suse.com
2022-02-21 10:17:00 -05:00
Ilya Dryomov
8965a0f2a6 rbd-mirror: synchronize with in-flight stop in ImageReplayer::stop()
Complete on_finish right away only if the replayer is stopped (meaning
that it is legible to be restarted immediately, possibly from on_finish
itself).  This is the behaviour pretty much anyone would assume and
also what ImageReplayer::restart() relies on.

Fixes: https://tracker.ceph.com/issues/54344
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-21 14:57:44 +01:00
Ilya Dryomov
4ad31cd058 rbd-mirror: turn m_on_stop_finish into a list of Contexts
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-21 14:57:44 +01:00
Ilya Dryomov
c5b5787349 rbd-mirror: manual stop should take precedence over regular stop
Somewhat similar to commit 0a3794e562 ("rbd-mirror: make stop
properly cancel restart"), make it so that a) if a manual stop is
joined to regular stop, the stop becomes manual and b) if a regular
stop is joined to a manual stop, the stop stays manual.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-21 14:57:44 +01:00
Ilya Dryomov
219c500977 rbd-mirror: straighten ImageReplayer::stop() a bit
- don't default on_finish parameter
- m_restart_requested is set in ImageReplayer::restart() which is the
  only restart=true call site, so setting m_restart_requested here is
  redundant
- is_stopped_() can't be true in is_running_() branch
- on_finish->complete(0) in the end is unreachable

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-21 14:57:44 +01:00
Venky Shankar
fe3d543a0d
Merge pull request #44873 from kotreshhr/clone-inherit-quota-files
mgr/volumes: Inherit file quota attr to clone

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-21 14:37:44 +05:30
Venky Shankar
b8afe74b49
Merge pull request #44854 from kotreshhr/subvolumegroup_ls
mgr/volumes: Fix subvolumegroup ls

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-21 14:37:03 +05:30
Yingxin Cheng
0a51462bef crimson/os/seastore/seastore_types: pretty print fundamental types
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-21 14:55:03 +08:00
Yingxin Cheng
c49bb67e2b crimson/os/seastore/seastore_types: unify NULL/MAX/default values
Mostly for paddr_t and journal_seq_t, and use P_ADDR_NULL and
JOURNAL_SEQ_NULL where possible, with related cleanups.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-21 14:55:03 +08:00
Samuel Just
d98319f8fd
Merge pull request #45089 from athanatos/sjust/wip-seastore-journal-refactor
seastore: seperate Journal interface from SegmentedJournal implementation

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-02-20 22:04:04 -08:00
zdover23
3497a47e36
Merge pull request #45033 from anthonyeleven/anthonyeleven/releases-tweaks
doc/releases: Improve capitalization for Octopus

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-02-21 15:59:52 +10:00
myoungwon oh
4fd423ff04 osd: fix ObjectContextRef reference leak
After start_dedup() is called on the object,
several CREATE_OR_GET_REFs are sent.
In the meantime, the ObjectContextRef can be evicted
from the cache while the deduplication is in progress.

To avoid this situation, this commit adds ObjectContextRef
to ManifestOp as FlushOp works.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-02-21 10:03:43 +09:00
Laura Flores
b62d7129f9
Merge pull request #44994 from ljflores/wip-telemetry-device-assertion-failure
mgr/telemetry: handle empty device report when "send" is triggered
2022-02-20 18:52:47 -06:00
myoungwon oh
13bafdff81 seastore: seperate Journal interface from SegmentedJournal implementation
A subsequent PR will introduce a CircularBoundedJournal implementation
for fast nvme devices.

SegmentCleaner no longer needs a reference to Journal, so dispense with
the set_segment_provider machinery and simply pass it in the
constructor.

Move responsibility for finding the journal segments into the journal
itself.  This does mean that we check the segment headers on the journal
device twice, but that should be a neglible amount of overhead on mount.

SegmentCleaner::init_segments no longer needs to return Journal
segments, so merge with mount().

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Signed-off-by: Samuel Just <sjust@redhat.com>
2022-02-20 23:45:29 +00:00
Sarthak0702
15211a6378 mgr/dashboard: Contact Info should be visible only when Ident channel is checked
Fixes:https://tracker.ceph.com/issues/54133
Signed-off-by: Sarthak0702 <sarthak.0702@gmail.com>
2022-02-21 02:42:47 +05:30
Kefu Chai
83953dfda6
Merge pull request #44936 from javacruft/build-compress-common-dep
cmake: add dependency compress->common

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-02-21 01:02:44 +08:00
James Page
1b3bfcd4fe cmake: add dependency compression->common
The compression code depends on headers generated during the build
of the common code for Ceph.

Ensure that CMake understands this dependency, avoiding a race
between generation of header files in common and compilation of the
compression module.

Signed-off-by: James Page <james.page@ubuntu.com>
2022-02-20 21:39:13 +08:00
Casey Bodley
8fdd4c0be0 rgw/dbstore: use string_view for string constants
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-02-19 12:33:53 -05:00
Kefu Chai
1e7e098d55
Merge pull request #44608 from liumiaomiaoIntel/qatchange
common: fix compilation and function issues about compressor and crypto to enable latest QAT driver

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-02-20 01:25:44 +08:00
Ilya Dryomov
c82eeadaa1
Merge pull request #44904 from chrisphoffman/wip_rbd_default_map_override
tools/rbd: expand where option rbd_default_map_options can be set

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-19 17:18:42 +01:00
Samuel Just
3fe5bf2632
Merge pull request #45085 from tchaikov/crimson-fmtlib-v8
crimson: fixes for compiling with fmtlib v8

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-02-18 17:38:45 -08:00
Laura Flores
f2b75166a2
Merge pull request #43388 from e337/wip-doc-50499 2022-02-18 18:24:02 -06:00
Mykola Golub
ad4a2990b8 rbd-mirror: make mirror properly detect pool replayer needs restart
When a PoolReplayer detects remote pool metadata change it
sets "stopping" flag expecting the Mirror will restart it.

Although setting "stopping" flag makes the PoolReplayer::run
thread to terminate, the thread's is_started function will still
return true until join is called (and reset the thread id).

This made impossible for the Mirror to detect (by calling
PoolReplayer::is_running) that the PoolReplayer needed restart.

Fixes: https://tracker.ceph.com/issues/54258
Signed-off-by: Mykola Golub <mgolub@suse.com>
2022-02-18 18:33:20 +00:00
Kefu Chai
bb9d099ede crimson: specialize fmt::formatter<>() for crimson types
otherwise we'd have FTBFS like

/usr/include/fmt/core.h:1727:3: error: static_assert failed due to requirement 'formattable' "Cannot format an argument. To make type T formattable provide a formatter<T> specialization: https://fmt.dev/latest/api$
  static_assert(
  ^
/usr/include/fmt/core.h:1853:23: note: in instantiation of function template specialization 'fmt::detail::make_arg<true, fmt::basic_format_context<fmt::appender, char>, fmt::detail::type::custom_type, crimson::os:$
        data_{detail::make_arg<

please note, delta_op_t is lifted out of the templated outer class
to avoid the headache of specialization of template of template in
another namespace.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-02-19 00:22:37 +08:00
Christopher Hoffman
19d46b9181 qa/suites/krbd: add rbd_default_map_options override coverage
Add coverage to test precedence, override, and option merge on rbd map.

Signed-off-by: Christopher Hoffman <choffman@redhat.com>
2022-02-18 17:19:45 +01:00
Ilya Dryomov
7f391c5688 qa/suites/krbd: rename rxbounce subsuite
A new job that doesn't want ms_mode to be set underneath it is about to
be added.  Rename rxbounce to ms_modeless to make this purpose obvious.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-18 17:19:45 +01:00
Christopher Hoffman
9afc971282 rbd: support pool and image level overrides for rbd_default_map_options
Fixes: https://tracker.ceph.com/issues/52850
Signed-off-by: Christopher Hoffman <choffman@redhat.com>
2022-02-18 17:19:45 +01:00
Kefu Chai
3fd91d7e6d crimson/os/seastore: drop compile-time fmt validation
_format() was deprecated in fmtlib v8, see also
https://github.com/fmtlib/fmt/pull/2646

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-02-18 23:31:51 +08:00
Miaomiao Liu
9a9001a08f compressor: fix compilation issues about QATzip
Signed-off-by: Miaomiao Liu <miaomiao.liu@intel.com>
Signed-off-by: Hualong Feng <hualong.feng@intel.com>
2022-02-18 17:45:30 +08:00
Samuel Just
cee3cae9b2
Merge pull request #44933 from liu-chunmei/seastore-support-sparse-read
crimson/seastore: support sparse_read

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-02-17 14:40:27 -08:00
Ernesto Puerta
28a5465fde
doc: fix titles 2022-02-17 20:24:43 +01:00
Ernesto Puerta
28437f9426
doc: fix ceph-volume ref 2022-02-17 19:57:52 +01:00
Neha Ojha
e3463e286d
Merge pull request #44955 from aclamk/wip-vselector-check-fix
os/bluestore/bluefs: Fix improper vselector tracking in _flush_special()

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2022-02-17 10:26:10 -08:00
chunmei-liu
bc1e1116f5 crimson/seastore: put ObjectDataHandler instance into do_with
make ObjectDataHandler instance alive before sub functions are resolved.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-02-17 09:18:55 -08:00
chunmei-liu
f4e20eec8e crimson/seastore:: add fiemap and sparse read unit test
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-02-17 09:18:49 -08:00
chunmei-liu
2baabdaf12 crimson/seastore: support sparse_read
add fiemap and readv functions.

Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-02-17 07:57:57 -08:00
zdover23
d11d2e72da
Merge pull request #45057 from zdover23/wip-doc-2022-02-17-os-recs-nautilus-and-luminous-table-removal
doc/start: remove L and N release-related tables

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-02-17 20:19:35 +10:00
Ronen Friedman
e1b5347b81 osd/scrub: stop sending bogus digest-update event messages
A minimal change extracted from PR#44050, to facilitate
backporting.

The multitudes of bogus events generated fill up the logs.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-02-17 09:38:40 +00:00
Samuel Just
74b7fe8264
Merge pull request #45049 from liu-chunmei/crimson-clang-warning-cleanup
crimson: eliminate clang build warning in crimson

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-02-16 12:07:56 -08:00
Casey Bodley
c2e34c7513 rbd: avoid get_callback_adapter() for tcp_stream::async_connect()
works around a compilation failure in c++20 (with gcc 11.2 and boost
1.76) when choosing between two overloads of
`boost::beast::tcp_stream::async_connect()`

`get_callback_adapter()` returns a variadic lambda that matches the
concept for both overloads (`completion_token_for<ConnectHandler>`
and `completion_token_for<RangeConnectHandler>`), but compilation of
the wrapped lambda fails for the `ConnectHandler` overload because it
expects two arguments instead of one

instead of using `get_callback_adapter()` to convert the first argument
from `boost::system::error_code` to `int` for the wrapped lambda, do
this in the lambda itself

Fixes: https://tracker.ceph.com/issues/54303

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2022-02-16 14:53:46 -05:00