Commit Graph

129725 Commits

Author SHA1 Message Date
Zac Dover
07a1f7fe04 doc/start: include A. D'Atri's hardware-recs recs
This PR restores material about partition alignment
and material about separating OS and OSD data that
was removed in an earlier rewrite. The restoration
of this information was requested by Anthony D'Atri in
https://github.com/ceph/ceph/pull/45123/

This PR also includes several refinements to the language
that could not be made to this text until now, owing to my
(Zac's) ignorance and illiteracy.

I call upon Mark Nelson (and anyone else with sufficient
command of the current state of storage technology) to advise
me on whether the Ceph Foundation feels comfortable in the year
2022 referring to QLC as an emerging technology.

Signed-off-by: Zac Dover <zac.dover@gmail.com>

(squash) more notes and revisions

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-02-28 19:19:00 +10:00
Samuel Just
38843c630f
Merge pull request #45010 from cyx1231st/wip-seastore-types-cleanup
crimson/os/seastore/seastore_types: cleanups

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-02-23 20:28:24 -08:00
Yuri Weinstein
b0d6bed71a
Merge pull request #44911 from Matan-B/wip-matanb-pool-name
mon/OSDMonitor: Restrict pool names beggining with a dot

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-23 10:22:49 -08:00
Yuri Weinstein
69e3bca571
Merge pull request #44321 from Alexponomarev7/fix-static-librados-build
cmake: add ceph-common DENABLE_SHARED=OFF support

Reviewed-by: Kefu Chai <kchai@redhat.com>
2022-02-23 10:22:17 -08:00
Adam King
774c1a67bb
Merge pull request #45023 from rkachach/fix_issue_54198
mgr/cephadm: Show an error when invalid format

Reviewed-by: Adam King <adking@redhat.com>
2022-02-23 09:05:38 -05:00
Adam King
5e8c4dc186
Merge pull request #44928 from rkachach/fix_issue_54184
mgr/cephadm: validating service_id for MDS

Reviewed-by: Adam King <adking@redhat.com>
2022-02-23 09:02:16 -05:00
Adam King
9b6fe23f69
Merge pull request #44896 from rkachach/fix_issue_53540
mgr/cephadm: Adding AGE field to device ls cmd

Reviewed-by: Adam King <adking@redhat.com>
2022-02-23 08:58:58 -05:00
Ernesto Puerta
02285666d5
Merge pull request #45119 from rhcs-dashboard/fix-dashboard_frontend_vulnerabilities-master
mgr/dashboard: fix front-end vulnerabilities

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-02-23 13:40:24 +01:00
Ilya Dryomov
8488ea525e
Merge pull request #45062 from cbodley/wip-54303
librbd: avoid get_callback_adapter() for tcp_stream::async_connect()

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-23 11:47:20 +01:00
Ilya Dryomov
24b7bdc759
Merge pull request #45031 from cbodley/wip-54279
common: replace BitVector::NoInitAllocator with wrapper struct

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-23 11:45:56 +01:00
Ilya Dryomov
20c96256bb
Merge pull request #45086 from trociny/wip-54258
rbd-mirror: make mirror properly detect pool replayer needs restart

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-23 11:45:02 +01:00
Ilya Dryomov
b09cfa853a
Merge pull request #45106 from idryomov/wip-image-replayer-stop
rbd-mirror: synchronize with in-flight stop in ImageReplayer::stop()

Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-02-23 11:42:59 +01:00
Ernesto Puerta
4fb3ee50b9
mgr/dashboard: fix front-end vulnerabilities
Fixes: https://tracker.ceph.com/issues/54367

Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2022-02-22 20:34:53 +01:00
Ilya Dryomov
76ad859658
Merge pull request #45117 from idryomov/wip-rbd-trash-purge-error-typo
mgr/rbd_support: fix a typo in the error message

Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
2022-02-22 20:10:05 +01:00
Yuri Weinstein
efc4a8fc9b
Merge pull request #45068 from ronen-fr/wip-rf-minimal-digestupd-fix
osd/scrub: stop sending bogus digest-update event messages

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-02-22 07:26:45 -08:00
Ilya Dryomov
5b3798626b mgr/rbd_support: fix a typo in the error message
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-22 13:16:14 +01:00
Redouane Kachach
1c5b3e86f9
mgr/cephadm: Adding AGE field to device ls cmd
Fixes: https://tracker.ceph.com/issues/53540

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-02-21 19:21:06 +01:00
Redouane Kachach
db765bd806
mgr/cephadm: using MDSSPec instead of ServiceSpec
Fixes:  https://tracker.ceph.com/issues/54184

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-02-21 17:23:33 +01:00
Yuri Weinstein
66f198407b
Merge pull request #44985 from rhcs-dashboard/dashboard-turns-telemetry-off
mgr/dashboard: dashboard turns telemetry off when configuring report

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Yaarit Hatuka <yaarit@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-02-21 07:44:51 -08:00
Casey Bodley
9ddf7fa059
Merge pull request #45022 from kalebskeithley/54266
rgw: cmake configure error on fedora-37/rawhide

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Soumya Koduri <skoduri@redhat.com>
2022-02-21 10:41:19 -05:00
Adam King
a3ed8ddb4f
Merge pull request #44905 from mgfritch/cephadm-prom-chown
cephadm: chown the prometheus data dir during redeploy

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
2022-02-21 10:19:40 -05:00
Adam King
62d327cf93
Merge pull request #45054 from rkachach/fix_issue_46655
mgr/cephadm: Delete ceph.target if last cluster

Reviewed-by: Michael Fritch mfritch@suse.com
2022-02-21 10:17:00 -05:00
Ilya Dryomov
8965a0f2a6 rbd-mirror: synchronize with in-flight stop in ImageReplayer::stop()
Complete on_finish right away only if the replayer is stopped (meaning
that it is legible to be restarted immediately, possibly from on_finish
itself).  This is the behaviour pretty much anyone would assume and
also what ImageReplayer::restart() relies on.

Fixes: https://tracker.ceph.com/issues/54344
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-21 14:57:44 +01:00
Ilya Dryomov
4ad31cd058 rbd-mirror: turn m_on_stop_finish into a list of Contexts
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-21 14:57:44 +01:00
Ilya Dryomov
c5b5787349 rbd-mirror: manual stop should take precedence over regular stop
Somewhat similar to commit 0a3794e562 ("rbd-mirror: make stop
properly cancel restart"), make it so that a) if a manual stop is
joined to regular stop, the stop becomes manual and b) if a regular
stop is joined to a manual stop, the stop stays manual.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-21 14:57:44 +01:00
Ilya Dryomov
219c500977 rbd-mirror: straighten ImageReplayer::stop() a bit
- don't default on_finish parameter
- m_restart_requested is set in ImageReplayer::restart() which is the
  only restart=true call site, so setting m_restart_requested here is
  redundant
- is_stopped_() can't be true in is_running_() branch
- on_finish->complete(0) in the end is unreachable

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-21 14:57:44 +01:00
Venky Shankar
fe3d543a0d
Merge pull request #44873 from kotreshhr/clone-inherit-quota-files
mgr/volumes: Inherit file quota attr to clone

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-21 14:37:44 +05:30
Venky Shankar
b8afe74b49
Merge pull request #44854 from kotreshhr/subvolumegroup_ls
mgr/volumes: Fix subvolumegroup ls

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-21 14:37:03 +05:30
Yingxin Cheng
0a51462bef crimson/os/seastore/seastore_types: pretty print fundamental types
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-21 14:55:03 +08:00
Yingxin Cheng
c49bb67e2b crimson/os/seastore/seastore_types: unify NULL/MAX/default values
Mostly for paddr_t and journal_seq_t, and use P_ADDR_NULL and
JOURNAL_SEQ_NULL where possible, with related cleanups.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-21 14:55:03 +08:00
Samuel Just
d98319f8fd
Merge pull request #45089 from athanatos/sjust/wip-seastore-journal-refactor
seastore: seperate Journal interface from SegmentedJournal implementation

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-02-20 22:04:04 -08:00
zdover23
3497a47e36
Merge pull request #45033 from anthonyeleven/anthonyeleven/releases-tweaks
doc/releases: Improve capitalization for Octopus

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-02-21 15:59:52 +10:00
Laura Flores
b62d7129f9
Merge pull request #44994 from ljflores/wip-telemetry-device-assertion-failure
mgr/telemetry: handle empty device report when "send" is triggered
2022-02-20 18:52:47 -06:00
myoungwon oh
13bafdff81 seastore: seperate Journal interface from SegmentedJournal implementation
A subsequent PR will introduce a CircularBoundedJournal implementation
for fast nvme devices.

SegmentCleaner no longer needs a reference to Journal, so dispense with
the set_segment_provider machinery and simply pass it in the
constructor.

Move responsibility for finding the journal segments into the journal
itself.  This does mean that we check the segment headers on the journal
device twice, but that should be a neglible amount of overhead on mount.

SegmentCleaner::init_segments no longer needs to return Journal
segments, so merge with mount().

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Signed-off-by: Samuel Just <sjust@redhat.com>
2022-02-20 23:45:29 +00:00
Sarthak0702
15211a6378 mgr/dashboard: Contact Info should be visible only when Ident channel is checked
Fixes:https://tracker.ceph.com/issues/54133
Signed-off-by: Sarthak0702 <sarthak.0702@gmail.com>
2022-02-21 02:42:47 +05:30
Kefu Chai
83953dfda6
Merge pull request #44936 from javacruft/build-compress-common-dep
cmake: add dependency compress->common

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-02-21 01:02:44 +08:00
James Page
1b3bfcd4fe cmake: add dependency compression->common
The compression code depends on headers generated during the build
of the common code for Ceph.

Ensure that CMake understands this dependency, avoiding a race
between generation of header files in common and compilation of the
compression module.

Signed-off-by: James Page <james.page@ubuntu.com>
2022-02-20 21:39:13 +08:00
Kefu Chai
1e7e098d55
Merge pull request #44608 from liumiaomiaoIntel/qatchange
common: fix compilation and function issues about compressor and crypto to enable latest QAT driver

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-02-20 01:25:44 +08:00
Ilya Dryomov
c82eeadaa1
Merge pull request #44904 from chrisphoffman/wip_rbd_default_map_override
tools/rbd: expand where option rbd_default_map_options can be set

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-19 17:18:42 +01:00
Samuel Just
3fe5bf2632
Merge pull request #45085 from tchaikov/crimson-fmtlib-v8
crimson: fixes for compiling with fmtlib v8

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-02-18 17:38:45 -08:00
Laura Flores
f2b75166a2
Merge pull request #43388 from e337/wip-doc-50499 2022-02-18 18:24:02 -06:00
Mykola Golub
ad4a2990b8 rbd-mirror: make mirror properly detect pool replayer needs restart
When a PoolReplayer detects remote pool metadata change it
sets "stopping" flag expecting the Mirror will restart it.

Although setting "stopping" flag makes the PoolReplayer::run
thread to terminate, the thread's is_started function will still
return true until join is called (and reset the thread id).

This made impossible for the Mirror to detect (by calling
PoolReplayer::is_running) that the PoolReplayer needed restart.

Fixes: https://tracker.ceph.com/issues/54258
Signed-off-by: Mykola Golub <mgolub@suse.com>
2022-02-18 18:33:20 +00:00
Kefu Chai
bb9d099ede crimson: specialize fmt::formatter<>() for crimson types
otherwise we'd have FTBFS like

/usr/include/fmt/core.h:1727:3: error: static_assert failed due to requirement 'formattable' "Cannot format an argument. To make type T formattable provide a formatter<T> specialization: https://fmt.dev/latest/api$
  static_assert(
  ^
/usr/include/fmt/core.h:1853:23: note: in instantiation of function template specialization 'fmt::detail::make_arg<true, fmt::basic_format_context<fmt::appender, char>, fmt::detail::type::custom_type, crimson::os:$
        data_{detail::make_arg<

please note, delta_op_t is lifted out of the templated outer class
to avoid the headache of specialization of template of template in
another namespace.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-02-19 00:22:37 +08:00
Christopher Hoffman
19d46b9181 qa/suites/krbd: add rbd_default_map_options override coverage
Add coverage to test precedence, override, and option merge on rbd map.

Signed-off-by: Christopher Hoffman <choffman@redhat.com>
2022-02-18 17:19:45 +01:00
Ilya Dryomov
7f391c5688 qa/suites/krbd: rename rxbounce subsuite
A new job that doesn't want ms_mode to be set underneath it is about to
be added.  Rename rxbounce to ms_modeless to make this purpose obvious.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-18 17:19:45 +01:00
Christopher Hoffman
9afc971282 rbd: support pool and image level overrides for rbd_default_map_options
Fixes: https://tracker.ceph.com/issues/52850
Signed-off-by: Christopher Hoffman <choffman@redhat.com>
2022-02-18 17:19:45 +01:00
Kefu Chai
3fd91d7e6d crimson/os/seastore: drop compile-time fmt validation
_format() was deprecated in fmtlib v8, see also
https://github.com/fmtlib/fmt/pull/2646

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-02-18 23:31:51 +08:00
Miaomiao Liu
9a9001a08f compressor: fix compilation issues about QATzip
Signed-off-by: Miaomiao Liu <miaomiao.liu@intel.com>
Signed-off-by: Hualong Feng <hualong.feng@intel.com>
2022-02-18 17:45:30 +08:00
Samuel Just
cee3cae9b2
Merge pull request #44933 from liu-chunmei/seastore-support-sparse-read
crimson/seastore: support sparse_read

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-02-17 14:40:27 -08:00
Neha Ojha
e3463e286d
Merge pull request #44955 from aclamk/wip-vselector-check-fix
os/bluestore/bluefs: Fix improper vselector tracking in _flush_special()

Reviewed-by: Igor Fedotov <igor.fedotov@croit.io>
2022-02-17 10:26:10 -08:00