Commit Graph

129731 Commits

Author SHA1 Message Date
Yingxin Cheng
d2e3bb6f7a crimson/os/seastore/epm: replace condition_variable by a shared_promise
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-24 20:39:39 +08:00
Yingxin Cheng
7ebf3590de crimson/os/seastore/epm: simplify gating writes for Writer
Dropped open_segment_wrapper_t.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-24 20:24:26 +08:00
Yingxin Cheng
65a294058f crimson/os/seastore/segment_cleaner: drop unnecessary future from get_segment()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-24 20:24:26 +08:00
Sridhar Seshasayee
0853e6b2c9
Merge pull request #45121 from yaarith/fix-wear-level-empty-page
mgr/devicehealth: skip null pages when extracting wear level

Reviewed-by: Laura  Flores <lflores@redhat.com>
2022-02-24 13:24:08 +05:30
Sridhar Seshasayee
db045e005f
Merge pull request #45118 from sseshasa/wip-fix-osd-bench-fill-non-zeros
osd: Write non-zero data as part of osd benchmark test.

Reviewed-by: Laura  Flores <lflores@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-02-24 13:23:40 +05:30
Samuel Just
38843c630f
Merge pull request #45010 from cyx1231st/wip-seastore-types-cleanup
crimson/os/seastore/seastore_types: cleanups

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-02-23 20:28:24 -08:00
Yuri Weinstein
b0d6bed71a
Merge pull request #44911 from Matan-B/wip-matanb-pool-name
mon/OSDMonitor: Restrict pool names beggining with a dot

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-02-23 10:22:49 -08:00
Yuri Weinstein
69e3bca571
Merge pull request #44321 from Alexponomarev7/fix-static-librados-build
cmake: add ceph-common DENABLE_SHARED=OFF support

Reviewed-by: Kefu Chai <kchai@redhat.com>
2022-02-23 10:22:17 -08:00
Adam King
774c1a67bb
Merge pull request #45023 from rkachach/fix_issue_54198
mgr/cephadm: Show an error when invalid format

Reviewed-by: Adam King <adking@redhat.com>
2022-02-23 09:05:38 -05:00
Adam King
5e8c4dc186
Merge pull request #44928 from rkachach/fix_issue_54184
mgr/cephadm: validating service_id for MDS

Reviewed-by: Adam King <adking@redhat.com>
2022-02-23 09:02:16 -05:00
Adam King
9b6fe23f69
Merge pull request #44896 from rkachach/fix_issue_53540
mgr/cephadm: Adding AGE field to device ls cmd

Reviewed-by: Adam King <adking@redhat.com>
2022-02-23 08:58:58 -05:00
Ernesto Puerta
02285666d5
Merge pull request #45119 from rhcs-dashboard/fix-dashboard_frontend_vulnerabilities-master
mgr/dashboard: fix front-end vulnerabilities

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-02-23 13:40:24 +01:00
Ilya Dryomov
8488ea525e
Merge pull request #45062 from cbodley/wip-54303
librbd: avoid get_callback_adapter() for tcp_stream::async_connect()

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-23 11:47:20 +01:00
Ilya Dryomov
24b7bdc759
Merge pull request #45031 from cbodley/wip-54279
common: replace BitVector::NoInitAllocator with wrapper struct

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-23 11:45:56 +01:00
Ilya Dryomov
20c96256bb
Merge pull request #45086 from trociny/wip-54258
rbd-mirror: make mirror properly detect pool replayer needs restart

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-23 11:45:02 +01:00
Ilya Dryomov
b09cfa853a
Merge pull request #45106 from idryomov/wip-image-replayer-stop
rbd-mirror: synchronize with in-flight stop in ImageReplayer::stop()

Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-02-23 11:42:59 +01:00
Ernesto Puerta
4fb3ee50b9
mgr/dashboard: fix front-end vulnerabilities
Fixes: https://tracker.ceph.com/issues/54367

Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2022-02-22 20:34:53 +01:00
Yaarit Hatuka
2864ac30d4 mgr/devicehealth: skip null pages when extracting wear level
Some devices have null pages in their ata_device_statistics struct; skip
those pages in order to avoid an AttributeError when extracting device's
wear level.

Fixes: https://tracker.ceph.com/issues/51554
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-02-22 19:22:09 +00:00
Ilya Dryomov
76ad859658
Merge pull request #45117 from idryomov/wip-rbd-trash-purge-error-typo
mgr/rbd_support: fix a typo in the error message

Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
2022-02-22 20:10:05 +01:00
Yuri Weinstein
efc4a8fc9b
Merge pull request #45068 from ronen-fr/wip-rf-minimal-digestupd-fix
osd/scrub: stop sending bogus digest-update event messages

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-02-22 07:26:45 -08:00
Sridhar Seshasayee
09f94ace86 osd: Write non-zero data as part of osd benchmark test.
An optimization (see PR: https://github.com/ceph/ceph/pull/43337) was made
in BlueStore to avoid writing bufferlists made up of zeros. The osd
benchmark used zero filled bufferlists and this resulted in inflated osd
benchmark results.

This issue is fixed by using bufferlists filled with non-zero values.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
Fixes: https://tracker.ceph.com/issues/54364
2022-02-22 18:38:24 +05:30
Ilya Dryomov
5b3798626b mgr/rbd_support: fix a typo in the error message
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-22 13:16:14 +01:00
Redouane Kachach
1c5b3e86f9
mgr/cephadm: Adding AGE field to device ls cmd
Fixes: https://tracker.ceph.com/issues/53540

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-02-21 19:21:06 +01:00
Redouane Kachach
db765bd806
mgr/cephadm: using MDSSPec instead of ServiceSpec
Fixes:  https://tracker.ceph.com/issues/54184

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-02-21 17:23:33 +01:00
Yuri Weinstein
66f198407b
Merge pull request #44985 from rhcs-dashboard/dashboard-turns-telemetry-off
mgr/dashboard: dashboard turns telemetry off when configuring report

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Yaarit Hatuka <yaarit@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-02-21 07:44:51 -08:00
Casey Bodley
9ddf7fa059
Merge pull request #45022 from kalebskeithley/54266
rgw: cmake configure error on fedora-37/rawhide

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Soumya Koduri <skoduri@redhat.com>
2022-02-21 10:41:19 -05:00
Adam King
a3ed8ddb4f
Merge pull request #44905 from mgfritch/cephadm-prom-chown
cephadm: chown the prometheus data dir during redeploy

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
2022-02-21 10:19:40 -05:00
Adam King
62d327cf93
Merge pull request #45054 from rkachach/fix_issue_46655
mgr/cephadm: Delete ceph.target if last cluster

Reviewed-by: Michael Fritch mfritch@suse.com
2022-02-21 10:17:00 -05:00
Ilya Dryomov
8965a0f2a6 rbd-mirror: synchronize with in-flight stop in ImageReplayer::stop()
Complete on_finish right away only if the replayer is stopped (meaning
that it is legible to be restarted immediately, possibly from on_finish
itself).  This is the behaviour pretty much anyone would assume and
also what ImageReplayer::restart() relies on.

Fixes: https://tracker.ceph.com/issues/54344
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-21 14:57:44 +01:00
Ilya Dryomov
4ad31cd058 rbd-mirror: turn m_on_stop_finish into a list of Contexts
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-21 14:57:44 +01:00
Ilya Dryomov
c5b5787349 rbd-mirror: manual stop should take precedence over regular stop
Somewhat similar to commit 0a3794e562 ("rbd-mirror: make stop
properly cancel restart"), make it so that a) if a manual stop is
joined to regular stop, the stop becomes manual and b) if a regular
stop is joined to a manual stop, the stop stays manual.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-21 14:57:44 +01:00
Ilya Dryomov
219c500977 rbd-mirror: straighten ImageReplayer::stop() a bit
- don't default on_finish parameter
- m_restart_requested is set in ImageReplayer::restart() which is the
  only restart=true call site, so setting m_restart_requested here is
  redundant
- is_stopped_() can't be true in is_running_() branch
- on_finish->complete(0) in the end is unreachable

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-21 14:57:44 +01:00
Venky Shankar
fe3d543a0d
Merge pull request #44873 from kotreshhr/clone-inherit-quota-files
mgr/volumes: Inherit file quota attr to clone

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-21 14:37:44 +05:30
Venky Shankar
b8afe74b49
Merge pull request #44854 from kotreshhr/subvolumegroup_ls
mgr/volumes: Fix subvolumegroup ls

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-21 14:37:03 +05:30
Yingxin Cheng
0a51462bef crimson/os/seastore/seastore_types: pretty print fundamental types
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-21 14:55:03 +08:00
Yingxin Cheng
c49bb67e2b crimson/os/seastore/seastore_types: unify NULL/MAX/default values
Mostly for paddr_t and journal_seq_t, and use P_ADDR_NULL and
JOURNAL_SEQ_NULL where possible, with related cleanups.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-21 14:55:03 +08:00
Samuel Just
d98319f8fd
Merge pull request #45089 from athanatos/sjust/wip-seastore-journal-refactor
seastore: seperate Journal interface from SegmentedJournal implementation

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-02-20 22:04:04 -08:00
zdover23
3497a47e36
Merge pull request #45033 from anthonyeleven/anthonyeleven/releases-tweaks
doc/releases: Improve capitalization for Octopus

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-02-21 15:59:52 +10:00
Laura Flores
b62d7129f9
Merge pull request #44994 from ljflores/wip-telemetry-device-assertion-failure
mgr/telemetry: handle empty device report when "send" is triggered
2022-02-20 18:52:47 -06:00
myoungwon oh
13bafdff81 seastore: seperate Journal interface from SegmentedJournal implementation
A subsequent PR will introduce a CircularBoundedJournal implementation
for fast nvme devices.

SegmentCleaner no longer needs a reference to Journal, so dispense with
the set_segment_provider machinery and simply pass it in the
constructor.

Move responsibility for finding the journal segments into the journal
itself.  This does mean that we check the segment headers on the journal
device twice, but that should be a neglible amount of overhead on mount.

SegmentCleaner::init_segments no longer needs to return Journal
segments, so merge with mount().

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Signed-off-by: Samuel Just <sjust@redhat.com>
2022-02-20 23:45:29 +00:00
Sarthak0702
15211a6378 mgr/dashboard: Contact Info should be visible only when Ident channel is checked
Fixes:https://tracker.ceph.com/issues/54133
Signed-off-by: Sarthak0702 <sarthak.0702@gmail.com>
2022-02-21 02:42:47 +05:30
Kefu Chai
83953dfda6
Merge pull request #44936 from javacruft/build-compress-common-dep
cmake: add dependency compress->common

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-02-21 01:02:44 +08:00
James Page
1b3bfcd4fe cmake: add dependency compression->common
The compression code depends on headers generated during the build
of the common code for Ceph.

Ensure that CMake understands this dependency, avoiding a race
between generation of header files in common and compilation of the
compression module.

Signed-off-by: James Page <james.page@ubuntu.com>
2022-02-20 21:39:13 +08:00
Kefu Chai
1e7e098d55
Merge pull request #44608 from liumiaomiaoIntel/qatchange
common: fix compilation and function issues about compressor and crypto to enable latest QAT driver

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-02-20 01:25:44 +08:00
Ilya Dryomov
c82eeadaa1
Merge pull request #44904 from chrisphoffman/wip_rbd_default_map_override
tools/rbd: expand where option rbd_default_map_options can be set

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-19 17:18:42 +01:00
Samuel Just
3fe5bf2632
Merge pull request #45085 from tchaikov/crimson-fmtlib-v8
crimson: fixes for compiling with fmtlib v8

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-02-18 17:38:45 -08:00
Laura Flores
f2b75166a2
Merge pull request #43388 from e337/wip-doc-50499 2022-02-18 18:24:02 -06:00
Mykola Golub
ad4a2990b8 rbd-mirror: make mirror properly detect pool replayer needs restart
When a PoolReplayer detects remote pool metadata change it
sets "stopping" flag expecting the Mirror will restart it.

Although setting "stopping" flag makes the PoolReplayer::run
thread to terminate, the thread's is_started function will still
return true until join is called (and reset the thread id).

This made impossible for the Mirror to detect (by calling
PoolReplayer::is_running) that the PoolReplayer needed restart.

Fixes: https://tracker.ceph.com/issues/54258
Signed-off-by: Mykola Golub <mgolub@suse.com>
2022-02-18 18:33:20 +00:00
Kefu Chai
bb9d099ede crimson: specialize fmt::formatter<>() for crimson types
otherwise we'd have FTBFS like

/usr/include/fmt/core.h:1727:3: error: static_assert failed due to requirement 'formattable' "Cannot format an argument. To make type T formattable provide a formatter<T> specialization: https://fmt.dev/latest/api$
  static_assert(
  ^
/usr/include/fmt/core.h:1853:23: note: in instantiation of function template specialization 'fmt::detail::make_arg<true, fmt::basic_format_context<fmt::appender, char>, fmt::detail::type::custom_type, crimson::os:$
        data_{detail::make_arg<

please note, delta_op_t is lifted out of the templated outer class
to avoid the headache of specialization of template of template in
another namespace.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-02-19 00:22:37 +08:00
Christopher Hoffman
19d46b9181 qa/suites/krbd: add rbd_default_map_options override coverage
Add coverage to test precedence, override, and option merge on rbd map.

Signed-off-by: Christopher Hoffman <choffman@redhat.com>
2022-02-18 17:19:45 +01:00