Commit Graph

136623 Commits

Author SHA1 Message Date
Radoslaw Zarzynski
e57d3bb082 crimson/osd: PerShardState::start_operation() doesn't assume Ret is seastar::future<>
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
0a0b5f8ddc crimson/osd: implement SnapMapper::OSDriver for crimson
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
a9b270baa0 crimson/ertr: let ErrVisitorT return plain value if ValueFuncT returns seastar::future
The following corner case was unsupported till now:

```cpp
  return os->omap_get_values(
    ch, hoid, keys
  ).safe_then([] (FuturizedStore::omap_values_t&& vals) {
    return 0;
  }, FuturizedStore::read_errorator::all_same_way([] (auto&) {
    return -1;
  })).get();
```
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
89b322d387 common/ceph_mutex: add green thread-requiring condition variable for crimson
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
8c01fa651e crimson/osd, osd: share SnapMapper with crimson
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
c77fb5f815 osd: drop the scrub_purged_snaps() declaration from SnapMapper
Nowadays this is a dead code; the actual definition is in `OSD`.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
742cb2efb1 crimson/osd: SnapMapper::record_purged_snaps() takes abstratced store and txn
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
3fef67bf36 crimson/osd: convert SnapMapper::record_purged_snaps() to OSTransaction
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
3da8d3f69c crimson/osd: initialize OSDriver in SnapMapper::record_purged_snaps()
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
6f7ed37496 common, osd: switch SnapMapper::_lookup_purged_snap to use OSDriver
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
609dca58dc crimson/osd: fix debug in Orderer::clear_and_cancel()
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
3d48489f4b osd: don't build unnecessary parts of SnapMapper for crimson
This commits skips building two call-sites of `omap_get_iterator()`
of `ObjectStore` which are bypassing the `OSDriver` abstraction
layer.

1. `SnapMapper::convert_legacy()` likely never be needed by
crimson and we can leave it unchanged.

2. `SnapMapper::Subber` isn't needed right now but will be
needed in the future.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radosław Zarzyński
972af821bb crimson/osd: bring SnapTrimObjSubEvent
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radosław Zarzyński
116c04595b crimson/osd: wire SnapTrimEvent with SnapMapper up
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
83043ca789 crimson/osd: bring SubOpBlocker to SnapTrimEvent
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
b224749643 crimson/osd: implement the basics of SnapTrimEvent
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
1650b392cf crimson/osd/osd_operations: flatten indentation of InternalClientRequest
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
d3043ed76c crimson/osd: drop the residue of CompoundPeeringRequest
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
f3cfe84c17 crimson/osd: simplify ShardServices::snap_request_reservation()
`on_preempt` is not used by snap trimming; we can left its default.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
806aa25960 crimson/osd: bring the skeleton of SnapTrimEvent
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
ba60d84e7b crimson/osd: settle snap_reserver within ShardServices
This bit will be used by the upcoming `SnapTrimRequest`.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:22:04 +00:00
Radoslaw Zarzynski
c9bdfdc1a4 crimson/osd: move the SnapTrimmer-related handlers of PeeringState from .h to .cc
This commit is solely about code shuffling.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-02-28 16:21:56 +00:00
Adam King
33284b3be8
Merge pull request #49836 from rkachach/fix_issue_58548
cephadm: using ip instead of short hostname for prometheus urls

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2023-02-28 09:31:21 -05:00
Adam King
ba1277c371
Merge pull request #50083 from adk3798/pids-limit
cephadm: set pids-limit unlimited for all ceph daemons

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Vikhyat Umrao <vikhyat@redhat.com>
2023-02-28 09:28:34 -05:00
Venky Shankar
222c3e0269 Merge PR #50268 into main
* refs/pull/50268/head:
	mds: memset the head by default to fix the readable.sh test failure

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-02-28 19:15:32 +05:30
Adam King
4040af32b7
Merge pull request #46601 from rkachach/fix_issue_55814
mgr/cephadm: adding support for a secure ceph monitoring stack

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com> 
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-02-28 08:41:50 -05:00
Ilya Dryomov
188d7e7ab9
Merge pull request #50006 from idryomov/wip-58647
mon/MgrMap: dump last_failure_osd_epoch and active_clients at top level

Reviewed-by: Ramana Raja <rraja@redhat.com>
2023-02-28 13:31:02 +01:00
Ernesto Puerta
1223e590e0
Merge pull request #50285 from ceph/epuertat-patch-1
.github: update add-to-project action

Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-02-28 12:41:56 +01:00
Nizamudeen A
ed0e876373
Merge pull request #50299 from rhcs-dashboard/fix-broken-styles-crud
mgr/dashboard: minor fixes to crud form UI

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-02-28 16:27:32 +05:30
Yingxin
a36ad053ca
Merge pull request #50085 from myoungwon/wip-fix-initialization-vstart-rbm
crimson/os/seastore: RBM fixes during vstart startup time 

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-02-28 16:33:32 +08:00
Venky Shankar
dec35de185 Merge PR #50197 into main
* refs/pull/50197/head:
	cephfs-top: navigate to home screen while selecting sort field, if no filesystems.
	cephfs-top: display_menu() isn't triggered when all fs' are removed

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-02-28 12:31:59 +05:30
Nizamudeen A
930abb78f2 mgr/dashboard: minor fixes to crud form UI
Fixes: https://tracker.ceph.com/issues/58864
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-02-28 11:48:16 +05:30
Anthony D'Atri
6e1117b2b7
Merge pull request #50295 from zdover23/wip-doc-2023-02-28-radosgw-multisite-zonegroup-correction-and-formatting
doc/radosgw: s/zone group/zonegroup/g et alia
2023-02-28 01:02:03 -05:00
Yingxin
8df7ad7234
Merge pull request #50273 from cyx1231st/wip-seastore-fix-submitter-roll-segment
crimson/os/seastore/journal: allow pending i/o in a full record_submitter when rolling the segment 2

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2023-02-28 13:29:36 +08:00
Zac Dover
d1f2e9f3a6 doc/radosgw: s/zone group/zonegroup/g et alia
s/zone group/zonegroup/ where simple greps failed to find instances of
"zone group" that were spread across two lines; break a paragraph into
two paragraphs so that each paragraph has a thematic idea of its own.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-02-28 12:55:08 +10:00
zdover23
facacdff0f
Merge pull request #50276 from zdover23/wip-doc-2023-02-27-radosgw-multisite-caption-zone-data-replication
doc/rgw: caption a diagram

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-02-28 12:10:02 +10:00
Laura Flores
fdc1a21c7c
Merge pull request #48010 from ljflores/wip-lflores-primary-balancer
osd, tools, test/osd: implement read balancer
2023-02-27 17:55:52 -06:00
Laura Flores
fac345d9fe
Merge pull request #49482 from amathuria/wip-amathuria-mclock-high-prio-queue
mClock: Add ability to handle high priority operations
2023-02-27 17:55:43 -06:00
Ilya Dryomov
7b5e16130a mon/MgrMap: dump last_failure_osd_epoch and active_clients at top level
Currently last_failure_osd_epoch and active_clients are dumped in the
always_on_modules dictionary in "ceph mgr dump" output.  This goes back
to when these fields were added in commits f2986a4400 ("mon/MgrMonitor:
blacklist previous instance") and df507cde8d ("mgr: forward RADOS
client instances for potential blacklist") but is wrong as these fields
have nothing to do with always-on modules.

Fixes: https://tracker.ceph.com/issues/58647
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-02-27 21:17:04 +01:00
Yuri Weinstein
d56c21fe4a
Merge pull request #48706 from Matan-B/wip-matanb-max-oldest-map
OSD: Fix check_past_interval_bounds()

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-02-27 12:12:59 -08:00
Laura Flores
45aeba5773
Merge pull request #49990 from rzarzynski/wip-osd-mon-public_bind_in_bindv
mon, osd: rework the public_bind_addr support. Bring it to OSD
2023-02-27 14:10:49 -06:00
Yuri Weinstein
d11d8c27a6
Merge pull request #50047 from rhcs-dashboard/post-css-error-teuth
mgr/dashboard: fix conflicting peer dependency: postcss@8.4.21 

Reviewed-by: Laura Flores <lflores@redhat.com>
2023-02-27 11:56:27 -08:00
Yuri Weinstein
6c9011017b
Merge pull request #49507 from Matan-B/wip-matanb-check_pg_num-edit
mon/OSDMontior: Simplify check_pg_num()

Reviewed-by: Nitzan Mordechai <nmordech@redhat.com>
2023-02-27 11:56:00 -08:00
Yuri Weinstein
9f40fccd78
Merge pull request #48192 from amathuria/amathuria-edit-pg-deletion-cost
osd: Change default value of osd_pg_delete_cost

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
2023-02-27 11:54:33 -08:00
Ilya Dryomov
b487144ae5
Merge pull request #48657 from alimaredia/wip-rgw-labeled-perf-counters-cache
Labeled Perf Counters

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-02-27 20:05:54 +01:00
Zac Dover
ce2bd7cb26 doc/rgw: caption a diagram
Add an explanation of a diagram that shows how object data is replicated
between zones within a zonegroup.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-02-28 04:36:08 +10:00
Ernesto Puerta
c9a7e7158e
.github: update add-to-project action
Signed-off-by: Ernesto Puerta <37327689+epuertat@users.noreply.github.com>
2023-02-27 16:01:33 +01:00
Anthony D'Atri
7a29b2dd74
Merge pull request #50274 from zdover23/wip-doc-2023-02-27-radosgw-multisite-remove-tertiary
doc/rgw: remove "tertiary", link to procedure
2023-02-27 08:43:58 -05:00
Ilya Dryomov
8d57d55738
Merge pull request #50230 from idryomov/wip-58833
librbd: call apply_changes() after setting librados_thread_count

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Christopher Hoffman <choffman@redhat.com>
2023-02-27 14:15:31 +01:00
Ilya Dryomov
e037aac2bc
Merge pull request #50232 from idryomov/wip-qa-workunits-windows-ownership
CODEOWNERS: assign qa/workunits/windows to RBD

Reviewed-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2023-02-27 11:24:40 +01:00