Commit Graph

142999 Commits

Author SHA1 Message Date
Casey Bodley
85562f9fce crypto/qat: qualify spawn::yield_context
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-07 10:37:47 -05:00
zdover23
b5ca96c21d
Merge pull request #55476 from zdover23/wip-doc-2024-02-07-cephadm-tshooting
doc/cephadm - edit t11ing.

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-02-08 01:11:35 +10:00
Casey Bodley
72b962bf57
Merge pull request #54596 from cbodley/wip-cmake-dencoder-modules
cmake: ceph-dencoder depends on ceph-dencoder-modules

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2024-02-07 14:50:58 +00:00
Guillaume Abrioux
c6ad60686d
Merge pull request #55376 from guits/guits-cv-64248
ceph-volume: fix zap_partitions() in devices.lvm.zap
2024-02-07 15:10:23 +01:00
Zac Dover
f5b8afe981 doc/cephadm - edit t11ing.
Edit "Running Repeated Debugging Sessions" in
doc/cephadm/troubleshooting.rst. Improve grammar. Fix a misspelling.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-02-07 23:33:18 +10:00
Matan Breizman
31717ac36c
Merge pull request #55444 from Matan-B/wip-crimson-seastar-upgrade
Crimson: bump up seastar version 

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-02-07 11:38:45 +02:00
Yingxin
fbd3c912d0
Merge pull request #54280 from xxhdx1985126/wip-rbm-scattered-allocation
crimson/os/seastore/random_block_manager: allow allocating multiple extents for a single disk space allocation request

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2024-02-07 13:42:47 +08:00
Matan Breizman
d49990f246 ceph.spec.in: crimson add protobuf
Following eea4102091

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-02-06 15:49:08 +00:00
Matan Breizman
40c1978b69 crimson/crush/CrushLocation: fix compilation errors
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-02-06 15:49:08 +00:00
Matan Breizman
42ead863ec CMakeLists.txt: fix Seastar expected dirs
```
  # create the directory so cmake won't complain when looking at the imported
  # target: Seastar exports this directory created at build-time
```

Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-02-06 15:49:08 +00:00
Matan Breizman
fb802ca724 seastar: bump up seastar submodule version
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2024-02-06 15:49:08 +00:00
Adam Kupczyk
b5bae62c00
Merge pull request #55054 from pereman2/zns-remove
os/bluestore: remove zoned namespace support
It has never been finished and now its in the way of future improvements.
2024-02-06 15:32:48 +01:00
Yuval Lifshitz
ac9e76f852
Merge pull request #55275 from qiuxinyidian/rgw-noti-dev
rgw: add topic owner user check when creating

reviewed-by: cbodley, kchheda3
2024-02-06 14:09:37 +02:00
zdover23
d21648a178
Merge pull request #55447 from zdover23/wip-doc-2024-02-05-rados-operations-pools
doc/rados: update PG guidance

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-02-06 19:36:55 +10:00
Zhipeng Li
4581d0dafa rgw: modify topic owner check when creating
add tests to cover topic policies
as well as behavior when no policies are defined

Fixes: https://tracker.ceph.com/issues/64124

Signed-off-by: Zhipeng Li <qiuxinyidian@gmail.com>
2024-02-06 07:41:55 +00:00
Casey Bodley
ce47bb15f0
Merge pull request #54311 from gabriel-samfira/do-not-escape-slash
RGW: fix cloud-sync not being able to sync folders

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-05 21:21:11 +00:00
Casey Bodley
23bbd1e28a
Merge pull request #55252 from jzhu116-bloomberg/wip-21800
rgw/multisite: avoid writing multipart parts to the bucket index log

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-05 21:17:31 +00:00
Casey Bodley
60da519566
Merge pull request #55293 from jzhu116-bloomberg/wip-63178
rgw/lc: pass in flag as an argument when calling function complete(..)

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-05 21:16:56 +00:00
Casey Bodley
5d8a0143fc
Merge pull request #54661 from lightmelodies/rgw-gc
rgw: optimize gc chain size calculation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-05 21:16:27 +00:00
Ilya Dryomov
a298a68386
Merge pull request #55452 from nbalacha/wip-typo-fix
rbd-mirror: fix a typo in NotifyAckPayload::dump()

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-02-05 20:12:51 +01:00
Casey Bodley
7b689a3898
Merge pull request #55406 from cbodley/wip-64255
rgw: SiteConfig::load() falls back to local zonegroup

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
2024-02-05 17:59:46 +00:00
Adam King
3ddbe8f537
Merge pull request #55448 from guits/subclass-thread
node-proxy: refactor entrypoint

Reviewed-by: Adam King <adking@redhat.com>
2024-02-05 08:28:42 -05:00
Ronen Friedman
c44c8d2bc4
Merge pull request #55280 from ronen-fr/wip-rf-extra-lg
osd: remove superfluous '>' in spg_t formatter

Reviewed-by: Samuel Just <sjust@redhat.com>
2024-02-05 14:21:32 +02:00
Yuval Lifshitz
4c0fc4a686
Merge pull request #55414 from yuvalif/wip_yuval_url_decode_sns
rgw/rest: fix url decode of post params passed as attributes

reviewed-by: cbodley
2024-02-05 14:16:55 +02:00
N Balachandran
1e9b8f0e76 rbd-mirror: fixed a typo in instance_watcher
Fixes a typo in NotifyAckPayload::dump().

Signed-off-by: N Balachandran <nibalach@redhat.com>
2024-02-05 15:16:17 +05:30
Guillaume Abrioux
ebf05d5d6c node-proxy: refactor entrypoint
This commit introduces a major refactor of the main
entrypoint.

- subclass threading.Thread:
  - Introduce a new class `BaseThread()` that is a
    `threading.Thread()` abstraction class in order
    to monitor the different threads.
  - `BaseSystem()` inherits from `BaseThread()`.
  - Handle `SIGTERM` signal in order to gracefully shutdown
    node-proxy (make threads exit gracefully, log out from RedFish API, etc.)

Additionally, this:
  - drops the class `Logger()` from util.py which
was not adding value. It is now replaced with a simple `get_logger()`
function.
  - changes the node-proxy API port from 8080 to 9456
    (8080 being widely used for frontend apps...)
  - changes the container entrypoint in order to use the
    `ceph-node-proxy` binary from the packaging

Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
2024-02-05 09:26:46 +00:00
Zac Dover
5ad241442d doc/rados: update PG guidance
Update the "Creating a Pool" section of doc/rados/operations/pools.rst
so that the documentation no longer insists that the user change the
values of "osd_pool_default_pg_num" and "osd_pool_default_pgp_num".

See also: https://github.com/ceph/ceph/pull/55419

Tracker: https://tracker.ceph.com/issues/64259

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-02-05 18:41:21 +10:00
Xuehan Xu
c35866f371 crimson/os/seastore/transaction_manager: allow allocating multiple
extents when rewriting data extents

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-02-05 16:27:50 +08:00
Xuehan Xu
b35549d714 crimson/os/seastore/object_data_handler: allow alloc multiple extents
for a single request

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-02-05 16:27:50 +08:00
Xuehan Xu
cf509b1933 crimson/os/seastore/transaction_manager: fix errorator mismatch
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-02-05 16:27:50 +08:00
Xuehan Xu
63b87f70ce test/crimson/seastore: add unittest cases for scattered allocation
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-02-05 16:27:50 +08:00
Xuehan Xu
e418cfd6f5 test/crimson/seastore: test avlallocator's scattered allocation
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-02-05 16:27:50 +08:00
Xuehan Xu
554db8d88d crimson/os/seastore/transaction_manager: TransactionManager::alloc_extent(s) may return enospc
Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-02-05 16:27:50 +08:00
Xuehan Xu
2226e0c942 crimson/os/seastore: add new interfaces to alloc multiple extents for a
single request

Signed-off-by: Xuehan Xu <xuxuehan@qianxin.com>
2024-02-05 16:27:50 +08:00
Kefu Chai
a3ec5d366b
Merge pull request #55089 from cbodley/wip-boost-mirrors
make-dist: update boost mirrors

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2024-02-05 10:20:07 +08:00
zdover23
3a8d63a892
Merge pull request #55434 from anthonyeleven/rgwyamlin
src/common/options: Correct typo in rgw.yaml.in

Reviewed-by: Zac Dover <zac.dover@proton.me>
2024-02-05 00:44:35 +10:00
Matan Breizman
ad212a5c83
Merge pull request #55276 from Matan-B/wip-matanb-crimson-alienstore-cores
crimson: rework CPU pinning

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2024-02-04 11:45:43 +02:00
zdover23
6847404eda
Merge pull request #55419 from zdover23/wip-doc-2024-02-02-rados-config-pool-pg-config-ref
doc/rados: update config for autoscaler

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2024-02-04 08:25:50 +10:00
Anthony D'Atri
1796022aa4 src/common/options: Correct typo in rgw.yaml.in
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2024-02-03 02:18:25 -05:00
Zac Dover
4dc12092be doc/rados: update config for autoscaler
Update doc/rados/configuration/pool-pg-config-ref.rst to account for the
behavior of autoscaler.

Previously, this file was last meaningfully altered in 2013, prior to
the invention of autoscaler. A recent confusion was brought to my
attention on the Ceph Slack whereby a user attempted to alter the
default values of a Quincy cluster, as suggested in this documentation.
That alteration caused Ceph to throw the error "Error ERANGE: 'pgp_num'
must be greater than 0 and lower or equal than 'pg_num', which in this
case is one" and a related "rgw_init_ioctx ERROR" reading in part
"Numerical result out of range". The user removed the
"osd_pool_default_pgp_num" configuration line from ceph.conf and the
cluster worked as expected. I presume that this is because the removal
of this configuration line allowed autoscaler to work as intended.

Fixes: https://tracker.ceph.com/issues/64259

Co-authored-by: David Orman <ormandj@corenode.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2024-02-03 12:35:19 +10:00
Casey Bodley
1183db4146 rgw: SiteConfig::load() falls back to local zonegroup
allow radosgw-admin commands like 'user create' to operate on a new zone
that hasn't been committed to the period yet. this follows similar logic
in RGWSI_Zone::do_start()

Fixes: https://tracker.ceph.com/issues/64255

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2024-02-02 20:23:39 -05:00
Adam King
4103b566e4
Merge pull request #54312 from dvanders/dvanders_mcltf_true
qa/tasks/cephadm: enable mon_cluster_log_to_file

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-02-02 13:57:49 -05:00
Casey Bodley
ebd79592bd
Merge pull request #54837 from imtzw/urlencode
rgw: fix list obj v1 nextmarker

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-02 16:37:53 +00:00
Casey Bodley
862b2eeb5b
Merge pull request #54867 from BBoozmen/oozmen_lc_subsystem
rgw/common: add rgw lifecycle specific debug log subsystem

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Jiffin Tony Thottan <jthottan@redhat.com>
2024-02-02 15:42:00 +00:00
Casey Bodley
0359613a9f
Merge pull request #55162 from cfsnyder/wip-64014-cfsnyder-pacific
rgw: fix issue with concurrent versioned deletes leaving behind olh entries

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2024-02-02 15:41:17 +00:00
Casey Bodley
868a8eb2d1
Merge pull request #55229 from tobias-urdin/http-error-keystone-issue-admin-token-request
rgw: fix http error check in keystone issue_admin_token_request

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2024-02-02 15:40:48 +00:00
baum
3cb0412e26
Merge pull request #55330 from baum/centos9-install-build-deps
🧹build dependencies: centos9
2024-02-02 09:54:28 +02:00
Venky Shankar
57856522a6 Merge PR #55233 into main
* refs/pull/55233/head:
	qa: use centos 9.stream for cephfs stock kernel testing

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2024-02-02 10:35:00 +05:30
Casey Bodley
3a05c6f0f3
Merge pull request #53901 from cbodley/wip-qa-container-distros-s
qa/distros: bump container host distros from centos 8->9

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2024-02-01 19:40:57 +00:00
Ilya Dryomov
9102ec9bad
Merge pull request #55413 from petrutlucian94/flipped_tid
msg: update MOSDOp() to use ceph_tid_t instead of long

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2024-02-01 20:29:58 +01:00