Commit Graph

128477 Commits

Author SHA1 Message Date
Ernesto Puerta
d10b0b7e72
mgr/dashboard: disable Promql test in ARM
Temporarily disable this test while debugging the issue (since https://github.com/ceph/ceph/pull/43669
originally passed the ARM check).

Fixes: https://tracker.ceph.com/issues/53451
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2021-12-13 20:20:44 +01:00
Casey Bodley
44d706c353
Merge pull request #44009 from cbodley/wip-qa-cls-rgw-gc
qa/rgw: run ceph_test_cls_rgw_gc in rgw/verify suite

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-12-13 11:18:49 -05:00
Sebastian Wagner
0c021eb69b
Merge pull request #42905 from sebastian-philipp/service_spec_no_redundant_placement
python-common: improve OSD spec error messages

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-12-13 12:11:09 +01:00
Guillaume Abrioux
b6f0e1969f
Merge pull request #44218 from guits/guits-issue-44356
ceph-volume: fix error 'KeyError' with inventory
2021-12-13 09:47:01 +01:00
Guillaume Abrioux
0a67a3347f
Merge pull request #44219 from guits/guits-issue-53425
ceph-volume: fix tags dict output in `lvm list`
2021-12-13 09:46:44 +01:00
Samuel Just
0200b02155
Merge pull request #44281 from athanatos/sjust/wip-53555
crimson/os/seastore: index lba pins atomically with addition to cache

Reviewed-by: Xuehan Xu <xuxuehan@360.cn>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-13 00:43:34 -08:00
Yuri Weinstein
8c4e9d665b
Merge pull request #44225 from liewegas/fix-53506
osd/OSDMapMapping: fix spurious threadpool timeout errors

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2021-12-10 15:35:42 -08:00
Yuri Weinstein
b2e20eb068
Merge pull request #44025 from ljflores/wip-remove-aggregated-perf-data
mgr/telemetry: remove aggregated perf metrics from the perf channel

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Yaarit Hatuka <yaarit@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2021-12-10 15:35:09 -08:00
Yuri Weinstein
ebb64e4a3d
Merge pull request #43612 from adamemerson/wip-unleveling
build: Remove LevelDB support

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-12-10 15:33:05 -08:00
Samuel Just
62f3cf1a3d crimson/os/seastore/cache: init extents prior to read
Thus should ensure that any captured members of extent_init_func are
still valid at the cost of not being able to access the contents of the
extent at invocation time.  With this, we should be able to rely on any
logical extents/lba extents in the cache having validly initialized lba
pins.

Fixes: https://tracker.ceph.com/issues/53555
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-12-10 14:57:32 -08:00
Samuel Just
96390d5f9e crimson/os/seatore/.../lba_btree: update get_*_node to add_pin without reading node contents
This will allow us to do add_pin before we perform the actual extent read.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-12-10 14:56:15 -08:00
Samuel Just
43f347ecec crimson/os/seastore: pass depth/begin/end to get_*_node
We'll need this to populate the pin fields prior to read.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-12-10 14:56:15 -08:00
Samuel Just
c2d2dd7e70 crimson/os/seastore/transaction_manager: clarify that init lambda only runs on new extents
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-12-10 14:56:15 -08:00
Samuel Just
96fd5ab492 crimson/os/seastore/cache: remove unnecessary forward
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-12-10 14:56:15 -08:00
Casey Bodley
0ec5b8b2dd
Merge pull request #44262 from cbodley/wip-53325
test/rgw: disable cls_rgw_gc test cases with defer_gc()

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2021-12-10 11:48:39 -05:00
Matt Benjamin
7a02a6d87c
Merge pull request #44206 from linuxbox2/wip-rgwlc-9969
rgwlc:  remove magic debug blocks for clearing stale lc entries
2021-12-10 08:46:09 -05:00
Alfonso Martínez
a1e7562c57
Merge pull request #43991 from rhcs-dashboard/introduce-haroxy-metrics-rgw
mgr/dashboard: introduce HAProxy metrics for RGW

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-12-10 08:46:43 +01:00
Soumya Koduri
3ddb7e4435
Merge pull request #43258 from soumyakoduri/wip-skoduri-dbstore-mp
rgw/dbstore: Multipart upload APIs
2021-12-10 10:40:55 +05:30
Matt Benjamin
669798af85
Merge pull request #42104 from linuxbox2/wip-rgwadminops-fsid
rgw: expose RADOS cluster_fsid via adminops
2021-12-09 18:35:03 -05:00
Matt Benjamin
338d024a28 rgw:adminops: remove "import json" from radosgw_admin_rest.py
This is perhaps erring a bit on the side of cosmetic fixes.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-12-09 13:24:52 -05:00
Yuri Weinstein
8cc8360499
Merge pull request #44220 from vshankar/wip-53487
qa: exclude `nofallback` mount option when using v1-style syntax

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-12-09 08:27:09 -08:00
Casey Bodley
f70d24997e qa/rgw: run ceph_test_cls_rgw_gc in rgw/verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-12-09 11:07:03 -05:00
Casey Bodley
29beb17e04 test/rgw: disable cls_rgw_gc test cases with defer_gc()
Fixes: https://tracker.ceph.com/issues/53325

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-12-09 10:58:16 -05:00
Matt Benjamin
bcbf3b1067 rgw:adminops: slightly generalize /info
Adds a get_name() method to rgw::sal::Store, by which each store
returns its unique name in lowercase.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-12-09 10:48:06 -05:00
Matt Benjamin
a4b28946bf rgw:sal: implement (placeholder) get_cluster_fsid in DBStore
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-12-09 10:47:56 -05:00
Matt Benjamin
e8716889c7 rgw:adminops: add test case for 'info' section
Add 'info' section test case to the radosgw_admin_test.py qa
task.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-12-09 10:47:49 -05:00
Matt Benjamin
bdda0d2ba1 rgw: introduce new /{admin}/info api resource
The new resource returns an array of informational data, which
currently consists of the RADOS cluster fsid as "cluster_fsid."

Fixes: https://tracker.ceph.com/issues/51432

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-12-09 10:47:43 -05:00
Matt Benjamin
cfe546991a rgw:sal: expose cluster fsid in RGWStore
Adds a get_cluster_id() method to RGWStore, provided librados
cluster_fsid in the RADOS implementation.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-12-09 10:47:36 -05:00
Alfonso Martínez
50cc016efb
Merge pull request #44001 from votdev/issue_53317_fix_proxy_conf
mgr/dashboard: API docs UI does not work with Angular dev server

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-12-09 16:27:03 +01:00
Matt Benjamin
279e29b9bb
Merge pull request #44237 from pritha-srivastava/wip-rgw-abort-multipart-bypass-gc
rgw: deleting objects inline in case bypass_gc is specified
2021-12-09 10:05:16 -05:00
Avan Thakkar
8d83126e51 mgr/dashboard: introduce HAProxy metrics for RGW
Fixes: https://tracker.ceph.com/issues/53311
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2021-12-09 20:03:03 +05:30
Venky Shankar
a15e6d6721 qa: exclude nofallback mount option when using v1-style syntax
Otherwise, certain upgrade tests fail which install pacific
or earlier releases since the mount helper does not understand
this mount option, thereby passing it to the kernel which would
does not handle this config causing mount to fail in tests.

Note that this mount config is only used during teuthology tests
to catch v2-style syntax implementation bugs in the kernel.

Fixes: http://tracker.ceph.com/issues/53487
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-12-09 13:30:22 +05:30
Samuel Just
961bfc8e45
Merge pull request #44127 from cyx1231st/wip-seastore-merge-journal-headers-2
crimson/os/seastore: make JournalSubmitter aware of header merging

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-12-08 23:51:30 -08:00
Yingxin Cheng
f971289e5d crimson/os/seastore/journal: make JournalSubmitter aware of header merging
Introduce an option seastore_journal_batch_preferred_fullness for
JournalSubmitter to control the preferred fullness to trigger batch
flushes.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 11:28:49 +08:00
Yingxin Cheng
a689a0ff4c crimson/os/seastore: refactor get_encoded_length_after()
To return a more informative record_group_size_t.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 11:28:49 +08:00
Yingxin Cheng
a15a862432 crimson/os/seastore: debug print journal write details
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 11:28:49 +08:00
Yingxin Cheng
1f02b33d67 crimson/os/seastore: measure records write in journal
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 11:28:49 +08:00
Yingxin Cheng
e428c13d34 crimson/os/seastore: fix record metrics in cache
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 11:28:49 +08:00
Yingxin Cheng
a0540ae936 crimson/os/seastore/cache: misc cleanup
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 11:28:33 +08:00
Yingxin Cheng
b495938d18 crimson/os/seastore: add debug logs to print transaction name
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 09:41:37 +08:00
Yingxin Cheng
f9df13f0dd crimson/os/seastore: don't print detail if the extent is not ready
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 09:39:06 +08:00
Yingxin Cheng
bd0041cbbf crimson/os/seastore: print extent length
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 09:37:05 +08:00
Yingxin Cheng
76b1d352fb crimson/os/seastore: move implementation to seastore_types.cc
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 09:37:05 +08:00
Yingxin Cheng
91f46e79a7 crimson/os/seastore: merge records metadata if they are grouped
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 09:37:05 +08:00
Yingxin Cheng
c5093c8048 crimson/os/seastore: mark out empty transactions
TODO: avoid write if the transaction is empty.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 09:37:05 +08:00
Yingxin Cheng
310ed9ee81 crimson/os/seastore: refactor, introduce record_t and record_group_t with sizes
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 09:37:05 +08:00
Yingxin Cheng
28fec46261 crimson/os/seastore: scan records based on record_locator_t
Record may not have its own base if headers are merged.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 09:37:05 +08:00
Yingxin Cheng
3f90994e58 crimson/os/seastore: add more checks when read record_header_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 09:37:05 +08:00
Yingxin Cheng
2241111087 crimson/os/seastore: misc cleanup and reformat
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 09:37:05 +08:00
Yingxin Cheng
2cd753aa7d crimson/os/seastore: add logs in ExtentReader
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-12-09 09:37:05 +08:00