Commit Graph

131137 Commits

Author SHA1 Message Date
Yingxin Cheng
29558b3dcd crimson/os/seastore/segment_cleaner: add metrics about journal sizes
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-17 16:37:44 +08:00
Yingxin Cheng
dc400ca98b crimson/os/seastore/segment_cleaner: add metrics about why IO is blocking
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-17 16:37:44 +08:00
zdover23
4a7401b115
Merge pull request #46292 from anthonyeleven/anthonyeleven/clarify-min-alloc-size2
doc/rados/configuration: clarify VMware note in bluestore-config-ref.rst

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-05-17 17:58:17 +10:00
Anthony D'Atri
1a0e0cd4b6 doc/rados/configuration: clarify VMware note in bluestore-config-ref.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-05-16 18:46:58 -07:00
J. Eric Ivancich
9c1916f6f3
Merge pull request #46265 from ivancich/wip-misplaced-dout_subsys-def
rgw: remove potentially conficting definition of dout_subsys

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2022-05-16 18:36:58 -04:00
Samuel Just
86aacf1148
Merge pull request #46158 from cyx1231st/wip-seastore-cleaner
crimson/os/seastore/segment_cleaner: misc cleanups and improvements

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-16 14:06:27 -07:00
Yuval Lifshitz
17f72562b2
Merge pull request #45662 from zenomri/wip-cond-tracing
rgw: support conditional tracing using lua script

Reviewed-by: Casey Bodley <cbodley@redhat.com>, Yuval Lifshitz <ylifshit@redhat.com>
2022-05-16 17:26:50 +03:00
Kefu Chai
d4d929386b
Merge pull request #46274 from xxhdx1985126/wip-admin-sock
crimson/admin: deal with seastar's new metric types/logics

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-05-16 19:56:13 +08:00
Xuehan Xu
d3ce716907 crimson/admin: deal with seastar's new metric types/logics
Fixes: https://tracker.ceph.com/issues/55666
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-05-16 16:51:30 +08:00
Ronen Friedman
7145287fa3
Merge pull request #45962 from ronen-fr/wip-rf-sbe-test2
test/osd: test environment for the scrubber "backend"

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2022-05-16 11:32:27 +03:00
zdover23
058a0ee89a
Merge pull request #46270 from anthonyeleven/anthonyeleven/clarify-min-alloc-size 2022-05-16 17:12:59 +10:00
Anthony D'Atri
7a2a565101 doc/rados/configuration: Enhance BlueStore min_alloc_size section
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-05-15 14:50:47 -07:00
Kefu Chai
cd0cd7cb09
Merge pull request #45947 from optimistyzy/418_add_nvme_tcp_support
blk/spdk:  add support to use NVMe device provided by NVMe-oF target

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-05-15 19:49:42 +08:00
Ronen Friedman
c5684e44b9
Merge pull request #46226 from ronen-fr/wip-rf-cln-typesh
osd: cleanup object_stat_sum_t initialization

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2022-05-15 09:31:51 +03:00
Ziye Yang
27b7ccacd4 blk/spdk: Add the support to use nvme device provided by NVMe-of Target
This patch is used to add the support to use the nvmedevice provided
by NVMe-oF target.

Signed-off-by: Ziye Yang <ziye.yang@intel.com>
2022-05-15 09:15:40 +08:00
Venky Shankar
42b74f497e
Merge pull request #45886 from lxbsz/wip-55283
qa: add filesystem/file sync stuck test support

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:14:51 +05:30
Venky Shankar
3f55262ea9
Merge pull request #45955 from lxbsz/wip-55240
mds: trigger to flush the mdlog in handle_find_ino()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:13:17 +05:30
Venky Shankar
450cdbaab5
Merge pull request #46063 from vshankar/wip-55170
mds: fetch all dirfrag entries when no dentry keys are requested

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:12:13 +05:30
Venky Shankar
8beaa5e5db
Merge pull request #46153 from lxbsz/wip-54411-1
client: force send global open_files/metadata metrics

 Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:11:17 +05:30
J. Eric Ivancich
8efea3e894 rgw: remove potentially conficting definition of dout_subsys
dout_subsys should strictly be defined in .cc files. There was a
definition of dout_subsys in rgw_log.h, which is included in a variety
of .cc files due to transitive includes. When a subsystem wants a
conflicting definition, a compiler warning is then generated due to
the redefinition of dout_subsys.

The definition is removed from rgw_log.h and follow-on fixes are made.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2022-05-14 00:33:26 -04:00
Samuel Just
8dc7cb108e
Merge pull request #46258 from xxhdx1985126/wip-backref-minor-bug-fixes
crimson/os/seastore/cache: backref buffer minor bug fix

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-13 12:25:44 -07:00
zdover23
ecb948ab1a
Merge pull request #46154 from zdover23/wip-doc-2022-04-14-dev-guide-basic-workflow
doc/dev: update basic-workflow.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-05-14 01:40:19 +10:00
Ernesto Puerta
cfa5d0fe2d
Merge pull request #45581 from MrFreezeex/jsonnet-multiline-cleanup
ceph-mixin: rewrite promql queries to multiline

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-05-13 16:21:30 +02:00
Kefu Chai
417774f60b
Merge pull request #46142 from tchaikov/wip-cmake-fuse
cmake: mark FUSE REQUIRED if WITH_FUSE

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-13 20:58:14 +08:00
Venky Shankar
a00fd5f873
Merge pull request #46237 from vshankar/wip-add-multids-stray-check-for-upgrade
doc: add note about checking pending stray directory entries before initiating upgrade

 Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-13 18:10:16 +05:30
Xuehan Xu
0ad9c3ff8b crimson/os/seastore/cache: backref buffer minor bug fix
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-05-13 20:16:29 +08:00
Venky Shankar
92724156e6 doc: add note about checking pending stray directory entries before initiating upgrade
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-05-13 16:24:14 +05:30
Venky Shankar
c325d50d9b
Merge pull request #46236 from vshankar/wip-manual-upgrade-add-check
doc: add setting/unsetting `mon_mds_skip_sanity` config for manual ceph-mds upgrade

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-13 15:52:20 +05:30
Ernesto Puerta
b6f6246e9b
Merge pull request #46206 from votdev/issue_55578_prom_am_silence
mgr/dashboard: Creating and editing Prometheus AlertManager silences is buggy

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2022-05-13 11:12:38 +02:00
Yingxin Cheng
538f95542b crimson/os/seastore: fix metrics with TRIM_BACKREF transaction
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
f4a3af686a crimson/os/seastore/segment_cleaner: measure the initial reclaim ratio
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
37aef8a72f crimson/os/seastore/segment_cleaner: distinguish journal/ool when count open/close/release
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
3ea0e7bb2f crimson/os/seastore/segment_cleaner: distinguish in-journal and type-journal segments
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
5ebc4744dd crimson/os/seastore/segment_cleaner: exclude utilizations from empty/open segments
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
c3e23dd53d crimson/os/seastore/segment_cleaner: refine metrics
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
c7f46a4ab4 crimson/os/seastore/segment_cleaner: fix an issue that caused forever-GC
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
236c8a41a6 crimson/os/seastore/segment_cleaner: improve space calculations
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
8eedd51857 crimson/os/seastore/segment_cleaner: classify space into available, unreclaimable and reclaimable
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
dcce611de3 crimson/os/seastore/segment_cleaner: cleanup, track available space in open segments
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
f3042862d2 crimson/os/seastore/segment_cleaner: unify update_segment_avail_bytes()
* unify update_segment_avail_bytes() and set_journal_head() interfaces.
* reuse segment_info_t::written_to to get the current journal head.
* more strict validations about journal head maintainence.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
6ecbc1e775 crimson/os/seastore/segment_cleaner: misc assert reinforcements
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
1be6f39658 crimson/os/seastore/segment_cleaner: add missing maybe_wake_on_space_used()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
d8ff107183 crimson/os/seastore/segment_cleaner: cleanup, drop the unnecessary stopping flag
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:19 +08:00
Yingxin Cheng
2e40d4e10f crimson/os/seastore/segment_cleaner: fix journal tail calculations
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:19 +08:00
Yingxin Cheng
ff1b189195 crimson/os/seastore/segment_allocator: simplify close_segment()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:19 +08:00
Yingxin Cheng
f681364e15 crimson/os/seastore/segment_cleaner: cleanup and validate config_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:19 +08:00
Yingxin Cheng
210985aa8d crimson/os/seastore/segment_cleaner: drop unused code
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:19 +08:00
Yingxin
58eb062361
Merge pull request #46256 from xxhdx1985126/wip-backref-big-buffer
crimson/os/seastore: use a whole large backref buffer in cache instea…

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:50:22 +08:00
Xuehan Xu
aab8bb0fa0 crimson/os/seastore: use a whole large backref buffer in cache instead of several small bufs
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-05-13 12:44:53 +08:00
Kefu Chai
26f8b9f7fc
Merge pull request #45368 from a16bitsysop/nasm
nasm-wrapper: ignore -O flags passed

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-05-13 10:58:12 +08:00