Commit Graph

131138 Commits

Author SHA1 Message Date
Rishabh Dave
ab19827858 qa/cephfs: remove temporary files
These temporary files don't matter for test execution with teuthology
but they do matter for execution with vstart_runner.py since the test
fails if these files exist already. And tests are often run repeatedly
with vstart_runner.py, unlike with teuthology.

Fixes: https://tracker.ceph.com/issues/55719
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-05-20 10:58:33 +05:30
Rishabh Dave
ff86ae7556 cephfs-shell: check version before importing Cmd2ArgparseError
Cmd2ArgparseError is available only cmd2 version 1.0.1 onwards. Before
that, SystemExit(2) is raised. This commit creates an empty class
Cmd2ArgparseError for earlier version so that similar error won't creep
up again.

Fixes: https://tracker.ceph.com/issues/55716
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-05-19 21:03:54 +05:30
Rishabh Dave
c7306b7df6 cephfs-shell: set exit code when Cmd2ArgparseError is caught
Not doing so, sets the exit code to zero which is not desired in case of
a command failure.

Fixes: https://tracker.ceph.com/issues/55710
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-05-19 18:07:39 +05:30
zdover23
4a7401b115
Merge pull request #46292 from anthonyeleven/anthonyeleven/clarify-min-alloc-size2
doc/rados/configuration: clarify VMware note in bluestore-config-ref.rst

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-05-17 17:58:17 +10:00
Anthony D'Atri
1a0e0cd4b6 doc/rados/configuration: clarify VMware note in bluestore-config-ref.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-05-16 18:46:58 -07:00
J. Eric Ivancich
9c1916f6f3
Merge pull request #46265 from ivancich/wip-misplaced-dout_subsys-def
rgw: remove potentially conficting definition of dout_subsys

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2022-05-16 18:36:58 -04:00
Samuel Just
86aacf1148
Merge pull request #46158 from cyx1231st/wip-seastore-cleaner
crimson/os/seastore/segment_cleaner: misc cleanups and improvements

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-16 14:06:27 -07:00
Yuval Lifshitz
17f72562b2
Merge pull request #45662 from zenomri/wip-cond-tracing
rgw: support conditional tracing using lua script

Reviewed-by: Casey Bodley <cbodley@redhat.com>, Yuval Lifshitz <ylifshit@redhat.com>
2022-05-16 17:26:50 +03:00
Kefu Chai
d4d929386b
Merge pull request #46274 from xxhdx1985126/wip-admin-sock
crimson/admin: deal with seastar's new metric types/logics

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-05-16 19:56:13 +08:00
Xuehan Xu
d3ce716907 crimson/admin: deal with seastar's new metric types/logics
Fixes: https://tracker.ceph.com/issues/55666
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-05-16 16:51:30 +08:00
Ronen Friedman
7145287fa3
Merge pull request #45962 from ronen-fr/wip-rf-sbe-test2
test/osd: test environment for the scrubber "backend"

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2022-05-16 11:32:27 +03:00
zdover23
058a0ee89a
Merge pull request #46270 from anthonyeleven/anthonyeleven/clarify-min-alloc-size 2022-05-16 17:12:59 +10:00
Anthony D'Atri
7a2a565101 doc/rados/configuration: Enhance BlueStore min_alloc_size section
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-05-15 14:50:47 -07:00
Kefu Chai
cd0cd7cb09
Merge pull request #45947 from optimistyzy/418_add_nvme_tcp_support
blk/spdk:  add support to use NVMe device provided by NVMe-oF target

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-05-15 19:49:42 +08:00
Ronen Friedman
c5684e44b9
Merge pull request #46226 from ronen-fr/wip-rf-cln-typesh
osd: cleanup object_stat_sum_t initialization

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2022-05-15 09:31:51 +03:00
Ziye Yang
27b7ccacd4 blk/spdk: Add the support to use nvme device provided by NVMe-of Target
This patch is used to add the support to use the nvmedevice provided
by NVMe-oF target.

Signed-off-by: Ziye Yang <ziye.yang@intel.com>
2022-05-15 09:15:40 +08:00
Venky Shankar
42b74f497e
Merge pull request #45886 from lxbsz/wip-55283
qa: add filesystem/file sync stuck test support

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:14:51 +05:30
Venky Shankar
3f55262ea9
Merge pull request #45955 from lxbsz/wip-55240
mds: trigger to flush the mdlog in handle_find_ino()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:13:17 +05:30
Venky Shankar
450cdbaab5
Merge pull request #46063 from vshankar/wip-55170
mds: fetch all dirfrag entries when no dentry keys are requested

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:12:13 +05:30
Venky Shankar
8beaa5e5db
Merge pull request #46153 from lxbsz/wip-54411-1
client: force send global open_files/metadata metrics

 Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:11:17 +05:30
J. Eric Ivancich
8efea3e894 rgw: remove potentially conficting definition of dout_subsys
dout_subsys should strictly be defined in .cc files. There was a
definition of dout_subsys in rgw_log.h, which is included in a variety
of .cc files due to transitive includes. When a subsystem wants a
conflicting definition, a compiler warning is then generated due to
the redefinition of dout_subsys.

The definition is removed from rgw_log.h and follow-on fixes are made.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2022-05-14 00:33:26 -04:00
Samuel Just
8dc7cb108e
Merge pull request #46258 from xxhdx1985126/wip-backref-minor-bug-fixes
crimson/os/seastore/cache: backref buffer minor bug fix

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-13 12:25:44 -07:00
zdover23
ecb948ab1a
Merge pull request #46154 from zdover23/wip-doc-2022-04-14-dev-guide-basic-workflow
doc/dev: update basic-workflow.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-05-14 01:40:19 +10:00
Ernesto Puerta
cfa5d0fe2d
Merge pull request #45581 from MrFreezeex/jsonnet-multiline-cleanup
ceph-mixin: rewrite promql queries to multiline

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-05-13 16:21:30 +02:00
Kefu Chai
417774f60b
Merge pull request #46142 from tchaikov/wip-cmake-fuse
cmake: mark FUSE REQUIRED if WITH_FUSE

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-13 20:58:14 +08:00
Venky Shankar
a00fd5f873
Merge pull request #46237 from vshankar/wip-add-multids-stray-check-for-upgrade
doc: add note about checking pending stray directory entries before initiating upgrade

 Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-13 18:10:16 +05:30
Xuehan Xu
0ad9c3ff8b crimson/os/seastore/cache: backref buffer minor bug fix
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-05-13 20:16:29 +08:00
Venky Shankar
92724156e6 doc: add note about checking pending stray directory entries before initiating upgrade
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2022-05-13 16:24:14 +05:30
Venky Shankar
c325d50d9b
Merge pull request #46236 from vshankar/wip-manual-upgrade-add-check
doc: add setting/unsetting `mon_mds_skip_sanity` config for manual ceph-mds upgrade

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-13 15:52:20 +05:30
Ernesto Puerta
b6f6246e9b
Merge pull request #46206 from votdev/issue_55578_prom_am_silence
mgr/dashboard: Creating and editing Prometheus AlertManager silences is buggy

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2022-05-13 11:12:38 +02:00
Yingxin Cheng
538f95542b crimson/os/seastore: fix metrics with TRIM_BACKREF transaction
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
f4a3af686a crimson/os/seastore/segment_cleaner: measure the initial reclaim ratio
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
37aef8a72f crimson/os/seastore/segment_cleaner: distinguish journal/ool when count open/close/release
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
3ea0e7bb2f crimson/os/seastore/segment_cleaner: distinguish in-journal and type-journal segments
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
5ebc4744dd crimson/os/seastore/segment_cleaner: exclude utilizations from empty/open segments
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
c3e23dd53d crimson/os/seastore/segment_cleaner: refine metrics
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
c7f46a4ab4 crimson/os/seastore/segment_cleaner: fix an issue that caused forever-GC
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
236c8a41a6 crimson/os/seastore/segment_cleaner: improve space calculations
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
8eedd51857 crimson/os/seastore/segment_cleaner: classify space into available, unreclaimable and reclaimable
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
dcce611de3 crimson/os/seastore/segment_cleaner: cleanup, track available space in open segments
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
f3042862d2 crimson/os/seastore/segment_cleaner: unify update_segment_avail_bytes()
* unify update_segment_avail_bytes() and set_journal_head() interfaces.
* reuse segment_info_t::written_to to get the current journal head.
* more strict validations about journal head maintainence.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
6ecbc1e775 crimson/os/seastore/segment_cleaner: misc assert reinforcements
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
1be6f39658 crimson/os/seastore/segment_cleaner: add missing maybe_wake_on_space_used()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:20 +08:00
Yingxin Cheng
d8ff107183 crimson/os/seastore/segment_cleaner: cleanup, drop the unnecessary stopping flag
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:19 +08:00
Yingxin Cheng
2e40d4e10f crimson/os/seastore/segment_cleaner: fix journal tail calculations
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:19 +08:00
Yingxin Cheng
ff1b189195 crimson/os/seastore/segment_allocator: simplify close_segment()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:19 +08:00
Yingxin Cheng
f681364e15 crimson/os/seastore/segment_cleaner: cleanup and validate config_t
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:19 +08:00
Yingxin Cheng
210985aa8d crimson/os/seastore/segment_cleaner: drop unused code
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:51:19 +08:00
Yingxin
58eb062361
Merge pull request #46256 from xxhdx1985126/wip-backref-big-buffer
crimson/os/seastore: use a whole large backref buffer in cache instea…

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-13 15:50:22 +08:00
Xuehan Xu
aab8bb0fa0 crimson/os/seastore: use a whole large backref buffer in cache instead of several small bufs
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-05-13 12:44:53 +08:00