Commit Graph

131363 Commits

Author SHA1 Message Date
Samuel Just
3cc7b3b7bd
Merge pull request #46176 from athanatos/sjust/wip-55563
vstart: default CEPH_ASOK_DIR to asok/

Reviewed-by: Milind Changire <mchangir@redhat.com>
2022-05-17 07:53:15 -07:00
Yuri Weinstein
dca4844076 doc: updated release date
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2022-05-17 07:15:38 -07:00
Redouane Kachach
7cfcc7ef08
mgr/cephadm: do not use sudo for root user
Fixes: https://tracker.ceph.com/issues/55641

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-05-17 12:32:50 +02:00
Ernesto Puerta
5b9dcf3a82
Merge pull request #45313 from rhcs-dashboard/unselect-datatable-row
mgr/dashboard: unselect rows in datatables

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2022-05-17 11:48:48 +02:00
Yingxin Cheng
935cc3f9d5 crimson/os/seastore: adjust logs to FixedKVBtree
* Fix the subsys name.
* Change FixedKVBtree logs to trace level -- seems too verbose when the
  global level is debug.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-17 16:37:45 +08:00
Yingxin Cheng
bbe7a1beac crimson/os/seastore: add metrics for extent rewrite version
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-17 16:37:45 +08:00
Yingxin Cheng
a12808e40c crimson/os/seastore: improve and fix tree metrics
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-17 16:37:45 +08:00
Yingxin Cheng
29558b3dcd crimson/os/seastore/segment_cleaner: add metrics about journal sizes
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-17 16:37:44 +08:00
Yingxin Cheng
dc400ca98b crimson/os/seastore/segment_cleaner: add metrics about why IO is blocking
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-05-17 16:37:44 +08:00
zdover23
4a7401b115
Merge pull request #46292 from anthonyeleven/anthonyeleven/clarify-min-alloc-size2
doc/rados/configuration: clarify VMware note in bluestore-config-ref.rst

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-05-17 17:58:17 +10:00
Anthony D'Atri
1a0e0cd4b6 doc/rados/configuration: clarify VMware note in bluestore-config-ref.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-05-16 18:46:58 -07:00
Adam King
63d13df4eb mgr/cephadm: force fail over when we want to remove active mgr
Fixes: https://tracker.ceph.com/issues/55679

Signed-off-by: Adam King <adking@redhat.com>
2022-05-16 20:48:48 -04:00
J. Eric Ivancich
9c1916f6f3
Merge pull request #46265 from ivancich/wip-misplaced-dout_subsys-def
rgw: remove potentially conficting definition of dout_subsys

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2022-05-16 18:36:58 -04:00
Yuri Weinstein
276360a9fe docs: updated Change Log PRs
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2022-05-16 14:32:25 -07:00
Samuel Just
86aacf1148
Merge pull request #46158 from cyx1231st/wip-seastore-cleaner
crimson/os/seastore/segment_cleaner: misc cleanups and improvements

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-16 14:06:27 -07:00
Sarthak0702
b79e2a6c6a mgr/dashboard: unselect rows in datatables
Fixes: https://tracker.ceph.com/issues/53244
Signed-off-by: Sarthak0702 <sarthak.0702@gmail.com>
2022-05-17 02:07:06 +05:30
Yuval Lifshitz
17f72562b2
Merge pull request #45662 from zenomri/wip-cond-tracing
rgw: support conditional tracing using lua script

Reviewed-by: Casey Bodley <cbodley@redhat.com>, Yuval Lifshitz <ylifshit@redhat.com>
2022-05-16 17:26:50 +03:00
Kefu Chai
d4d929386b
Merge pull request #46274 from xxhdx1985126/wip-admin-sock
crimson/admin: deal with seastar's new metric types/logics

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-05-16 19:56:13 +08:00
Ronen Friedman
603a29a813 osd/scrub: relocate determine_scrub_time()
This aux func calculates the next scrub time based on
configuration data, scrub history and the requested scrub
flags. As part of creating unit-tests for ScrubQueue,
determine_scrub_time() is moved to that component.

A related change codifies the OSD services used by
the scheduler.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-05-16 09:32:45 +00:00
Xuehan Xu
d3ce716907 crimson/admin: deal with seastar's new metric types/logics
Fixes: https://tracker.ceph.com/issues/55666
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-05-16 16:51:30 +08:00
Ronen Friedman
7145287fa3
Merge pull request #45962 from ronen-fr/wip-rf-sbe-test2
test/osd: test environment for the scrubber "backend"

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2022-05-16 11:32:27 +03:00
Sarthak0702
9f8bcd764e mgr/dashboard: customizable log-in page text/banner
Fixes:https://tracker.ceph.com/issues/55231
Signed-off-by: Sarthak0702 <sarthak.dev.0702@gmail.com>
2022-05-16 12:45:11 +05:30
zdover23
058a0ee89a
Merge pull request #46270 from anthonyeleven/anthonyeleven/clarify-min-alloc-size 2022-05-16 17:12:59 +10:00
Milind Changire
c15b854c0c doc/cephfs: remove subvol support from snap-schedule
Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-05-16 12:24:42 +05:30
Milind Changire
b814630794 qa: remove spurious argument to snap-schedule status command
Removing the subvol support exposed a spurious argument to the status
command which was assgned to the 'subvol' parameter but was unused in
this command implementation.

The spurious argument is now removed.

Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-05-16 12:24:42 +05:30
Milind Changire
919c156884 mgr/snap_schedule: remove subvol interface
Remove snap-schedule support for subvolumes.

Fixes: https://tracker.ceph.com/issues/55148
Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-05-16 12:24:36 +05:30
Adam King
abfbbd383c mgr/cephadm: unit test for re-adding host and receiving loopback address
Signed-off-by: Adam King <adking@redhat.com>
2022-05-15 20:31:38 -04:00
Adam King
7e8d8317be mgr/cephadm: re-use old ip when re-adding hosts if necessary
When a host is re-added without an explicit ip we can default to the old
ip we had stored for the host rather than either keeping the loopback
address or throwing an exception. We only want to actually error when
the only options left are error or use a resolved loopback address

Fixes: https://tracker.ceph.com/issues/53438

Signed-off-by: Adam King <adking@redhat.com>
2022-05-15 20:31:38 -04:00
Anthony D'Atri
7a2a565101 doc/rados/configuration: Enhance BlueStore min_alloc_size section
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-05-15 14:50:47 -07:00
Kefu Chai
cd0cd7cb09
Merge pull request #45947 from optimistyzy/418_add_nvme_tcp_support
blk/spdk:  add support to use NVMe device provided by NVMe-oF target

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-05-15 19:49:42 +08:00
Ronen Friedman
c5684e44b9
Merge pull request #46226 from ronen-fr/wip-rf-cln-typesh
osd: cleanup object_stat_sum_t initialization

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2022-05-15 09:31:51 +03:00
Ziye Yang
27b7ccacd4 blk/spdk: Add the support to use nvme device provided by NVMe-of Target
This patch is used to add the support to use the nvmedevice provided
by NVMe-oF target.

Signed-off-by: Ziye Yang <ziye.yang@intel.com>
2022-05-15 09:15:40 +08:00
Venky Shankar
42b74f497e
Merge pull request #45886 from lxbsz/wip-55283
qa: add filesystem/file sync stuck test support

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:14:51 +05:30
Venky Shankar
3f55262ea9
Merge pull request #45955 from lxbsz/wip-55240
mds: trigger to flush the mdlog in handle_find_ino()

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:13:17 +05:30
Venky Shankar
450cdbaab5
Merge pull request #46063 from vshankar/wip-55170
mds: fetch all dirfrag entries when no dentry keys are requested

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:12:13 +05:30
Venky Shankar
8beaa5e5db
Merge pull request #46153 from lxbsz/wip-54411-1
client: force send global open_files/metadata metrics

 Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-05-14 15:11:17 +05:30
J. Eric Ivancich
8efea3e894 rgw: remove potentially conficting definition of dout_subsys
dout_subsys should strictly be defined in .cc files. There was a
definition of dout_subsys in rgw_log.h, which is included in a variety
of .cc files due to transitive includes. When a subsystem wants a
conflicting definition, a compiler warning is then generated due to
the redefinition of dout_subsys.

The definition is removed from rgw_log.h and follow-on fixes are made.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2022-05-14 00:33:26 -04:00
Samuel Just
8dc7cb108e
Merge pull request #46258 from xxhdx1985126/wip-backref-minor-bug-fixes
crimson/os/seastore/cache: backref buffer minor bug fix

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-05-13 12:25:44 -07:00
Adam King
361c71c732 cephadm: fix adoption of osds from custom name clusters
Fixes: https://tracker.ceph.com/issues/55654

Signed-off-by: Adam King <adking@redhat.com>
2022-05-13 12:55:10 -04:00
zdover23
ecb948ab1a
Merge pull request #46154 from zdover23/wip-doc-2022-04-14-dev-guide-basic-workflow
doc/dev: update basic-workflow.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-05-14 01:40:19 +10:00
John Mulligan
4904b02f9f .github: ensure object_format.py is labeled the same as mgr_util.py
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-05-13 10:42:00 -04:00
John Mulligan
1ecbffbea5 pybind/mgr: include object_format.py in CMakeLists.txt for build
Because ceph uses CMake for building python packages too.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-05-13 10:42:00 -04:00
John Mulligan
d6c31681cf pybind/mgr: add short guide to the object_format.py docstring
Add a short-ish guide to the use of the object_format module's Responder
and other types.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-05-13 10:42:00 -04:00
John Mulligan
55ee8a3163 pybind/mgr: add test cases for ErrorResponse exception type
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-05-13 10:42:00 -04:00
John Mulligan
777814d594 pybind/mgr: add a wrapper exception for use with Responder
In order to best get a "real" exception converted to something
that can be cleanly sent to the mgr response, this new exception
type can be invoked directly, or with the wrap method to automatically
pull as many properties as possibly from the original exception.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-05-13 10:42:00 -04:00
John Mulligan
1800f30f04 pybind/mgr: add tests to verify Responder decorator behavior
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-05-13 10:42:00 -04:00
John Mulligan
efee0d7ebc pybind/mgr: add format arg to Responder's extra args
To ensure that the Responder can make use of a user provided `--format=`
parameter even if the programmer doesn't explicitly add one to the
args of an endpoint function we set the `extra_args` attribute on
our wrapper function so that CLICommand can later extract it.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-05-13 10:42:00 -04:00
John Mulligan
2b22297f56 pybind/mgr: enhance CLICommand to fetch extra args from wrapped funcs
Previously, the CLICommand decorator "assumed" that the decorator was
applied directly to a mgr module api endpoint function. Now that we plan
on adding the Responder decorator into the mix we need a way of
properly fetching the arguments of the endpoint function. In addition,
the decorator itself needs to provide extra arguments to the mgr
(in cases where the endpoint function doesn't explicitly ask for it).
Thus we add a helper function to find the endpoint function when
wrapped as well as extract extra arguments when "walking" the stack
of __wrapped__ functions.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-05-13 10:42:00 -04:00
John Mulligan
8c7876146b pybind/mgr: change to private _load_func_metadata classmethod
The load_func_metadata had exactly one use in the codebase, the
store_func_metadata method. It was also a staticmethod that referred to
a property of it's class.

This change makes the function "private" by renaming it to
_load_func_metadata, removing it from the public "surface area" of the
type. It changes it to a classmethod so that it would work correctly
if used from a subclass of CLICommand.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-05-13 10:42:00 -04:00
John Mulligan
76492408dc pybind/mgr: add test cases for Responder type
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-05-13 10:42:00 -04:00