Commit Graph

122514 Commits

Author SHA1 Message Date
Kefu Chai
aa50d14b61 common/optinos: extract crimson options out
prepare for the change to split the options by services

in future, osd will have its own osd.yaml.in, while crimson will consume
both osd.yaml.in and crimson.yaml.in.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-21 13:17:17 +08:00
Kefu Chai
52a5655296 doc/rados/configuration/mon-config-ref: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-21 12:37:03 +08:00
Kefu Chai
4481f4ac75 doc/rados/configuration/general-config-ref: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-21 12:33:19 +08:00
Kefu Chai
4a4dc9f5a1 doc/rados/configuration/osd-config-ref: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-21 12:33:19 +08:00
Kefu Chai
c3c2da4e32
Merge pull request #40915 from rzarzynski/wip-crimson-backtrace-3
crimson: make backtraces more human-readable with boost::stacktrace and addr2line

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-21 11:54:32 +08:00
Kefu Chai
f2851d62e7
Merge pull request #40939 from tchaikov/wip-doc-confval
doc/rados/configuration/osd-config-ref:  use confval directive

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-21 10:15:46 +08:00
Venky Shankar
18deb52f5d test: adjust mirroring test to use changed daemon status JSON
Fixes: http://tracker.ceph.com/issues/50266
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-04-20 21:18:54 -04:00
Venky Shankar
3c600928c2 doc: adjust daemon status section with changed JSON
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-04-20 21:18:54 -04:00
Venky Shankar
06a248b30f pybind/mirroring: sanitize daemon status JSON
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-04-20 21:18:54 -04:00
Kalpesh
75060d50c2 src/test: Removing unrecognized option from bootstrap file
Removing '--distribute' option from a command in bootstrap file which seemed to be the reason of failure in:
http://qa-proxy.ceph.com/teuthology/dang-2021-04-19_12:28:43-rgw-wip-dang-zipper-sysobj-distro-basic-smithi/6059513/teuthology.log

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2021-04-21 02:36:22 +05:30
Patrick Donnelly
fab5c0fe4f
Merge PR #39742 into master
* refs/pull/39742/head:
	client: make Inode to inherit from RefCountedObject
	client: minor cleanup to Inode class to simplify the code
	client: minor cleanup to Inode related code

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-20 14:01:32 -07:00
Adam King
eebb842d04 mgr/cephadm: don't remove daemons from hosts in maintenance or offline mode
Fixes: https://tracker.ceph.com/issues/50364

Signed-off-by: Adam King <adking@redhat.com>
2021-04-20 14:44:06 -04:00
Adam King
56641742a7 mgr/cephadm: default status for daemons on maintenance hosts to stopped
we do not refresh the daemons on maintenance hosts so our info
on them is always outdated. Therefore, the best option is to
assume maintenance mode is working correctly and the daemons
are stopped

Signed-off-by: Adam King <adking@redhat.com>
2021-04-20 14:43:55 -04:00
Daniel Gryniewicz
4836b06358
Merge pull request #40191 from dang/wip-dang-zipper-sysobj
RGW Zipper - Remove rgw_pool from API
2021-04-20 14:19:47 -04:00
Samuel Just
851dd14f75 crimson/os/seastore/cache: factor out remove_from_dirty
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-04-20 10:41:44 -07:00
Sage Weil
ba135842e3 mgr/cephadm: fix 'orch ls' count to reflect schedulable hosts
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-20 12:10:13 -04:00
Sage Weil
f260c48f72 mgr/cephadm: do not schedule on _no_schedule hosts
Reuse and rename existing helper to return schedulable hosts.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-20 12:10:06 -04:00
Kefu Chai
d72fb1f3e6 doc/rados/configuration/osd-config-ref: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-20 22:49:20 +08:00
Lee Yarwood
79fca7aaf1 pybind/rados: Document that timeout arg is ignored by connect
While this argument is accepted it has always been ignored. To avoid
confusion it should at least be called out in the documentation.

Signed-off-by: Lee Yarwood <lyarwood@redhat.com>
2021-04-20 11:02:57 +01:00
Ilya Dryomov
477b705fe7
Merge pull request #40928 from idryomov/wip-gid-reclaim-notes
doc: 14.2.20, 15.2.11 and 16.2.1 releases and notes (CVE-2021-20288)

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2021-04-20 10:46:29 +02:00
Ilya Dryomov
a2b1c69981 doc/releases/index: update for 14.2.20, 15.2.11 and 16.2.1
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-20 10:05:28 +02:00
Kefu Chai
0be78da368
Merge pull request #40877 from mgfritch/doc-rgw-python3-print
doc/rgw: update to python3 print syntax

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-20 15:02:49 +08:00
Samuel Just
9b5d2042ee crimson/os/seastore/cache: swap dirty_from users to get_dirty_from()
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-04-19 23:51:18 -07:00
Samuel Just
2ce4484312 crimson/os/seastore: route all transaction creations through cache
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-04-19 23:51:18 -07:00
Samuel Just
5c1ae5bcd2
Merge pull request #40846 from athanatos/sjust/wip-object-data
seastore: initial object data support

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2021-04-19 23:50:22 -07:00
Kefu Chai
20bab70a08
Merge pull request #40911 from tchaikov/wip-doc-confval
doc/rados/configuration/auth-config-ref: drop section of keyrings

Reviewed-by: Sage Weil <sage@redhat.com>
2021-04-20 08:03:48 +08:00
Abutalib Aghayev
389d8dec5c os/bluestore: Removed redundant logging.
Signed-off-by: Abutalib Aghayev <agayev@psu.edu>
2021-04-19 18:30:15 -04:00
Zac Dover
4106e331fb doc/cephadm: rewrite "advanced osd s. specs"
This PR improves the readbility and elegance of
the "Advanced OSD Service Specifications" section
of the OSD chapter of the cephadm guide.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-04-20 02:03:30 +10:00
Radoslaw Zarzynski
d3dcf510c3 crimson/common: do backtrace via boost::stackstrace and addr2line.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-19 15:24:04 +00:00
Radoslaw Zarzynski
33cc480d11 crimson/common: don't use Seastar's handle_signal() for fatal signals.
The `handle_signal()` way requires going through the reactor, and
thus is unsuitable for situations when it's no longer operational.
SIGSEGV generated as a result of actual fault (not `kill()`) is
the intended audience of this change.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-19 15:24:04 +00:00
Radoslaw Zarzynski
7dec410192 crimson/common: let's dump the core on fatal signal.
Removing the call to engine's `exit()` should allow the singnal
handler to exit. In the case of `SIGSEGV` this would return back
to the problematic instruction, and thus retrigger the fault.
As our handler already restores `SIG_DFL`, it's expected to get
a core dump.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-19 15:24:04 +00:00
Kefu Chai
5a6e58e162 crimson/osd: handle fatal signals
seastar sets the signal handler for SIGSEGV and SIGABRT, and its signal
handler prints the stacktrace, but the the stack frames are adresses,
which are not human readable without the help of addr2line.

since crimson is linked with -rdynamic option, we have the symbols added
to the dynamic symbol table already. let print out the symbolized
addresses instead using our own stacktrace utility.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 6e26243b6db49bb9813f8b8aeade68da07dc6065)

 Conflicts:
	src/crimson/osd/main.cc
2021-04-19 15:24:04 +00:00
Sage Weil
d51d80b323 msgr/async: fix unsafe access in unregister_conn()
We were looking at anon_conns and accepting_conns without holding
the lock (deleted_lock is not sufficient).

Drop this test, and move the decrements:

- inc when we add to conns or anon_conns (no changes there)
- dec when we remove from deleted_conns (several different paths!)

Fixes: https://tracker.ceph.com/issues/49237
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-19 09:26:30 -05:00
Deepika Upadhyay
ec2a402f55 qa/tasks/cephadm: fix ctx archive check for teuthology
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-04-19 19:48:47 +05:30
Mykola Golub
936898b8ca os/FileStore: don't propagate split/merge error to "create"/"remove"
Either ignore or terminate, otherwise it may confuse the
"create"/"remove" caller.

Fixes: https://tracker.ceph.com/issues/50395
Signed-off-by: Mykola Golub <mgolub@suse.com>
2021-04-19 15:17:42 +01:00
Kefu Chai
2041207674 doc/man/8/ceph-authtool: fix the indent of option
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-19 22:09:52 +08:00
Ernesto Puerta
b9575dc757
Merge pull request #40899 from malcolmholmes/malcolmholmes/fix-json-dashboard-error
mgr/Dashboard: Remove erroneous elements in hosts-overview Grafana dashboard

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: p-se <NOT@FOUND>
2021-04-19 16:09:39 +02:00
Kefu Chai
e63a6c6a26
Merge pull request #40898 from rzarzynski/wip-crimson-only-mgrclt-noconn-report
crimson/mgr: don't report if there is no connection available.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-19 22:06:27 +08:00
Kefu Chai
8e0158a047 doc/rados/configuration/mon-config-ref: use confval directive
for defining options

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-19 22:03:45 +08:00
Kefu Chai
e5722a46e1 doc/rados/configuration/auth-config-ref: drop section of keyrings
as per Sage, the caps are out of date (should be based on profiles) and
the keyring locations aren't useful information

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-19 21:45:07 +08:00
Kefu Chai
366a1263bb
Merge pull request #40897 from tchaikov/wip-doc-more-conf-vals
doc/rados/configuration: use confval directive to define options.

Reviewed-by: Reviewed-by: Sage Weil <sage@redhat.com>
2021-04-19 21:43:43 +08:00
Daniel Gryniewicz
cbbe8e8680 RGW Zipper - Remove rgw_pool/sysobj from API
rgw_pool and sysobj are part of the RADOS backend, and do not belong in
the API.  Instead, pull the objects using them into the API.  These are:
RGWOIDCProvider, RGWRole, and a new object LuaScript.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2021-04-19 09:40:34 -04:00
Ilya Dryomov
bd87bf3e30
Merge pull request #40905 from idryomov/wip-rbd-kms-config-map-doc
doc/rbd/rbd-kubernetes: update for recent ceph-csi versions

Reviewed-by: Madhu Rajanna <madhupr007@gmail.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2021-04-19 15:40:21 +02:00
zdover23
df10995f7a
Merge pull request #40378 from zdover23/wip-doc-cephadm-osd-declarative-state-rewrite-2021-Mar-25
doc/cephadm: rewrite "delcarative state" in osd.rst

Reviewed-by: Sage Weil <sweil@redhat.com>
2021-04-19 23:03:21 +10:00
Sage Weil
56ade4769c Merge PR #40817 into master
* refs/pull/40817/head:
	mgr/MgrStandby: fix config observer
	mgr/MgrStandby: respawn if mgr_standby_modules changes
	qa/tasks/mgr/test_dashboard: skip test_standby if mgr_standby_modules=false
	qa/suites/rados/cephadm/smoke-*: use cephadm.wait_for_service
	qa/suites/rados/cephadm/smoke-singlehost: test --single-host-defaults
	cephadm: add --single-host-defaults option to bootstrap
	mgr/cephadm: allow mgr colo if mgr_standby_modules=false
	mgr/MgrStandby: add mgr_standby_modules option

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-04-19 08:30:42 -04:00
Sage Weil
139ff3adb1 Merge PR #40893 into master
* refs/pull/40893/head:
	mgr/cephadm: don't list non ceph daemons as needing upgrade in upgrade check

Reviewed-by: Sage Weil <sage@redhat.com>
2021-04-19 08:30:11 -04:00
Matt Benjamin
b040f25b71
Merge pull request #37730 from thotz/rgwkmsvaultsslsupport
rgw: extending existing ssl support for vault KMS
2021-04-19 07:37:29 -04:00
Kefu Chai
149ad529c4
Merge pull request #40881 from tchaikov/wip-50393
qa/workunits/mon/test_mon_config_key: use subprocess.run() instead of…

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-19 18:54:40 +08:00
Kefu Chai
1392b40ba2 osd/ReplicatedBackend: cast variable to unsigned before comparing
after the yaml-to-cxx migration, osd_deep_scrub_stride is an OPT_SIZE,
and is hence represented with an uint64. so we need to cast `r` to
uint64_t before comparing it with this setting for silencing GCC
warning.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-19 18:04:47 +08:00
Ilya Dryomov
6f77102706 doc/rbd/rbd-kubernetes: expose volume expansion functionality
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-19 11:52:23 +02:00