Commit Graph

122166 Commits

Author SHA1 Message Date
Ilya Dryomov
2656448617 doc/rbd/rbd-kubernetes: mention KMS config map
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-19 11:52:23 +02:00
Sage Weil
4cfc002cb7 Merge PR #40870 into master
* refs/pull/40870/head:
	auth/cephx: make KeyServer::build_session_auth_info() less confusing
	auth/cephx: cap ticket validity by expiration of "next" key
	auth/cephx: drop redundant KeyServerData::get_service_secret() overload

Reviewed-by: Sage Weil <sage@redhat.com>
2021-04-16 08:14:28 -04:00
Sage Weil
ae2cc14912 Merge PR #40711 into master
* refs/pull/40711/head:
	mgr/cephadm: fix nfs-rgw stray daemon

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-04-16 08:01:15 -04:00
Ilya Dryomov
af3233864a
Merge pull request #40883 from tchaikov/wip-option-auth_mon_ticket_ttl
common/options/global: correct default of auth_mon_ticket_ttl

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-16 10:43:59 +02:00
Kefu Chai
75e07f8638 common/options/global: correct default of auth_mon_ticket_ttl
in 5505fc0051, during rebasing against
master it was set to 12_hr by accident.

this setting was changed to 72_hr in
522a52e6c2

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-16 13:41:27 +08:00
Kefu Chai
03f47d0dfe
Merge pull request #40319 from cypherean/skip_ssh_patch
mgr/cephadm: skip-ssh flag enables cephadm mgr module

Reviewed-by: Adam King <adking@redhat.com>
2021-04-16 12:46:36 +08:00
Kefu Chai
74be7fa1c9
Merge pull request #40858 from adk3798/upgrade-fail
mgr/cephadm: report exception during upgrade in upgrade status

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-04-16 12:44:48 +08:00
Kefu Chai
d54605c7e6
Merge pull request #40837 from liewegas/cephadm-qa-shorten-thrash
qa/suites/rados/thrash: shorten radosbench

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-04-16 12:42:05 +08:00
Kefu Chai
dd0e21a52e
Merge pull request #40860 from liewegas/cephadm-cleanup-ha-rgw
mgr/cephadm: remove old haproxy and keepalived templates

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Adam King <adking@redhat.com>
2021-04-16 12:41:05 +08:00
Kefu Chai
11b7c258bb
Merge pull request #40552 from Daniel-Pivonka/cephadmverifylistsinspecjson
mgr/orchestrator: validate lists in spec jsons

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-04-16 12:30:11 +08:00
Kefu Chai
11283aa049
Merge pull request #40841 from tchaikov/wip-yamlize-legacy-option
common: generate legacy_config_opts.h from .yaml.in files

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-04-16 12:28:56 +08:00
Patrick Donnelly
e25d70de21
Merge PR #40828 into master
* refs/pull/40828/head:
	mds: set fscrypt flag on create if xattr buffer has an encryption context

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-04-15 21:08:21 -07:00
Patrick Donnelly
a8205b58bb
Merge PR #40741 into master
* refs/pull/40741/head:
	mgr/volumes: remove unused semicolon

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-15 21:07:08 -07:00
Patrick Donnelly
bd7db0c878
Merge PR #40539 into master
* refs/pull/40539/head:
	cephfs-top: set the cursor to be invisible
	cephfs-top: self-adapt the display according the window size
	cephfs-top: use the default window object from curses.wrapper()
	cephfs-top: improve the output

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-04-15 21:06:31 -07:00
Patrick Donnelly
2a81253141
Merge PR #40412 into master
* refs/pull/40412/head:
	vstart_runner: reuse code in LocalRemoteProcess

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-15 21:05:51 -07:00
Patrick Donnelly
3a30edf3de
Merge PR #39660 into master
* refs/pull/39660/head:
	qa: Update the mdsmap schema in mgr/dashboard/test_health.py
	doc: add lsflags command to Administrative Commands document
	qa: test fs lsflags command
	mon: add command to print fs flags
	mds: print each flag value

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-15 21:03:19 -07:00
Kefu Chai
9caffaeb7d
Merge pull request #40824 from batrick/i50304
pybind/mgr/devicehealth: fix command name

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
2021-04-16 10:10:16 +08:00
Kefu Chai
e80365b8bf
Merge pull request #40829 from batrick/i50307
SimpleRADOSStriper: use debug_cephsqlite

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-16 09:55:12 +08:00
Kefu Chai
4b3bcdf627
Merge pull request #40859 from wjwithagen/wjw-fix-make-rook-optional
cmake: Add an option for enabling rook client in dashboard

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-16 09:53:21 +08:00
Kefu Chai
b3e9c97ff4
Merge pull request #40876 from tchaikov/wip-top-bar-spacing
doc/_theme: increasing the padding in navigation bar

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-16 08:25:13 +08:00
Daniel Pivonka
f94e0baf9e mgr/cephadm: fix nfs-rgw stray daemon
nfs-rgw registers under a gid cephadm needs covert that to its known name during the stray daemon check

Signed-off-by: Daniel Pivonka <dpivonka@redhat.com>
2021-04-15 16:47:24 -04:00
Mykola Golub
dc94eeddc1
Merge pull request #40718 from CongMinYin/fix-dead-lock-in-pwl
librbd/cache/pwl: Fix dead lock issue when pwl initialization failed

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-04-15 21:05:00 +03:00
Kefu Chai
6711b735f1 doc/_theme: increasing the padding in navigation bar
otherwise the "home-icon" and the right most "Edit on GitHub" are displayed
right next to the left and right borders of the top-bar.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-16 00:57:28 +08:00
Kefu Chai
f5bc82e076
Merge pull request #40875 from batrick/i50378
test: bump DecayCounter.steady acceptable error

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-16 00:25:57 +08:00
Kefu Chai
4394f75fbd
Merge pull request #40847 from tchaikov/wip-doc-build
admin/build-doc: use htmldir builder for livehtml

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-15 23:06:15 +08:00
Patrick Donnelly
2293099bdf
Merge PR #40845 into master
* refs/pull/40845/head:
	systemd: remove `ProtectClock=true` for `ceph-osd@.service`

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-15 07:30:11 -07:00
Kefu Chai
e3459154f6
Merge pull request #40843 from tchaikov/wip-cmake-rgw-civetweb.h
cmake: update civetweb.h on demand

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-04-15 22:08:43 +08:00
Patrick Donnelly
9a369ef119
test: bump DecayCounter.steady acceptable error
The test is often run on heavily loaded machines which will effect the
precision of the test.

Fixes: https://tracker.ceph.com/issues/50378
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-15 06:58:44 -07:00
Kefu Chai
5df2530fc6
Merge pull request #40873 from tchaikov/wip-50374
vstart.sh: disable "auth_allow_insecure_global_id_reclaim"

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-15 21:33:12 +08:00
Kefu Chai
c945f59d78
Merge pull request #40867 from tchaikov/wip-50339
test/cls_cas: allow multi hobjects tracked by cls_cas

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: Sam Just <sjust@redhat.com>
2021-04-15 21:24:38 +08:00
Ilya Dryomov
6f12cd3688 auth/cephx: make KeyServer::build_session_auth_info() less confusing
The second KeyServer::build_session_auth_info() overload is used only
by the monitor, for mon <-> mon authentication.  The monitor passes in
service_secret (mon secret) and secret_id (-1).  The TTL is irrelevant
because there is no rotation.

However the signature doesn't make it obvious.  Clarify that
service_secret and secret_id are input parameters and info is the only
output parameter.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-15 15:20:59 +02:00
Kefu Chai
77a8376d07 vstart.sh: disable "auth_allow_insecure_global_id_reclaim"
to silence the health warning of "mons are allowing insecure global_id
reclaim", which prevents the cluster from being active+clean. couple
tests are expecting a warning free cluster before they starts.

as this option is enabled by default for appeasing the old clients, but when it
comes to most of upstream testing, we can just disable it.

Fixes: https://tracker.ceph.com/issues/50374
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-15 21:10:36 +08:00
Adam King
6119294b28 mgr/cephadm: report exception during upgrade in upgrade status
Fixes: https://tracker.ceph.com/issues/50361

Signed-off-by: Adam King <adking@redhat.com>
2021-04-15 08:07:57 -04:00
Ilya Dryomov
11b72cce08
Merge pull request #40196 from ceph/wip-15210-notes
doc/releases/octopus.rst: 15.2.10 Release Notes

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-15 13:36:22 +02:00
Ilya Dryomov
2e445fc888 doc/releases/releases: add 15.2.10 release
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-15 13:22:22 +02:00
David Galloway
aa4a53a3c1 doc/releases/octopus.rst: 15.2.10 Release Notes
Signed-off-by: David Galloway <dgallowa@redhat.com>
2021-04-15 12:57:44 +02:00
Ilya Dryomov
370c9b1397 auth/cephx: cap ticket validity by expiration of "next" key
If auth_mon_ticket_ttl is increased by several times as done in
commit 522a52e6c2 ("auth/cephx: rotate auth tickets less often"),
active clients eventually get stuck because the monitor sends out an
auth ticket with a bogus validity.  The ticket is secured with the
"current" secret that is scheduled to expire according to the old TTL,
but the validity of the ticket is set to the new TTL.  As a result,
the client simply doesn't attempt to renew, letting the secrets rotate
potentially more than once.  When that happens, the client first hits
auth authorizer errors as it tries to renew service tickets and when
it finally gets to renewing the auth ticket, it hits the insecure
global_id reclaim wall.

Cap TTL by expiration of "next" key -- the "current" key may be
milliseconds away from expiration and still be used, legitimately.
Do it in KeyServerData alongside key rotation code and propagate the
capped TTL to the upper layer.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-15 11:51:38 +02:00
Ilya Dryomov
3078af7165 auth/cephx: drop redundant KeyServerData::get_service_secret() overload
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-15 11:18:51 +02:00
Kefu Chai
117838c91d
Merge pull request #40866 from hualongfeng/pmdk_in_dist
make-dist: add pmdk to dist tarball

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-15 16:43:28 +08:00
Willem Jan Withagen
1003f1ffee cmake: Add an option for enabling rook client in dashboard
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2021-04-15 10:40:17 +02:00
Xiubo Li
93cbe72521 cephfs-top: set the cursor to be invisible
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-04-15 16:27:57 +08:00
Xiubo Li
f224c3e03d cephfs-top: self-adapt the display according the window size
This will allow change the window size when the cephfs-top tool is
running and will adapt the display according to the real time window
size.

Fixes: https://tracker.ceph.com/issues/50091
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-04-15 16:27:57 +08:00
Xiubo Li
a8f3f44dc1 cephfs-top: use the default window object from curses.wrapper()
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-04-15 16:27:57 +08:00
Xiubo Li
0b4807aefb cephfs-top: improve the output
When adding more metrics the top line will be too long and maybe
wrapped with serval lines, which will make it hard to read.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2021-04-15 16:27:34 +08:00
Kefu Chai
7c9032a07f rgw: cast rgw_max_chunk_size to off_t
as the left-hand operator is promoted to off_t which is a signed
integer, while rgw_max_chunk_size will be an unsigned after the
yaml-to-cxx migration. so let's cast it to `off_t` before comparing
them.

the same applies to rgw_copy_obj_progress_every_bytes.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-15 13:34:33 +08:00
Kefu Chai
98f0617bd6 os/bluestore: do not cast min_alloc_size to int64_t
as the left-hand operator will be an unsigned integer after the
yaml-to-cxx migration.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-15 12:37:44 +08:00
Kefu Chai
5c243ca419 msg/Message: use an unsigned type for get_data_len()
to avoid warnings like:

../src/osd/PrimaryLogPG.cc:2123:27: warning: comparison of integer expressions of different signedness: ‘off_t’ {aka ‘long int’} and ‘uint64_t’ {aka ‘long unsigned int’} [-Wsign-compare]
 2123 |         m->get_data_len() > cct->_conf->osd_max_write_size << 20) {
      |         ~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

after change the size options' type to unsigned or uint64_t.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-15 12:37:44 +08:00
Kefu Chai
5505fc0051 common: generate legacy_config_opts.h from .yaml.in files
* add a setting named "with_legacy" to .yaml.in files, so
  each option with a true "with_legacy" will have an entry
  in legacy_config_opts.h.
* preserve the comments from legacy_config_opts.h to .yaml.in,
  some of them are solely for developers, but some of them are
  good reading for users as well. we can use them for "desc"
  field in a follow-up change.
* move common/legacy_config_opts.h to common/options/legacy_config_opts.h
  as legacy_config_opts.h is "closer" to the options directory
  than other sources files under src/common.
* update y2c.py to generate separate .h files which are in turn
  included by legacy_config_opts.h
* add a target named "legacy-option-headers", and let
  some targets depend on it so that these headers generated by
  y2c.py can be generated before the .cc files including them
  are compiled.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-15 12:37:43 +08:00
Kefu Chai
3c0aa2d70a rgw: use min<offset_t> instead of min()
as its parameters' types might not be identical. to be specific,
the 2nd parameter's type will be an unsigned one after the c++ => yaml
migration.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-15 12:33:23 +08:00
Kefu Chai
972bb2e1e6 test/cls_cas: allow multi hobjects tracked by cls_cas
in d2737fd41a, we started to use multiset
for tracking the references of hobject for snapshot support. as the same
hobject maps to multiple snapshots. and we don't want to consider
different snapshots as the same entry tracked by cls_cas.

but cls_cas.dup_get() still tries to verify that the `get` operation
is able to dedup the same referenced "source". but this does not apply
to "by_object" trunk ref type anymore.

since we cannot check/choose the chunk ref type used by OSD from the
client of the cls_cas, in this change, cls_cas.dup_get() is updated
to adapt the change solely for "by_object". otherwise we could skip
this test for "by_object" type and/or define another test for other
chunk ref types.

Fixes: https://tracker.ceph.com/issues/50339
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-15 11:36:43 +08:00