Commit Graph

114246 Commits

Author SHA1 Message Date
Venky Shankar
9a76c01536 mgr/volumes: make subvolume_v2::_is_retained() object property
... and drop the leading underscore.

Fixes: https://tracker.ceph.com/issues/47154
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-08-26 13:40:11 -04:00
Kefu Chai
8db888ea42
Merge pull request #36521 from tchaikov/wip-rgw-optional
rgw: hold reloader using unique_ptr

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-08-23 02:02:23 +08:00
Mykola Golub
f919b9f2b6
Merge pull request #36707 from dillaman/wip-47007
rbd-mirror: peer setup can still race and fail creation of peer 

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-08-22 13:12:05 +03:00
Mykola Golub
5f90adc450
Merge pull request #36471 from dillaman/wip-41394
librbd: using migration abort can result in the loss of data

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-08-22 13:11:19 +03:00
Mykola Golub
88b11a7d8e
Merge pull request #36380 from dillaman/wip-46754
rbd: retrieve global config overrides from the MONs

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-08-22 13:10:17 +03:00
Kefu Chai
12212a40db
Merge pull request #36751 from tchaikov/wip-redirect-stderr
qa/tasks/ceph: create a log file before redirecting to it

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-08-22 16:59:14 +08:00
Kefu Chai
bf045f5400
Merge pull request #36696 from tchaikov/wip-cmake-boost-zlib
cmake: link against ZLIB if statically linked against Boost

Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-08-22 12:49:15 +08:00
Kefu Chai
885779d4a6
Merge pull request #36710 from tchaikov/wip-ceph-pypath
ceph: correct additional paths added to sys.path

Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-08-22 12:48:34 +08:00
Kefu Chai
72eb53d0bc
Merge pull request #36722 from tchaikov/wip-test-pybind
test/pybind: label test_rados tests with attributes

Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-08-22 12:30:20 +08:00
Kefu Chai
e6eabeeeb2 qa/tasks/ceph: create a log file before redirecting to it
as it is shell who interprets ">>" and redirect the stderr to given
file, but the shell process is launched by ubuntu:ububunt without using
sudo, so the command fails with "Permission denied" failure. to address
this issue, in this change, a file with proper priviledges is created
beforehand using `install`, so shell is able to write to it.

also, instead of creating this file in `maybe_redirect_stderr()`, it
returns the command to create the log file.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-22 11:33:12 +08:00
Patrick Donnelly
b092bdac82
Merge PR #36560 into master
* refs/pull/36560/head:
	client: choose a random replica mds to send the request

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:44:46 -07:00
Patrick Donnelly
2b66fa1fe9
Merge PR #36681 into master
* refs/pull/36681/head:
	mds: don't track change of config 'mds_replay_unsafe_with_closed_session'
	mds: fix 'forward loop' when forward_all_requests_to_auth is set

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:44:06 -07:00
Patrick Donnelly
decf2ebee8
Merge PR #36673 into master
* refs/pull/36673/head:
	mds: don't recover files after normal session close

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:42:50 -07:00
Patrick Donnelly
aa150dc35f
Merge PR #36632 into master
* refs/pull/36632/head:
	mds: standy-replay mds remained in the "resolve" state after restart the active mds

Reviewed-by: Zheng Yan <zyan@redhat.com>
2020-08-21 18:41:35 -07:00
Patrick Donnelly
3fb857cd04
Merge PR #36131 into master
* refs/pull/36131/head:
	doc: document cephfs mirroring dev work
	test: add tests for `ceph fs mirror` family of commands
	mds: track filesystem mirror peers in fsmap

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:40:42 -07:00
Patrick Donnelly
beb0d00c8d
Merge PR #36459 into master
* refs/pull/36459/head:
	mds: dump granular cap info in mds_sessions
	common: fix validate type CephBool cause 'invalid command json'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:39:01 -07:00
Patrick Donnelly
1f4c23efad
Merge PR #36598 into master
* refs/pull/36598/head:
	mds: drop decoding as MDSMap in FSMap::decode()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:38:09 -07:00
Patrick Donnelly
52f9eab18b
Merge PR #36687 into master
* refs/pull/36687/head:
	client: use ccap_string to show caps in more user friendly

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:37:21 -07:00
Patrick Donnelly
03406f0e25
Merge PR #36697 into master
* refs/pull/36697/head:
	messages,mds: Fix decoding of enum types on big-endian systems

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:35:56 -07:00
Patrick Donnelly
3228b19bda
Merge PR #36472 into master
* refs/pull/36472/head:
	qa/workunits/fs: add test for subvolume
	mds: don't move inode with nlink > 1 to global snaprealm if it's in subvolume
	mds: disallow hardlink across subvolume
	mds: disallow across subvolume rename
	mds: disallow creating snapshot on descendent directory of subvolume
	mds: add vxattr that marks/clears subvolume flag

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 16:12:32 -07:00
Kefu Chai
c8bfc66f2d
Merge pull request #35789 from Reperator/fix-ceph-objectstore-tool-docs
doc/man/8/ceph-objectstore-tool.rst: remove duplicate lines

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-08-21 18:31:20 +08:00
Kefu Chai
344d964b94
Merge pull request #36742 from hulksmaaash/patch-2
doc/rados: remove statement that ISA plugin only works on Intel chips

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-08-21 18:26:46 +08:00
Sebastian Wagner
cb529acaf4
Merge pull request #36496 from Daniel-Pivonka/cephadm-44926
mgr/cephadm: rgw update period after realm, zone creation

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-21 11:40:17 +02:00
Sebastian Wagner
95042ecce8
Merge pull request #36716 from jmolmo/dashboard_ports_2
cephadm: Allow users to use a custom dashboard ssl port

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-21 11:39:52 +02:00
Lenz Grimmer
5b8d52e9d7
Merge pull request #36721 from ceph/47036-sass-colors-typescript
mgr/dashboard: use SASS colors in TypeScript

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
2020-08-21 11:12:33 +02:00
Lenz Grimmer
218d2df473
Merge pull request #36735 from rhcs-dashboard/fix-this-week-endpoint
mgr/dashboard: remove "This week/month/year" and "Today" time stamps of Grafana in dashboard

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2020-08-21 11:10:18 +02:00
Kefu Chai
d8bc9c7b09 test/pybind: remove object for testing after done with it
* add vertical spacing for better readability
* remove object for testing after done with it

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-21 16:41:31 +08:00
Kefu Chai
90dbe6b3ba test/pybind: label test_rados tests with attributes
so we can pick the tests selectively. currently, some features are not
supported by crimson. but we will cover more and more of them. so
attaching different labels to tests cases helps us to run these tests
selectively.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-21 16:41:31 +08:00
Kefu Chai
6ad87dbbdc qa/workunits/rados: pass options down to test_rados.py
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-21 16:41:31 +08:00
Sebastian Wagner
fc9da48226
Merge pull request #36740 from varshar16/wip-fix-nfs-bug-47009
qa/tasks/nfs: Change the mds name and delete created nfs clusters

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.
2020-08-21 09:58:12 +02:00
Kefu Chai
2e029fa331
Merge pull request #36694 from shun-s/fix-linger-op-stray
osdc: fix lingerOp stray

Reviewed-By: Josh Durgin <jdurgin@redhat.com>
2020-08-21 15:33:14 +08:00
Avan Thakkar
f76d56c45f mgr/dashboard: remove "This week/month/year" and "Today" time stamps of Grafana in dashboard
Fixes: https://tracker.ceph.com/issues/47049

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2020-08-21 12:37:35 +05:30
Kefu Chai
e2031418d4
Merge pull request #36465 from majianpeng/bluefs-avoid-flush-much-data
os/bluestore/BlueRocksEnv: Avoid flushing too much data at once.

Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2020-08-21 09:57:27 +08:00
Kefu Chai
268cbe5bb7
Merge pull request #36593 from gregsfortytwo/wip-46914
mon: mark pgtemp messages as no_reply more consistenly in preprocess_…

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-08-21 09:53:25 +08:00
Kefu Chai
03891c82c2
Merge pull request #36675 from tchaikov/wip-fix-option-typo
common/options: fix a typo in option description

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-08-21 09:52:40 +08:00
Kefu Chai
565f6ed3f1
Merge pull request #35613 from changchengx/str_list
use for_each_substr to avoid redundant operation by calling get_str_set

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-08-21 09:51:28 +08:00
Kefu Chai
f2b13ff87c
Merge pull request #36573 from changchengx/osdmonitor
mon: use string_veiw to glimpse string and remove unused variable

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-08-21 09:50:11 +08:00
Kefu Chai
ec73fea99e
Merge pull request #36680 from tchaikov/wip-mgr-disk-predict
pybind/mgr/diskprediction_cloud: remove mgr-diskprediction-cloud

Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-By: Zac Dover <zac.dover@gmail.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-08-21 09:46:54 +08:00
Kefu Chai
e9e4af403c
Merge pull request #36534 from changchengx/formatter
common/Formatter: don't construct string if string_view work

Reviewed-By: Kefu Chai <kchai@redhat.com>
2020-08-21 09:45:03 +08:00
Kefu Chai
afaf5913ac
Merge pull request #36420 from qwren/qat-compressor
compressor: fix compile error for QAT

Reviewed-By: Kefu Chai <kchai@redhat.com>
2020-08-21 09:42:18 +08:00
Robbie Williamson
ccee814ffc doc/rados: remove statement that ISA plugin only works on Intel chips
ISA-L supports aarch64 (Arm), not just Intel processors, as does Ceph (see #32171).

Signed-off-by: Robbie Williamson <robbie.williamson@arm.com>
2020-08-21 08:32:53 +08:00
Greg Farnum
73a014fc2c mon: mark pgtemp messages as no_reply more consistently in preprocess_pgtemp
If a message is forwarded, it's conceivable the leader's and peon's evaluation
will disagree about whether the message is useful or not, which could result
in the leader ignoring it and the peon having a dangling forwarded message.
Fix this by marking the op as no_reply whenever ignoring it.

Fixes:  https://tracker.ceph.com/issues/46914

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2020-08-20 19:31:52 +00:00
Varsha Rao
5c4e659067 qa/tasks/nfs: Instead of 'orch ls' use 'orch ps'
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-08-20 15:18:31 +00:00
Jason Dillaman
34f539d8af rbd: delay parsing of default kernel map options
It now connects to the cluster to retrieve any global config
overrides before processing the default map options.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-08-20 10:40:38 -04:00
Jason Dillaman
1527dcfa6d rbd: 'list' action should connect to cluster before querying config
This will allow global config overrides for the max concurrent ops to
be applied prior to listing the images.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-08-20 10:40:38 -04:00
Jason Dillaman
596d892e60 rbd: drop querying of RBD default features
These will be computed internally by librbd using any potential
global configuration overrides.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-08-20 10:40:38 -04:00
Jason Dillaman
96f05a7956 rbd: delay determination of default pool name
Wait until after the CLI has connected to the cluster and therefore
has received all global configuration overrides.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-08-20 10:40:37 -04:00
Jason Dillaman
f6c6887fe7 rbd: let librados finish initializing the global context
librados will retrieve a bootstrap config update from the MONs
after connecting and then finish initializing the context. In
general, non-primitive config options cannot be updated after
initialization is complete. This prevents the rbd CLI from
supporting non-primitive config overrides from the MON.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-08-20 10:35:30 -04:00
Jason Dillaman
313aeaa55d mon/MonClient: apply MON config before finishing bootstrap
In general, non-primitive config options cannot be updated after
the service threads have been marked as running. In librados, this
happens after the MonClient bootstrap process. However, the configs
received from the MON were applied in a separate thread which can
race with librados marking the service threads as running.

Now the received MON configs will be applied within the context of
the bootstrap function call instead of deferring to a separate
thread.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-08-20 10:35:29 -04:00
Varsha Rao
572f0aeceb qa/suites/rados/test_orch_cli: Change mds name
As MDS name should not start with numeric digit.

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-08-20 14:28:57 +00:00