Commit Graph

114225 Commits

Author SHA1 Message Date
Kefu Chai
af93f56203 qa/workunits/rados: quote optional args
otherwise they will be escaped by shell

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-22 16:11:36 +08:00
Kefu Chai
56c86bbb23 qa/tasks/workunit: allow passing optional args to workunit
* add comment to _run_tests()
* use `os.path.commonpath()` instead using string matching directly
  for matching given workunit spec with executables.
* allow passing optional args to workunit

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-22 15:26:54 +08:00
Kefu Chai
72eb53d0bc
Merge pull request #36722 from tchaikov/wip-test-pybind
test/pybind: label test_rados tests with attributes

Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-08-22 12:30:20 +08:00
Patrick Donnelly
b092bdac82
Merge PR #36560 into master
* refs/pull/36560/head:
	client: choose a random replica mds to send the request

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:44:46 -07:00
Patrick Donnelly
2b66fa1fe9
Merge PR #36681 into master
* refs/pull/36681/head:
	mds: don't track change of config 'mds_replay_unsafe_with_closed_session'
	mds: fix 'forward loop' when forward_all_requests_to_auth is set

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:44:06 -07:00
Patrick Donnelly
decf2ebee8
Merge PR #36673 into master
* refs/pull/36673/head:
	mds: don't recover files after normal session close

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:42:50 -07:00
Patrick Donnelly
aa150dc35f
Merge PR #36632 into master
* refs/pull/36632/head:
	mds: standy-replay mds remained in the "resolve" state after restart the active mds

Reviewed-by: Zheng Yan <zyan@redhat.com>
2020-08-21 18:41:35 -07:00
Patrick Donnelly
3fb857cd04
Merge PR #36131 into master
* refs/pull/36131/head:
	doc: document cephfs mirroring dev work
	test: add tests for `ceph fs mirror` family of commands
	mds: track filesystem mirror peers in fsmap

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:40:42 -07:00
Patrick Donnelly
beb0d00c8d
Merge PR #36459 into master
* refs/pull/36459/head:
	mds: dump granular cap info in mds_sessions
	common: fix validate type CephBool cause 'invalid command json'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:39:01 -07:00
Patrick Donnelly
1f4c23efad
Merge PR #36598 into master
* refs/pull/36598/head:
	mds: drop decoding as MDSMap in FSMap::decode()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:38:09 -07:00
Patrick Donnelly
52f9eab18b
Merge PR #36687 into master
* refs/pull/36687/head:
	client: use ccap_string to show caps in more user friendly

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:37:21 -07:00
Patrick Donnelly
03406f0e25
Merge PR #36697 into master
* refs/pull/36697/head:
	messages,mds: Fix decoding of enum types on big-endian systems

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 18:35:56 -07:00
Patrick Donnelly
3228b19bda
Merge PR #36472 into master
* refs/pull/36472/head:
	qa/workunits/fs: add test for subvolume
	mds: don't move inode with nlink > 1 to global snaprealm if it's in subvolume
	mds: disallow hardlink across subvolume
	mds: disallow across subvolume rename
	mds: disallow creating snapshot on descendent directory of subvolume
	mds: add vxattr that marks/clears subvolume flag

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-21 16:12:32 -07:00
Kefu Chai
c8bfc66f2d
Merge pull request #35789 from Reperator/fix-ceph-objectstore-tool-docs
doc/man/8/ceph-objectstore-tool.rst: remove duplicate lines

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-08-21 18:31:20 +08:00
Kefu Chai
344d964b94
Merge pull request #36742 from hulksmaaash/patch-2
doc/rados: remove statement that ISA plugin only works on Intel chips

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-08-21 18:26:46 +08:00
Sebastian Wagner
cb529acaf4
Merge pull request #36496 from Daniel-Pivonka/cephadm-44926
mgr/cephadm: rgw update period after realm, zone creation

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-21 11:40:17 +02:00
Sebastian Wagner
95042ecce8
Merge pull request #36716 from jmolmo/dashboard_ports_2
cephadm: Allow users to use a custom dashboard ssl port

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-21 11:39:52 +02:00
Lenz Grimmer
5b8d52e9d7
Merge pull request #36721 from ceph/47036-sass-colors-typescript
mgr/dashboard: use SASS colors in TypeScript

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
2020-08-21 11:12:33 +02:00
Lenz Grimmer
218d2df473
Merge pull request #36735 from rhcs-dashboard/fix-this-week-endpoint
mgr/dashboard: remove "This week/month/year" and "Today" time stamps of Grafana in dashboard

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2020-08-21 11:10:18 +02:00
Kefu Chai
d8bc9c7b09 test/pybind: remove object for testing after done with it
* add vertical spacing for better readability
* remove object for testing after done with it

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-21 16:41:31 +08:00
Kefu Chai
90dbe6b3ba test/pybind: label test_rados tests with attributes
so we can pick the tests selectively. currently, some features are not
supported by crimson. but we will cover more and more of them. so
attaching different labels to tests cases helps us to run these tests
selectively.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-21 16:41:31 +08:00
Kefu Chai
6ad87dbbdc qa/workunits/rados: pass options down to test_rados.py
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-21 16:41:31 +08:00
Sebastian Wagner
fc9da48226
Merge pull request #36740 from varshar16/wip-fix-nfs-bug-47009
qa/tasks/nfs: Change the mds name and delete created nfs clusters

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.
2020-08-21 09:58:12 +02:00
Kefu Chai
2e029fa331
Merge pull request #36694 from shun-s/fix-linger-op-stray
osdc: fix lingerOp stray

Reviewed-By: Josh Durgin <jdurgin@redhat.com>
2020-08-21 15:33:14 +08:00
Avan Thakkar
f76d56c45f mgr/dashboard: remove "This week/month/year" and "Today" time stamps of Grafana in dashboard
Fixes: https://tracker.ceph.com/issues/47049

Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2020-08-21 12:37:35 +05:30
Kefu Chai
e2031418d4
Merge pull request #36465 from majianpeng/bluefs-avoid-flush-much-data
os/bluestore/BlueRocksEnv: Avoid flushing too much data at once.

Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2020-08-21 09:57:27 +08:00
Kefu Chai
268cbe5bb7
Merge pull request #36593 from gregsfortytwo/wip-46914
mon: mark pgtemp messages as no_reply more consistenly in preprocess_…

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-08-21 09:53:25 +08:00
Kefu Chai
03891c82c2
Merge pull request #36675 from tchaikov/wip-fix-option-typo
common/options: fix a typo in option description

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-08-21 09:52:40 +08:00
Kefu Chai
565f6ed3f1
Merge pull request #35613 from changchengx/str_list
use for_each_substr to avoid redundant operation by calling get_str_set

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-08-21 09:51:28 +08:00
Kefu Chai
f2b13ff87c
Merge pull request #36573 from changchengx/osdmonitor
mon: use string_veiw to glimpse string and remove unused variable

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-08-21 09:50:11 +08:00
Kefu Chai
ec73fea99e
Merge pull request #36680 from tchaikov/wip-mgr-disk-predict
pybind/mgr/diskprediction_cloud: remove mgr-diskprediction-cloud

Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-By: Zac Dover <zac.dover@gmail.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-08-21 09:46:54 +08:00
Kefu Chai
e9e4af403c
Merge pull request #36534 from changchengx/formatter
common/Formatter: don't construct string if string_view work

Reviewed-By: Kefu Chai <kchai@redhat.com>
2020-08-21 09:45:03 +08:00
Kefu Chai
afaf5913ac
Merge pull request #36420 from qwren/qat-compressor
compressor: fix compile error for QAT

Reviewed-By: Kefu Chai <kchai@redhat.com>
2020-08-21 09:42:18 +08:00
Robbie Williamson
ccee814ffc doc/rados: remove statement that ISA plugin only works on Intel chips
ISA-L supports aarch64 (Arm), not just Intel processors, as does Ceph (see #32171).

Signed-off-by: Robbie Williamson <robbie.williamson@arm.com>
2020-08-21 08:32:53 +08:00
Greg Farnum
73a014fc2c mon: mark pgtemp messages as no_reply more consistently in preprocess_pgtemp
If a message is forwarded, it's conceivable the leader's and peon's evaluation
will disagree about whether the message is useful or not, which could result
in the leader ignoring it and the peon having a dangling forwarded message.
Fix this by marking the op as no_reply whenever ignoring it.

Fixes:  https://tracker.ceph.com/issues/46914

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2020-08-20 19:31:52 +00:00
Varsha Rao
5c4e659067 qa/tasks/nfs: Instead of 'orch ls' use 'orch ps'
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-08-20 15:18:31 +00:00
Varsha Rao
572f0aeceb qa/suites/rados/test_orch_cli: Change mds name
As MDS name should not start with numeric digit.

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-08-20 14:28:57 +00:00
Varsha Rao
049afe5a7e qa/tasks/nfs: Delete nfs cluster after exports are created
Fixes: https://tracker.ceph.com/issues/47009
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-08-20 14:27:25 +00:00
Sebastian Wagner
281dce82c0
Merge pull request #36477 from p-se/fix-downstream-alertmanager
cephadm: Support custom alertmanager container


Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-20 14:24:43 +02:00
Juan Miguel Olmo Martínez
08c4a53e79
cephadm: Allow users to use a custom dashboard ssl port
This modification allows the user to create a new bootstrap cluster using a predefined SSl port for the dashboard.
If firewall is enabled, any new manager daemon deployed in new hosts will take care of open the required ports for all the services enabled in the manager.

Two new parameters for cephadm tool (aka binary or standalone):
Command bootstrap:
--ssl-dashboard-port SSL_DASHBOARD_PORT
                      Port number used to connect with dashboard using SSL
Command deploy:
--tcp-ports TCP_PORTS
                      List of tcp ports to open in the host firewall

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2020-08-20 13:56:59 +02:00
Ramana Raja
f84d22832a
Merge pull request #35756 from ShyamsundarR/tr-46163
mgr/volumes: Use snapshot root directory attrs when creating clone root

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
2020-08-20 16:53:11 +05:30
Sebastian Wagner
35b0261818
Merge pull request #36485 from adk3798/cephadm-44252
mgr/cephadm: mgr or mds scale-down should prefer non-active daemons

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-08-20 11:18:26 +02:00
Yan, Zheng
df7e9aa42b qa/workunits/fs: add test for subvolume
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-08-20 11:10:19 +08:00
Yan, Zheng
63da28d6a8 mds: don't move inode with nlink > 1 to global snaprealm if it's in subvolume
Fixes: https://tracker.ceph.com/issues/46074
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-08-20 11:10:19 +08:00
Yan, Zheng
55cc3f7d7d mds: disallow hardlink across subvolume
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-08-20 11:10:18 +08:00
Yan, Zheng
53348ab67f mds: disallow across subvolume rename
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-08-20 11:10:18 +08:00
Yan, Zheng
34c6b4437a mds: disallow creating snapshot on descendent directory of subvolume
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-08-20 11:10:18 +08:00
Yan, Zheng
8d531680cd mds: add vxattr that marks/clears subvolume flag
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-08-20 11:10:08 +08:00
Kefu Chai
8088de77e4
Merge pull request #36723 from tchaikov/wip-osd-writesame
crimson/osd: support writesame op

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-08-20 11:03:32 +08:00
Patrick Donnelly
aa6fca2151
Merge PR #36711 into master
* refs/pull/36711/head:
	Revert "vstart_runner: rotate logs between testcases"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-19 19:10:54 -07:00