Commit Graph

105795 Commits

Author SHA1 Message Date
Sage Weil
6476517def qa/tasks: nosetests -> python -m nose
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-17 12:57:57 -06:00
Sage Weil
ea21829ae7 qa/suites/rgw: disable valgrind for tests that require py2/ubuntu
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-17 12:26:15 -06:00
Jason Dillaman
6787219e71
Merge pull request #32280 from dillaman/wip-librbd-qos-test
qa/workunit/rbd: fixed QoS throughput unit parsing

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-12-17 12:30:52 -05:00
Sage Weil
92b0638efd Merge PR #32279 into master
* refs/pull/32279/head:
	mgr/orchestrator_cli: combine all host into one 'device ls' table
	python-common: 'ssd/nvme' -> 'ssd'
	mgr/orchestrator_cli: make 'device ls' table formatting consistent

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-17 10:59:26 -06:00
Sage Weil
0e738af729 Merge PR #32282 into master
* refs/pull/32282/head:
	cephadm: clean up shell containers on exit
	cephadm: do not force container removal on unit stop

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2019-12-17 10:59:11 -06:00
Sage Weil
5a80fbe505 qa/suites/rgw: disable remaining ragweed test
Needs to be py3 since it relies on the python bindings.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-17 10:47:49 -06:00
Sage Weil
91da2fe0d2 Merge PR #32284 into master
* refs/pull/32284/head:
	qa/suites/rbd/openstack: use 18.04, not 16.04

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-12-17 10:32:52 -06:00
Sage Weil
1e0c2e2061 cephadm: drop 'sha256:' prefix on container id
Podman doesn't include the prefix--only the (bionic) docker as far as I
can tell.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-17 09:59:46 -06:00
Jason Dillaman
72ff60db4b
Merge pull request #32273 from changchengx/doc_libvirt
doc/rbd: refine rbd/libvirt usage

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-12-17 10:57:06 -05:00
Kefu Chai
67cf46df18 build-integration-branch: s/prefix/postfix/
prefix is not defined.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-17 23:48:02 +08:00
Kefu Chai
068aafb2ea
Merge pull request #32296 from rzarzynski/wip-seastar-pickup-futureopt
seastar: pickup the recent future optimizations.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-17 23:30:28 +08:00
Sebastian Wagner
70bae966aa mgr/orchestrator: Rename PlacementSpec.nodes -> PlacementSpec.hosts
By definition in the orchestrator's docs, we're using `host` insted of `node`

Fixes wrong usage of PlacementSpec in mgr/ansible

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-12-17 16:27:57 +01:00
Kefu Chai
35909b8dff
Merge pull request #32301 from tchaikov/wip-build-doc
admin/doc-requirements.txt: bump up Sphinx and breathe

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-17 23:27:21 +08:00
Kefu Chai
a8d03f898d
Merge pull request #32285 from liewegas/wip-py3-docs
admin/build-doc: do not use system site-packages

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-17 23:26:46 +08:00
Sage Weil
c919080fad cephadm: check for both ntp.service and ntpd.service
Sigh...

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-17 08:58:58 -06:00
Kefu Chai
1b900fc9ac
Merge pull request #32263 from rosinL/fix-vcluster-stop
stop.sh: use bash shell to solve syntax error

Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-17 22:50:24 +08:00
Sage Weil
92595f3f9d admin/build-doc: do not use system site-packages
Don't use site-packages, since the host might have the same version, and
it won't have the ditaa and breathe.

Require Cython to make the venv sufficient.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-17 08:47:25 -06:00
Kefu Chai
bb0c10e567 admin/doc-requirements.txt: bump Sphinx and breathe
* use the latest Sphinx
* use the latest breathe. also, since there is no need to be compatible
  with python2. we can move to 4.14.0 which is python3 only.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-17 22:27:30 +08:00
Jason Dillaman
7838d3e18e qa/workunit/rbd: fixed QoS throughput unit parsing
The 'rbd bench' command was recently modified to print IEC units
instead of bytes/sec. This broke the handling for QoS throughput
tests since it was incorrectly evaluating the available RBD
throughput. Additionally, the QoS tests should use a "<="
comparison operator since the QoS is the upper-bound limit.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-12-17 09:12:43 -05:00
Sage Weil
fee585933c Merge PR #32293 into master
* refs/pull/32293/head:
	script/build-integration-branch: Add usage

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-17 08:10:01 -06:00
Kefu Chai
3040ccd960
Merge pull request #32295 from tchaikov/wip-stop.sh
stop.sh: do not try to contact mon unless cluster is up

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: David Disseldorp <ddiss@suse.de>
2019-12-17 21:14:23 +08:00
Sage Weil
ef98700e81 cephadm: clean up shell containers on exit
The run_cmd() was already passing --rm; do it for shell_cmd too so that
we don't leave behind a mess from shell commands, ceph-volume, etc.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-17 07:02:42 -06:00
Sage Weil
26f9fe54cb cephadm: do not force container removal on unit stop
The -f arg for 'podman rm' will remove the container without actually
stopping it, leaving the running containers and processes (conmon and
daemon) running and generally making a mess of things.

Doing 'podman rm' without the -f on a running container will complain
that the container is still running.

So, first stop, then remove.

Fixes: f1de706076
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-17 07:02:38 -06:00
Kefu Chai
b99b55ab72 stop.sh: use ${CEPH_BIN} and -c ${conf_fn}
to make sure ${CEPH_BIN} and ${CEPH_CONF_PATH} are respected

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-17 20:11:35 +08:00
Kefu Chai
b92f2c05a6 stop.sh: do not try to contact mon unless cluster is up
otherwise "ceph mon metadata" will hang, when we try to stop an
already-stopped cluster. and `vstart_runner.py` always calls `stop.sh`
before setting up a cluster.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-17 20:11:28 +08:00
Radoslaw Zarzynski
d50d1981b2 seastar: pickup the recent future optimizations.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-12-17 12:56:54 +01:00
Varsha Rao
b303e487a0 vstart: Add note for nfs-ganesha dev packages
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-12-17 17:04:55 +05:30
Sebastian Wagner
f3239419ff script/build-integration-branch: Add usage
Also add a --no-date to make it possible to re-use an existing branch name

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-12-17 12:25:43 +01:00
Jos Collin
cb7614adea
doc: update 'adding an MDS'
Fixes: https://tracker.ceph.com/issues/43162
Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-12-17 16:11:27 +05:30
Laura Paduano
8186dd98a6
Merge pull request #32207 from bk201/wip-43136
mgr/dashboard: Fix OSD IDs are not displayed when using cephadm backend

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-12-17 10:57:43 +01:00
Venky Shankar
6373f8c763 doc: add config help/get/set section for runtime client configuration
Fixes: http://tracker.ceph.com/issues/41688
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2019-12-17 04:52:16 -05:00
Xie Xingguo
0f0ae55a0d
Merge pull request #32266 from xiexingguo/wip-balancer-efficiency-1
mgr/balancer: avoid pulling pg_dump twice

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-17 17:15:04 +08:00
Sebastian Wagner
c915cd08ac mgr/ssh: Fix remove_osds()
Changed signature from `(str) -> ...` to `(List[str]) -> ...`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-12-17 10:12:26 +01:00
Kefu Chai
1886e5d158
Merge pull request #32237 from tchaikov/wip-cmake-rdkafka
cmake: check version of librdkafka

Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-12-17 16:29:00 +08:00
Varsha Rao
c5fbbe97a8 stop.sh: Add option to kill Ganesha daemons
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-12-17 13:55:10 +05:30
Varsha Rao
11b42275d2 vstart: Add option to deploy ganesha daemons
To create Ganesha daemons with vstart following packages needs to be installed:
nfs-ganesha nfs-ganesha-ceph nfs-ganesha-rados-grace

Version used for these packages 2.7.6-2 on fedora 30 system.

This is an experimental option, it just deploys specified number of ganesha
daemons.

Signed-off-by: Varsha Rao <varao@redhat.com>
2019-12-17 13:53:19 +05:30
Kefu Chai
6b009b49f2
Merge pull request #31144 from badone/wip-use-dnf-on-rhel-or-centos-8
install-deps.sh: Use dnf for rhel/centos 8

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-17 12:03:54 +08:00
Patrick Donnelly
b31a020008
Merge PR #31884 into master
* refs/pull/31884/head:
	qa/tasks: Fix the volume ls in test_volume_rm
	qa/tasks: tests for 'fs volume create' and 'fs volume ls'

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-16 16:30:45 -08:00
Patrick Donnelly
05b8932e42
Merge PR #29059 into master
* refs/pull/29059/head:
	mds: complete all the replay op when mds is restarted ,no matter the session is closed or not.

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-16 16:09:23 -08:00
Patrick Donnelly
77f7b8d9c4
Merge PR #31662 into master
* refs/pull/31662/head:
	mds: fix revoking caps after after stale->resume circle
	client: fix incorrect debug message

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-16 16:06:30 -08:00
Patrick Donnelly
72901b133a
Merge PR #32162 into master
* refs/pull/32162/head:
	qa: note timeout in debug message

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-16 16:04:52 -08:00
Patrick Donnelly
d7af29a84f
Merge PR #31118 into master
* refs/pull/31118/head:
	mds: Reorganize class members in MDSMap header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-16 16:04:04 -08:00
Patrick Donnelly
fd16bddc4d
Merge PR #31123 into master
* refs/pull/31123/head:
	mds : optimization functions,get_dirfrags_under, to speed up processing directories with tens of millions of files

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-16 16:02:53 -08:00
Patrick Donnelly
333e938327
Merge PR #31595 into master
* refs/pull/31595/head:
	mds: optimize function, fragset_t::simplify, to improve the efficiency of  merging fragment

Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-12-16 16:01:19 -08:00
Patrick Donnelly
a80fd8bc39
Merge PR #32020 into master
* refs/pull/32020/head:
	mds: fix assert(omap_num_objs <= MAX_OBJECTS) of OpenFileTable

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-16 16:00:08 -08:00
Patrick Donnelly
4ef0310742
qa: note timeout in debug message
Some tests set this to a dynamic value, it'd be helpful to know how long
a test is planning to wait.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-12-16 15:59:25 -08:00
Patrick Donnelly
71df46d5a7
Merge PR #32042 into master
* refs/pull/32042/head:
	mds: update default MDS cache size memory limit
	common/options: note runtime effect for some MDS configs

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-12-16 15:57:38 -08:00
Sage Weil
a9ee4bcf24 qa/suites/rbd/openstack: use 18.04, not 16.04
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-16 17:11:47 -06:00
Sage Weil
fc6840933b qa/tasks/rbd_fio: fio 2.21 -> 3.16
2.21 doesn't build on el8; 3.16 does.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-16 17:03:06 -06:00
Sage Weil
2c655f2555 src/test/cli-integration/rbd/snap-diff.t: python -> python
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-16 17:03:06 -06:00