Commit Graph

842 Commits

Author SHA1 Message Date
Casey Bodley
7ad313768a qa/rgw: raise default curl timeout for multisite suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 14:50:52 -04:00
Sage Weil
b500359409 qa/rgw: vary omap osd-side limit
Signed-off-by: Sage Weil <sage@redhat.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 14:50:52 -04:00
Patrick Donnelly
2ea86fa4d3
Merge PR #21948 into master
* refs/pull/21948/head:
	ceph_volume_client: use integer division for pg_num
	packages.yaml: install py3 compatible cephfs and rados bindings...
	qa: test py2 and py3 for volume client
	qa: make test_volume_client.py py3 compatible
	qa/ceph-volume: allow executing python pyloads using python3
	cephfs.pyx: add py3 compatibility
	ceph-volume-client: add py3 compatibility

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-01 21:42:27 -07:00
Casey Bodley
8d36655fcb
Merge pull request #23372 from cbodley/wip-25214
qa/rgw: override valgrind --max-threads for radosgw

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2018-08-01 16:12:21 -04:00
Casey Bodley
e617990efe qa/rgw: override valgrind --max-threads for radosgw
radosgw now uses 512 frontend threads by default, and valgrind won't
start with its default --max-threads=500

Fixes: http://tracker.ceph.com/issues/25214

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-01 14:45:24 -04:00
Casey Bodley
ce45875d80
Merge pull request #23145 from cbodley/wip-qa-rgw-admin-rest
qa/rgw: add radosgw-admin-rest task to singleton suite

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-08-01 13:52:40 -04:00
Patrick Donnelly
a5e3b0512c
qa: test py2 and py3 for volume client
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-30 16:12:48 -07:00
Sage Weil
1ebafdb65f
Merge pull request #23292 from yuriw/wip-yuriw-25140-master
qa/tests: added 1st draft of mimic-x suite
2018-07-30 14:55:41 -05:00
Yuri Weinstein
baa4d0ea78
Merge pull request #23305 from smithfarm/wip-cleanup-upgrade
qa/upgrade: cleanup for nautilus

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-07-30 09:01:03 -07:00
Yuri Weinstein
e6f21c1aa3 qa/tests: added 1st draft of mimic-x suite
Fixes: https://tracker.ceph.com/issues/25140
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-07-30 08:41:18 -07:00
Nathan Cutler
17d9b5be4d qa/upgrade: cleanup for nautilus
Drop unused suites, which ATM means all of them except upgrade/luminous-x
which recently got a cleanup in https://github.com/ceph/ceph/pull/23162

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-29 19:56:53 +02:00
Casey Bodley
bfc892ab84 qa/rgw: add radosgw-admin-rest task to singleton suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:47 -04:00
Nathan Cutler
4432b16673 tests: upgrade/luminous-x: fix order of final-workload directory
This is just a cosmetic fix.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-21 20:30:38 +02:00
Nathan Cutler
2555524f1f tests: upgrade/luminous-x: whitelist REQUEST_SLOW for rados_mon_thrash
Fixes: http://tracker.ceph.com/issues/25051
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-21 11:31:20 +02:00
Sage Weil
e2465fdc22
Merge pull request #23151 from neha-ojha/wip-25008
qa/suites/powercycle: whitelist MDS_SLOW_REQUEST
2018-07-20 15:59:16 -05:00
Yuri Weinstein
6d77600fef
Merge pull request #23123 from yuriw/wip-yuriw-24926-master
qa/tests: Set ansible-version: 2.5
2018-07-20 13:04:36 -07:00
Neha Ojha
ac87fd946c qa/suites/powercycle: whitelist MDS_SLOW_REQUEST
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-07-20 12:50:02 -07:00
Casey Bodley
0b5bed7ecf
Merge pull request #22919 from liewegas/wip-rgw-cls-test
qa/suites/rgw/verify/tasks/cls_rgw: test cls_rgw

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-07-20 10:01:36 -04:00
Yuri Weinstein
f40ea9709f qa/tests: Set ansible-version: 2.5
Fixes http://tracker.ceph.com/issues/24926
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-07-18 17:28:34 -07:00
Patrick Donnelly
333444e8aa
Merge PR #21885 into master
* refs/pull/21885/head:
	qa: update cluster log health warning message
	qa: add tests for client features
	mds: evict clients that lack required features
	mds: cleanup MDSRank::evict_client
	mds: infer client version by client metadata and connection's features
	mds: introduce "ceph fs set <fs_name> min_compat_client <release_name>"
	mds: tell client why it's rejected
	mds: introduce cephfs' own feature bits
	mds: make Server::prepare_force_open_sessions() update client metadata

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-13 13:57:17 -07:00
Patrick Donnelly
3b7233a402
qa: use 4 mds cluster for multifs tests
Fixes: http://tracker.ceph.com/issues/24899

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-13 12:11:44 -07:00
Patrick Donnelly
87dcaab130
qa: update cluster log health warning message
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-13 12:06:11 -07:00
Patrick Donnelly
441a2730e5
qa: add tests for client features
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-12 10:12:12 -07:00
Sage Weil
1fdd424815 qa/suites/rados/thrash-erasure-code: add many deletes workload
Having lots of deletes will mean deletes on objects that don't exist,
which will in turn mean error log entries and more coverage of the
append_log_entries_update_missing code.  Hopefully this will trigger
http://tracker.ceph.com/issues/24597

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-11 16:15:49 -05:00
vasukulkarni
9731dff850
Merge pull request #22921 from ceph/wip-default-ceph-volume
qa/tests: remove ceph-disk tests from ceph-deploy and default all tests to use ceph-volume
2018-07-10 09:37:34 -07:00
Patrick Donnelly
86c817febc
Merge PR #22740 into master
* refs/pull/22740/head:
	qa: create common conf for all cephfs suites
	qa: remove wrongly created random distro conf

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-07-08 20:56:09 -07:00
Vasu Kulkarni
ff1f97e276 qa/tests: remove ceph-disk tests and default all tests to use ceph-volume
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2018-07-06 15:03:17 -07:00
Sage Weil
a3c2b28edb qa/suites/rgw/verify/tasks/cls_rgw: test cls_rgw
Test this as part of the rgw suite (currently we only cover it in the
rados suite).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-06 16:49:10 -05:00
Patrick Donnelly
73fa0efcbb
qa: create common conf for all cephfs suites
This will be followed by removing common CephFS configurations in the
ceph.conf.template in teuthology.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-04 13:08:10 -07:00
Sage Weil
6dbf8ad2ec Merge PR #22703 into master
* refs/pull/22703/head:
	doc/mgr: add doc for crash mgr module
	qa/suites/rados/mgr: Add test_crash
	qa/tasks/mgr: add test_crash, call from test_module_selftest
	qa/tasks/{ceph_manager.py,vstart_runner.py}: allow kwargs in raw_*
	mgr/pybind/crash: handle crashdumps

Reviewed-by: John Spray <john.spray@redhat.com>
2018-07-04 14:22:18 -05:00
Dan Mick
85ab978567 qa/suites/rados/mgr: Add test_crash
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-06-29 14:52:17 -07:00
Patrick Donnelly
654aaa90ed
qa: add one-off clusters to qa/cephfs/clusters
To consistently handle openstack configuration.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 09:33:53 -07:00
Patrick Donnelly
5d4a1f232b
qa: allocate more space for VM disk
Otherwise daemons may run out of space due to logging.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 09:30:29 -07:00
Patrick Donnelly
4309d7ce1f
Merge PR #22560 into master
* refs/pull/22560/head:
	qa/fs/upgrade/snaps: whitelist inconsistent rstat
	mds: track snapshot count in rstat
	mds: add MAY_SNAPSHOT in MDSAuthCaps

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-27 14:19:03 -07:00
Patrick Donnelly
5833a77f76
qa: remove wrongly created random distro conf
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-27 12:52:18 -07:00
Yan, Zheng
162b1ed5f9 qa/fs/upgrade/snaps: whitelist inconsistent rstat
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-06-27 11:14:34 +08:00
Patrick Donnelly
b39f9d06dc
qa: fix symlinks indirectly pointing at qa to .qa
Building on the previous commit.

Command used:

$ find suites/ -type l -and -not -name .qa -execdir ~/fix.sh {} \;

fix.sh:
    #!/bin/bash

    link="$(readlink "$1")"

    echo $link
    dirlink="$(dirname "$link")"
    baselink="$(basename "$link")"

    while true; do
        echo $dirlink
        if [ "$dirlink" -ef ~/ceph/qa ]; then
            ln -nsf ".qa/$baselink" "$1"
            exit
        else
            baselink="$(basename "$dirlink")/$baselink"
            dirlink="$(dirname "$dirlink")"
            if [ "$dirlink" -ef . ]; then
                break
            fi
        fi
    done

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:48:38 -07:00
Patrick Donnelly
716db6e2fd
qa: add .qa helper link
This utilizes the recent feature in teuthology [1] to skip hidden files in
suites when building the job matrix.

Idea of this change is to enable referring to the top-level qa directory in a
position-independent way such that copies of a suite to another location do not
break any symlinks.

[1] https://github.com/ceph/teuthology/pull/1185

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:33:48 -07:00
Patrick Donnelly
9829f56c07
Merge PR #22532 into master
* refs/pull/22532/head:
	qa/suites: Add supported-random-distro$ links.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-25 15:48:34 -07:00
Yuri Weinstein
ef91aef78e qa/tests - added all supported distro to the mix, so we can track stats across diff OSes
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-06-22 09:13:11 -07:00
Casey Bodley
4181b03d8c
Merge pull request #22249 from cbodley/wip-qa-rgw-verify-tasks
qa/rgw: reorganize verify tasks

Reviewed-by: Sage Weil <sage@redhat.com>
2018-06-22 09:43:25 -04:00
Sage Weil
cf7beba662
Merge pull request #22536 from yuriw/wip-yuriw-distros-master
qa/tests: changed disto symlink to point to new way using supported OS'es
2018-06-21 17:08:12 -05:00
Yuri Weinstein
bd8882c22f qa/tests - added all supported distro
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-06-20 09:17:39 -07:00
Sage Weil
247586a0be Merge PR #22596 into master
* refs/pull/22596/head:
	os/bluestore: use vector instead of set for zombies
	os/bluestore: reuse zombie OpSequencers by collection id
	qa/suites/rados/objecstore/backends/objectstore: capture coredumps
	os/bluestore: more debug output
	os/bluestore: print cnode from _open_collections
	os/bluestore: print cnode on fsck
	qa/suites/rados/objecstore: preserve data dir for ceph_test_objecstore

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-06-19 13:51:09 -05:00
Sage Weil
55f390d0eb qa/suites/rados/objecstore/backends/objectstore: capture coredumps
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-19 13:49:57 -05:00
Sage Weil
3cd7d5eb22 Merge PR #22343 into master
* refs/pull/22343/head:
	qa/standalone remove ceph-disk from activate_osd helper
	cmake: remove subman.sh tests
	test remove ceph-disk directory
	debian: remove ceph_detect_init python files from base
	qa/standalone remove virtualenv paths for ceph-disk and ceph-detect-init
	debian: remove ceph-disk ceph-detect-init python files
	rpm: remove ceph-disk ceph-detect-init python files
	alpine: remove ceph-disk ceph-detect-init python files
	alpine: remove ceph-osd and parttypeuuid udev rules
	debian: remove ceph-osd and parttypeuuid udev rules
	rpm: remove ceph-osd and parttypeuuid udev rules
	ceph-helpers.sh: remove ceph-disk, set up osds directly
	CMakeLists.txt: add back CEPH_BUILD_VIRTUALENV
	alpine: remove ceph-disk, add ceph-volume in APKBUILD.in
	upstart: remove ceph-disk activation call
	doc/install add anchor for manual osd deployment in freebsd guide
	doc/dev remove ceph-disk from freebsd guide, link to manual reference
	doc/dev/config-key remove ceph-disk references
	doc/dev remove ceph-disk.rst
	doc/dev: change ceph-disk suite examples for ceph-deploy
	doc/man_index: remove ceph-disk, ceph-detect-init refs
	doc/install: remove ceph-disk from freebsd examples
	doc/rados remove ceph-disk from man references
	doc/man remove ceph-disk ref from ceph-volume-systemd
	doc/man: update reference from ceph-disk to ceph-volume
	doc/man: remove ceph-disk, ceph-detect-init from cmake
	doc/man/ceph-volume remove doc reference to ceph-disk
	doc/man: remove ceph-disk, ceph-detect-init
	qa/suites: remove ceph-disk
	qa/run-standalone.sh: remove requirement for ceph-detect-init virtualenv
	qa/workunits: remove ceph-detect-init from rbdmapfile test
	qa/workunits: remove ceph-detect-init from ceph-helpers-root.sh
	qa/workunits: remove ceph-disk
	build: remove ceph-disk from freebsd script
	cmake: remove ceph-disk, ceph-detect-init tox tests
	init-ceph: remove ceph-disk
	cmake: remove top-level entries for ceph-disk, ceph-detect-init
	debian: remove ceph-detect-init references
	debian: remove ceph-disk references
	src: remove ceph-detect-init tool
	rpm: remove ceph-disk, ceph-detect-init from spec file
	test: remove subman script
	script: remove subman script
	udev: remove parttypeuuid rules for ceph-disk
	tool remove ceph-disk from ps-ceph.pl
	upstart: remove ceph-disk conf file
	systemd: remove ceph-disk from CMakeLists
	systemd: remove ceph-disk service
	udev: remove ceph-disk rules
	src: remove ceph-disk tool
2018-06-19 07:07:55 -05:00
Warren Usui
affaae045f qa/suites: Add supported-random-distro$ links.
Add supported-random-distro$ links for fs, kcephfs, and multimds

Fixes: http://tracker.ceph.com/issues/24138
Signed-off-by: Warren Usui <wusui@redhat.com>
2018-06-15 22:17:57 +00:00
Patrick Nawracay
d7de1fa067 mgr/dashboard/backend: Enable get/set of cluster-wide OSD settings
Add ability to list, set and unset cluster-wide OSD flags.

Flags can be listed and changed through the `/api/osd/flags` API
resource. By using a GET request, the list is retrieved. By using a PUT
request, the flags are updated (all at once). Flags not contained in the
data of the PUT are removed, additional once are added. Note that the
PUT requests require a JSON body with the data contained as value of the
'flags' key like so:

    {"flags": ["flag1", "flag2", ...]}

Fixes: http://tracker.ceph.com/issues/24056

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-06-15 10:26:29 +02:00
Alfredo Deza
5f0d542cbd qa/suites: remove ceph-disk
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-06-13 15:16:24 -04:00
Sage Weil
23dd6279bb qa/suites/rados/objecstore: preserve data dir for ceph_test_objecstore
If we fail, preserve the data directory.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-13 06:55:18 -05:00