Commit Graph

3878 Commits

Author SHA1 Message Date
Sage Weil
1fdd424815 qa/suites/rados/thrash-erasure-code: add many deletes workload
Having lots of deletes will mean deletes on objects that don't exist,
which will in turn mean error log entries and more coverage of the
append_log_entries_update_missing code.  Hopefully this will trigger
http://tracker.ceph.com/issues/24597

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-11 16:15:49 -05:00
Sage Weil
4f9fdd98e2 qa/standalone/osd/repro_long_log.sh: fix test
The log trimming case wasn't quite right.  Before HEAD^ we were
rolling forward too aggressively and miscalculating the can_rollforward_to,
which affected the trim_to calculation.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-11 16:15:49 -05:00
Sage Weil
1d9d61b784 Merge PR #22969 into master
* refs/pull/22969/head:
	qa/mgr: delete devicehealth pool after selftest

Reviewed-by: Sage Weil <sage@redhat.com>
2018-07-11 09:50:27 -05:00
Patrick Donnelly
bb7fbdb96b
Merge PR #22455 into master
* refs/pull/22455/head:
	qa/ceph-volume: add a test for put_object_versioned()
	ceph-volume-client: allow atomic updates for RADOS objects

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-10 13:24:27 -07:00
Patrick Donnelly
15733f0a1f
Merge PR #22543 into master
* refs/pull/22543/head:
	qa/tasks/cephfs: add test for ceph_abort_conn()
	libcephfs: introduce ceph_get_instance_id()
	client: introduce ceph_abort_conn()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-10 13:24:20 -07:00
John Spray
d7601c546f qa/mgr: delete devicehealth pool after selftest
This prevents tests getting hung up on the health
warnings from its very low pg count.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-07-10 12:54:52 -04:00
vasukulkarni
9731dff850
Merge pull request #22921 from ceph/wip-default-ceph-volume
qa/tests: remove ceph-disk tests from ceph-deploy and default all tests to use ceph-volume
2018-07-10 09:37:34 -07:00
Sage Weil
737b9e3ef8 Merge PR #22940 into master
* refs/pull/22940/head:
	mon/OSDMonitor: add 'osd repeer <pgid>' command

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-07-10 08:42:27 -05:00
Sage Weil
95b2281f9d mon/OSDMonitor: add 'osd repeer <pgid>' command
Selecting force peering on a single PG.  In reality this probably induces
*2* interval changes.

Note that in the case of a single OSD cluster we can't actually force a
repeer on a single PG because the pg_temp code is pretty robust about
filtering out redundant or meaningless changes, so we can't pg_temp our
way into a new interval if there are no other OSDs to switch to and the
code also prevents an empty pg_temp.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-09 16:33:11 -05:00
Sage Weil
975528f632 Merge remote-tracking branch 'private/wip-mon-snap-caps' 2018-07-09 08:29:32 -05:00
Patrick Donnelly
0918f8fd4f
Merge PR #22741 into master
* refs/pull/22741/head:
	qa: fix ffsb cd argument
	qa: fix cd argument during iogen unpack

Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-07-08 21:06:26 -07:00
Patrick Donnelly
86c817febc
Merge PR #22740 into master
* refs/pull/22740/head:
	qa: create common conf for all cephfs suites
	qa: remove wrongly created random distro conf

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-07-08 20:56:09 -07:00
Vasu Kulkarni
ff1f97e276 qa/tests: remove ceph-disk tests and default all tests to use ceph-volume
Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2018-07-06 15:03:17 -07:00
Patrick Donnelly
73fa0efcbb
qa: create common conf for all cephfs suites
This will be followed by removing common CephFS configurations in the
ceph.conf.template in teuthology.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-04 13:08:10 -07:00
Sage Weil
6dbf8ad2ec Merge PR #22703 into master
* refs/pull/22703/head:
	doc/mgr: add doc for crash mgr module
	qa/suites/rados/mgr: Add test_crash
	qa/tasks/mgr: add test_crash, call from test_module_selftest
	qa/tasks/{ceph_manager.py,vstart_runner.py}: allow kwargs in raw_*
	mgr/pybind/crash: handle crashdumps

Reviewed-by: John Spray <john.spray@redhat.com>
2018-07-04 14:22:18 -05:00
Patrick Donnelly
6c7e09568d
qa: fix ffsb cd argument
Avoid potential failures relating to HEAD^.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-03 23:08:15 -07:00
Patrick Donnelly
fe62ea36d4
qa: fix cd argument during iogen unpack
Fixes: http://tracker.ceph.com/issues/24680

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-03 23:07:55 -07:00
David Zafman
fbc8bcfe05 test: test_get_timeout_delays() fix
Caused by: 7b0d1c8b8a

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-07-03 14:01:36 -07:00
Patrick Donnelly
628927d5ba
Merge PR #22165 into master
* refs/pull/22165/head:
	qa: add one-off clusters to qa/cephfs/clusters
	qa: allocate more space for VM disk
	qa/cephfs/clusters/*: bigger cinder volumses

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-03 09:10:09 -07:00
Josh Durgin
9106dc56c2
Merge pull request #22761 from fullerdj/wip-djf-24686
osd/filestore: Change default filestore_merge_threshold to -10

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-07-02 17:36:00 -07:00
Dan Mick
85ab978567 qa/suites/rados/mgr: Add test_crash
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-06-29 14:52:17 -07:00
Dan Mick
8145598f59 qa/tasks/mgr: add test_crash, call from test_module_selftest
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-06-29 14:51:45 -07:00
Dan Mick
7fc8714a27 qa/tasks/{ceph_manager.py,vstart_runner.py}: allow kwargs in raw_*
Allow passing kwargs (like stdin=) to the local and teuthology
clusters when running tests

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-06-29 14:51:34 -07:00
Patrick Donnelly
0e50b1217d
Merge PR #22718 into master
* refs/pull/22718/head:
	qa/workunits/suites/ffsb.sh: fix strncpy bug in ffsb

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 10:23:38 -07:00
Patrick Donnelly
654aaa90ed
qa: add one-off clusters to qa/cephfs/clusters
To consistently handle openstack configuration.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 09:33:53 -07:00
Patrick Donnelly
5d4a1f232b
qa: allocate more space for VM disk
Otherwise daemons may run out of space due to logging.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 09:30:29 -07:00
Sage Weil
aa3dcb2b26
qa/cephfs/clusters/*: bigger cinder volumses
Fixes: http://tracker.ceph.com/issues/24238
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-29 09:27:59 -07:00
Douglas Fuller
75f55f2dfc osd/filestore: Change default filestore_merge_threshold to -1
Performance evaluations of medium to large size Ceph clusters have
demonstrated negligible performance impact from unnecessarily deep
directory hierarchies but significant performance impact from filestore
split and merge activity. Disable merges by default.

Fixes: http://tracker.ceph.com/issues/24686
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2018-06-29 11:45:12 -04:00
David Zafman
663d96e934
Merge pull request #22727 from dzafman/wip-21664
qa/standalone/scrub: When possible show side-by-side diff in addition to regular diff

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-28 19:59:21 -04:00
David Zafman
3ff56a82a4
Merge pull request #22763 from dzafman/wip-remove-sudo
qa: Don't use sudo when moving logs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-06-28 18:37:24 -04:00
David Zafman
23ed63e15f
Merge pull request #22441 from ErwanAliasr1/evelu-makecheck
Improving make check reliability

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2018-06-28 14:55:12 -04:00
David Zafman
808c628304 qa: Don't use sudo when moving logs
Caused by: f0964beac5

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-06-28 09:17:06 -07:00
Rishabh Dave
8ab6f84d57 qa/ceph-volume: add a test for put_object_versioned()
Test if the version passed to put_object_versioned() is used to
crosscheck.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2018-06-28 15:25:00 +00:00
Yan, Zheng
eb51786beb qa/tasks/cephfs: add test for ceph_abort_conn()
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-06-28 16:16:50 +08:00
David Zafman
dee4574a66
Merge pull request #22702 from dzafman/wip-standalone-log
qa: For teuthology copy logs to teuthology expected location

Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-06-28 01:57:25 -04:00
Josh Durgin
b8536e44d5
Merge pull request #22726 from yuriw/wip-yuriw-crontab
qa/tests - added mimic-p2p suite

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-06-27 16:13:51 -07:00
Patrick Donnelly
4309d7ce1f
Merge PR #22560 into master
* refs/pull/22560/head:
	qa/fs/upgrade/snaps: whitelist inconsistent rstat
	mds: track snapshot count in rstat
	mds: add MAY_SNAPSHOT in MDSAuthCaps

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-27 14:19:03 -07:00
Patrick Donnelly
5833a77f76
qa: remove wrongly created random distro conf
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-27 12:52:18 -07:00
Patrick Donnelly
5494e7229a
Merge PR #22719 into master
* refs/pull/22719/head:
	qa: fix symlinks indirectly pointing at qa to .qa
	qa: add .qa helper link

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-06-27 12:50:33 -07:00
Patrick Donnelly
f28cc3a082
Merge PR #22725 into master
* refs/pull/22725/head:
	qa/workunits/suites/blogbench.sh: use correct dir name

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-06-27 11:13:37 -07:00
Mykola Golub
40617ad18b
Merge pull request #22673 from dillaman/wip-24558
rbd: basic support for images within namespaces

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-06-27 11:40:23 +03:00
Yan, Zheng
162b1ed5f9 qa/fs/upgrade/snaps: whitelist inconsistent rstat
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-06-27 11:14:34 +08:00
David Zafman
ebb05b2542 test: When possible show side-by-side diff in addition to regular diff
Fixes: https://tracker.ceph.com/issues/21664

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-06-26 18:23:07 -07:00
Yuri Weinstein
298065df29 qa/tests - added mimic-p2p suite
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-06-26 16:05:44 -07:00
Neha Ojha
24513c39f1 qa/workunits/suites/blogbench.sh: use correct dir name
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-06-26 18:30:38 -04:00
Patrick Donnelly
b39f9d06dc
qa: fix symlinks indirectly pointing at qa to .qa
Building on the previous commit.

Command used:

$ find suites/ -type l -and -not -name .qa -execdir ~/fix.sh {} \;

fix.sh:
    #!/bin/bash

    link="$(readlink "$1")"

    echo $link
    dirlink="$(dirname "$link")"
    baselink="$(basename "$link")"

    while true; do
        echo $dirlink
        if [ "$dirlink" -ef ~/ceph/qa ]; then
            ln -nsf ".qa/$baselink" "$1"
            exit
        else
            baselink="$(basename "$dirlink")/$baselink"
            dirlink="$(dirname "$dirlink")"
            if [ "$dirlink" -ef . ]; then
                break
            fi
        fi
    done

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:48:38 -07:00
Patrick Donnelly
716db6e2fd
qa: add .qa helper link
This utilizes the recent feature in teuthology [1] to skip hidden files in
suites when building the job matrix.

Idea of this change is to enable referring to the top-level qa directory in a
position-independent way such that copies of a suite to another location do not
break any symlinks.

[1] https://github.com/ceph/teuthology/pull/1185

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:33:48 -07:00
Jason Dillaman
97e3f0aa01 qa/workunits/rados: test pool op permissions
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-06-26 11:41:19 -04:00
Jason Dillaman
b12dd0bf41 qa/workunits/rbd: test self-managed snapshot create/remove permissions
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-06-26 11:41:19 -04:00
Lenz Grimmer
cfcfa10a5b
Merge pull request #22672 from tspmelo/wip-encode-uri
mgr/dashboard: Add support for URI encode

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-26 17:03:29 +02:00