Commit Graph

328 Commits

Author SHA1 Message Date
Kefu Chai
7e90989214
Merge pull request #24291 from tchaikov/wip-23964
erasure-code: add clay codes

Reviewed-by: Myna Vajha <mynaramana@gmail.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-10-02 10:48:21 +08:00
Sage Weil
bc86b06a67 qa/suites/rados/thrash-erasure-code: add clay 4+2
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-27 18:56:21 +08:00
Nathan Cutler
c46c890d02 qa: add test that builds example librados programs
Fixes: http://tracker.ceph.com/issues/15100
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-09-25 13:18:04 +02:00
Sage Weil
757a94b980 qa/suites/rados/thrash-old-clients/workloads/rbd_cls.yaml: skip parents test
We can't (easily) build updated hammer packages, but all this sh script does
it run this one test binary with --gtest_filter arguments, so just do
it directly and skip the test explicitly here.  (Newer version of the .sh
understand the environemnt variable but the hammer version does not.)

Fixes: http://tracker.ceph.com/issues/36104
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-24 10:57:40 -05:00
Sage Weil
9bf7c810a7 Merge PR #23985 into master
* refs/pull/23985/head:
	ceph-objectstore-tool: add back pool dne check
	qa/suites/rados/singleton/reg11184: remove old test
	ceph-objectstore-tool: import pg at original epoch
	osd: handle null pg slot on startup
	ceph-objectstore-tool: drop support for ancient export files
	osd: avoid dropping osd_lock when pg osdmaps are not laggy
	qa/standalone/osd/pg-merge.sh: add merge vs pg import test

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-09-21 08:21:53 -05:00
Sage Weil
4e5f2bb596 qa/suites/rados/singleton/reg11184: remove old test
This bug was about filtering missing and divergent when doing a partial
PG import.  We don't support partial PG imports any more, so this can
go away!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-20 12:58:00 -05:00
Casey Bodley
d897b92878 osd: remove statelog from osd_class_load_list config
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-09-19 10:32:55 -04:00
John Spray
0551d0e14b
Merge pull request #23497 from noahdesu/insights
mgr/insights: insights reporting module

Reviewed-by: John Spray <john.spray@redhat.com>
2018-09-11 15:56:10 +01:00
John Spray
46a74a07d9 qa: add task for progress module
Signed-off-by: John Spray <john.spray@redhat.com>
2018-09-11 11:21:35 +01:00
John Spray
09f5f9e1eb qa: add 4th OSD to mgr test cluster
This is useful for testing progress module.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-09-11 11:21:35 +01:00
Noah Watkins
5c2615e3d7 qa/tasks/mgr: whitelist insights test health checks
these drive health history tracking tests.

Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-09-10 15:02:49 -07:00
Sage Weil
44de03d5e6 qa/suites: test pg merging
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-07 12:09:05 -05:00
Lenz Grimmer
82412896ff
Merge pull request #23491 from p-na/per-osd-settings
mgr/dashboard: Add support for managing individual OSD settings in the backend

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-09-04 12:01:19 +02:00
Patrick Nawracay
e71466cc49 mgr/dashboard: Add support for managing individual OSD settings (backend)
Add options to mark OSDs in/out/down/reweight/lost/remove/destroy/create

Fixes: http://tracker.ceph.com/issues/24270

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-09-03 12:51:04 +02:00
Sage Weil
35820f4b88 mon/AuthMonitor: raise health warning on invalid caps
Raise a health warning if we have invalid (unparsable) caps in the auth
database.  Include a simple test.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-31 15:54:58 -05:00
Noah Watkins
a087e417d0 qa/tasks/mgr: whitelist insights warning
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2018-08-24 10:45:40 -07:00
David Zafman
687f63e599 test: Update tests for error message changes
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-08-23 11:09:22 -07:00
David Zafman
b40784290f qa: Add new message to whitelist for scrub/repair tests
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-08-23 11:09:22 -07:00
Noah Watkins
3d96b2faaa qa/tasks/mgr: add tests for insights module
Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-08-16 15:29:46 -07:00
Dan Mick
298a1d92d2 qa/suites/rados, qa/workunits/rados: Add suite/workunit for ceph-crash
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-08-13 13:53:26 -07:00
Sage Weil
1fdd424815 qa/suites/rados/thrash-erasure-code: add many deletes workload
Having lots of deletes will mean deletes on objects that don't exist,
which will in turn mean error log entries and more coverage of the
append_log_entries_update_missing code.  Hopefully this will trigger
http://tracker.ceph.com/issues/24597

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-11 16:15:49 -05:00
Dan Mick
85ab978567 qa/suites/rados/mgr: Add test_crash
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-06-29 14:52:17 -07:00
Patrick Donnelly
b39f9d06dc
qa: fix symlinks indirectly pointing at qa to .qa
Building on the previous commit.

Command used:

$ find suites/ -type l -and -not -name .qa -execdir ~/fix.sh {} \;

fix.sh:
    #!/bin/bash

    link="$(readlink "$1")"

    echo $link
    dirlink="$(dirname "$link")"
    baselink="$(basename "$link")"

    while true; do
        echo $dirlink
        if [ "$dirlink" -ef ~/ceph/qa ]; then
            ln -nsf ".qa/$baselink" "$1"
            exit
        else
            baselink="$(basename "$dirlink")/$baselink"
            dirlink="$(dirname "$dirlink")"
            if [ "$dirlink" -ef . ]; then
                break
            fi
        fi
    done

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:48:38 -07:00
Patrick Donnelly
716db6e2fd
qa: add .qa helper link
This utilizes the recent feature in teuthology [1] to skip hidden files in
suites when building the job matrix.

Idea of this change is to enable referring to the top-level qa directory in a
position-independent way such that copies of a suite to another location do not
break any symlinks.

[1] https://github.com/ceph/teuthology/pull/1185

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:33:48 -07:00
Sage Weil
247586a0be Merge PR #22596 into master
* refs/pull/22596/head:
	os/bluestore: use vector instead of set for zombies
	os/bluestore: reuse zombie OpSequencers by collection id
	qa/suites/rados/objecstore/backends/objectstore: capture coredumps
	os/bluestore: more debug output
	os/bluestore: print cnode from _open_collections
	os/bluestore: print cnode on fsck
	qa/suites/rados/objecstore: preserve data dir for ceph_test_objecstore

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-06-19 13:51:09 -05:00
Sage Weil
55f390d0eb qa/suites/rados/objecstore/backends/objectstore: capture coredumps
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-19 13:49:57 -05:00
Patrick Nawracay
d7de1fa067 mgr/dashboard/backend: Enable get/set of cluster-wide OSD settings
Add ability to list, set and unset cluster-wide OSD flags.

Flags can be listed and changed through the `/api/osd/flags` API
resource. By using a GET request, the list is retrieved. By using a PUT
request, the flags are updated (all at once). Flags not contained in the
data of the PUT are removed, additional once are added. Note that the
PUT requests require a JSON body with the data contained as value of the
'flags' key like so:

    {"flags": ["flag1", "flag2", ...]}

Fixes: http://tracker.ceph.com/issues/24056

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-06-15 10:26:29 +02:00
Sage Weil
23dd6279bb qa/suites/rados/objecstore: preserve data dir for ceph_test_objecstore
If we fail, preserve the data directory.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-13 06:55:18 -05:00
Sage Weil
697d98dafc qa/suites/rados/upgrade: remove stray link
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-07 11:25:55 -05:00
Sage Weil
4f769a3cc9 qa/suites/rados: move valgrind test to singleton-flat
No distro facet (or anything else) since we require centos for this test.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-27 10:07:45 -05:00
Neha Ojha
7cfc95b367 qa/suites/rados/objectstore: move yaml files under a subdir
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-05-23 15:39:23 -07:00
Neha Ojha
dca3275f0c qa: whitelist SMALLER_PGP_NUM
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-05-23 15:15:54 -07:00
Sage Weil
2a6f1633b1
Merge pull request #22158 from liewegas/wip-24222
mon/MgrMonitor: change 'unresponsive' message to info level

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2018-05-23 06:42:48 -05:00
Sage Weil
4ddbbe561c mon/MgrMonitor: change 'unresponsive' message to info level
We generate a MGR_DOWN health warning at the appropriate points; having
this at WRN level just triggers failed teuthology runs but doesn't much
value for the user.

Clear out teuthology whitelisting for this message.

Fixes: http://tracker.ceph.com/issues/24222
Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-22 16:55:03 -05:00
David Zafman
ee4acb6e1f test: Whitelist corrections
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-05-22 14:26:46 -07:00
David Zafman
4fad800043 test: Add CACHE_POOL_NO_HIT_SET to whitelist for mon/pool_ops.sh
Ignore
  cluster [WRN] Health check failed: 1 cache pools are missing hit_sets (CACHE_POOL_NO_HIT_SET)

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-05-21 09:47:59 -07:00
David Zafman
918921ab2f test: Need to escape parens in log-whitelist for grep
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-05-21 09:47:59 -07:00
Sage Weil
dd46ae1006 qa/suites/rados/thrash-old-clients: only centos and 16.04
We don't have old client builds for the newer distros.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-05-20 09:38:02 -05:00
Kefu Chai
c237d0befb qa/suites/rados/verify: remove random-distro$
the distro specified by random-distro$ will be overwrited by the one
specfied by valgrind.yaml. and teuthology-suite will give

KeyError: '16.04 not a centos version or codename'

when scheduling a suite involving the facets above. also, i think it's
of not much value to run valgrind/lockdep with different distros.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-05-17 19:11:14 +08:00
Sage Weil
664af17b30
Merge pull request #21932 from yuriw/wip-yuriw-add-dollar-rgw
tests/qa: Adding $ distro mix - rgw

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-05-15 16:15:05 -05:00
Josh Durgin
e8f5038f2b
Merge pull request #21895 from yuriw/wip-yuriw-add-dollar1
tests/qa: trying $ distro mix

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-05-14 16:18:45 -07:00
Yuri Weinstein
9f2c485942 tests/qa: adding rados/.. dirs
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-05-11 14:03:15 -07:00
Casey Bodley
7da0fe2832
Merge pull request #21680 from cbodley/wip-rm-replica-log
rgw: remove all traces of cls replica_log

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-05-10 10:26:55 -04:00
Yuri Weinstein
c79a74a33c tests/qa: adding rados/.. dirs
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-05-08 16:00:05 -07:00
Kefu Chai
770dbae2ca qa/suites/rados/thrash-old-clients: ms_type=simple
hammer does not support async messenger, so set ms_type to "simple" for
hammer client.

Fixes: http://tracker.ceph.com/issues/23922
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-30 21:40:53 +08:00
Josh Durgin
aef8d96def
Merge pull request #21710 from neha-ojha/wip-cosbench-workloads
qa: add cosbench workloads and override teuthology default settings

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-04-27 18:30:11 -07:00
Neha Ojha
f01eb7adc6 qa/suites/rados/perf: add cosbench workloads
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-04-27 16:02:40 -07:00
Jason Dillaman
0cb3e64221
Merge pull request #21704 from liewegas/wip-rados-old-clients
qa/suites/rados/thrash-old-clients: add rbd tests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-04-27 17:35:58 -04:00
Yuri Weinstein
2c98007a13
Merge pull request #21630 from neha-ojha/wip-rgw-pools
qa: modify rgw default pool names

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-04-27 14:21:52 -07:00
Sage Weil
9fbdca34bf qa/suites/rados/thrash-old-clients: add cls_rbd, rbd api tests
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-27 14:04:25 -05:00