Commit Graph

3184 Commits

Author SHA1 Message Date
Patrick Donnelly
81d0a52a2a
Merge PR #20428 into master
* refs/pull/20428/head:
	qa: ignore MON_DOWN while thrashing mons

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-18 10:36:25 -08:00
Patrick Donnelly
27b6bfbd81
qa: ignore full cluster warnings for mds-full
Fixes: http://tracker.ceph.com/issues/23033

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-17 16:09:57 -08:00
Casey Bodley
94922266ce
Merge pull request #17020 from theanalyst/lc-time-disable
qa: re enable LC tests

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-02-16 12:01:18 -05:00
Kefu Chai
097e2de5f7
Merge pull request #20362 from tchaikov/wip-mgr-py3
mgr: fix py3 support

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-02-16 02:32:04 +08:00
Patrick Donnelly
2e44b87141
Merge PR #19263 into master
* refs/pull/19263/head:
	qa: ignore bad backtrace cluster wrn
	qa/cephfs: Add tests to validate scrub functionality
	cephfs: Add option to load invalid metadata from disk
	cephfs: Reset scrub data when inodes move

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 14:43:32 -08:00
Patrick Donnelly
5224d94f4b
qa: ignore bad backtrace cluster wrn
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 14:12:53 -08:00
Patrick Donnelly
608e002195
qa: ignore MON_DOWN while thrashing mons
Fixes: https://tracker.ceph.com/issues/22993

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 11:24:39 -08:00
Douglas Fuller
07339e2d1d qa/cephfs: Add tests to validate scrub functionality
Add tests to ensure the scrub operation is not adversly affected
by certain metadata pathologies.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2018-02-13 14:07:28 -05:00
Gregory Farnum
240b688177
Merge pull request #20147 from smithfarm/wip-15904
tools: rados: make -f be --format for consistency with ceph tool

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-02-13 09:07:24 -08:00
Sage Weil
13738cd752
Merge pull request #19939 from liewegas/wip-osd-new-class
mon,osd: do not use crush_device_class file to initalize class for new osds

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-02-12 11:17:14 -06:00
Kefu Chai
d73b7f2c2a
Merge pull request #20198 from wido/zabbix-health-checks
mgr/zabbix: Implement health checks

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-12 11:14:41 +08:00
Kefu Chai
ba82060def qa/tasks/mgr: correct the log message
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-02-11 14:25:37 +08:00
Jason Dillaman
82ef376e80 librbd: auto-remove trash snapshots when image is deleted
Fixes: http://tracker.ceph.com/issues/22873
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-09 13:34:55 -05:00
Mykola Golub
57baca0166 qa/workunits/rbd/cli_generic: fix test_purge for rbd default format 1
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-02-09 16:04:43 +02:00
Mykola Golub
8079d23897
Merge pull request #20364 from Songweibin/wip-fix-test-rbd
test/rbd: cli_generic fails if v1 image format or deep-flatten disabled

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-02-09 14:42:27 +02:00
Wido den Hollander
b7d0cab99e
mgr/zabbix: Implement health checks in Zabbix module
Should make it easier for users to see why the module is failing.

Signed-off-by: Wido den Hollander <wido@42on.com>
2018-02-09 09:57:41 +01:00
songweibin
21c3bc3e69 test/rbd: cli_generic fails if v1 image format or deep-flatten disabled
Fixes: http://tracker.ceph.com/issues/22950

Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-02-09 16:17:27 +08:00
Patrick Donnelly
8c95cc5144
Merge PR #19954 into master
* refs/pull/19954/head:
	test/encoding: refactor to avoid escaping shell magic
	mds: minor refactor of SimpleLock
	mds: track Capability in mempool
	mds: move CInode container members to mempool
	mds: move CDentry container members to mempool
	mds: move CDir container members to mempool
	mds: put MDSCacheObject compact_map in mempool
	common: use size_t for object size
	mds: convert to allocator agnostic string_view
	mds: simplify initialization
	compact_*: support mempool allocated containers

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-02-08 18:17:15 -08:00
Patrick Donnelly
84ae0ce5fc
Merge PR #20310 into master
* refs/pull/20310/head:
	qa: adjust cephfs full test for kclient

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-08 13:30:04 -08:00
Sage Weil
59bdada5d5 mon/OSDMonitor: accept crush_device_class in 'osd new' json input
If provided, set the OSD device_class at OSD creation time.  This is
simpler than writing a file that the OSD has to read in and use to
set its initial device class, and also avoids a bit of sticky state
at the OSD that will make it keep trying to reset its device class on
startup if it ever gets cleared.

Note that we now ignore json input fields we don't understand, so remove
a test case.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-08 12:34:49 -06:00
Patrick Donnelly
46c25abd1c
test/encoding: refactor to avoid escaping shell magic
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-07 18:03:05 -08:00
Josh Durgin
eae6e64034
Merge pull request #20173 from liewegas/wip-os-ch
os: unify Sequencer and CollectionHandle

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-02-07 14:04:08 -08:00
Mykola Golub
db81bd81fa
Merge pull request #20176 from dillaman/wip-librbd-clone-v2-1
librbd: initial hooks for clone v2 support

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-02-07 19:54:50 +02:00
Sage Weil
3ca0e0c565
Merge pull request #20279 from liewegas/wip-idempotent-sequence
ceph_test_filestore_idempotent_sequence: many fixes

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-02-06 10:53:35 -06:00
Sage Weil
e4e4079636 qa/tasks/recovery_bench: drop recovery_bench task
This relies on smalliobench, which is gone now.  The task could
pretty easily be resurrected if we substitute in another tool.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 08:21:29 -06:00
Sage Weil
5749434ad6 test/bench: remove smallio bench tools
These are stale and superceded by the fio ObjectStore (and other)
backends.  Shed the weight!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-06 08:21:29 -06:00
Sage Weil
135ccf8790 qa/tasks/filestore_idempotent: run failure tests later in sequence
We want to get past the initial colleciton and object creation steps,
which don't include interesting ops.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-02-05 18:08:28 -06:00
Jason Dillaman
57559a47f6 qa/workunits/rbd: force use of v1 clone when testing orphan
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-05 11:12:00 -05:00
Yan, Zheng
27b1ca076e qa: adjust cephfs full test for kclient
Fixes: http://tracker.ceph.com/issues/22886
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-02-05 18:00:57 +08:00
Jason Dillaman
3ac57a7eb7
Merge pull request #19711 from trociny/wip-20762
rbd: unified way to map images using different drivers

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2018-02-02 13:56:13 -05:00
Jason Dillaman
bba63db1b4
Merge pull request #20170 from trociny/wip-22803
qa/workunits/rbd: remove "trash purge --threshold" test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-02-02 08:32:36 -05:00
Jason Dillaman
4b69976510
Merge pull request #20099 from Songweibin/wip-fix-deep-cp
librbd: fix deep copy a child-image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-02-02 08:32:20 -05:00
Patrick Donnelly
7dabdf526d
Merge PR #19856 into master
* refs/pull/19856/head:
	qa: synchronize kcephfs suites with fs/multimds

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-02-01 14:50:12 -08:00
Mykola Golub
be60490f15 qa/workunits/rbd: remove "trash purge --threshold" test
It is difficult to make it work reliably in different environments.

Fixes: http://tracker.ceph.com/issues/22803
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-02-01 17:36:21 +02:00
songweibin
c3e119d0d3 librbd: fix deep copy a child-image
* tweak create a cloned image when the source image is
  a clone (or at least one of its snapshots is a clone).

Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-02-01 08:17:19 +08:00
Mykola Golub
6a57358add rbd: unified way to map images using different drivers
Instead of "rbd map|unmap|showmapped", "rbd ndb map|unmap|list",
"rbd ggate map|unmap|list" commands, provide:

 rbd device -t krbd|nbd|ggate|... map|unmap|list

which gives interface consistent between drivers.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-01-29 09:34:11 +02:00
Nathan Cutler
3a058a2e42 tests: rados tool: test -f option
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-01-28 12:52:34 +01:00
Sage Weil
f67bd47d0a
Merge pull request #20096 from myoungwon/wip-manifest-two-pool-test
src/test/osd: add two pool test for manifest objects

Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-26 14:41:14 -06:00
myoungwon oh
a1d6304442 qa/suites/rados/thrash/workloads: add paramters to support two pools
Signed-off-by: Myoungwon Oh <omwmw@sk.com>
2018-01-26 16:20:01 +09:00
Kefu Chai
4233cc02d4
Merge pull request #19651 from yanghonggang/master
mon/OSDMonitor.cc: fix expected_num_objects interpret error

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-26 14:34:11 +08:00
Mykola Golub
023759c7c1
Merge pull request #20124 from dillaman/wip-devstack
qa/workunits/rbd: switch devstack to pike release

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-01-26 07:41:00 +02:00
Jason Dillaman
6253490445
Merge pull request #19996 from Songweibin/wip-rbd-deep-cp
rbd: add deep cp CLI method

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-01-25 21:59:31 -05:00
Jason Dillaman
7ff1e0bc21 qa/workunits/rbd: switch devstack to pike release
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-01-25 18:44:20 -05:00
Kefu Chai
52bf90bb10
Merge pull request #20047 from jcsp/wip-prometheus-qa
qa: add new prometheus test to rados/mgr suite

Reviewed-By: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-25 23:43:07 +08:00
John Spray
b3e6b8e1e2 qa: always dump corrupt messages in rados/upgrade
Previously only a service with debug_ms>=1 would dump
corrupt messages: in an upgrade test we're *alway*
interested in a corrupt message.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-01-24 13:08:21 -05:00
John Spray
d9a47181c4 mgr: add health checks for failed modules
Signed-off-by: John Spray <john.spray@redhat.com>
2018-01-24 13:08:20 -05:00
John Spray
f95b079c21 qa/mgr: add test for command execution errors
Signed-off-by: John Spray <john.spray@redhat.com>
2018-01-24 13:08:20 -05:00
songweibin
0551029242 rbd: add deep cp CLI method
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2018-01-24 09:04:33 +08:00
Theofilos Mouratidis
b9e4aa94b7 rbd trash: replace cli delay option, add rbd trash purge command
Replaced the delay argument for the trash move
command with a string acceptable by /bin/date, e.g.:

$ rbd trash move --pool foo --image bar --expires-in "2 weeks"

Added a "rbd trash purge" command that deletes any expired
image from the trash, has also a command to alter the current
expiration date with the "--older-than" argument which accepts
again a valid argument for /bin/date, e.g.:

$rbd trash purge mypool --older-than "2017-08-20"

There is also the "threshold" argument which tries to remove the
oldest trashed images (by deferment end time) until the pool space
is freed up to a percentage point, e.g.:

$ rbd trash purge mypool --threshold 0.9

If mypool uses 1GB it will try to remove trashed images until the
pool usage becomes equal to or lower than 900MB.

Signed-off-by: Theofilos Mouratidis <t.mour@cern.ch>
2018-01-23 11:41:54 +01:00
John Spray
e2c68d5e25 qa: assign prometheus ports during selftest
This was throwing IOError("Port 9283 not free on '::'",)
when trying to serve, since merging https://github.com/ceph/ceph/pull/19744

It's because the standbys (on the same node as the active) are
now trying to listen too.

Fixes: https://tracker.ceph.com/issues/22755
Signed-off-by: John Spray <john.spray@redhat.com>
2018-01-23 10:23:39 +00:00