Commit Graph

2066 Commits

Author SHA1 Message Date
Kefu Chai
b76a6c729f qa/workunits/rados/test_envlibrados_for_rocksdb: support SUSE distros
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-12 17:46:46 +08:00
Kefu Chai
be89e66f74 qa/workunits/rados/test_librados_build.sh: install build deps
to build helloworld of librados, we need to install the build
dependencies.

Fixes: https://tracker.ceph.com/issues/40155
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-12 17:46:46 +08:00
Kefu Chai
0072d487aa qa/workunits/rados/test_envlibrados_for_rocksdb: use helper script
instead of having its own copy of `install()`, try to leverage the
helper in ceph-helpers-root.sh.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-12 17:46:46 +08:00
Kefu Chai
e8e72319aa qa/workunits/ceph-helpers-root: use /etc/os-release instead
as lsb_release does not work on SUSE distros

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-06-12 17:32:38 +08:00
Xie Xingguo
302d7bcdd8
Merge pull request #27735 from xiexingguo/wip-device-class-noout
osd: revamp {noup,nodown,noin,noout} related commands

Reviewed-by: Sage Weil <sage@redhat.com>
2019-06-05 14:17:06 +08:00
xie xingguo
199d92aec0 qa: tolerate wildcard position
It does not make much sense to add this kind of restrictions
as long as user is aware of what is going on.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-05-30 10:52:38 +08:00
xie xingguo
5d695267ef osd: add no{out,down,in,out} flags by device class
This works as a good supplement of https://github.com/ceph/ceph/pull/27563.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-05-30 10:52:35 +08:00
xie xingguo
9a05a065b9 osd,mon: add 'ceph osd {set,unset}-group <flags> <who>' command
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-05-30 09:46:51 +08:00
Jason Dillaman
b36a1ad302 qa/workunits/rbd: remove 'fast-diff' from dynamic features test
Fixes: http://tracker.ceph.com/issues/39946
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-15 16:53:43 -04:00
Nathan Cutler
cfa2c5fb4d
Merge pull request #26281 from smithfarm/wip-git-describe-long
make-dist: set version number only once

Reviewed-by: Tim Serong <tserong@suse.com>
2019-05-13 15:10:20 +02:00
Jason Dillaman
fb4f9a8a08 qa/workunits/rbd: use https protocol for devstack git operations
Fixes: http://tracker.ceph.com/issues/39656
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-10 11:09:54 -04:00
Nathan Cutler
f9f824448a qa: add version number sanity singleton to rados suite
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-05-08 11:31:34 +02:00
Mykola Golub
a3de279923
Merge pull request #27981 from dillaman/wip-39598
qa/workunits/rbd: wait for rbd-nbd unmap to complete

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-05-07 20:58:01 +03:00
Joao Eduardo Luis
28c70208d8
Merge pull request #26488 from mogeb/per-pool-scrub-status
mon: show no[deep-]scrub flags per pool in the status

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2019-05-07 17:50:52 +01:00
Jason Dillaman
87278548a5 qa/workunits/rbd: wait for rbd-nbd unmap to complete
The "unmap" request is asynchronous, so wait for a short amount
of time for the "rbd-nbd" daemon process to exit.

Fixes: http://tracker.ceph.com/issues/39598
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-06 15:16:03 -04:00
Boris Ranto
aaaef9146c restful: Expose perf counters
We currently do not expose perf counters in the restful module but this
is a useful piece of information to be exposed by the restful module.

Since we already have a function to gather all the information about the
perf counters, we can make this easily accessible through the restful
API.

This also supports filtering by daemons through regexps.

Signed-off-by: Boris Ranto <branto@redhat.com>
2019-04-30 13:30:14 +02:00
David Zafman
39cc14bdc1
Merge pull request #27503 from dzafman/wip-39099
osd: Give recovery for inactive PGs a higher priority

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-04-25 15:06:56 -07:00
David Zafman
444aa9f9fe osd, mon: New pool recovery priority range -10 to 10
Use OSD_POOL_PRIORITY_MAX and OSD_POOL_PRIORITY_MIN constants
Scale legacy priorities if exceeds maximum

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-04-25 13:53:27 -07:00
Sage Weil
d64d14a577 Merge PR #26730 into master
* refs/pull/26730/head:
	src/test: remove unused objects to calculate accurate dedup ratio.
	src/tools: fix counting total objects
	src/tools: fix printing wrong offset.
	src/tools: fix dedup tool's name
	qa/workunit: add rabin chunk test
	src/tool: add rabin fingerprint option to cephdeduptool
	src/common: add rabin fingerprint class
	Initail work for rabin fingerprint

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-24 20:38:02 -05:00
Mykola Golub
22973d9d46
Merge pull request #27683 from dillaman/wip-24668
qa/workunits/rbd: use more recent qemu-iotests that support Bionic

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-04-24 15:40:43 +03:00
myoungwon oh
8a8d5e89bb src/test: remove unused objects to calculate accurate dedup ratio.
Signed-off-by: Myoungwon Oh <ommw@sk.com>
2019-04-24 18:22:37 +09:00
Xie Xingguo
78bcae1d6b
Merge pull request #27719 from xiexingguo/wip-crush-node-flags
mon/OSDMonitor: crush node flags - two fixes; add tests

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-24 08:44:08 +08:00
Jason Dillaman
b7c7a4f39e
Merge pull request #27521 from trociny/wip-rbd-remove-clone_v2-parent
librbd: optionally move parent image to trash on remove

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-04-23 08:11:38 -04:00
xie xingguo
bae2231cc5 qa: add crush-node-flags test
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-04-23 14:20:17 +08:00
Jason Dillaman
b184acd218 qa/workunits/rbd: use more recent qemu-iotests that support Bionic
Fixes: http://tracker.ceph.com/issues/24668
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-04-22 12:46:47 -04:00
Jason Dillaman
5b0a611a48 test/librbd: drop 'ceph_test_librbd_api' target
This was used for API backwards compatibility testing, but now that
the C++ API will not remain stable, it serves no purpose.

Fixes: http://tracker.ceph.com/issues/39072
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-04-19 14:18:00 -04:00
Mykola Golub
6e1434eefc librbd: optionally move parent image to trash on remove
and auto-delete when the last clone is detached

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-04-19 08:53:38 +01:00
Ilya Dryomov
b56e933373
Merge pull request #27271 from idryomov/wip-krbd-wac-on-dm
qa: add device mapper and lvm test cases for stable pages

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-04-14 21:31:00 +02:00
myoungwon oh
d72cc5a0ee src/tools: fix dedup tool's name
Signed-off-by: Myoungwon Oh <ommw@sk.com>
2019-04-08 19:19:09 +09:00
myoungwon oh
a095765f2f qa/workunit: add rabin chunk test
Signed-off-by: Myoungwon Oh <ommw@sk.com>
2019-04-04 23:58:57 +09:00
Sage Weil
3760e8f918 mon/OSDMonitor: add mon_debug_no_require_octopus
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
2806de1147 mon/OSDMonitor: allow 'osd require-osd-release octopus'
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Mohamad Gebai
aa9cb58390 test: add tests for per-pool scrub status
Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2019-04-02 05:50:03 -04:00
Ilya Dryomov
9c736f57ee qa: krbd_wac.sh: add lvm test case
The script isn't generic anymore, move it to the rbd directory.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-03-29 11:20:30 +01:00
Ilya Dryomov
316ae0cfa4 qa: krbd_stable_pages_required.sh: add device mapper test cases
device mapper core wasn't propagating BDI_CAP_STABLE_WRITES.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-03-28 19:34:15 +01:00
Sage Weil
1dad9d2fe1 Merge PR #27155 into master
* refs/pull/27155/head:
	mon/ConfigMonitor: make 'config reset' idempotent

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-26 11:35:45 -05:00
Ilya Dryomov
0ba913ba2c
Merge pull request #27192 from idryomov/wip-krbd-discard-fixups
qa/workunits/rbd: fixups for the new krbd discard behavior

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-03-26 14:09:41 +01:00
Jason Dillaman
6e32108204
Merge pull request #27137 from trociny/wip-qa-rbd-qos
qa: add RBD QOS functional test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-03-26 08:21:18 -04:00
Ilya Dryomov
f3f757aaa3 qa/workunits/rbd: fixups for the new krbd discard behavior
With discard_granularity set to alloc_size, we no longer get object
size alignment from blk_bio_discard_split().

This assumption is pretty deeply ingrained in krbd_data_pool.sh, so
make it explicit.  For krbd_fallocate.sh, just fix the expectation.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-03-25 22:06:14 +01:00
Ilya Dryomov
673673f53d qa: krbd_fallocate.sh: zero can be munged to truncate
The test case is issuing discards that span two objects: the tail of
the first object is truncated, the head of the second object is zeroed.
These discards aren't serial, so there is a race:

  discard i ~ i + 1: truncate i, zero i + 1
  discard i + 1 ~ i + 2: truncate i + 1, zero i + 2

can be executed as

  truncate i + 1, zero i + 2, truncate i, zero i + 1

For object i + 1, the sequence ends up being truncate tail, then zero
head.  This zero op is munged to truncate on the OSD, resulting in size
0 instead of OBJECT_SIZE / 2.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-03-25 22:06:14 +01:00
xie xingguo
794e3dfc80 mon/ConfigMonitor: make 'config reset' idempotent
This partially revert 1bc9c86d08.
It's generally not a good idea if a command is not idempotent.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-03-25 20:35:42 +08:00
Xie Xingguo
c9dbaf279e
Merge pull request #27090 from xiexingguo/wip-config-mon-core
mon/ConfigMonitor: make 'num' of 'config reset' optional; allow target version 0

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-25 13:28:41 +08:00
xie xingguo
1bc9c86d08 mon/ConfigMonitor: make 'num' of 'config reset' command optional
This way it can be used to fast cancel/undo the last command.
Also make the tip message a litter bit nicer..

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-03-25 09:41:05 +08:00
Kefu Chai
b8082ebc56 qa/workunits/mon/config.sh: s|bin/ceph|ceph|
so we can verify that ceph is able to reject wrong debug levels.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-23 22:43:08 +08:00
Mykola Golub
63f3d7e377 qa/workunits/rbd: add QOS functional test
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-03-22 14:58:22 +00:00
Sage Weil
be1187575b Merge PR #27021 into master
* refs/pull/27021/head:
	msg: remove XioMessenger
	qa/suites/rados/thrash-old-clients: add nautilus
	qa/suites/rados/thrash-old-clients: add mimic v1 variant
	qa/suites/rados/thrash-old-clients: add mimic
	qa/suites/rados/thrash-old-clients: collapse msgr and client choice
	qa: remove simplemessenger tests
	ceph_test_msgr: remove simple
	msg: remove SimpleMessenger

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-03-22 04:42:30 -05:00
Kefu Chai
32df73f9f2
Merge pull request #26940 from xiexingguo/wip-monc-add-con
mon/MonClient: weight-based mon selection

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-03-22 15:43:04 +08:00
Sage Weil
cc9a9142fd msg: remove XioMessenger
There is a lot of good stuff going on here, but nobody is investing in xio
and it is not expected to be the path forward for RDMA.  If that ever
changes, we can resurrect the code.  Until then, let's clean up the tree
and reduce friction for changes going forward.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-21 00:57:33 -05:00
Sage Weil
1245809516 Merge PR #26604 into master
* refs/pull/26604/head:
	qa/workunits/rest: Better detection of rest url

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-19 22:45:43 -05:00
xie xingguo
2f195b7072 mon: add set-weight command
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-03-20 11:23:32 +08:00