RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-02-23 19:17:37 +00:00
Code Issues Packages Projects Releases Wiki Activity
100,171 Commits 216 Branches 395 Tags 1.4 GiB
02eace72e2
Commit Graph

5166 Commits

Author SHA1 Message Date
Mykola Golub
11e2951243 qa/suites/rbd: allow to test with require-min-compat-client octopus 
Signed-off-by: Mykola Golub <mgolub@suse.com>
 2019-06-23 10:06:45 +01:00
Kefu Chai
90022b35ab
Merge pull request #17619 from liuchang0812/wip-ec-below-min-size 
osd: allow EC PGs to do recovery below min_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
 2019-06-22 12:58:55 +08:00
Casey Bodley
9b8be0584d qa/rgw: fix swift warning message 
File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/swift.py", line 245, in task
    log.warning('Swift tests cannot run on rhel 7.6+, skipping client {client}'.format(client))
KeyError: 'client'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2019-06-21 15:18:59 -04:00
Neha Ojha
bd15824567
Merge pull request #28204 from dzafman/wip-39555 
mon: Improve health status for backfill_toofull and recovery_toofull

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Neha Ojha <nojha@redhat.com>
 2019-06-20 11:12:10 -07:00
Patrick Donnelly
475f2deaf3
Merge PR #28561 into master 
* refs/pull/28561/head:
	vstart_runner: upgrade the check for commands to be run as another user
	vstart_runner: split unicode arguments into lists

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-20 11:09:01 -07:00
Rishabh Dave
21a1b30a3e vstart_runner: upgrade the check for commands to be run as another user 
Rectify the condition that checks if command to be issued as another
user using sudo is issued as a single argument after "-c".

Signed-off-by: Rishabh Dave <ridave@redhat.com>
 2019-06-20 21:35:38 +05:30
Patrick Donnelly
f26493cc25
Merge PR #28194 into master 
* refs/pull/28194/head:
	test_volume_client: declare only one default for python version
	test_volume_client: don't shadow class variable

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-20 06:27:04 -07:00
Patrick Donnelly
753da4ec7b
Merge PR #28638 into master 
* refs/pull/28638/head:
	qa: elide python version config
	cephfs-shell: assert python3

Reviewed-by: Rishabh Dave <ridave@redhat.com>
 2019-06-20 06:08:47 -07:00
Rishabh Dave
d78e035432 test_volume_client: declare only one default for python version 
Fixes: http://tracker.ceph.com/issues/40460
Signed-off-by: Rishabh Dave <ridave@redhat.com>
 2019-06-20 12:18:49 +05:30
Rishabh Dave
da441cb381 vstart_runner: split unicode arguments into lists 
Split not just string arguments but also unicode arguments into lists.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
 2019-06-20 11:04:59 +05:30
Xie Xingguo
b294dc6749
Merge pull request #28629 from xiexingguo/wip-osd-df-by-pool-name 
mgr, osd: 'osd df' by pool

Reviewed-by: Sage Weil <sage@redhat.com>
 2019-06-20 10:40:40 +08:00
David Zafman
fa698e18e1 mon: Improve health status for backfill_toofull and recovery_toofull 
Treat backfull_toofull as a warning condition because it can resolve itself.
Includes test case for PG_BACKFILL_FULL
Includes test case for recovery_toofull / PG_RECOVERY_FULL

Fixes: https://tracker.ceph.com/issues/39555

Signed-off-by: David Zafman <dzafman@redhat.com>
 2019-06-20 02:22:01 +00:00
Patrick Donnelly
ff1f04f4d5
qa: elide python version config 
This test doesn't actually use the config and cephfs-shell is py3 only.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-19 18:22:51 -07:00
Jason Dillaman
9497655da5
Merge pull request #28553 from trociny/wip-40071 
librbd: mirror image enable/disable should enable/disable journaling

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2019-06-19 20:21:37 -04:00
Sage Weil
afd0b508c2 qa/suites/rados/thrash: force normal pg log length with cache tiering 
When we are doing cache tiering, we are more sensitive to short PG logs
because the dup op entries are not perfectly promoted from the base to
the cache.

See:
 http://tracker.ceph.com/issues/38358
 http://tracker.ceph.com/issues/24320

This works around the problem by not testing short pg logs in combination
with cache tiering.  This works because the short_pg_log.yaml fragment
sets the short log in the [global] section but the cache workloads overload
it (back to a large/default value) in the [osd] section.

Signed-off-by: Sage Weil <sage@redhat.com>
 2019-06-19 11:15:25 -05:00
Casey Bodley
8d44d03d4d
Merge pull request #28631 from cbodley/wip-17882 
qa/rgw: extra s3tests tasks use rgw endpoint configuration

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2019-06-19 09:32:18 -04:00
Sage Weil
ef1f331b8f Merge PR #28453 into master 
* refs/pull/28453/head:
	qa/valgrind.supp: be slightly less specific on suppression
	msg/async, v2: make the reset_recv_state() unconditional.

Reviewed-by: Sage Weil <sage@redhat.com>
 2019-06-19 07:59:45 -05:00
Rishabh Dave
4870574473 test_volume_client: don't shadow class variable 
Name class and instance variables differently so that the latter doesn't
shadow the former.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
 2019-06-19 17:50:55 +05:30
Casey Bodley
1643879218 qa/rgw: update default port in perl workunits 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2019-06-19 07:50:35 -04:00
Casey Bodley
09e992ff01 qa/rgw: extra s3tests tasks use rgw endpoint configuration 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2019-06-19 07:50:35 -04:00
Yan, Zheng
cd29206974 mds: remove the code that skip evicting the only client 
There is already logic that defer marking unresponsive client stale.
No reason to defer evicting the only stale client.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
 2019-06-19 14:28:31 +08:00
xie xingguo
ec27a162de mgr, osd: 'ceph osd df' by pool 
Our test admin has been asking for this for the past few years:-)
Besides, this is also useful for operating on large Ceph clusters with
mutliple storage pools possibly spanning over all osds.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
 2019-06-18 20:29:40 +08:00
Mykola Golub
c99e26eff9 qa/workunits/rbd: tweak mirror tests 
(after "image mirror disable" started to disable journaling)

Signed-off-by: Mykola Golub <mgolub@suse.com>
 2019-06-18 12:08:58 +01:00
Kiefer Chang
f57a3aae01
mgr/dashboard: support pool quotas in backend 
Fixes: https://tracker.ceph.com/issues/36559
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
 2019-06-18 15:44:03 +08:00
Yuri Weinstein
10dfa31e23
Merge pull request #28605 from cbodley/wip-40304 
qa/rgw: fix import error in tasks/swift.py

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
 2019-06-17 13:22:49 -07:00
Casey Bodley
2dd5574cf9 qa/rgw: fix import error in tasks/swift.py 
> ImportError: No module named packaging

replaces packaging.version.Version with distutils.version.LooseVersion

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2019-06-17 15:07:40 -04:00
Stephan Müller
2f18cf5770 mgr/dashboard: Pool list shows current r/w byte usage in graph 
Now the pool list will show the current read and write byte usage in the
sparkline graph like it is already done in the OSD listing.

Fixes: https://tracker.ceph.com/issues/39650
Signed-off-by: Stephan Müller <smueller@suse.com>
 2019-06-17 17:04:22 +02:00
Jason Dillaman
6dd39a1764
Merge pull request #28524 from trociny/wip-qa-rbd-mirror-compare 
qa/workunits/rbd: fix compare_images and compare_image_snapshots

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2019-06-17 09:02:40 -04:00
Lenz Grimmer
61c7632a3d
mgr/dashboard: Add QA tests for RBD configuration (#27774) 
mgr/dashboard: Add QA tests for RBD configuration

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
 2019-06-17 13:29:00 +02:00
Patrick Donnelly
85470cd171
Merge PR #28198 into master 
* refs/pull/28198/head:
	qa/tasks: upgrade command arguments checks in vstart_runner.py

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-14 11:44:17 -07:00
Neha Ojha
94246359f2
Merge pull request #28522 from neha-ojha/wip-add-client-endpoints 
qa/tasks/cbt.py: add support for client_endpoints

Reviewed-by: Mark Nelson <mnelson@redhat.com>
 2019-06-14 09:34:57 -07:00
Mykola Golub
017bc7db97
Merge pull request #28346 from smithfarm/wip-39447-alt 
qa/rbd: add cram-based snap diff test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
 2019-06-14 18:19:31 +03:00
Yuri Weinstein
2b3719264c
Merge pull request #28532 from cbodley/wip-40304 
qa/rgw: skip swift tests on rhel 7.6+
 2019-06-14 08:16:32 -07:00
Laura Paduano
a6636bd941
Merge pull request #28260 from s0nea/wip-dashboard-pool-delete-flag 
mgr/dashboard: consider 'mon_allow_pool_delete' flag

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
 2019-06-14 12:02:02 +02:00
Nathan Cutler
47645be3bb qa/rbd: add cram-based snap diff test 
Fixes: http://tracker.ceph.com/issues/39447
Signed-off-by: Shyukri Shyukriev <shshyukriev@suse.com>
Signed-off-by: Nathan Cutler <ncutler@suse.com>
 2019-06-14 09:42:23 +02:00
Casey Bodley
c0c00180bd
Merge pull request #28521 from alimaredia/wip-qa-rgw-ssl 
qa: use curl in wait_for_radosgw() in util/rgw.py

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2019-06-13 15:00:21 -04:00
Ali Maredia
9c6afa3fb5 qa: use curl in wait_for_radosgw() in util/rgw.py 
Signed-off-by: Ali Maredia <amaredia@redhat.com>
 2019-06-13 12:05:56 -04:00
Casey Bodley
c62f89fd75 qa/rgw: skip swift tests on rhel 7.6+ 
swift bootstrap fails because libev-devel is not available

Fixes: http://tracker.ceph.com/issues/40304

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2019-06-13 11:10:31 -04:00
Mykola Golub
92ee1c7b8b qa/workunits/rbd: fix compare_images and compare_image_snapshots 
Due to pipe, sdiff return code was ignored. Also the compare functions
spent most of time in xxd, which was normally unnecessary.

Signed-off-by: Mykola Golub <mgolub@suse.com>
 2019-06-13 08:26:29 +01:00
Neha Ojha
143c1da2d2 qa/tasks/cbt.py: add support for client_endpoints 
Note that this will only work for librbdfio for now.

Signed-off-by: Neha Ojha <nojha@redhat.com>
 2019-06-12 22:36:12 +00:00
Patrick Donnelly
c28ae6970f
Merge PR #27856 into master 
* refs/pull/27856/head:
	test: remove fs/test-volume.sh workunit
	test: port fs/volume related tests to python

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-12 14:27:07 -07:00
Patrick Donnelly
9e1771472b
Merge PR #28221 into master 
* refs/pull/28221/head:
	qa/tasks/cephfs/test_volume_client: print py2 or py3 which the test case runs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
 2019-06-12 14:15:30 -07:00
Patrick Donnelly
97e71e64df
Merge PR #26737 into master 
* refs/pull/26737/head:
	qa/cephfs: update tests for stale session handling
	mds: change how mds revoke stale caps
	mds: don't mark unresponsive sessions holding no caps stale

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-12 14:07:22 -07:00
Venky Shankar
0d044a97e9 test: remove fs/test-volume.sh workunit 
.. since its ported to python now.

Fixes: http://tracker.ceph.com/issues/39949
Signed-off-by: Venky Shankar <vshankar@redhat.com>
 2019-06-12 12:43:17 -04:00
Venky Shankar
d92840b59e test: port fs/volume related tests to python 
... and add subvolume related tests.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
 2019-06-12 12:43:17 -04:00
Yuri Weinstein
524e339a9d qa/tests: removed upgrade/client-upgrade-hammer becasue ubuntu 14.04 is not supported 
Also removed ubuntu 14.04 filters

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
 2019-06-12 09:13:15 -07:00
Sage Weil
f019fc094e qa/valgrind.supp: be slightly less specific on suppression 
I am seeing this trace, which matches except for the
'fun:_ZN15AsyncConnection7processEv' frame.

<error>
  <unique>0x2399</unique>
  <tid>11</tid>
  <threadname>msgr-worker-1</threadname>
  <kind>UninitCondition</kind>
  <what>Conditional jump or move depends on uninitialised value(s)</what>
  <stack>
    <frame>
      <ip>0x5366B18</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>ceph::crypto::onwire::AES128GCM_OnWireRxHandler::authenticated_decrypt_update_final(ceph::buffer::v14_2_0::list&amp;&amp;, unsigned int)</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>crypto_onwire.cc</file>
      <line>274</line>
    </frame>
    <frame>
      <ip>0x5355E60</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&lt;ceph::buffer::v14_2_0::ptr_node, ceph::buffer::v14_2_0::ptr_node::disposer&gt;&amp;&amp;, int)</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>ProtocolV2.cc</file>
      <line>1311</line>
    </frame>
    <frame>
      <ip>0x533E2A3</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>ProtocolV2::run_continuation(Ct&lt;ProtocolV2&gt;&amp;)</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>ProtocolV2.cc</file>
      <line>45</line>
    </frame>
    <frame>
      <ip>0x534FB1C</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>ProtocolV2::reuse_connection(boost::intrusive_ptr&lt;AsyncConnection&gt; const&amp;, ProtocolV2*)::{lambda(ConnectedSocket&amp;)#3}::operator()(ConnectedSocket&amp;)::{lambda()#2}::operator()()</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>ProtocolV2.cc</file>
      <line>2739</line>
    </frame>
    <frame>
      <ip>0x534FF57</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>ProtocolV2::reuse_connection(boost::intrusive_ptr&lt;AsyncConnection&gt; const&amp;, ProtocolV2*)::{lambda(ConnectedSocket&amp;)#3}::operator()(ConnectedSocket&amp;)</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>ProtocolV2.cc</file>
      <line>2745</line>
    </frame>
    <frame>
      <ip>0x535001E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>__invoke_impl&lt;void, ProtocolV2::reuse_connection(const AsyncConnectionRef&amp;, ProtocolV2*)::&lt;lambda(ConnectedSocket&amp;)&gt;&amp;, ConnectedSocket&amp;&gt;</fn>
      <dir>/opt/rh/devtoolset-8/root/usr/include/c++/8/bits</dir>
      <file>invoke.h</file>
      <line>60</line>
    </frame>
    <frame>
      <ip>0x535001E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>__invoke&lt;ProtocolV2::reuse_connection(const AsyncConnectionRef&amp;, ProtocolV2*)::&lt;lambda(ConnectedSocket&amp;)&gt;&amp;, ConnectedSocket&amp;&gt;</fn>
      <dir>/opt/rh/devtoolset-8/root/usr/include/c++/8/bits</dir>
      <file>invoke.h</file>
      <line>95</line>
    </frame>
    <frame>
      <ip>0x535001E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>__call&lt;void, 0&gt;</fn>
      <dir>/opt/rh/devtoolset-8/root/usr/include/c++/8</dir>
      <file>functional</file>
      <line>400</line>
    </frame>
    <frame>
      <ip>0x535001E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>operator()&lt;&gt;</fn>
      <dir>/opt/rh/devtoolset-8/root/usr/include/c++/8</dir>
      <file>functional</file>
      <line>484</line>
    </frame>
    <frame>
      <ip>0x535001E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>EventCenter::C_submit_event&lt;std::_Bind&lt;ProtocolV2::reuse_connection(boost::intrusive_ptr&lt;AsyncConnection&gt; const&amp;, ProtocolV2*)::{lambda(ConnectedSocket&amp;)#3} (ConnectedSocket)&gt; &gt;::do_request(unsigned long)</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>Event.h</file>
      <line>227</line>
    </frame>
    <frame>
      <ip>0x535FCD6</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>EventCenter::process_events(unsigned int, std::chrono::duration&lt;unsigned long, std::ratio&lt;1l, 1000000000l&gt; &gt;*)</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>Event.cc</file>
      <line>441</line>
    </frame>
    <frame>
      <ip>0x5365086</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>operator()</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>Stack.cc</file>
      <line>53</line>
    </frame>
    <frame>
      <ip>0x5365086</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>std::_Function_handler&lt;void (), NetworkStack::add_thread(unsigned int)::{lambda()#1}&gt;::_M_invoke(std::_Any_data const&amp;)</fn>
      <dir>/opt/rh/devtoolset-8/root/usr/include/c++/8/bits</dir>
      <file>std_function.h</file>
      <line>297</line>
    </frame>
    <frame>
      <ip>0x55F519E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>execute_native_thread_routine</fn>
    </frame>
    <frame>
      <ip>0x1076BDD4</ip>
      <obj>/usr/lib64/libpthread-2.17.so</obj>
      <fn>start_thread</fn>
    </frame>
    <frame>
      <ip>0x118E0EAC</ip>
      <obj>/usr/lib64/libc-2.17.so</obj>
      <fn>clone</fn>
    </frame>
  </stack>
</error>

Signed-off-by: Sage Weil <sage@redhat.com>
 2019-06-12 10:33:16 -05:00
Kefu Chai
b76a6c729f qa/workunits/rados/test_envlibrados_for_rocksdb: support SUSE distros 
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-12 17:46:46 +08:00
Kefu Chai
be89e66f74 qa/workunits/rados/test_librados_build.sh: install build deps 
to build helloworld of librados, we need to install the build
dependencies.

Fixes: https://tracker.ceph.com/issues/40155
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-12 17:46:46 +08:00
Kefu Chai
0072d487aa qa/workunits/rados/test_envlibrados_for_rocksdb: use helper script 
instead of having its own copy of `install()`, try to leverage the
helper in ceph-helpers-root.sh.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-12 17:46:46 +08:00
Kefu Chai
e8e72319aa qa/workunits/ceph-helpers-root: use /etc/os-release instead 
as lsb_release does not work on SUSE distros

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-12 17:32:38 +08:00
Neha Ojha
469abff18c qa/suites/perf-basic/workloads: add client_endpoint_rbd_4K_rand_write.yaml 
Signed-off-by: Neha Ojha <nojha@redhat.com>
 2019-06-12 00:16:59 +00:00
Lianne
7c7c7870d3 qa/tasks/cephfs/test_volume_client: print py2 or py3 which the test case runs 
Fixes: http://tracker.ceph.com/issues/40184

Signed-off-by: Lianne <liyan.wang@xtaotech.com>
 2019-06-11 18:27:06 +08:00
Yuri Weinstein
a986bd0ae2 qa.tests: added "smoke" suite to the schedule on "mimic","nautilus" 
Note: frequency can/will reduce later

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
 2019-06-10 12:40:30 -07:00
Yan, Zheng
1c8be588e3 qa/cephfs: update tests for stale session handling 
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
 2019-06-08 21:15:14 +08:00
Patrick Donnelly
38fc69d0fa
Merge PR #28171 into master 
* refs/pull/28171/head:
	test_volume_client: simplify test_get_authorized_ids()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-07 21:20:18 -07:00
Patrick Donnelly
2c2cf856b2
Merge PR #28293 into master 
* refs/pull/28293/head:
	mds: avoid passing null to SessionmMap::hit_session()
	qa/cephfs: add test for blacklisted client eviction
	mds: fix 'is session in blacklist' check in Server::apply_blacklist()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-07 21:16:14 -07:00
Patrick Donnelly
eaaf648ccb
Merge PR #28411 into master 
* refs/pull/28411/head:
	qa/cephfs: fix test_evict_client

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-07 21:12:38 -07:00
Yuri Weinstein
103a4299cd qa/tests: removed 1node and systemd tests as ceph-deploy is not actively developed 
Fixes: http://tracker.ceph.com/issues/40207
Fixes: http://tracker.ceph.com/issues/40208
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
 2019-06-07 14:39:15 -07:00
Neha Ojha
2780813667
Merge pull request #28442 from neha-ojha/wip-40120-port 
qa/tasks/cbt.py: change port to work with client_endpoints

Reviewed-by: Mark Nelson <mnelson@redhat.com>
 2019-06-07 09:36:52 -07:00
Yuri Weinstein
dd1ef1081a
Merge pull request #28435 from yuriw/wip-yuriw-smoke-master 
qa/tests: reduced distro to run to be random
 2019-06-07 09:13:49 -07:00
Rishabh Dave
c086c13b22 qa/tasks: upgrade command arguments checks in vstart_runner.py 
Exempt run.Raw from checks in vstart_runner.py as most of them are
meant for strings.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
 2019-06-07 13:20:06 +05:30
Neha Ojha
ee02416c65 qa/tasks/cbt.py: change port to work with client_endpoints 
hack to work with https://github.com/ceph/cbt/pull/160/

Signed-off-by: Neha Ojha <nojha@redhat.com>
 2019-06-06 17:21:38 -07:00
Yuri Weinstein
4c335b31fe
Merge pull request #28439 from yuriw/wip-yuriw-crontab-master 
qa/tests:  filtered in only "trusty"
 2019-06-06 16:24:19 -07:00
Yuri Weinstein
7939b1a10f qa/tests: filtered in only "trusty" 
Fixes: http://tracker.ceph.com/issues/40195
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
 2019-06-06 14:36:57 -07:00
Patrick Donnelly
66f18ecd09
qa: use mimic-O upgrade process 
Fixes: https://tracker.ceph.com/issues/39436

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-06 13:06:56 -07:00
Yuri Weinstein
c6c90663c3 qa/tests: reduced distro to run to be random 
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
 2019-06-06 10:08:55 -07:00
Lenz Grimmer
e7b605ae5b
mgr/dashboard: show degraded/misplaced/unfound objects. (#28104) 
mgr/dashboard: show degraded/misplaced/unfound objects.

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
 2019-06-06 11:46:36 +02:00
David Zafman
590b4138ae
Merge pull request #28302 from dzafman/wip-40078 
test: Make sure that extra scheduled scrubs don't confuse test

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2019-06-05 14:43:30 -07:00
Sage Weil
65379e3165 Merge PR #28353 into master 
* refs/pull/28353/head:
	qa/suites/rados/multimon: skew clocks 2s (< paxos lease)
	qa/suites/rados/multimon: create_rbd_pool: false
	qa/suites/rados/multimon: no osds when skewing clock

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2019-06-05 10:22:26 -05:00
Yan, Zheng
4fd0202fdf qa/cephfs: fix test_evict_client 
explictly kill stale session, otherwise session count check is racy.

Fixes: https://tracker.ceph.com/issues/40173
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
 2019-06-05 22:04:22 +08:00
Yan, Zheng
89759654c1 qa/cephfs: add test for blacklisted client eviction 
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
 2019-06-05 21:05:06 +08:00
Xie Xingguo
302d7bcdd8
Merge pull request #27735 from xiexingguo/wip-device-class-noout 
osd: revamp {noup,nodown,noin,noout} related commands

Reviewed-by: Sage Weil <sage@redhat.com>
 2019-06-05 14:17:06 +08:00
Patrick Donnelly
fd358e73c0
qa: fix kclient symlink to use latest rhel7 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-03 14:39:57 -07:00
Patrick Donnelly
39e23bb596
qa: fix latest distros and add helper symlinks 
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-03 14:39:17 -07:00
Casey Bodley
8c8a706b6f qa/rgw: add dnsmasq back to s3a-hadoop 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2019-06-03 13:07:41 -04:00
Casey Bodley
658e5932fb qa/rgw: rgw task can override --rgw-dns-name on the command line 
the value for rgw_dns_name isn't known until a machine is assigned, so
it can't be set via 'override: conf:'. add a per-client config option
to the rgw task so it can add the endpoint's hostname and/or s3website
hostname on the radosgw command line

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2019-06-03 13:07:41 -04:00
Casey Bodley
0fc2c8ecee qa/rgw: remove ceph-ansible from s3a-hadoop suite 
Fixes: http://tracker.ceph.com/issues/39706

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2019-06-03 13:07:41 -04:00
Casey Bodley
3ff5f0c240 qa/rgw: use default ports (80 or 443) unless overridden 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2019-06-03 13:07:41 -04:00
Casey Bodley
921faebb72 qa/rgw: allow rgw client config to override port 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2019-06-03 13:07:41 -04:00
Sage Weil
fd00136eb3 qa/suites/rados/multimon: skew clocks 2s (< paxos lease) 
If the leader is the one with the accurate clock, it can still
form quorum, but if the leader has the skewed clock, all other mons appear
skewed from its perspective and no quorum is formed.  This leads to
intermittent failures, depending on the non-deterministic teuthology
deployment order and how the mon IPs sort.

Fix by reducing the skew.  This is enough skew to trigger a warning, but
not enough that it will break quorum.  This ensures that the parts of the
teuthology test that issue random mon commands won't fail (e.g., 'ceph osd
dump').

Fixes: http://tracker.ceph.com/issues/40112
Signed-off-by: Sage Weil <sage@redhat.com>
 2019-06-03 10:49:02 -05:00
Casey Bodley
bdfc3bb92d
Merge pull request #28305 from rzarzynski/wip-bug-38827 
qa/valgrind.supp: generalize the whiterule for aes-128-gcm to help rgw suite.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2019-06-03 09:09:24 -04:00
Patrick Donnelly
d1ae3194d8
Merge PR #28199 into master 
* refs/pull/28199/head:
	qa/tasks: upgrade the check for -c sudo option in vstart_runner.py

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-05-31 13:10:18 -07:00
Mykola Golub
4c5e9267ea
Merge pull request #28135 from dillaman/wip-39946 
qa/workunits/rbd: remove 'fast-diff' from dynamic features test

Reviewed-by: Mykola Golub <mgolub@suse.com>
 2019-05-31 17:16:46 +03:00
Sage Weil
8d137b9345 qa/suites/rados/multimon: create_rbd_pool: false 
Signed-off-by: Sage Weil <sage@redhat.com>
 2019-05-30 15:43:48 -05:00
Sage Weil
1991faaafe qa/suites/rados/multimon: no osds when skewing clock 
Sometimes the clock skew prevents the mon quorum from making progress and
processing the osd boot messages.

Signed-off-by: Sage Weil <sage@redhat.com>
 2019-05-30 13:05:54 -05:00
Kefu Chai
cdba0f1420 qa/standalone/ceph-helpers: resurrect all OSD before waiting for health 
address the regression introduced by e62cfceb
in e62cfceb, we wanted to test the newly introduced TOO_FEW_OSDS
warning, so we increased the number of OSD to the size of pool, so if
the number of OSD is less than pool size, monitor will send a warning
message.

but we need to bring all OSDs back if we are expecting a healthy
cluster. in this change, all OSDs are resurrect before
`wait_for_health_ok`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-05-30 23:52:36 +08:00
Kefu Chai
e5064b894c qa/run-standalone.sh: s/Makefile/CMakeCache.txt/ 
as we could use a generator other than Make, for instance ninja.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-05-30 23:52:36 +08:00
Kefu Chai
f6b022bdbe
Merge pull request #27806 from ashitakasam/add-osd-alarm 
osd: Better error message when OSD count is less than osd_pool_default_size

Reviewed-by: Neha Ojha <nojha@redhat.com>
 2019-05-30 21:28:54 +08:00
alfonsomthd
439fec829f mgr/dashboard: show degraded/misplaced/unfound objects. 
* Landing Page 'Objects' card now is a chart that shows more info about objects.
* Fix: Dimless/dimlessBinary pipe applied to amount displayed in
  chart slice tooltip body (if shown).
* Refactoring: simplified way of setting chart initial config
  via 'config' @Input; erased redundant @Inputs.
  Updated chart component default config (for the sake of simplicity).

Fixes: https://tracker.ceph.com/issues/39613

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
 2019-05-30 09:57:54 +02:00
xie xingguo
199d92aec0 qa: tolerate wildcard position 
It does not make much sense to add this kind of restrictions
as long as user is aware of what is going on.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
 2019-05-30 10:52:38 +08:00
xie xingguo
5d695267ef osd: add no{out,down,in,out} flags by device class 
This works as a good supplement of https://github.com/ceph/ceph/pull/27563.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
 2019-05-30 10:52:35 +08:00
xie xingguo
9a05a065b9 osd,mon: add 'ceph osd {set,unset}-group <flags> <who>' command 
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
 2019-05-30 09:46:51 +08:00
Radoslaw Zarzynski
b2007e275f Revert "qa: remove mon valgrind check in rgw verfiy suite" 
This reverts commit d25d6ee0af.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
 2019-05-29 23:39:16 +02:00
Radoslaw Zarzynski
af63e3f51f qa/valgrind.supp: fix the name for aes-128-gcm whiterules. 
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
 2019-05-29 23:39:16 +02:00
Radoslaw Zarzynski
b71ded7b44 qa/valgrind.supp: generalize the whiterule for aes-128-gcm. 
Fixes: http://tracker.ceph.com/issues/38827
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
 2019-05-29 23:10:52 +02:00
David Zafman
893d227c82 test: Make sure that extra scheduled scrubs don't confuse test 
Fixes: http://tracker.ceph.com/issues/40078

Signed-off-by: David Zafman <dzafman@redhat.com>
 2019-05-29 14:03:57 -07:00
Sage Weil
b747ae1711 qa/tasks/ceph: tolerate 'T' or ' ' as date and time separator 
Signed-off-by: Sage Weil <sage@redhat.com>
 2019-05-29 14:12:15 -05:00
Yuri Weinstein
5111f6df16
Merge pull request #28271 from yuriw/wip-yuriw-crontab-master 
qa/tests: removed filters for client-upgrade-* suites
 2019-05-29 09:33:19 -07:00
Tatjana Dehler
b5eb71dbd2 mgr/dashboard: consider 'mon_allow_pool_delete' flag 
Check if the 'mon_allow_pool_delete' flag is set. If not,
disable the menu item to delete a pool. Show also a description
why the item is disabled.

Fixes: https://tracker.ceph.com/issues/39533
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
 2019-05-29 12:40:15 +02:00
Yuri Weinstein
3315df374c qa/tests: removed filters for client-upgrade-* suites 
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
 2019-05-28 13:33:12 -07:00
Tatjana Dehler
808d7cb39e mgr/dashboard: Add PG scrub configuration form 
The commit adapts two different parts:

1. It adds all frontend related changes around the PG scrub
   configuration form
2. It also adds an API test case to check the existence of
   all hard-coded config options in the frontend

Fixes: https://tracker.ceph.com/issues/38211
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
 2019-05-28 16:14:33 +02:00
Tatjana Dehler
cede2d4590 mgr/dashboard: Add config filter and delete routes 
Add a filter route to the configurations endpoint to get a subset of
config options in one request.
Add a delete route to the configurations endpoint to delete a
specific config option value.

The commit contains the frontend and backend related changes.

It also adds the missing '/' to `ConfigurationService.bulkCreate` and
unit test.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
 2019-05-28 16:14:33 +02:00
Rishabh Dave
96be56c4f1 qa/tasks: upgrade the check for -c sudo option in vstart_runner.py 
Right now vstart_runner.py checks if the command to be ran as a
different user using sudo is a single argument by checking if "-c" is
the second last arguemnt. However, this check fails in a case where
"-c" is option for a command being ran as root (e.g. "sudo python -c
some-python-program"). So, add check for this.

Fixes: http://tracker.ceph.com/issues/39385
Signed-off-by: Rishabh Dave <ridave@redhat.com>
 2019-05-26 17:10:44 +02:00
Matt Benjamin
b97022ce55
Merge pull request #28155 from alimaredia/wip-remove-mon-valgrind-check-in-rgw-suite 
qa: remove mon valgrind check in rgw verfiy suite
 2019-05-24 12:04:51 -04:00
Lenz Grimmer
9577d6b00b
Merge pull request #28147 from bk201/wip-39933 
mgr/dashboard: fix backend error when updating RBD interlocked features

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
 2019-05-21 14:00:54 +02:00
Rishabh Dave
79d62dd874 test_volume_client: simplify test_get_authorized_ids() 
Signed-off-by: Rishabh Dave <ridave@redhat.com>
 2019-05-20 11:30:07 +02:00
Ali Maredia
d25d6ee0af qa: remove mon valgrind check in rgw verfiy suite 
memory leaks in the monitor are causing a significant
percentage of jobs run in the rgw verify suite to
fail even though the jobs succeeded before hand.

See: http://tracker.ceph.com/issues/38827 for
root cause

Signed-off-by: Ali Maredia <amaredia@redhat.com>
 2019-05-17 15:59:30 -04:00
Yuri Weinstein
31e8cd9aeb
Merge pull request #28067 from yuriw/wip-yuriw-crontab-master 
qa/tests: added new client-upgrade-*-nautilus suites for jewel, luminous, mimic
 2019-05-16 13:14:53 -07:00
Kiefer Chang
d654e8c620
mgr/dashboard: fix backend error when updating RBD interlocked features 
Now object-map and fast-diff features are interlocked. Allow
enabling/disabling these two features together without raising an already
enabled/disabled error.

Fixes: http://tracker.ceph.com/issues/39933
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
 2019-05-16 17:43:29 +08:00
Jason Dillaman
b36a1ad302 qa/workunits/rbd: remove 'fast-diff' from dynamic features test 
Fixes: http://tracker.ceph.com/issues/39946
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2019-05-15 16:53:43 -04:00
Yuri Weinstein
659f41e77b qa/tests: added new client-upgrade-*-nautilus suites for jewel, luminous, mimic 
NOTE:

!!!! three suites below MUST use --suite-branch jewel, luminous, mimic (see https://tracker.ceph.com/issues/24021)
ref: https://github.com/ceph/ceph/pull/27983; https://github.com/ceph/ceph/pull/27934; https://github.com/ceph/ceph/pull/28027
--filter "ubuntu_16.04,centos_7.6,rhel_7.6" - test ONLY supported distro BEFORE mimic
--filter "ubuntu_16.04,ubuntu_18.04,centos_7.6,rhel_7.6" - test ONLY supported distro AFTER mimic

Merge after https://github.com/ceph/ceph/pull/28027

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
 2019-05-15 07:48:57 -07:00
Patrick Donnelly
8e7be2cc4a
Merge PR #27377 into master 
* refs/pull/27377/head:
	qa: fs Ignore getfattr errors for ceph.dir.pin

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-05-14 13:14:21 -07:00
Patrick Donnelly
d35396ca07
Merge PR #27872 into master 
* refs/pull/27872/head:
	cephfs-shell: teuthology tests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-05-14 12:50:28 -07:00
Nathan Cutler
cfa2c5fb4d
Merge pull request #26281 from smithfarm/wip-git-describe-long 
make-dist: set version number only once

Reviewed-by: Tim Serong <tserong@suse.com>
 2019-05-13 15:10:20 +02:00
Mykola Golub
b2c799e7d0
Merge pull request #28063 from dillaman/wip-39656 
qa/workunits/rbd: use https protocol for devstack git operations

Reviewed-by: Mykola Golub <mgolub@suse.com>
 2019-05-13 15:24:39 +03:00
David Zafman
624d1172c3
Merge pull request #27914 from dzafman/wip-39304 
osd: Include dups in copy_after() and copy_up_to()

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
 2019-05-10 17:41:31 -07:00
David Zafman
7959159e83 test: Adding standalone test of log copy handling 
Signed-off-by: David Zafman <dzafman@redhat.com>
 2019-05-10 15:31:51 -07:00
Sage Weil
0483c1c3e7 qa/tasks/ceph.conf: do not warn on TOO_FEW_OSDS 
Signed-off-by: Sage Weil <sage@redhat.com>
 2019-05-10 14:45:22 -05:00
Jason Dillaman
fb4f9a8a08 qa/workunits/rbd: use https protocol for devstack git operations 
Fixes: http://tracker.ceph.com/issues/39656
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2019-05-10 11:09:54 -04:00
Chang Liu
b02e2f6cf2 test: update test_pool_min_size test in thrasher 
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
 2019-05-10 10:45:25 +08:00
Greg Farnum
0ee63a0450 qa: extend get_pool_property() to allow non-int values 
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
 2019-05-10 10:45:25 +08:00
Greg Farnum
7950ce2488 qa: don't create rbd pool for min-size thrashing tests 
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
 2019-05-10 10:45:25 +08:00
Greg Farnum
b701395065 qa: write a thrasher for putting PGs below min_size and watching them recover 
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
 2019-05-10 10:45:25 +08:00
Greg Farnum
78755091f9 qa: remove unused variable from ceph_manager 
Pyflakes warned me about this.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
 2019-05-10 10:45:25 +08:00
Sidharth Anupkrishnan
9f40c783db qa: fs Ignore getfattr errors for ceph.dir.pin 
Signed-off-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
 2019-05-09 18:46:21 +05:30
Sebastian Wagner
615b11b9c6
Merge pull request #26654 from sebastian-philipp/orchestrator-progress 
mgr/orchestrator: add progress events to all orchestrators

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
 2019-05-09 10:41:53 +02:00
Milind Changire
73ada8d1d9 cephfs-shell: teuthology tests 
* mkdir
* get
* put

Fixes: http://tracker.ceph.com/issues/39526
Signed-off-by: Milind Changire <mchangir@redhat.com>
 2019-05-09 11:37:31 +05:30
Patrick Donnelly
5e49c15d69
Merge PR #27761 into master 
* refs/pull/27761/head:
	qa: use skipTest method instead of exception

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
 2019-05-08 14:48:03 -07:00
Antoaneta Damyanova
d43302ef42 Explicitly show force-branch and force-repo in s3tests-java.yaml 
Signed-off-by: Antoaneta Damyanova <adamyanova@gmail.com>
 2019-05-08 21:28:43 +02:00
Antoaneta Damyanova
47babdf8a6 minor updates in s3-java task; add log-level option in config 
Signed-off-by: Antoaneta Damyanova <adamyanova@gmail.com>
 2019-05-08 21:25:24 +02:00
Antoaneta Damyanova
09683dbac8 Updated task functionality 
- run tests in groups: AWS4Test, BucketTest,ObjectTest
- do garbage collection via radosgw-admin before and after
each group to remove shadow objects and leftovers from multipart upoload
- add output forwarding of gradle to log and cat log file on completion
- switcehd from teardown to end method
- check for endpoint certificat and add it to the java keystore
- add s3tests-java.yaml task file to qa/suites/rgw/verify/tasks
- remove optional branch and repo and use default at ceph/java_s3tests

Signed-off-by: Antoaneta Damyanova <adamyanova@gmail.com>
 2019-05-08 21:25:24 +02:00
Antoaneta Damyanova
c2c5e8dae7 A task to run S3 Java tests against RGW 
option to download test suite from a custom repository

import ssl certificates to java keystore

read data from config file and create rgw users

installs required packages and runs the tests

Signed-off-by: Antoaneta Damyanova <adamyanova@gmail.com>
 2019-05-08 21:25:24 +02:00
Nathan Cutler
f9f824448a qa: add version number sanity singleton to rados suite 
Signed-off-by: Nathan Cutler <ncutler@suse.com>
 2019-05-08 11:31:34 +02:00
Sebastian Wagner
fccbbb55c6 mgr/orchestrator: add progress events to all orchestrators 
Now, progress events are part of `WriteCompletion` istead of part of the orchestrator module.

It does not yet provide a way to just show orchestrator events.

Also fixes issue in the SSH orchestrator

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
 2019-05-08 11:07:02 +02:00
Patrick Nawracay
d410bda838 mgr/dashboard: Add QA tests for RBD configuration 
Fixes: http://tracker.ceph.com/issues/37572

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
 2019-05-08 10:44:50 +02:00
Yuri Weinstein
43ef3cfbb6
Merge pull request #27979 from yuriw/wip-yuriw-crontab-master 
qa/test: reduce over all number of runs
 2019-05-07 12:43:11 -07:00
Mykola Golub
a3de279923
Merge pull request #27981 from dillaman/wip-39598 
qa/workunits/rbd: wait for rbd-nbd unmap to complete

Reviewed-by: Mykola Golub <mgolub@suse.com>
 2019-05-07 20:58:01 +03:00
Joao Eduardo Luis
28c70208d8
Merge pull request #26488 from mogeb/per-pool-scrub-status 
mon: show no[deep-]scrub flags per pool in the status

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
 2019-05-07 17:50:52 +01:00
Yuri Weinstein
544d13d851 qa/test: reduce over all number of runs 
We kill thousands of queued jobs every week, so why do we even schedule them ?
Another point was that we run numerous of tests as part of PRs testing on released versions anyway, so it's duplicating effort

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
 2019-05-07 09:49:58 -07:00
Lenz Grimmer
6455f96c49
mgr/dashboard/qa: Fix a few linting issues in dashboard backend tests (#27865) 
mgr/dashboard/qa: Fix a few linting issues in dashboard backend tests

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
 2019-05-07 15:01:04 +02:00
Jason Dillaman
87278548a5 qa/workunits/rbd: wait for rbd-nbd unmap to complete 
The "unmap" request is asynchronous, so wait for a short amount
of time for the "rbd-nbd" daemon process to exit.

Fixes: http://tracker.ceph.com/issues/39598
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2019-05-06 15:16:03 -04:00
Lenz Grimmer
22d6a82ad9
mgr/dashboard: Allow the decrease of pg's of an existing pool (#27785) 
mgr/dashboard: Allow the decrease of pg's of an existing pool

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
 2019-05-06 17:38:34 +02:00
zjh
e62cfceb95 qa/standalone: remove osd_pool_default_size in test_wait_for_health_ok 
Signed-off-by: zjh <jhzeng93@foxmail.com>
 2019-05-06 14:35:54 +08:00
Kefu Chai
ba970314fe
Merge pull request #27885 from b-ranto/wip-restful-perf-counters 
restful: Expose perf counters

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2019-05-04 13:28:13 +08:00
Yuri Weinstein
bb4bceb3b2
Merge pull request #27960 from yuriw/wip-yuriw-crontab-master 
qa/tests: removed all runs on ovh
 2019-05-03 13:36:56 -07:00
Yuri Weinstein
e96f61a205
Merge pull request #27956 from yuriw/wip-yuriw-smoke-master 
qa/tests - cleaned up distro settings
 2019-05-03 13:06:11 -07:00
Yuri Weinstein
e699d9026d qa/tests: removed all runs on ovh 
and consolidated `smoke` runs re: https://github.com/ceph/ceph/pull/27956

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
 2019-05-03 12:40:59 -07:00
Casey Bodley
10e9fa3df0
Merge pull request #27838 from yuvalif/wip-yuval-pubsub_teuthology-new 
rgw/pubsub: add multisite pubsub tests to teuthology

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2019-05-03 14:49:25 -04:00
Yuri Weinstein
52fdf23026 qa/tests - cleaned up distro settings 
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
 2019-05-03 08:21:42 -07:00
Jason Dillaman
ade792ee03 qa/valgrind.supp: added false-positive in boost::queue::lockfree 
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2019-05-02 12:59:57 -04:00
Jos Collin
fc7a50be7b
qa/tasks: Check MDS failover during mon_thrash 
Check MDS failover during mon_thrash.

Fixes: http://tracker.ceph.com/issues/17309
Signed-off-by: Jos Collin <jcollin@redhat.com>
 2019-05-02 08:26:24 +05:30
Samuel Just
5ea5c47152 test-erasure-eio: first eio may be fixed during recovery 
The changes to the way EC/ReplicatedBackend communicate read
t showerrors had a side effect of making first eio on the object in
TEST_rados_get_subread_eio_shard_[01] repair itself depending
on the timing of the killed osd recovering.  The test should
be improved to actually test that behavior at some point.

Signed-off-by: Samuel Just <sjust@redhat.com>
 2019-05-01 11:22:28 -07:00
sjust@redhat.com
252d5c20cf osd/: move stat updates and publishing to PeeringState 
Signed-off-by: Samuel Just <sjust@redhat.com>
 2019-05-01 11:22:24 -07:00
Boris Ranto
aaaef9146c restful: Expose perf counters 
We currently do not expose perf counters in the restful module but this
is a useful piece of information to be exposed by the restful module.

Since we already have a function to gather all the information about the
perf counters, we can make this easily accessible through the restful
API.

This also supports filtering by daemons through regexps.

Signed-off-by: Boris Ranto <branto@redhat.com>
 2019-04-30 13:30:14 +02:00
Yuval Lifshitz
d8d817a600 rgw/pubsub: add another zone for pubsub 
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
 2019-04-30 11:51:16 +03:00
Stephan Müller
789f9352ab mgr/dashboard: Allow the decrease of pg's of an existing pool 
Now it's possible to decrease the pg's of an existing pool. The decrease
will take place over time like the increase. As for both no notification
will be created when this is done (issue #39482).

Fixes: https://tracker.ceph.com/issues/35917
Signed-off-by: Stephan Müller <smueller@suse.com>
 2019-04-29 16:44:27 +02:00
Tatjana Dehler
8785242de2 mgr/dashboard/qa: Fix a few linting issues in dashboard backend tests 
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
 2019-04-29 15:28:45 +02:00
Yuval Lifshitz
8362ecc7df rgw/pubsub: actually adding the ps tests 
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
 2019-04-29 09:42:32 +03:00
Yuval Lifshitz
2d7c07bbeb rgw/pubsub: fix popping the wrong key 
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
 2019-04-29 09:42:32 +03:00
Yuval Lifshitz
677dbfce61 Merge branch 'wip-yuval-pubsub_teuthology' of https://github.com/ceph/ceph-ci into wip-yuval-pubsub_teuthology 
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
 2019-04-29 09:42:32 +03:00
Sage Weil
fdf6f8b26b qa/suites/upgrade/mimic-x-singleton: suppress legacy statfs warning 
Signed-off-by: Sage Weil <sage@redhat.com>
 2019-04-28 19:21:52 -05:00
David Zafman
66b041fa4a
Merge pull request #27769 from dzafman/wip-39333 
osd-backfill-space.sh test failed in TEST_backfill_multi_partial()

Reviewed-by: Neha Ojha <nojha@redhat.com>
 2019-04-26 11:55:04 -07:00
Sage Weil
8de8eadc6e Merge PR #27786 into master 
* refs/pull/27786/head:
	qa/suites/upgrade/*-x-singleton: enable bluestore debugging settings

Reviewed-by: Neha Ojha <nojha@redhat.com>
 2019-04-26 13:23:04 -05:00
David Zafman
9931023457 test: osd-backfill-spsace.sh doesn't matter which PG wins the race 
Fixes: http://tracker.ceph.com/issues/39333

Signed-off-by: David Zafman <dzafman@redhat.com>
 2019-04-26 10:11:00 -07:00
Sage Weil
908ea39b3b Merge PR #27655 into master 
* refs/pull/27655/head:
	common/options: flag misc ms_* options STARTUP
	common/options: flag misc options STARTUP
	common/options: mark cluster log options with FLAG_RUNTIME, use get_val
	common/options: mark a bunch of options with FLAG_STARTUP

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
 2019-04-26 10:40:31 -05:00
David Zafman
39cc14bdc1
Merge pull request #27503 from dzafman/wip-39099 
osd: Give recovery for inactive PGs a higher priority

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
 2019-04-25 15:06:56 -07:00
Neha Ojha
5f34369c71
Merge pull request #27764 from neha-ojha/wip-fix-mimic-x-singleton 
qa/suites/upgrade: use correct branch names

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-04-25 14:42:24 -07:00
Sage Weil
5dcf3676a6 common/options: mark cluster log options with FLAG_RUNTIME, use get_val 
We already have observers set up for these; switch to using the
runtime-safe accessor and flag them.

Signed-off-by: Sage Weil <sage@redhat.com>
 2019-04-25 16:26:06 -05:00
David Zafman
71d254647a test: osd-recovery-scrub.sh ignore error from kill_daemons() 
Another work around for http://tracker.ceph.com/issues/38195

Signed-off-by: David Zafman <dzafman@redhat.com>
 2019-04-25 13:53:27 -07:00
David Zafman
71d82dbeb9 test: Add tests for pool recovery priority conversion 
Signed-off-by: David Zafman <dzafman@redhat.com>
 2019-04-25 13:53:27 -07:00
David Zafman
444aa9f9fe osd, mon: New pool recovery priority range -10 to 10 
Use OSD_POOL_PRIORITY_MAX and OSD_POOL_PRIORITY_MIN constants
Scale legacy priorities if exceeds maximum

Signed-off-by: David Zafman <dzafman@redhat.com>
 2019-04-25 13:53:27 -07:00
Sage Weil
0fe0ec3343 qa/suites/upgrade/*-x-singleton: enable bluestore debugging settings 
We default to bluestore already; use the yaml explicitly so that we get
debugging turned up.

Signed-off-by: Sage Weil <sage@redhat.com>
 2019-04-25 08:33:56 -05:00
Sage Weil
d64d14a577 Merge PR #26730 into master 
* refs/pull/26730/head:
	src/test: remove unused objects to calculate accurate dedup ratio.
	src/tools: fix counting total objects
	src/tools: fix printing wrong offset.
	src/tools: fix dedup tool's name
	qa/workunit: add rabin chunk test
	src/tool: add rabin fingerprint option to cephdeduptool
	src/common: add rabin fingerprint class
	Initail work for rabin fingerprint

Reviewed-by: Sage Weil <sage@redhat.com>
 2019-04-24 20:38:02 -05:00
David Zafman
6c98782b76 test: Remove redundant mon-seesaw.yaml file 
mon.yaml runs all scripts in the qa/standalone/mon dir

Signed-off-by: David Zafman <dzafman@redhat.com>
 2019-04-24 17:29:48 -07:00
Neha Ojha
5f1702e87c qa/suites/upgrade: use correct branch names 
Signed-off-by: Neha Ojha <nojha@redhat.com>
 2019-04-24 13:01:20 -07:00
David Zafman
3a234164d0
Merge pull request #27279 from dzafman/wip-divergent 
Improvements to standalone tests

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
 2019-04-24 10:58:11 -07:00
Patrick Donnelly
1071f73c76
qa: use skipTest method instead of exception 
This is the recommended method to skip a test according to [1]. It also lets us
avoid an unnecessary import.

[1] https://docs.python.org/2/library/unittest.html#unittest.TestCase.skipTest

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-04-24 09:38:52 -07:00
Sage Weil
a3a4af3454 Merge PR #27656 into master 
* refs/pull/27656/head:
	doc/dev/erasure-coded-pool: update
	doc/rados/operations/erasure-code*: update default ec profile references
	common/options: change default erasure-code-profile to k=2 m=2

Reviewed-by: Neha Ojha <nojha@redhat.com>
 2019-04-24 08:14:55 -05:00
Mykola Golub
22973d9d46
Merge pull request #27683 from dillaman/wip-24668 
qa/workunits/rbd: use more recent qemu-iotests that support Bionic

Reviewed-by: Mykola Golub <mgolub@suse.com>
 2019-04-24 15:40:43 +03:00
myoungwon oh
8a8d5e89bb src/test: remove unused objects to calculate accurate dedup ratio. 
Signed-off-by: Myoungwon Oh <ommw@sk.com>
 2019-04-24 18:22:37 +09:00
Xie Xingguo
78bcae1d6b
Merge pull request #27719 from xiexingguo/wip-crush-node-flags 
mon/OSDMonitor: crush node flags - two fixes; add tests

Reviewed-by: Sage Weil <sage@redhat.com>
 2019-04-24 08:44:08 +08:00
Jason Dillaman
b7c7a4f39e
Merge pull request #27521 from trociny/wip-rbd-remove-clone_v2-parent 
librbd: optionally move parent image to trash on remove

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2019-04-23 08:11:38 -04:00
xie xingguo
bae2231cc5 qa: add crush-node-flags test 
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
 2019-04-23 14:20:17 +08:00
David Zafman
7e77898001 test: Divergent testing of _merge_object_divergent_entries() cases 
Case 1: A more recent update exists
Case 2: The first entry in the divergent sequence is a create
Case 3  NOT TESTED - Ohject currently missing
Case 4: We can rollback all of the entries
Case 5: We cannot rollback at least 1 of the entries

Support starting OSDs even when "noup" is set (don't wait for up).
Move create_ec_pool() to ceph-helpers.sh

Fixes: https://tracker.ceph.com/issues/39162

Signed-off-by: David Zafman <dzafman@redhat.com>
 2019-04-22 18:50:24 -07:00
Jason Dillaman
b184acd218 qa/workunits/rbd: use more recent qemu-iotests that support Bionic 
Fixes: http://tracker.ceph.com/issues/24668
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2019-04-22 12:46:47 -04:00
Mykola Golub
34112907a7
Merge pull request #27694 from dillaman/wip-39386 
qa/suites/rbd: added writearound cache test permutations

Reviewed-by: Mykola Golub <mgolub@suse.com>
 2019-04-22 18:13:02 +03:00
Mykola Golub
b098cc9fd8
Merge pull request #27695 from dillaman/wip-39072 
test/librbd: drop 'ceph_test_librbd_api' target

Reviewed-by: Mykola Golub <mgolub@suse.com>
 2019-04-22 08:22:20 +03:00
Mykola Golub
47bf240939
Merge pull request #27577 from dillaman/wip-rbd-suite-distros 
qa/suites/rbd: add random distro selection to librbd tests

Reviewed-by: Mykola Golub <mgolub@suse.com>
 2019-04-21 20:19:15 +03:00
Sage Weil
755e8c4ef2 Merge PR #27595 into master 
* refs/pull/27595/head:
	osd: add 'ceph osd stop <osd.nnn>' command

Reviewed-by: Sage Weil <sage@redhat.com>
 2019-04-20 08:52:01 -05:00
Sage Weil
3e86be7d50 common/options: change default erasure-code-profile to k=2 m=2 
Signed-off-by: Sage Weil <sage@redhat.com>
 2019-04-19 16:47:57 -05:00
Jason Dillaman
5b0a611a48 test/librbd: drop 'ceph_test_librbd_api' target 
This was used for API backwards compatibility testing, but now that
the C++ API will not remain stable, it serves no purpose.

Fixes: http://tracker.ceph.com/issues/39072
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2019-04-19 14:18:00 -04:00
Jason Dillaman
ead16e9ad7 qa/suites/rbd: added writearound cache test permutations 
Also tweaked the existing writeback cache test permutations to
specify the use of the writeback cache policy.

Fixes:  http://tracker.ceph.com/issues/39386
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2019-04-19 14:11:43 -04:00
Mykola Golub
6e1434eefc librbd: optionally move parent image to trash on remove 
and auto-delete when the last clone is detached

Signed-off-by: Mykola Golub <mgolub@suse.com>
 2019-04-19 08:53:38 +01:00
Jason Dillaman
83c11efb98 qa/tasks/rbd_fio: fixed missing delimiter between 'cd' and 'configure' 
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2019-04-18 08:57:04 -04:00
Jason Dillaman
d83d598c12 qa/suites/rbd: add random distro selection to librbd tests 
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
 2019-04-18 08:57:04 -04:00
xie xingguo
5dbae13ce0 osd: add 'ceph osd stop <osd.nnn>' command 
stop command can be used to force stopping a specified osd daemon, e.g.,
you don't have to pre-figure out where it located.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
 2019-04-18 13:55:02 +08:00
Patrick Donnelly
8e91a1aa37
Merge PR #27481 into master 
* refs/pull/27481/head:
	qa: add a method to test if a file can be created
	qa: add wrappers for vstart's run() with check_status as False
	qa: add a method to create an empty file with any user
	qa: add stdin parameter to run_shell
	qa: command to be ran as a different user should be a single string
	qa: looks for quotes in Python shell and get rid of them
	qa: move checks on command arguments to a different method
	qa: accept args as strings
	qa: add a method to run given command as root user
	qa: add a method to run a command as a different user
	qa: allow keeping sudo in command arguments
	qa: make execution abortion optional for command ran through run_shell()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
 2019-04-17 15:04:09 -07:00
Rishabh Dave
39417e47de qa: add a method to test if a file can be created 
Signed-off-by: Rishabh Dave <ridave@redhat.com>
 2019-04-17 23:58:22 +05:30
Rishabh Dave
532670bd05 qa: add wrappers for vstart's run() with check_status as False 
Too often in tests it is required to run a command that we want to (or
will probably) fail so that we can check if it failed for expected
reason(s) (eg. a testcase where command must fail with "Permission
denied"). Therefore, add few wrapper methods for vstart_runner.py's
run() with check_status's default value as False so that we don't need
to pass check_status's value at every call to run() or it's other
wrappers.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
 2019-04-17 23:58:22 +05:30