Commit Graph

3974 Commits

Author SHA1 Message Date
Patrick Nawracay
e71466cc49 mgr/dashboard: Add support for managing individual OSD settings (backend)
Add options to mark OSDs in/out/down/reweight/lost/remove/destroy/create

Fixes: http://tracker.ceph.com/issues/24270

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-09-03 12:51:04 +02:00
David Zafman
d0b260c272 test: Fix test to use -gt instead of creating an empty file "0"
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-08-17 19:33:44 -07:00
Noah Watkins
61e2648c19 qa/ceph_objectstore_tool.py: set mgr module path
Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-08-17 15:24:10 -07:00
Noah Watkins
7d3fa9bda3 qa/standalone/ceph-helpers.sh: fix mgr module path
callers of get_python_path were not passing in a $1 parameter, so
ceph_lib was an empty string resulting in an invalid path to the built
cython modules. assume this is called from the `lib` parent directory.

pass path to the manager modules when starting ceph-mgr.

Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-08-17 15:21:57 -07:00
Patrick Donnelly
f0fe0936e6
qa: use recent kernel to kernel build testing
Fixes: http://tracker.ceph.com/issues/24679

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-16 09:16:39 -07:00
Patrick Donnelly
0b5df6e00a
qa: add cephfs-shell skeleton test case
Right now just tests that "help" works.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-16 09:13:36 -07:00
Sage Weil
b0b616df7b Merge PR #23240 into master
* refs/pull/23240/head:
	qa/suites/rados, qa/workunits/rados: Add suite/workunit for ceph-crash
	add ceph-crash service
	common/options: enable mgr 'crash' module by default
	global/signal_handler: add 'done' file to signal crashdump is ready

Reviewed-by: Sage Weil <sage@redhat.com>
2018-08-14 20:31:29 -05:00
Mykola Golub
7f27f19753 rbd: CLI to migrate images
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-08-14 18:29:45 -04:00
Casey Bodley
b2fe116d97
Merge pull request #23402 from cbodley/wip-23659
qa/rgw: patch keystone requirements.txt

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-08-14 16:53:30 -04:00
Ricardo Marques
2a6ce09691
Merge pull request #22457 from p-na/dash-settings
mgr/dashboard: Add backend support for changing dashboard configuration settings via the REST API

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-08-14 09:27:09 +01:00
Dan Mick
298a1d92d2 qa/suites/rados, qa/workunits/rados: Add suite/workunit for ceph-crash
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-08-13 13:53:26 -07:00
Casey Bodley
909f74d6c5
Merge pull request #23401 from cbodley/wip-rgw-getomapkeys2-more
rgw: RGWRadosGetOmapKeysCR uses 'more' flag from omap_get_keys2()

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-08-13 15:44:45 -04:00
Patrick Donnelly
47e60908a3
qa: fix mon config section
Fixes: fc6e683832

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 19:13:06 -07:00
Patrick Donnelly
358432308d
Merge PR #23457 into master
* refs/pull/23457/head:
	qa: ignore normal slow IO warnings for cephfs

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-08-12 14:10:09 -07:00
Patrick Donnelly
fc6e683832
qa: ignore normal slow IO warnings for cephfs
Generally the slow warnings we get are just over the threshold. These warnings
are related to deploying multiple Ceph daemons side-by-side. Let's see how we
do with two minutes.

Ignoring the warnings entirely is unsatisfactory as they serve as a useful
canary in the coal mine when you see warnings for ops > some unreasonably large
amount of time.

Fixes: http://tracker.ceph.com/issues/26900

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-12 13:59:59 -07:00
Casey Bodley
7ad313768a qa/rgw: raise default curl timeout for multisite suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 14:50:52 -04:00
Sage Weil
b500359409 qa/rgw: vary omap osd-side limit
Signed-off-by: Sage Weil <sage@redhat.com>
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-10 14:50:52 -04:00
Patrick Nawracay
7340e70d7f mgr/dashboard/backend: API to manage dashboard settings
Enables to change (set/unset) values of settings of the dashboard using
the REST API.

Fixes: https://tracker.ceph.com/issues/24273

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-08-10 11:32:25 +02:00
Sage Weil
ebaa80690d Merge PR #23471 into master
* refs/pull/23471/head:
	mon/PGMap: fix spacing around pretty-printed SI units
	include/types: render SI units adjacent to number

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: João Eduardo Luís <joao@suse.de>
2018-08-09 14:35:56 -05:00
Sage Weil
aa485c9b41 mon/PGMap: fix spacing around pretty-printed SI units
"1k foo" not "1kfoo"

Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-08 10:55:18 -05:00
Sage Weil
138b8b41db Merge PR #23475 into master
* refs/pull/23475/head:
	qa/standalone/crush/crush-choose-args: run mgr

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-08-08 08:31:31 -05:00
Sage Weil
662e883683 qa/standalone/crush/crush-choose-args: run mgr
The osd purge command needs a running mgr.

Fixes: d2b41d4095
Signed-off-by: Sage Weil <sage@redhat.com>
2018-08-07 11:57:05 -05:00
David Galloway
066d345cb8
Merge pull request #23456 from yuriw/wip-yuriw-crontab-master
qa/tests: changed ceph qa email address to bypass dreamhost's spam filter
2018-08-06 17:02:00 -04:00
Yuri Weinstein
790a3960cb qa/tests: changed ceph qa email address to bypass dreamhost's spam filter
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-08-06 13:59:21 -07:00
Kefu Chai
9754b3769b qa/suites/fs: add python3-cephfs to packages
the default set of packages to install is in
$suite/qa/packages/packages.yaml . see get_package_list() in
teuthology/teuthology/task/install/__init__.py for how we prepare a
package list for install task.

for running python3 tests in
fs/basic_functional/tasks/volume-client, we need to install
python3-cephfs. please note that,
_package_override() in teuthology/teutholoy/task/install/rpm.py will
take care of the different naming on centos/rhel, where the python3
packages are named python34-*.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-03 20:29:49 +08:00
Kefu Chai
7e5c85b604 qa: do not install python3 packages in task.install
This reverts commit c1efd59f61

task.install.rpm installs packages listed in
$suites/qa/packages/packages.yaml, the packge list applies to the
upgrade tests also. but we don't have python3 bindings packages in jewel
-- they were introduced in kraken.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-08-03 17:02:51 +08:00
Casey Bodley
338b97a8b9 qa/rgw: patch keystone requirements.txt
an ugly workaround for a python dependency conflict that's broken the
rgw/tempest suite. allows us to preserve the pinned versions of
keystone/tempest without having to maintain a fork of the keystone
repository

Fixes: http://tracker.ceph.com/issues/23659

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-02 16:43:42 -04:00
Patrick Donnelly
2ea86fa4d3
Merge PR #21948 into master
* refs/pull/21948/head:
	ceph_volume_client: use integer division for pg_num
	packages.yaml: install py3 compatible cephfs and rados bindings...
	qa: test py2 and py3 for volume client
	qa: make test_volume_client.py py3 compatible
	qa/ceph-volume: allow executing python pyloads using python3
	cephfs.pyx: add py3 compatibility
	ceph-volume-client: add py3 compatibility

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-08-01 21:42:27 -07:00
Casey Bodley
8d36655fcb
Merge pull request #23372 from cbodley/wip-25214
qa/rgw: override valgrind --max-threads for radosgw

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2018-08-01 16:12:21 -04:00
Casey Bodley
e617990efe qa/rgw: override valgrind --max-threads for radosgw
radosgw now uses 512 frontend threads by default, and valgrind won't
start with its default --max-threads=500

Fixes: http://tracker.ceph.com/issues/25214

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-08-01 14:45:24 -04:00
Casey Bodley
ce45875d80
Merge pull request #23145 from cbodley/wip-qa-rgw-admin-rest
qa/rgw: add radosgw-admin-rest task to singleton suite

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-08-01 13:52:40 -04:00
Ricardo Dias
47a50eeba5
Merge pull request #21881 from sebastian-philipp/dashboard-pool-patch
mgr/dashboard: Add Pool update endpoint 

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-08-01 10:00:10 +01:00
David Zafman
9d06ab3da9
Merge pull request #23217 from dzafman/wip-25085
osd: Allow repair of an object with a bad data_digest in object_info on all replicas

Reviewed-by: Sage Weil <sage@redhat.com>
2018-07-31 15:07:22 -04:00
Rishabh Dave
c1efd59f61
packages.yaml: install py3 compatible cephfs and rados bindings...
on Ubuntu and CentOS for upstream testing.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2018-07-30 16:12:48 -07:00
Patrick Donnelly
a5e3b0512c
qa: test py2 and py3 for volume client
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-30 16:12:48 -07:00
Rishabh Dave
f28274dc70
qa: make test_volume_client.py py3 compatible
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2018-07-30 16:12:48 -07:00
Rishabh Dave
2f35ade05f
qa/ceph-volume: allow executing python pyloads using python3
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2018-07-30 16:12:48 -07:00
Sage Weil
1ebafdb65f
Merge pull request #23292 from yuriw/wip-yuriw-25140-master
qa/tests: added 1st draft of mimic-x suite
2018-07-30 14:55:41 -05:00
Sage Weil
c6dd193f45
Merge pull request #23302 from yuriw/wip-yuriw-crontab-master
qa/tests: added mimic-x to the schedule
2018-07-30 14:55:27 -05:00
Yuri Weinstein
baa4d0ea78
Merge pull request #23305 from smithfarm/wip-cleanup-upgrade
qa/upgrade: cleanup for nautilus

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-07-30 09:01:03 -07:00
Yuri Weinstein
e6f21c1aa3 qa/tests: added 1st draft of mimic-x suite
Fixes: https://tracker.ceph.com/issues/25140
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-07-30 08:41:18 -07:00
Nathan Cutler
17d9b5be4d qa/upgrade: cleanup for nautilus
Drop unused suites, which ATM means all of them except upgrade/luminous-x
which recently got a cleanup in https://github.com/ceph/ceph/pull/23162

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-29 19:56:53 +02:00
Nathan Cutler
cecbf3e5dd
Merge pull request #23162 from smithfarm/wip-upgrade-cleanup
tests: upgrade/luminous-x: fix order of final-workload directory

Reviewed-by: Sage Weil <sage@redhat.com>
2018-07-29 18:08:48 +02:00
Yuri Weinstein
bba79cdb9f qa/tests: added mimic-x to the schedule
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-07-28 14:42:39 -07:00
Casey Bodley
3a55e13c44
Merge pull request #23143 from joke-lee/qa-admin-api-user-info-through-access-key
qa: add test for https://github.com/ceph/ceph/pull/22790

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 15:27:32 -04:00
Casey Bodley
b696c8493c qa/rgw: fix 'policy show' tests in radosgw_admin_rest task
'policy show' returns a json-encoded representation of
RGWAccessControlPolicy, while key.get_xml_acl() returns
RGWAccessControlPolicy_S3 encoded as xml. so even with '&format=xml',
the strings won't match

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:48 -04:00
Casey Bodley
638fa1de42 qa/rgw: add bucket-id param to 'bucket link' admin api test
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:47 -04:00
Casey Bodley
3b795cc2c3 qa/rgw: radosgw_admin_rest task tolerates empty responses
result.json() throws a 'JSONDecodeError: Expecting value: line 1 column 1'
for requests that return no body, such as 'user rm' 'key rm' 'subuser
rm', 'bucket unlink', etc

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:47 -04:00
Casey Bodley
975f34f2f6 qa/rgw: radosgw_admin_rest task uses rgw.role_endpoints for connections
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:47 -04:00
Casey Bodley
2f37710ce7 qa/rgw: radosgw_admin_rest task uses util.rgw.rgwadmin()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-27 14:29:47 -04:00