Commit Graph

3473 Commits

Author SHA1 Message Date
Josh Durgin
b4205921be
Merge pull request #21410 from badone/wip-test_large_omap_detection-scrub-pgs-instead-of-osds
qa/workunits/rados/test_large_omap_detection: Scrub pgs instead of OSDs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-04-13 17:54:21 -07:00
Matt Benjamin
7190e1b365
Merge pull request #21123 from theanalyst/wip-civetweb-1.1
rgw: civetweb fixes for v1.1 upgrade
2018-04-13 14:50:46 -04:00
Abhishek Lekshmanan
f8ed817ccc qa: drop rfc2616 checking on civetweb
Since newer versions of civetweb are also strict on rfc2616 checks let's enforce
strict rfc2616 checks in s3tests

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-04-13 19:19:13 +02:00
Kefu Chai
d55724ec4a
Merge pull request #21331 from liewegas/wip-slow-ops
qa/suites/rados/monthrash: whitelist SLOW_OPS

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-13 17:49:30 +08:00
Brad Hubbard
aba1e74e03 qa/workunits/rados/test_large_omap_detection: Scrub pgs instead of OSDs
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2018-04-13 18:41:40 +10:00
David Zafman
c6207d21a8
Merge pull request #21362 from dzafman/wip-hex-digest
osd: Change shard digests to hex like object info digests

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-12 16:07:36 -07:00
David Zafman
22ddc6da5f osd: Change shard digests to hex like object info digests
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-12 07:59:21 -07:00
Yuri Weinstein
997aced8a2
Merge pull request #21336 from ceph/wip-yuriw-crontab
qa/tests: Changed rhel7.4 to rhel7.5
2018-04-11 12:17:19 -07:00
Gregory Farnum
d90f4064f5
Merge pull request #21311 from liewegas/wip-validate-caps
mon: expand cap validity check for mgr, osd, mds

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-04-11 11:14:37 -07:00
Kefu Chai
4cc3dab070
Merge pull request #21318 from badone/wip-qa-mon-misc-add-osdmap-prune-tests
qa/standalone/mon/misc.sh: Add osdmap-prune tests

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-11 23:08:33 +08:00
Sage Weil
53588a41a1
Merge pull request #21334 from batrick/i23643
qa: fix typo in test_full

Reviewed-by: Sage Weil <sage@redhat.com>
2018-04-11 08:25:55 -05:00
Patrick Nawracay
e4a0b12abf mgr/dashboard: Implement RGW proxy
This implementation is basically a Rados Gateway reverse proxy.  It
additionally takes care of the authentication to the Rados Gateway, but to use
it you will have to be authenticated against the dashboards RESTful API.

The corresponding credentials can be configured using the following commands:

    dashboard set-rgw-api-secret-key <secret-key>

    dashboard set-rgw-api-access-key <access-key>

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-04-11 12:26:42 +02:00
Lenz Grimmer
34232b347b
Merge pull request #21022 from sebastian-philipp/dashboard_get_range
mgr/dashboard: Refactor multiple duplicates of `get_rate()`

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-04-11 12:22:00 +02:00
Lenz Grimmer
f0614a8d4e
Merge pull request #20920 from sebastian-philipp/dashboard_v2-erasure-code-profile
mgr/dashboard: Add ErasureCodeProfile controller

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2018-04-11 12:19:40 +02:00
David Zafman
80137ca39f
Merge pull request #20947 from dzafman/wip-23364
Special scrub handling of hinfo_key errors

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-04-10 16:32:09 -07:00
Yuri Weinstein
6adac01923 qa/tests: Changed rhel7.4 to rhel7.5
Note: This is a temp fix till we get $ implementaion

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-04-10 15:02:24 -07:00
David Zafman
9c5ef19f93 test: Be smarter about when jsonschema can be used
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:52:10 -07:00
David Zafman
60ae2b8eb3 osd rados command: Show snapset in list-inconsistent-snapset
Add SnapSet bufferlist to inconsistent_snapset_t

Partial fix for http://tracker.ceph.com/issues/23428

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:51:48 -07:00
David Zafman
1b1d45bf51 test: Add getjson variable to save output
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
007cb45fe5 osd rados command: Change error name snapset_mismatch to snapset_error
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
0c7ac9db3b test: Clean-up test and use local values for number of objects and osds
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
982509514c osd rados command: list-inconsistent-obj attribute improvements
System attributes shown as "object_info", "snapset" and "hashinfo"
Only output user attributes as "attrs"
	Drop leading undescore "_" for user attribute keys
Improve logic as to when to show user attributes or specific system attributes

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
01687b052f osd rados command: Change "oi" to "info" in scrub handling errors
data_digest_mismatch_oi -> data_digest_mismatch_info
omap_digest_mismatch_oi -> omap_digest_mismatch_info
size_mismatch_oi -> size_mismatch_info
obj_size_oi_mismatch -> obj_size_info_mismatch

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
273f6213ea osd rados command: Change "oi_attr" to "info" in scrub handling errors
oi_attr_missing -> info_missing
oi_attr_corrupted -> info_corrupted

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
bec67e3d40 osd rados command: Rename ss_attr_missing/ss_attr_corrupted to snapset_missing/snapset_corrupted
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
d713c7dad0 osd rados command: Improve scrub handling of HashInfo (hinfo_key xattr)
Fixes: http://tracker.ceph.com/issues/23364

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
be815f9b2b test: Remove check that masks differences (let diff fail)
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
Patrick Donnelly
c10907af02
qa: fix typo in test_full
Cause: 577737d007

Fixes: http://tracker.ceph.com/issues/23643

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-10 11:47:10 -07:00
Casey Bodley
f1e826ad7f rgw: beast frontend no longer experimental
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-04-10 12:26:37 -04:00
Sage Weil
2f00b8f990 Merge PR #21302 into wip-sage-testing-20180410.153118
* refs/pull/21302/head:
	qa/suites/rados/singleton/all/random-eio: whitelist eio error message

Reviewed-by: David Zafman <dzafman@redhat.com>
2018-04-10 10:31:26 -05:00
Sage Weil
dbdbbbfc89 Merge PR #21315 into wip-sage-testing-20180410.153007
* refs/pull/21315/head:
	qa/tasks/mgr/test_failover: fix for id -> name rename in mgr metadata

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-04-10 10:30:48 -05:00
Josh Durgin
d84f723c57
Merge pull request #21324 from tchaikov/wip-23495
qa/suites: whitelist SLOW_OPS

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-04-10 08:21:11 -07:00
Yehuda Sadeh
63221d9a81
Merge pull request #19283 from yehudasa/wip-rgw-mfa
rgw: mfa support

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-04-10 07:59:10 -07:00
Sage Weil
c365614292 qa/suites/rados/monthrash: whitelist SLOW_OPS
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-10 08:56:39 -05:00
Sage Weil
497a63251b qa/workunits/cephtool: test with valid auth syntax
'allow' is not a valid mon cap; use 'allow *'.  Add some negative tests
to ensure the validation is working.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-10 07:39:06 -05:00
Kefu Chai
acc08559ce qa/suites: whitelist SLOW_OPS
Fixes: http://tracker.ceph.com/issues/23495
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-10 19:25:47 +08:00
Josh Durgin
ee03866b9f
Merge pull request #21313 from ceph/wip-pg-clean-timeout
qa/tasks: Add default timeout for wait for pg clean task

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-04-09 22:27:16 -07:00
Patrick Donnelly
359f5cccd6
Merge PR #21039 into master
* refs/pull/21039/head:
	qa/workunits/fs: test for cephfs rstats
	mds: make rstat.rctime follow inodes' ctime

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-09 21:33:15 -07:00
Brad Hubbard
c0dac8ecd2 qa/standalone/mon/misc.sh: Add osdmap-prune tests
Fixes: http://tracker.ceph.com/issues/23621

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2018-04-10 14:26:53 +10:00
Sage Weil
b0fe734c21 qa/tasks/mgr/test_failover: fix for id -> name rename in mgr metadata
This was changed by 428236de8b

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-09 21:48:40 -05:00
Josh Durgin
447a107d5f
Merge pull request #21295 from badone/wip-large-omap-scrub-big-random-loser-2
qa/suites/rados: Disable scrub backoff

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-04-09 17:44:33 -07:00
Vasu Kulkarni
7881a19d92 qa/tasks: wait_for_clean is called after ceph task as well after osd's are up,
the default timeout is none in that case, there are cases where it can hang  forever
due to error cases, since this dumps quite a lot of info the logs grow in GB's, with
default timeout of 1200 we can avoid such huge logs and fail sooner. Any tests needing
higher timeout can pass the required value.

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2018-04-09 17:24:42 -07:00
Yuri Weinstein
9a2005d664 qa/tests - minor clean ups and made perf-suite run 3 times, so we can have more data points
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-04-09 09:17:10 -07:00
Sebastian Wagner
012be1dc86 qa/tasks/mgr/dashboard: Imroved JSON validation
Refactored `OsdTest` to make use of `self.assertSchema()`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-04-09 16:42:33 +02:00
Yehuda Sadeh
9569cc8278 qa/tasks/s3tests: configure mfa tests
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-04-09 07:02:17 -07:00
Sage Weil
35c14a0162 qa/suites/rados/singleton/all/random-eio: whitelist eio error message
"cluster [ERR] 2.1 shard 1: soid 2:8007ad8d:::benchmark_data_smithi115_12935_object2439:head candidate had a read error"

is normal when we're injecting EIO.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-09 07:40:23 -05:00
Brad Hubbard
eeeed6497b qa/suites/rados: Disable scrub backoff
A long run of lost coin flips can lead to a timeout in
test_large_omap_detection.py.

Fixes: http://tracker.ceph.com/issues/23578

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2018-04-09 17:21:01 +10:00
Nathan Cutler
fa5e8f9376
Merge pull request #17531 from smithfarm/wip-calamari-tests
tests: cleanup: drop calamari tasks

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Lenz Grimmer <lenz@grimmer.com>
2018-04-08 08:54:27 +02:00
Kefu Chai
9e840c4382
Merge pull request #21274 from dzafman/wip-cot-config
tools: Use --no-mon-config so ceph_objectstore_tool.py test doesn't hang

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-07 11:59:28 +08:00
Sage Weil
d7bca5d19f Merge PR #20512 into wip-sage-testing-20180407.022843
* refs/pull/20512/head:
	osd: osd_mon_report_interval_min -> osd_mon_report_interval, kill _max

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-04-06 21:29:32 -05:00