Commit Graph

2377 Commits

Author SHA1 Message Date
J. Eric Ivancich
78c357a005
Merge pull request #35979 from ivancich/wip-fix-orphan-list-teuthology
rgw: orphan list teuthology test & fully-qualified domain issue

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2020-07-08 16:15:46 -04:00
J. Eric Ivancich
3afc8ac253 rgw: orphan list teuthology test & fully-qualified domain issue
Sometimes when teuthology machines are provisioned, the command
`hostname --fqdn` does not provide a fully qualified domain name but
instead just the hostname (e.g., smithi149 instead of
smithi149.front.sepia.ceph.com). This prevents the teuthology test for
rgw-orphan-list from running successfully [for example, the hostname
was for some reason mis-interpreted as the bucket name in the
request].

This commit checks whether the hostname derived from `hostname --fqdn`
contains any '.'s and if it does not, it will append
".front.sepia.ceph.com" to the hostname. This is a hack, but until
teuthology machines are configured appropriately it seems to be a
reasonable work-around.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-07-08 10:53:49 -04:00
Kefu Chai
0a8188e461 qa/workunits: drop py2 support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-07-05 10:58:28 +08:00
Kefu Chai
fdcc3a89c7 qa/workunits/mon: flake8 fixes
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-06-23 23:01:27 +08:00
Kefu Chai
af44e844c0
Merge pull request #35186 from liewegas/wip-cas
cls_cas: misc cleanup, and dynamic chunk_refs_t

Reviewed-by: Samuel Just <sjust@redhat.com>
2020-06-09 20:10:43 +08:00
Sebastian Wagner
e45e9bf84e qa/cephadm: update adopt corpus
to 9cd9ad020d93b0b420924fec55da307aff8bd422

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-06-05 12:17:03 +02:00
Sage Weil
84f9603d8d ceph-dedup-tool: get-chunk-ref -> dump-chunk-refs
Signed-off-by: Sage Weil <sage@newdream.net>
2020-05-27 10:44:31 -05:00
Sage Weil
a92fa51b9b ceph-dedup-tool: --add-chunk-ref -> --chunk-get-ref (and -put-ref)
Signed-off-by: Sage Weil <sage@newdream.net>
2020-05-27 10:44:31 -05:00
Sage Weil
f80b23e5e8 cls_cas: renames, cleanups
- add write_or_get method
- fix PrimaryPG caller ot use write_or_get
- remove old method it previously called that did weird things
- cls_chunk_refcount_* -> cls_cas_chunk_*
- add _ref suffix for get and put to avoid confusion (get/put could mean
  read/write)
- some comments
- move (internal) refcount representation into separate header

Signed-off-by: Sage Weil <sage@newdream.net>
2020-05-27 10:44:31 -05:00
Kefu Chai
1b72cb4b6a
Merge pull request #35033 from badone/wip-test-the-right-rocksdb-version
qa/workunits/rados/test_envlibrados_rocksdb: Build correct rocksdb

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-27 21:58:16 +08:00
Sage Weil
c828e5d77c common/rabin: remove
The implementation is buggy, and slower than FastCDC.

Signed-off-by: Sage Weil <sage@newdream.net>
2020-05-27 07:48:18 -05:00
Kefu Chai
c927371894
Merge pull request #35082 from badone/wip-xenial-cmake-install-test_envlibrados_for_rocksdb
qa/workunits: Remove redundant Xenial cmake3 requirements

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-22 12:35:30 +08:00
Kefu Chai
a9b6103281
Merge pull request #34593 from hfutljx/master
qa/workunits:fix the error of getting encoding technique in ec test

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-05-22 12:33:52 +08:00
Nathan Cutler
4f0cecbadd qa/cephtool: clean up after removal of cache-tier modes
The "proxy" and "forward" cache-tier modes have been completely removed,
so it's sufficient to test once that they cannot be set.

Fixes: a0a3ed324a
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-21 13:42:09 +02:00
Jason Dillaman
7f1df0d18a
Merge pull request #34789 from trociny/wip-rbd-nbd-quiesce
rbd-nbd: add quiesce/unquiesce hooks

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-05-15 11:12:50 -04:00
Brad Hubbard
88094c264f qa/workunits/ceph-helpers-root: Remove unused function
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-05-15 16:50:25 +10:00
Brad Hubbard
9d2632a953 qa/workunits/rados/test_envlibrados_rocksdb: Remove Xenial cmake3 requirements
It's no longer necessary to handle Xenial as a special case.

Fixes: https://tracker.ceph.com/issues/45561

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-05-15 16:50:00 +10:00
Brad Hubbard
1361913f59 qa/workunits/rados/test_envlibrados_rocksdb: Build correct rocksdb
We should be building the version of rocksdb the release is pinned to,
not master. Let's just update the rocksdb submodule and clone that.

Fixes: https://tracker.ceph.com/issues/44981

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-05-13 12:45:31 +10:00
Michael Fritch
629a9eeeb5
qa/workunits/cephadm/test_cephadm.sh: add shell mount test
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-05-12 16:13:49 -06:00
Mykola Golub
b0ab564eae qa/workunits/rbd: add rbd-nbd quiesce tests
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-05-09 16:36:49 +01:00
Sebastian Wagner
6a15a25d9a
Merge pull request #34903 from sebastian-philipp/cephadm-adopt-qa-grafana
qa/workunits/cephadm: test grafana adoption

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-05-08 18:58:50 +02:00
Sebastian Wagner
b62dd11e3d qa/workunits/cephadm: test grafana adoption
now includes af85d49307

Fixes: https://github.com/ceph/cephadm-adoption-corpus/pull/3
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-05-05 14:50:14 +02:00
Shilpa Jagannath
06e6013ec1 qa/rgw: add ssl option in reshard tests
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-05-05 15:07:59 +05:30
J. Eric Ivancich
43c948a4ab qa/rgw: integration test for rgw-orphan-list & radosgw-admin radoslist
Add teuthology test for `rgw-orphan-list` in a new tool suite under
rgw. It only needs to be tested under one configuration. And the new
tool sub-suite can be used by other tooling int he
future. radosgw-admin `radoslist` is tested indirectly through
`rgw-orphan-list` and therefore does not need its own test.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-04 13:55:00 -04:00
Casey Bodley
67415ea07b
Merge pull request #34286 from cbodley/wip-qa-rgw-cls-2pc-queue
qa/rgw: run ceph_test_cls_2pc_queue in verify suite

Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>
2020-05-04 12:29:14 -04:00
Sebastian Wagner
e1360f1653
Merge pull request #34779 from mgfritch/cephadm-workunit-node-exporter-avail
qa/workunits/cephadm/test_cephadm.sh: wait longer for monitoring stack
2020-05-04 11:11:32 +02:00
Jason Dillaman
efb6b656a1
Merge pull request #34787 from trociny/wip-45305
qa/workunits/rbd: fix list-mapped filter in unmap_device

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-05-01 11:23:02 -04:00
Casey Bodley
6c1f3cbb24
Merge pull request #34352 from smanjara/wip-dynamic-resharding
rgw: more multisite dynamic resharding pieces.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-04-30 10:02:12 -04:00
Shilpa Jagannath
71b657b9d2 minor fix: run tests in python venv
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-30 12:39:50 +05:30
Jason Dillaman
fe5ca0c4fb
Merge pull request #34753 from trociny/wip-44938-fixup
qa/workunits/rbd: retry the addition of a mirror pool peer

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-04-28 16:43:19 -04:00
Mykola Golub
1ad816ae0c qa/workunits/rbd: fix peer_add helper
We need to temporary disable "exit on error" mode so it does not
abort when `rbd mirror pool peer add` returns "already exists"
error code.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-04-28 17:04:43 +01:00
Mykola Golub
d667e385a1 qa/workunits/rbd: fix list-mapped filter in unmap_device
In recent versions `rbd list-mapped` does not print the white space
at the end of the line.

Fixes: https://tracker.ceph.com/issues/45305
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-04-28 11:45:33 +01:00
Michael Fritch
c60ec03e47
qa/workunits/cephadm/test_cephadm.sh: wait longer for monitoring stack
Give the monitoring stack (node-exporter, prom, grafana) a few more
retries to become available before giving up

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-04-27 16:08:10 -06:00
Shilpa Jagannath
0270dc4aaa qa/rgw: some basic reshard tests
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2020-04-27 13:16:09 +05:30
Kefu Chai
d07960ef7a
Merge pull request #34578 from lxbsz/volume_client_py3
qa/volume_client: be python3 compatible

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-25 18:58:43 +08:00
Mykola Golub
7eced158a9 qa/workunits/rbd: retry the addition of a mirror pool peer
fb4311f5 has fixed this for setup, but "remove mirroring pool"
test needs fixing too.

Fixes: https://tracker.ceph.com/issues/44938
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-04-25 08:36:25 +01:00
Sebastian Wagner
d240d23b09
Merge pull request #34619 from sebastian-philipp/qa-adopt-specific-commit
qa/cephadm: make test_adoption checkout a specific commit
2020-04-24 18:01:18 +02:00
Sebastian Wagner
aab7045dec
Merge pull request #34620 from mgfritch/cephadm-timeout-test-fixup
qa/workunits/cephadm/test_cephadm.sh: extend timeout test
2020-04-23 12:03:20 +02:00
Sebastian Wagner
bf9cd06c6b qa/workunits/cephadm/test_cephadm: Also test octopus
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-22 15:31:19 +02:00
Sebastian Wagner
6a7d0bd973 qa/cephadm: make test_adoption checkout a specific commit
Reason is, I want to have a test run of test_adoption, *before* master is affected.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-22 12:23:07 +02:00
lijiaxu
d7107c1004 qa/workunits/erasure-code/bench.sh:fix the error of getting encoding technique in ec test
Isa / jerasure codec ‘technique’, obtained by the following statements,
 "eval technique_parameter=\$${plugin}2technique_${technique}",
 which generate a string such as "isa2technique_vandermonde",
 and assign the value of "technique_parameter" to "isa2technique_vandermonde".

 String such as "isa2technique_vandermonde" should have a preset value, but it does not,
 which will cause string "technique_parameter" to be empty.

 Run the script, prompt the following error message and exit:
 isa technique= is not a valid coding technique.  Choose one of the following: reed_sol_van,cauchy

 To fix the bug, specify a preset value for "technique_parameter":

 + isa2technique_vandermonde='reed_sol_van'
 + isa2technique_cauchy='cauchy'
 + jerasure2technique_vandermonde='reed_sol_van'
 + jerasure2technique_cauchy='cauchy_good'

 Signed-off-by: lijiaxu <lijiaxu@cmss.chinamobile.com>
2020-04-21 11:10:21 +08:00
Xiubo Li
3441261346 qa/volume_client: switch to use python3
Currently for the ceph_volume_client in pybind only the python3 is
support.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-20 07:05:03 -04:00
Michael Fritch
b06f5b7850
qa/workunits/cephadm/test_cephadm.sh: extend timeout test
test occasionally fails when the container is slow to start

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-04-17 15:01:55 -06:00
Michael Fritch
6b21144723
qa/workunits/cephadm/test_cephadm.sh: add CLEANUP var
preserve the current test state during EXIT:
`CLEANUP=false ../qa/workunits/cephadm/test_cephadm.sh`

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-04-17 14:17:02 -06:00
Mykola Golub
0f2305d127
Merge pull request #34573 from dillaman/wip-44938-2
test: tx-only peer from heartbeat can race w/ CLI

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-04-16 18:50:47 +03:00
Neha Ojha
61ad12e6ad
Merge pull request #34541 from neha-ojha/wip-balancer-on
mgr: turn on balancer in upmap mode by default

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-15 15:03:28 -07:00
Jason Dillaman
fb4311f597 qa/workunits/rbd: retry the addition of a mirror pool peer
We might race with the remote rbd-mirror daemon creating a
tx-only peer when adding a new peer. Therefore, delete the
tx-only peer and attempt to re-create it.

Fixes: https://tracker.ceph.com/issues/44938
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-04-15 16:27:07 -04:00
Casey Bodley
0f44806c53 qa/rgw: run ceph_test_cls_2pc_queue in verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-04-14 11:43:05 -04:00
Sebastian Wagner
de448fafe0 cephadm: Update images used
Print warning when using cephadm from master

See also "use quay octopus tip until 15.2 tag is available"
* a9b15c7e1a.

See also  "update default container images"
* 1f05f75787.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-14 16:05:14 +02:00
Neha Ojha
bca3b3f6e0 qa/workunits/cephtool/test.sh: don't set-require-min-compat-client luminous
This should not be required since mon_osd_initial_require_min_compat_client
is now luminous.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-04-14 00:05:02 +00:00