Commit Graph

6169 Commits

Author SHA1 Message Date
Patrick Donnelly
29d850fb7e
Merge PR #32570 into master
* refs/pull/32570/head:
	cephfs-shell: Add tests for setxattr, getxattr and listxattr
	cephfs-shell: Add listxattr command
	cephfs-shell: Add getxattr command
	cephfs-shell: Add setxattr command
	doc: Update about extended attributes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-02 06:56:50 -08:00
Patrick Donnelly
3a6f107331
Merge PR #31633 into master
* refs/pull/31633/head:
	cephfs-shell: Instead of assert use stat for tests in rmdir
	cephfs-shell: Add function for common rmdir test code
	cephfs-shell: Add rmdir test for non empty directory
	cephfs-shell: Add rmdir -p test for non empty directory
	cephfs-shell: Add rmdir -p test for non existing dir
	cephfs-shell: Add rmdir -p test to delete all dirs in given path
	cephfs-shell: Add rmdir -p test for root directory with empty directories
	cephfs-shell: Add rmdir test for valid file
	cephfs-shell: Add rmdir test for invalid directory
	cephfs-shell: Add rmdir test for valid directory
	cephfs-shell: Fix rmdir '-p' issues

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-02 06:52:23 -08:00
Sage Weil
b66f5df514 Merge PR #32986 into master
* refs/pull/32986/head:
	qa/tasks/ceph_manager: fix movement of cot exports with cephadm

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-02-01 10:47:56 -06:00
Ramana Raja
b7768eca2a
Merge pull request #32030 from vshankar/wip-mgr-volumes-clone
mgr/volumes: clone from snapshot
2020-02-01 13:17:51 +05:30
Sage Weil
d8a7c73a48 Merge PR #32987 into master
* refs/pull/32987/head:
	qa/tasks/ceph_manager: make fix_pgp_num behave when no pool is found

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-31 17:40:23 -06:00
Sage Weil
a5d848d206 Merge PR #32989 into master
* refs/pull/32989/head:
	qa/tasks/ceph_manager: add --log-early to raw_cluster_cmd

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-31 17:40:13 -06:00
Sage Weil
42768600d4 qa/tasks/ceph_manager: fix movement of cot exports with cephadm
I think this will finally work...

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-31 17:26:10 -06:00
Venky Shankar
b5970ff80d test: add subvolume clone tests
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-01-31 05:09:14 -05:00
Sage Weil
a7988dfd3f Merge PR #32988 into master
* refs/pull/32988/head:
	qa/tasks/ceph: only re-request scrub on unscrubbed pgs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 21:56:05 -06:00
Sage Weil
2954c607b7 Merge PR #32958 into master
* refs/pull/32958/head:
	qa/suites/rados/singleton/all/lost-unfound*: whitelist SLOW_OPS

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 11:01:24 -06:00
Sage Weil
f10cc22c60 Merge PR #32961 into master
* refs/pull/32961/head:
	qa/standalone/osd/osd-bench: debug bluestore

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 10:42:17 -06:00
Sage Weil
32a36f9c75 Merge PR #32968 into master
* refs/pull/32968/head:
	qa/suites/rados/verify: debug monc = 20

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-30 10:42:05 -06:00
Sage Weil
8c87110b54 qa/tasks/ceph_manager: add --log-early to raw_cluster_cmd
This is harmless if logging is low, but adds useful info when it is turned
up.

Hunting bug https://tracker.ceph.com/issues/43914

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 10:36:28 -06:00
Sage Weil
1dc2a8a09e qa/tasks/ceph: only re-request scrub on unscrubbed pgs
If we haven't scrubbed everything, we occasinoally re-request scrub in case
the request was missed by the OSD (this can happen).  But we were
re-requesting scrub on ALL pgs, and if they are done in a
semi-deterministic order and are slow, then we may never get to the final
ones.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 10:22:49 -06:00
Sage Weil
7d0a789b1b qa/tasks/ceph_manager: make fix_pgp_num behave when no pool is found
Fixes:

2020-01-30T04:41:24.697 INFO:tasks.thrashosds.thrasher:fixing pg num pool None
2020-01-30T04:41:24.698 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last):
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2020-01-29-1034/qa/tasks/ceph_manager.py", line 1070, in wrapper
    return func(self)
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2020-01-29-1034/qa/tasks/ceph_manager.py", line 1200, in _do_thrash
    self.choose_action()()
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2020-01-29-1034/qa/tasks/ceph_manager.py", line 768, in fix_pgp_num
    if self.ceph_manager.set_pool_pgpnum(pool, force):
  File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-sage-testing-2020-01-29-1034/qa/tasks/ceph_manager.py", line 2088, in set_pool_pgpnum
    assert isinstance(pool_name, six.string_types)
AssertionError

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-30 08:32:56 -06:00
Sage Weil
88c49d483a Merge PR #32969 into master
* refs/pull/32969/head:
	qa/suites/rados/cephadm: explicitly test many distros

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2020-01-30 08:28:25 -06:00
Patrick Donnelly
2931433cd1
Merge PR #32854 into master
* refs/pull/32854/head:
	qa: fix testing kernel branch link

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-30 06:25:25 -08:00
Sage Weil
68d3c86106 Merge PR #32972 into master
* refs/pull/32972/head:
	python-common/ceph/deployment/translate: use 'prepare' instead of 'batch' for trivial case
	qa/tasks/cephadm: pass short dev name to osd prepare
	mgr/cephadm: fix detection of just-created OSDs
	mgr/cephadm: properly indent raise conditions
	mgr/cephadm: add warning to other orchestrators
	mgr/cephadm: separate acceptance criterias for Devices
	mgr/cephadm: fix typos
	mgr/cephadm: move utils in test/utils.py
	mgr/ssh: increase disk size to 20G
	drivegroups: add support for drivegroups + tests
	mgr/orch_cli: allow multiple drivegroups
	drivegroups: translate disk spec to ceph-volume call

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-01-30 07:01:47 -06:00
David Zafman
6bb36f862f
Merge pull request #32945 from dzafman/wip-43864
test: Update pg log test for new trimming behavior

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-29 16:03:44 -08:00
Varsha Rao
e601242afe cephfs-shell: Add tests for setxattr, getxattr and listxattr
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-30 01:16:27 +05:30
Sage Weil
b119fc5f18 qa/suites/rados/cephadm: explicitly test many distros
Include _latest.yaml in a few cases here to be a bit future-proof.

cephadm-smoke/ is *just* a cephadm bring-up, and includes el7.  cephadm/
installs packages and runs a real workload.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 13:41:59 -06:00
Sage Weil
1ce0b70cc0 Merge PR #32943 into master
* refs/pull/32943/head:
	qa/tasks/ceph_manager: fix chmod on log dir during pg export copy

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-29 10:34:09 -06:00
Sage Weil
8e3eb592b0 qa/suites/rados/verify: debug monc = 20
Hunting https://tracker.ceph.com/issues/43882

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 09:53:41 -06:00
Sage Weil
b99e506a3f qa/standalone/osd/osd-bench: debug bluestore
Looking for https://tracker.ceph.com/issues/43888

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 07:43:41 -06:00
Sage Weil
c227b5d831 Merge PR #32940 into master
* refs/pull/32940/head:
	qa: remove rados/basic/tasks/rgw_snaps.yml

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2020-01-29 07:23:34 -06:00
Sage Weil
f4156aea10 qa/suites/rados/singleton/all/lost-unfound*: whitelist SLOW_OPS
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-29 07:11:15 -06:00
David Zafman
e18519ad09 test: Update pg log test for new trimming behavior
Fixes: https://tracker.ceph.com/issues/43864

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-28 15:23:45 -08:00
Sage Weil
f026a1c9f6 qa/tasks/cephadm: pass short dev name to osd prepare
Zap needs a full path, but create/prepare needs the VG/LV
only if it is an existing LV.

We'll make c-v more friendly later.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-28 14:21:53 -06:00
Sage Weil
9a4dd1fb3d qa/tasks/ceph_manager: fix chmod on log dir during pg export copy
With cephadm, we should chmod both /var/log/ceph and /var/log/ceph/$fsid.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-28 13:54:18 -06:00
Ali Maredia
7cf2af6e5c qa: remove rados/basic/tasks/rgw_snaps.yml
rgw_snaps tasks should not be running in the rados suite.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2020-01-28 14:29:27 -05:00
Yehuda Sadeh
d04ea3aab5 qa: s3a-hadoop: fix user creation
This breaks with the new more strict radosgw-admin command line parsing

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2020-01-28 10:20:39 -08:00
Sage Weil
ad67307ed9 Merge PR #32752 into master
* refs/pull/32752/head:
	cephadm: remove `logs` command

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-27 15:20:32 -06:00
Sage Weil
835ce72575 Merge PR #32920 into master
* refs/pull/32920/head:
	qa/suites/rados/rest: run restful test on el8

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-01-27 13:28:59 -06:00
Sage Weil
b0bea75ed7 Merge PR #32885 into master
* refs/pull/32885/head:
	qa/suites/rados/thrash: debug monc

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-27 11:36:37 -06:00
Sage Weil
e33f610af9 Merge PR #32851 into master
* refs/pull/32851/head:
	qa/standalone/osd/osd-backfill-recovery-log.sh: fix TEST_backfill_log_2
	qa/standalone/osd/osd-backfill-recovery-log.sh: fix TEST_backfill_log_1

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2020-01-27 11:05:29 -06:00
Sage Weil
674622190e qa/suites/rados/rest: run restful test on el8
For some reason the requests library has trouble connecting from
ubuntu 18.04.  I reproduced this locally on my 18.04 desktop, although
there it fails on the first API request instead of the last (as in QA).

In any case, this appears to be a client library problem.

Fixes: https://tracker.ceph.com/issues/43720
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-27 11:02:07 -06:00
Sage Weil
14d1490f58 Merge PR #32898 into master
* refs/pull/32898/head:
	qa/suites/rados/singleton/all/recovery-preemption: fix pg log length

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-27 10:37:16 -06:00
Michael Fritch
0d331fccdc
cephadm: remove logs command
Fixes: https://tracker.ceph.com/issues/43618
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-27 07:22:11 -07:00
Sage Weil
695d0be225 qa/suites/rados/singleton/all/recovery-preemption: fix pg log length
This was broken by the variable PG log lengths in
9c69c2f7cc585b5e13e4d1b0432016d38135a3de.

Disable the new option to get (roughly) the old behavior, or at least the
short logs that we want to trigger some backfill.

Fixes: https://tracker.ceph.com/issues/43810
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-27 07:42:50 -06:00
Sage Weil
05cc0d8c70 Merge PR #32853 into master
* refs/pull/32853/head:
	qa/suites/fs/upgrade: finish at octopus
	qa/suites/fs/upgrade: set min-compat-client to octopus
	qa/suites/fs/upgrade: set pg_autoscale_mode=off after upgrade

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-27 07:14:37 -06:00
Kefu Chai
fdc1e88b87 qa/workunits/rados/test_crash.sh: do not fail if coredump not found
Fixes: https://tracker.ceph.com/issues/43653
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-27 01:20:56 +08:00
Sage Weil
e04a08069f qa/suites/rados/thrash: debug monc
Hunting https://tracker.ceph.com/issues/43825

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-26 11:13:20 -06:00
Sage Weil
7ce7ac8bfc qa/suites/fs/upgrade: finish at octopus
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-25 16:04:28 -06:00
Sage Weil
3d94bc42db qa/suites/fs/upgrade: set min-compat-client to octopus
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-25 13:31:08 -06:00
Sage Weil
41c03aa143 qa/suites/fs/upgrade: set pg_autoscale_mode=off after upgrade
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-24 21:01:07 -06:00
Patrick Donnelly
8c52bee40d
qa: fix testing kernel branch link
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-24 15:58:41 -08:00
Sage Weil
4fda278eaf Merge PR #32750 into master
* refs/pull/32750/head:
	qa/suites/upgrade/*-x/stress-split: run latest python tests at end
	qa/tasks/ceph_manager: kludge around /var/log/ceph permissions
	mgr/pg_autoscaler: don't check anything until cluster is nautilus
	qa/suites/upgrade: install python3-* as part of final upgrade step
	qa/tasks/radosbench: only set object size if != block size
	qa/tasks/ceph: simplify mon_health_to_clog suppression during restart
	cls_hello: alias write_return_data -> writes_dont_return_data
	ceph_test_cls_hello: only do returndata test on octopus+
	qa: remove unnecessary package excludes in upgrades/nautilus*
	qa: exclude cephadm from upgrade/nautilus-x
	qa/suites/upgrade/mimic-x/parallel: fix msgr2 vs octopus ordering
	qa/suites/upgrade/nautilus-x/stress-split: fix msgr2 vs octopus ordering
	qa/suites/upgrade/mimic-x: fix msgr2 vs octopus ordering
	qa/suites/upgrade/nautilus-x: end on octopus
	qa/suites/upgrade/mimic-x: finish at octopus
	qa/suites/upgrade/nautilus-x: disable TOO_FEW_PGS warning
	qa/tasks/ceph: set mon_health_to_clog=false via mon config
	qa/suites/upgrade/mimic-x: disable TOO_FEW_PGS warning

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-24 17:21:28 -06:00
Neha
b20817795a qa/standalone/osd/osd-backfill-recovery-log.sh: fix TEST_backfill_log_2
Fixes: https://tracker.ceph.com/issues/43807
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-01-24 22:42:04 +00:00
Neha
994698277b qa/standalone/osd/osd-backfill-recovery-log.sh: fix TEST_backfill_log_1
Fixes: https://tracker.ceph.com/issues/43807
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-01-24 22:20:21 +00:00
Sage Weil
81fc73b24e Merge PR #32788 into master
* refs/pull/32788/head:
	qa/tasks/mgr/dashboard: set pg_num to 32
	mgr/pg_autoscaler: default to pg_num[_min] = 32

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-24 08:32:13 -06:00