Commit Graph

6219 Commits

Author SHA1 Message Date
Sage Weil
366d3fc33e Merge PR #33131 into master
* refs/pull/33131/head:
	mgr/orch: 'ceph orchestrator ...' -> 'ceph orch ...'

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-10 12:17:45 -06:00
Josh Durgin
772d7c1d3c mgr/pg_autoscaler: add warning when target bytes and ratio are both set
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Josh Durgin
d62c121ee3 mgr/pg_autoscaler: remove target ratio warning
Since the ratios are normalized, they cannot exceed 1.0 or overcommit
combined with target_bytes.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Josh Durgin
1ea8ce3480 qa: use ratios >1 in pg_autoscaler test
Also check for pg_num_target being set correctly, rather than pg_num,
so the test doesn't depend on merging/splitting speed.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Josh Durgin
435c56a03b mgr/pg_autoscaler: treat target ratios as weights
Normalize across pools so that it's simpler to use - this way you
don't have to adjust every other pool when you add one.

Handle pools with target_bytes by taking their capacity off the top,
and dividing the rest into the pools with a target_ratio.

If both target bytes and ratio are specified, ignore bytes. This
matches the docs and makes accounting simpler.

Fixes: https://tracker.ceph.com/issues/43947

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Sage Weil
20205e70c4 mgr/orch: 'ceph orchestrator ...' -> 'ceph orch ...'
Less typing for all!

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 15:39:57 -06:00
Sage Weil
ceff81c9a5 Merge PR #33136 into master
* refs/pull/33136/head:
	cephadm: fix ceph version probe

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-09 15:34:59 -06:00
Sage Weil
a7d5d5cc8c cephadm: fix ceph version probe
docker returns '<no value>' if the label isn't present, in which case we
still need to run ceph -v.

Also, don't probe non-ceph (e.g., monitoring) containers.

Also, only probe each image id once.

Add a simple test.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 14:00:50 -06:00
Sage Weil
9dba764c02 Merge PR #33133 into master
* refs/pull/33133/head:
	qa/workunits/cephadm/test_cephadm.sh: make monitoring tests faster
	qa/workunits/cephadm/test_cephadm: 2 OSDs is enough
	cephadm: disable node-exporter cpu/memory limits for the time being

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-09 13:55:27 -06:00
Sage Weil
c11d031bab Merge PR #33134 into master
* refs/pull/33134/head:
	qa/workunits/cephadm/test_repos: don't try to use the refspec

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-09 12:48:09 -06:00
Sage Weil
0fff7d61b5 Merge PR #33117 into master
* refs/pull/33117/head:
	qa/suites/upgrade/nautilus-x-singleton: ensure hit sets behave across upgrade
	osd/PrimaryLogPG: use legacy timestamp rendering for hit_set objects
	include/utime: allow legacy rendering of timestamp

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-09 09:40:10 -06:00
Sage Weil
36daf1cc29 qa/workunits/cephadm/test_cephadm.sh: make monitoring tests faster
The sleep 90 was way overkill.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-08 18:00:37 -06:00
Sage Weil
0594526393 qa/workunits/cephadm/test_cephadm: 2 OSDs is enough
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-08 18:00:37 -06:00
Sage Weil
12a0faa9fa Merge PR #33092 into master
* refs/pull/33092/head:
	doc/rados/operations: adjust docs a bit
	mon/OSDMonitor: accept 'autoscale_mode' argument to 'osd pool create'

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-02-08 08:10:57 -06:00
Sage Weil
8cdbc8e8e6 qa/workunits/cephadm/test_repos: don't try to use the refspec
This is usually a sha1, and we can't reliably find packages based on
that.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-08 07:33:47 -06:00
Sage Weil
82c4bce2a1 Merge PR #33132 into master
* refs/pull/33132/head:
	qa/workunits/cephadm/test_repos: apt update
	qa/workunits/cephadm/test_repos: fix subst
	qa/suites/rados/cephadm/.../test_repos: run without ulimit and coverage tools
	qa/tasks/workunit: accept coverage_and_limits: false
	qa/suites/rados/cephadm: move ubuntu_18.04_podman to shared location
	qa/suites/rados/cephadm: fix conflicts, missing .qa link

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-08 07:27:27 -06:00
Sage Weil
fd17368e9c qa/workunits/cephadm/test_repos: apt update
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-07 22:16:29 -06:00
Sage Weil
883f82aee6 qa/workunits/cephadm/test_repos: fix subst
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-07 21:26:03 -06:00
Sage Weil
ab71e45728 qa/suites/rados/cephadm/.../test_repos: run without ulimit and coverage tools
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-07 17:58:08 -06:00
Sage Weil
52cb75acf3 qa/tasks/workunit: accept coverage_and_limits: false
Allow workunits without teuthology tools (normally installed by ceph.py,
IIRC).

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-07 17:57:45 -06:00
Sage Weil
55518208ab qa/suites/rados/cephadm: move ubuntu_18.04_podman to shared location
Also set the registries.conf file so we can pull from docker.io.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-07 17:49:52 -06:00
Sage Weil
cbeb24323a qa/suites/upgrade/nautilus-x-singleton: ensure hit sets behave across upgrade
Create a pool that generates hit sets before the upgrade, and ensure that
they (continue to) trim after the upgrade.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-07 16:44:18 -06:00
Sage Weil
5dd8834c4a qa/suites/rados/cephadm: fix conflicts, missing .qa link
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-07 16:32:05 -06:00
Patrick Donnelly
53a5d1f4ec
Merge PR #33080 into master
* refs/pull/33080/head:
	qa: specify random distros in multimds

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-02-07 13:26:16 -08:00
Sage Weil
e52c567385 qa/suites/rados/cephadm: collect all cephadm tests together here
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-07 11:14:47 -06:00
Sage Weil
a98855ecf5 qa/workunits/cephadm/test_repos: add test for the repo commands
This isn't a great test, but it is something.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-07 11:14:47 -06:00
Sage Weil
abc20b6919 Merge PR #33111 into master
* refs/pull/33111/head:
	qa/suites/rados/cephadm[-smoke]: test podman on ubuntu 18.04

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-07 11:10:29 -06:00
Sage Weil
c6a731bf97 qa/suites/rados/cephadm[-smoke]: test podman on ubuntu 18.04
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-07 08:29:57 -06:00
Sage Weil
0eef82165b Merge PR #33110 into master
* refs/pull/33110/head:
	qa/distros: rhel and centos: whitelist cephadm logrotate selinux denial

Reviewed-by: Boris Ranto <branto@redhat.com>
2020-02-06 13:13:48 -06:00
Sage Weil
b91636dcfe qa/distros: rhel and centos: whitelist cephadm logrotate selinux denial
This is fixed in RHEL 8.1.1 (and by extension centos/rhel 8.2+).

No fix for el 7 yet

Partially-fixes: https://tracker.ceph.com/issues/43703
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-06 08:52:52 -06:00
Sage Weil
780b0c1205 mon/OSDMonitor: accept 'autoscale_mode' argument to 'osd pool create'
Allow the autoscale mode to be set atomically with pool creation.

Fixes: https://tracker.ceph.com/issues/42638
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-06 07:04:00 -06:00
Tatjana Dehler
4515ab32fa
Merge pull request #32546 from votdev/issue_43089_passwd_cmplx_config
mgr/dashboard: Make password policy check configurable

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-02-06 09:44:48 +01:00
Kefu Chai
edca34ea67 qa/tasks/cephadm: test "orchestrator host ls"
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-06 09:53:17 +08:00
Kefu Chai
062e0365ea qa/tasks: drop test_cephadm_orchestrator.py
this test will end with a failure like

```
2020-01-30T18:15:15.870 INFO:tasks.ceph.mgr.x.smithi042.stderr:Warning: Permanently added 'smithi042.front.sepia.ceph.com,172.21.15.42' (ECDSA) to the list of known hosts.
2020-01-30T18:15:15.925 INFO:tasks.ceph.mgr.x.smithi042.stderr:Permission denied, please try again.
2020-01-30T18:15:15.932 INFO:tasks.ceph.mgr.x.smithi042.stderr:Permission denied, please try again.
2020-01-30T18:15:15.939 INFO:tasks.ceph.mgr.x.smithi042.stderr:root@smithi042.front.sepia.ceph.com: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).
```

because mgr is not able to establish an ssh connection to that host with "root".
please note, the teuthology worker is acting using the "ubuntu" account on the
test node, and by default, "root" does not have its pubkey. and actually
`qa/tasks/cephadm.py` does push the pubkey to all the managed hosts before
testing cephadm.

since `qa/tasks/cephadm.py` is a better test for cephadm, let's just
drop this one.

as suites/rados/cephadm already covers cephadm

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-06 09:53:17 +08:00
Sage Weil
5948bd5545 Merge PR #32946 into master
* refs/pull/32946/head:
	qa/suites/rados: improve valgrind leak check
	common/ceph_context: add an asok command to deliberately leak memory

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-02-05 16:47:21 -06:00
Sage Weil
2611a73d57 Merge PR #33055 into master
* refs/pull/33055/head:
	qa/tasks/mgr/test_orchestrator_cli: support multiple DriveGroups

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-05 16:09:12 -06:00
Patrick Donnelly
1fc33c54f8
qa: specify random distros in multimds
Note: the name is important so that kclient mount can override the
distro setting.

Fixes: https://tracker.ceph.com/issues/43968
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-05 12:36:50 -08:00
Kefu Chai
5c5e1105bb
Merge pull request #33026 from liewegas/wip-el81
qa/distros: add rhel/centos 8.1

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-05 23:44:15 +08:00
Casey Bodley
8dbb92e4a1
Merge pull request #32996 from cbodley/wip-rgw-put-multipart-stripe
rgw: MultipartObjectProcessor supports stripe size > chunk size

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-02-05 08:42:50 -05:00
Kefu Chai
22da7813ef
Merge pull request #33018 from mgfritch/cephadm-docker-disabled
qa/workunits/cephadm/test_cephadm.sh: skip docker when service is disabled

Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-05 20:46:16 +08:00
Abhishek L
7c1a690560
Merge pull request #30684 from theanalyst/rgw/qa/rgw-admin-user-stats
qa: radosgw_admin: validate a simple user stats output

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2020-02-04 17:21:25 +01:00
Kiefer Chang
c9b12e2b66
qa/tasks/mgr/test_orchestrator_cli: support multiple DriveGroups
create_osds interface in Orchestrator supports multiple named DriveGroups
since https://github.com/ceph/ceph/pull/32972. Adapt the changes in
the test.

Fixes: https://tracker.ceph.com/issues/43945
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-02-04 14:31:21 +08:00
Sage Weil
e17ffa6c11 Merge PR #32977 into master
* refs/pull/32977/head:
	qa/workunits/cephadm/test_cephadm.sh: add missing monitoring tests
	cephadm: simplify Monitoring.components structure
	cephadm: add proper tox type for monitoring components

Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
2020-02-03 16:28:04 -06:00
Sage Weil
ebca44ccaa qa/suites/rados: improve valgrind leak check
Verify we can detect leak in the osd, mon, and mgr independently.  Also
include a negative test (no leaks).

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-03 10:25:39 -06:00
Casey Bodley
d486b5bc45 qa/rgw: test with non-default rgw-obj-stripe-size
each job will select one of the striping strategies at random

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-02-03 11:24:52 -05:00
Michael Fritch
4535216267
qa/workunits/cephadm/test_cephadm.sh: add missing monitoring tests
add tests for node-exporter, prometheus, and grafana

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-02-02 21:08:02 -07:00
Patrick Donnelly
29d850fb7e
Merge PR #32570 into master
* refs/pull/32570/head:
	cephfs-shell: Add tests for setxattr, getxattr and listxattr
	cephfs-shell: Add listxattr command
	cephfs-shell: Add getxattr command
	cephfs-shell: Add setxattr command
	doc: Update about extended attributes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-02 06:56:50 -08:00
Patrick Donnelly
3a6f107331
Merge PR #31633 into master
* refs/pull/31633/head:
	cephfs-shell: Instead of assert use stat for tests in rmdir
	cephfs-shell: Add function for common rmdir test code
	cephfs-shell: Add rmdir test for non empty directory
	cephfs-shell: Add rmdir -p test for non empty directory
	cephfs-shell: Add rmdir -p test for non existing dir
	cephfs-shell: Add rmdir -p test to delete all dirs in given path
	cephfs-shell: Add rmdir -p test for root directory with empty directories
	cephfs-shell: Add rmdir test for valid file
	cephfs-shell: Add rmdir test for invalid directory
	cephfs-shell: Add rmdir test for valid directory
	cephfs-shell: Fix rmdir '-p' issues

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-02 06:52:23 -08:00
Sage Weil
b66f5df514 Merge PR #32986 into master
* refs/pull/32986/head:
	qa/tasks/ceph_manager: fix movement of cot exports with cephadm

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-02-01 10:47:56 -06:00
Ramana Raja
b7768eca2a
Merge pull request #32030 from vshankar/wip-mgr-volumes-clone
mgr/volumes: clone from snapshot
2020-02-01 13:17:51 +05:30