Commit Graph

2999 Commits

Author SHA1 Message Date
Patrick Donnelly
21b69fda3c
Merge PR #41084 into master
* refs/pull/41084/head:
	test: test to verify dir path removal when no mirror daemons are running
	pybind/mirroring: advance state machine from stalled state
	pybind/mirroring: start from correct state during policy init

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-20 12:42:19 -07:00
Sage Weil
b9d8dc483a Merge PR #41286 into master
* refs/pull/41286/head:
	qa/suites/orch/rook: disable centos for now
	qa/suites/orch/rook/smoke: initial smoke suite
	qa/tasks/rook: ROOK_HOSTPATH_REQUIRES_PRIVILEGED=true on centos
	qa/tasks/rook: simplify shutdown
	qa/tasks/rook: archive logs
	qa/tasks/rook: more orderly cluster teardown
	qa/tasks/rook: deploy ceph via rook on top of kubernetes
	qa/tasks/kubeadm: install kubernetes with kubeadm
	qa/suites: move rados/cephadm -> orch/cephadm; symlink
	qa/tasks/cephadm: add whitespace between functions
	qa/tasks/cephadm: clean up ctx.manager setup

Reviewed-by: Sébastien Han <seb@redhat.com>
2021-05-19 07:55:30 -04:00
Patrick Donnelly
e9f7fafe52
Merge PR #41171 into master
* refs/pull/41171/head:
	test: disable mirroring module for certain tests

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-18 13:41:28 -07:00
Sage Weil
f765677b81 qa/tasks/rook: ROOK_HOSTPATH_REQUIRES_PRIVILEGED=true on centos
This fixes OSD creation on centos.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 15:19:16 -05:00
Sage Weil
929d6ad8ca qa/tasks/rook: simplify shutdown
For some reason deleting common.yaml sometimes fails.  Not really
sure why, but since we will tear down kubernetes anyway this
cleanup isn't really needed.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 15:19:16 -05:00
Sage Weil
e5148b3f59 qa/tasks/rook: archive logs
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 15:19:16 -05:00
Sage Weil
539cd362dd qa/tasks/rook: more orderly cluster teardown
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 15:19:16 -05:00
Sage Weil
4574ed70f4 qa/tasks/rook: deploy ceph via rook on top of kubernetes
This assumes that k8s is installed and kubectl works.

The ceph container to use is selected the same way the cephadm
task does it.

All scratch devices are consumed as OSDs.

A ceph.conf and client.admin keyring are deployed on all test
nodes, so normal tasks should work (if/when packages are installed).

Fixes: https://tracker.ceph.com/issues/47507
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 15:19:04 -05:00
Sage Weil
ebf841a82f qa/tasks/kubeadm: install kubernetes with kubeadm
- install k8s with kubeadm
- initial support for flannel only
- remove taint from bootstrap/master node
- create PVs for all scratch_devs + a 'scratch' SC
- kubeadm.kubectl task

Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 11:14:14 -05:00
Sage Weil
b6d1536a67 qa/tasks/cephadm: add whitespace between functions
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-18 10:05:16 -05:00
Casey Bodley
46c0292870 rgw: remove the civetweb frontend from src and qa
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-05-17 15:00:31 -04:00
Sage Weil
267cefc040 qa/tasks/cephadm: clean up ctx.manager setup
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-14 15:02:13 -05:00
Varsha Rao
94644d1e5f qa/tasks/nfs: add test to check if cmds fail on not passing required arguments
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-05-14 21:03:50 +05:30
Sage Weil
beb57679c6 Merge PR #39550 into master
* refs/pull/39550/head:
	mgr/cephadm: induce retune of osd memory on osd creation
	qa/tasks/cephadm.conf: autotune osd memory by default
	mgr/cephadm: do not autotune when _no_autotune_memory label is present
	mgr/cephadm: autotune osd memory
	common: add osd_memory_target_autotune
	mgr/cephadm: report memory usage, request (limit) in 'orch ps'
	doc/cephadm/host-management: document _admin group
	mgr/orchestrator: fix help formatting

Reviewed-by: Adam King <adking@redhat.com>
2021-05-13 09:57:14 -04:00
Sage Weil
e5c88e2c49 qa/tasks/cephadm.conf: autotune osd memory by default
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-12 11:02:34 -04:00
Venky Shankar
f4ed3ae5f3 test: test to verify dir path removal when no mirror daemons are running
Fixes: http://tracker.ceph.com/issues/50523
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-05-11 08:39:45 -04:00
Sage Weil
c690065423 Merge PR #41179 into master
* refs/pull/41179/head:
	qa/tasks/cephadm_cases: longer wait for osd to start

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-05-06 16:01:57 -04:00
Ernesto Puerta
0c7d35a6cf
Merge pull request #41050 from rhcs-dashboard/fix-bucket-versioning-edit
mgr/dashboard: fix bucket versioning when locking is enabled

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2021-05-06 11:32:51 +02:00
Sage Weil
a103fd6955 qa/tasks/cephadm_cases: longer wait for osd to start
Signed-off-by: Sage Weil <sage@newdream.net>
2021-05-05 11:03:02 -05:00
Venky Shankar
0676409bec test: disable mirroring module for certain tests
Without this a traceback is seen in mgr logs. Also, this solves
one part of the issue. The other half (failing tests) will be
resolved by PR #40885.

Fixes: http://tracker.ceph.com/issues/50224
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-05-05 08:37:35 -04:00
Avan Thakkar
e90ce333c6 mgr/dashboard: fix bucket versioning when locking is enabled
Fixes: https://tracker.ceph.com/issues/50545
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2021-05-05 17:24:41 +05:30
Patrick Donnelly
a52cc67249
Merge PR #40962 into master
* refs/pull/40962/head:
	test: add test to validate snap synchronization with parent directory snapshots
	cephfs-mirror: ignore parent directory snapshots when building snap map

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-03 17:43:47 -07:00
Sage Weil
75480f52e4 Merge PR #40941 into master
* refs/pull/40941/head:
	qa/suites/rados/cephadm/smoke-roleless: test client-keyring
	qa/tasks/cephadm.py: adjust client.admin key mode; place on all hosts
	cephadm: distribute client.admin keyring+conf to label:_admin on bootstrap
	doc/cephadm: document the default 'admin' label
	mgr/cephadm: 'ceph orch client-keyring ...' commands to manage keyring files
	mgr/cephadm: reimplement ceph.conf pushing
	mgr/cephadm: use _write_remote_file for ceph.conf
	mgr/cephadm: _write_remote_file helper
	mgr/cephadm: add placementspec for which hosts get ceph.conf

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Adam King <adking@redhat.com>
2021-04-28 14:26:35 -04:00
Sage Weil
b0dcaf2cfa qa/tasks/cephadm.py: adjust client.admin key mode; place on all hosts
Except during upgrades, since it is not supported there.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-27 18:29:50 -04:00
Venky Shankar
9dcf6f7c8c
Merge pull request #40157 from leseb/do-not-fail-when-nosnap
mgr/pybind/snap_schedule: do not fail when no fs snapshots are available

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-04-27 18:51:57 +05:30
Venky Shankar
8343471a0f
Merge pull request #40933 from vshankar/wip-50266
cephfs-mirror: sanitize `daemons status` JSON

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-04-27 12:22:37 +05:30
Sébastien Han
74a7cdda6b mgr/pybind/snap_schedule: do not fail when no fs snapshot schedules are available
When listing for available snapshot schedules, we should not an error in case
there is none. We should just return 0 with an empty dict.

Fixes: https://tracker.ceph.com/issues/49837
Signed-off-by: Sébastien Han <seb@redhat.com>
2021-04-26 08:57:28 +02:00
Patrick Donnelly
a4d3377ff4
Merge PR #40526 into master
* refs/pull/40526/head:
	spec: add nfs to spec file
	mgr/nfs: Don't enable nfs module by default
	mgr/nfs: check for invalid chars in cluster id
	mgr/nfs: Use CLICommand wrapper
	mgr/nfs: reorg nfs files
	mgr/nfs: Check if transport or protocol are list instance
	mgr/nfs: reorg cluster class and common helper methods
	mgr/nfs: move common export helper methods to ExportMgr class
	mgr/nfs: move validate methods into new ValidateExport class
	mgr/nfs: add custom exception module
	mgr/nfs: create new module for export utils
	mgr/nfs: rename fs dir to export
	mgr/volumes/nfs: Move nfs code out of volumes plugin

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-22 09:20:59 -07:00
Sage Weil
a5b1644660 Merge PR #40913 into master
* refs/pull/40913/head:
	qa/tasks/cephadm: fix ctx archive check for teuthology

Reviewed-by: Sage Weil <sage@redhat.com>
2021-04-22 09:50:02 -04:00
Varsha Rao
2a99da961a mgr/nfs: Don't enable nfs module by default
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-04-22 11:38:30 +05:30
Venky Shankar
2b308e6165 test: add test to validate snap synchronization with parent directory snapshots
Fixes: http://tracker.ceph.com/issues/50442
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-04-21 07:57:09 -04:00
Venky Shankar
18deb52f5d test: adjust mirroring test to use changed daemon status JSON
Fixes: http://tracker.ceph.com/issues/50266
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-04-20 21:18:54 -04:00
Deepika Upadhyay
ec2a402f55 qa/tasks/cephadm: fix ctx archive check for teuthology
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2021-04-19 19:48:47 +05:30
Sage Weil
56ade4769c Merge PR #40817 into master
* refs/pull/40817/head:
	mgr/MgrStandby: fix config observer
	mgr/MgrStandby: respawn if mgr_standby_modules changes
	qa/tasks/mgr/test_dashboard: skip test_standby if mgr_standby_modules=false
	qa/suites/rados/cephadm/smoke-*: use cephadm.wait_for_service
	qa/suites/rados/cephadm/smoke-singlehost: test --single-host-defaults
	cephadm: add --single-host-defaults option to bootstrap
	mgr/cephadm: allow mgr colo if mgr_standby_modules=false
	mgr/MgrStandby: add mgr_standby_modules option

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-04-19 08:30:42 -04:00
Sage Weil
1a55d82229 Merge PR #40888 into master
* refs/pull/40888/head:
	qa/tasks/cephadm: ignore --keep-logs failure
	qa/tasks/cephadm: use yaml.dump_all()
	qa/suites/rados/cephadm/smoke-*: use cephadm.wait_for_service
	qa/tasks/cephadm: tear down clsuter before gathering logs
	qa/suites/rados/cephadm/smoke-roleless: test rgw-ingress
	mgr/cephadm: remove virtual_ip check during scheduling
	mgr/orchestrator: orch ls: leave off virtual_ip prefixlen
	qa/tasks/cephadm: add wait_for_service
	qa/tasks/cephadm: allow skip_monitor_stack=true
	qa/tasks/cephadm: do subst_vip for cephadm.shell and .apply
	qa/tasks/vip: add vip task to allocate virtual IPs
	qa/suites/rados/cephadm/smoke-roleless: add rgw-ingress test case
	qa/tasks/cephadm: shell: take 'all-roles' or 'all-hosts'
	qa/tasks/cephadm: let cephadm.shell take string or list

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-04-16 18:10:46 -04:00
Sage Weil
a2c9333a0b qa/tasks/mgr/test_dashboard: skip test_standby if mgr_standby_modules=false
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-16 16:00:31 -04:00
Sage Weil
c20323d114 qa/suites/rados/cephadm/smoke-singlehost: test --single-host-defaults
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-16 16:00:31 -04:00
Sage Weil
65f2848e97 qa/tasks/cephadm: ignore --keep-logs failure
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-16 14:12:49 -05:00
Sage Weil
97c143c344 qa/tasks/cephadm: use yaml.dump_all()
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-16 10:30:05 -05:00
Sage Weil
deec9074bb qa/tasks/cephadm: tear down clsuter before gathering logs
We dont' always stop all services, because teuthology doesn't know about
things it didn't start.  Use rm-cluster to tear things down, but do not
remove the logs themselves.  After we get logs, we'll clean up completely.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-16 09:49:45 -05:00
Sage Weil
ced2f7fe4a qa/tasks/cephadm: add wait_for_service
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-16 09:49:45 -05:00
Sage Weil
bb825157dc qa/tasks/cephadm: allow skip_monitor_stack=true
(Useful for roleless when we want to go faster)

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-16 09:49:45 -05:00
Sage Weil
0d561e2741 qa/tasks/cephadm: do subst_vip for cephadm.shell and .apply
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-16 09:49:45 -05:00
Sage Weil
2a8ab2d2b8 qa/tasks/vip: add vip task to allocate virtual IPs
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-16 09:49:45 -05:00
Sage Weil
3a7c72a9ed Merge PR #40411 into master
* refs/pull/40411/head:
	doc: add note about removal of the `cephfs` nfs cluster type
	mgr/volumes/nfs: drop `type` param during cluster create

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
2021-04-16 10:48:04 -04:00
Sage Weil
0803957695 qa/tasks/cephadm: shell: take 'all-roles' or 'all-hosts'
'all' is ambiguous

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-16 07:36:47 -05:00
Sage Weil
779af3da6f qa/tasks/cephadm: let cephadm.shell take string or list
Make it a bit more forgiving.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-16 07:36:47 -05:00
Patrick Donnelly
2a81253141
Merge PR #40412 into master
* refs/pull/40412/head:
	vstart_runner: reuse code in LocalRemoteProcess

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-15 21:05:51 -07:00
Patrick Donnelly
3a30edf3de
Merge PR #39660 into master
* refs/pull/39660/head:
	qa: Update the mdsmap schema in mgr/dashboard/test_health.py
	doc: add lsflags command to Administrative Commands document
	qa: test fs lsflags command
	mon: add command to print fs flags
	mds: print each flag value

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-15 21:03:19 -07:00
Michael Fritch
e9b2c38354
mgr/volumes/nfs: drop type param during cluster create
PR #37600 introduced support for both `cephfs` and `rgw` exports
to be configured using a single nfs-ganesha cluster

Fixes: https://tracker.ceph.com/issues/50369
Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-04-14 18:21:36 -06:00