Commit Graph

628 Commits

Author SHA1 Message Date
Sage Weil
d3d1ea5507 Merge PR #34272 into master
* refs/pull/34272/head:
	mgr/PyModuleRegistry: ignore 'obsolete' modules
	qa/suites/fs/upgrade: start with msgr2
	qa/suites/fs/upgrade: s/mimic/nautilus/
	qa/suites/upgrade: whitelist when orchestrator_cli can't be loaded
	qa/standalone/mon/msgr-v2-transition: remove test
	mon/MgrMonitor: disable orchestrator_cli if >= octopus
	qa/suites/ugprade: remove mimic -> pacific upgrade tests
	qa/standalone/mon/misc: update TEST_mon_features
	mon/MgrMap: use always_on_modules from most recent release
	mon/MonCommands: require-osd-release pacific
	qa/suites/rados/thrash-old-clients: adjust octopus package list for el7
	doc/dev/release-kickoff-checklist: include ceph-build change
	qa/workunits/cephtool/test.sh: fix require-osd-release test
	mon/MgrMonitor: define mgr modules for pacific
	doc/dev/release-checklists: generalize
	doc/dev/release-kickoff-checklist: quotes
	qa/suites/rados/thrash-old-clients/1-install/octopus
	qa/releases/pacific.yaml
	mds/cephfs_features: CEPHFS_CURRENT_RELEASE
	doc/dev/release-kickoff-checklist: a few other items
	osd: remove redundant check
	mon/OSDMonitor: make pacific changes
	mon/mon_types: add mon pacific feature
	include/ceph_features: define SERVER_PACIFIC
	include/ceph_features: fix whitespace
	mon: persistent INCOMPAT_PACIFIC item
	ceph-volume: __release__ == pacific
	script: update backport scripts for now-released octopus
	common: pacific release constants
	doc/dev/release-kickoff-checklist
	src/ceph_release: pacific, 16, dev
	CMakeLists: 16.0.0

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2020-04-12 17:33:57 -05:00
Kefu Chai
8c63b26fe8
Merge pull request #34264 from tchaikov/wip-qa-py3
qa/tasks: be python3 compatible

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-09 10:08:44 +08:00
Sage Weil
3c7d5291de qa/suites/ugprade: remove mimic -> pacific upgrade tests
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:10:32 -05:00
Sage Weil
858b3a9c55 qa/suites/rados/thrash-old-clients: adjust octopus package list for el7
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:09:41 -05:00
Sage Weil
80fb39e469 qa/suites/rados/thrash-old-clients/1-install/octopus
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:09:41 -05:00
Kefu Chai
83c632099b mgr/telegraf: catch FileNotFoundError exception
in tasks/module_selftest.yaml, `TestModuleSelftest.test_telegraf()` is
called. but we fail to prepare a unix domain socket to which the telegraf
module can send stats. and telegraf module does not catch
FileNotFoundError exception, so the exception is populated to ceph-mgr
and is found by the test, hence the test is marked a failure whenever
telegraf is tested.

in this change,

* catch this exception, so it won't be caught by ceph-mgr
* whitelist the error message, so the test can pass

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-08 21:07:07 +08:00
Sebastian Wagner
58cc88dd14
Merge pull request #34406 from liewegas/fix-cephadm-upgrade-start
qa/suites/rados/cephadm/upgrade: start from v15.2.0

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-07 11:59:00 +02:00
Brad Hubbard
9c9be1b695
Merge pull request #34310 from badone/wip-restful-api-dont-pass-empty-dict-to-get
qa/suites/rados/rest: don't pass empty dict as data arg

Reviewed-by: Sage Weil <sage@redhat.com>
2020-04-07 08:14:03 +10:00
Sage Weil
44ca20017a qa/suites/rados/cephadm/upgrade: start from v15.2.0
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-03 14:15:01 -05:00
Sage Weil
76b559598a qa/suites/rados/cephadm/smoke-roleless: add smoke test
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-02 23:16:42 +00:00
Brad Hubbard
f7c49a4063 qa/suites/rados/rest: Test against all supported distros
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2020-03-31 17:43:10 +10:00
Xie Xingguo
b7a959c1cf
Merge pull request #33910 from xiexingguo/wip-44532-2
osd/PeeringState: do not trim pg log past last_update_ondisk

Reviewed-by: Yan Jun <yan.jun8@zte.com.cn>
Reviewed-by: Samuel Just <sjust@redhat.com>
2020-03-26 08:10:22 +08:00
Sage Weil
de20c7bc61 Merge PR #34105 into master
* refs/pull/34105/head:
	Merge PR #34042 into octopus
	Merge PR #33959 into octopus
	Merge PR #34067 into octopus
	mgr/DaemonServer: add explicit check that acting matches for merge
	Merge pull request #34040 from dillaman/wip-44396-partial-fix
	Merge PR #34098 into octopus
	mgr/rook: list rgw services
	mgr/rook: tolerate timestamps that are None
	mgr/orch: add 'subcluster' property to RGWSpec
	mgr/rook: do not create radosgw pools
	mgr/rook: refactor apply/add for rgw
	Merge PR #34082 into octopus
	Merge PR #34068 into octopus
	cephadm: relabel /etc/ganesha mount
	Merge PR #34046 into octopus
	Merge PR #34092 into octopus
	Merge pull request #33719 from ukernel/wip-44416
	rbd-mirror: leader watcher should not cancel get locker if locker is invalid
	rbd-mirror: snapshot sync request needs to check for interruption
	librbd: request exclusive lock when moving to trash
	rbd-mirror: basic integration with sync throttling
	rbd-mirror: don't prematurely finish snapshot replay loop
	rbd-mirror: pass InstanceWatcher to snapshot Replayer
	doc/releases/octopus.rst: add note about ec recovery below min_size
	mgr/cephadm: configure rgw_frontends for rgw service
	cephadm: switch grafana image to the ceph repo
	Merge PR #34034 into octopus
	qa/suites/rados/cephadm/upgrade: update starting version
	Merge PR #33540 into octopus
	Merge PR #34023 into octopus
	Merge PR #34044 into octopus
	Merge PR #34030 into octopus
	doc/orchestrator: update rgw creation
	mgr/cephadm: clean up client.crash.* container_image settings after upgrade
	cephadm: make add-repo --release and --version independent
	cephadm: env over last used
	mgr/orch: accept port and ssl flags to 'apply rgw'
	mgr/orch: 'ceph upgrade ...' -> 'ceph orch upgrade ...'
	cephadm: fall back to default for infer_image
	cephadm: remove outdated check
	cephadm: consolidate default image logic
	remove ceph_test_rados_watch_notify
	python-common/ceph/deployment/service_spec: add ssl to RGWSpec
	cephadm: only infer image for shell, run, inspect-image, pull, ceph-volume
	mgr/test_orchestrator: fix service filtering when using dummy data
	mgr/dashboard: fix adding/removing host errors
	mgr/rook: fix 'orch ps' for osds
	qa: fix all the fsx.sh-invoking yaml files to install dependencies
	mds: pass proper MutationImpl::LockOp to Locker::wrlock_start()

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-03-23 08:24:06 -05:00
Lenz Grimmer
b819847556
Merge pull request #34063 from s0nea/wip-dashboard-crush-rule-suite
mgr/dashboard: add crush rule test suite

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-03-23 13:11:50 +01:00
Sage Weil
ec1b0e33d8 qa/suites/rados/cephadm/upgrade: update starting version
Need upgrade command to match!

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-20 08:11:58 -05:00
Tatjana Dehler
04ee0178a5 mgr/dashboard: add crush rule test suite
https://tracker.ceph.com/issues/44679
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2020-03-19 16:33:22 +01:00
Sage Weil
41dcb3c814 mgr/orch: 'ceph upgrade ...' -> 'ceph orch upgrade ...'
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-18 20:56:44 -05:00
Samuel Just
ceb8e457e7 suites/rados/thrash: add rados-high-concurrency
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-03-19 08:15:02 +08:00
Sage Weil
7c19c1534b qa/suites/rados/verify/validater/valgrind: tolerate SLOW_OPS
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00
Sage Weil
baeb051910 qa/suites/rados/verify/validater/valgrind: less bluestore logging
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00
Sage Weil
4fda9d50f0 qa/suites/rados/verify/validater: increase heartbeat grace
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00
Sage Weil
0bd14ab080 Revert "qa/suites/rados/verify: debug_ms = 1, osd_heartbeat_grace = 60"
This reverts commit 4f742f200d.

This was in the wrong file.. see valgrind.yaml

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00
Sage Weil
12105ed9d7 Revert "qa/suites/rados/verify/validator/valgrind: debug refs = 5"
This reverts commit 65e81e6eb4.

This slows things down too much with valgrind.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00
Sage Weil
40a7bcea70 qa/suites/rados/verify: set ALLOW_TIMEOUTS for workunits
When running under valgrind (and thrashing) things can be slow.  Tell
tests in case they need to tolerate timeouts.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 18:24:12 -05:00
Sage Weil
d7de2abc2f cephadm: add allow_ptrace option to enable SYS_PTRACE
In any environments it is helpful to have SYS_PTRACE so that you can
gdb attach or strace a daemon.

Leave this off by default so that the container is more secure.

Enable this in teuthology and vstart.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 21:04:22 -05:00
Sage Weil
7957655227 cephadm: bootstrap: deploy monitoring stack by default
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 12:39:44 -05:00
Sage Weil
13919b5fed qa/suites/rados/cephadm/upgrade: start from compatible build
The osd create command is changing, so upgrade from something that the
latest cephadm.py task can use.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-14 10:18:25 -05:00
xie xingguo
a9412ba25c qa/osd-recovery: pass osd_pg_log_trim_min = 0 to exercise short pg logs
we have osd_min_pg_log_entries to 2 (good) but not osd_pg_log_trim_min
which defaults to 100. Thus, even on those tests we're only rarely vulnerable.
Reset osd_min_pg_log_entries to 0 to make sure we really
would keep a minimal pg log in hand.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2020-03-13 08:49:58 +08:00
Sage Weil
281b106dc6 Merge PR #33871 into octopus
* refs/pull/33871/head:
	qa/suites/rados/verify: debug_ms = 1, osd_heartbeat_grace = 60

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-03-12 11:17:53 -05:00
Sage Weil
4f742f200d qa/suites/rados/verify: debug_ms = 1, osd_heartbeat_grace = 60
The rados api tests are failing WatchNotify because the OSDs are so
heavily lagged.. in large part due to the high debug level of debug_ms=20
and debug_osd=25.  Reduce that.

Also increase the heartbeat grace so slow valgrind-y osds don't get marked
down.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-11 06:57:52 -05:00
Sage Weil
90b52cba91 qa/suites/rados/cephadm/upgrade: upgrade start point that supports the no-spec option
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-10 15:38:52 -05:00
Sage Weil
090288fa3e Merge PR #33801 into octopus
* refs/pull/33801/head:
	qa/suites/rados/ceph: drop opensuse for now

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2020-03-09 16:25:57 -05:00
Sage Weil
b6084c333d qa/suites/rados/cephadm/upgrade: new start point
The starting cephadm needs to look for default ceph.conf etc in /etc/ceph
for cephadm.py to be happy.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-07 15:19:07 -06:00
Sage Weil
af30e245dc qa/suites/rados/ceph: drop opensuse for now
Until https://tracker.ceph.com/issues/44501 is resolved and the builders
are able to keep up.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-07 08:23:20 -06:00
Sage Weil
bfb03adbe6 qa/suites/rados/cephadm/upgrade: adjust starting version
This version understands how to apply a mgr spec like '2;host=x' with a
semicolon.  This particular test build does.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-07 06:42:07 -06:00
Sage Weil
4e7ab6f2e6 qa/suites/rados/cephadm: deploy all monitoring components
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-06 15:51:45 -06:00
Kefu Chai
63f5528930
Merge pull request #33584 from liewegas/fix-39525
compressor/lz4: work around bug in liblz4 versions <1.8.2

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-03-04 12:44:38 +08:00
Sage Weil
dc4ff2b4e2 Merge PR #33648 into master
* refs/pull/33648/head:
	qa/suites/cephadm: move orchestrator_cli test into rados/cephadm

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-03-02 14:14:40 -06:00
Sage Weil
8c8fb59dcf qa/objectstore: test all bluestore compression algorithms
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-02 13:01:22 -06:00
Sage Weil
ddb8ab3dd3 qa/suites/cephadm: move orchestrator_cli test into rados/cephadm
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-02 10:52:24 -06:00
Kefu Chai
59546f6a49
Merge pull request #33645 from liewegas/fix-mon-down-cephtool-test
qa/suites/rados/singleton-bluestore/cephtool: whitelist MON_DOWN

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-02 19:11:42 +08:00
Sage Weil
4c5827241a qa/suites/rados/singleton-bluestore/cephtool: whitelist MON_DOWN
cephtool/test.sh now includes a test that disallows mon from the quorum
for a short period.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-01 08:03:21 -06:00
Sage Weil
1400b35858 qa/suites/rados/verity/tasks/mon_recovery: whitelist SLOW_OPS
The mon can see slow ops when thrashing.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-01 07:58:11 -06:00
Nathan Cutler
47926809f3
Merge pull request #33535 from smithfarm/wip-rados-cephadm-smoke-152
qa: run cephadm/smoke on opensuse 15.2 instead of 15.1

Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
2020-02-25 18:36:11 +01:00
Nathan Cutler
465eb03930 qa: run cephadm/smoke on opensuse 15.2 instead of 15.1
Companion PR to https://github.com/ceph/ceph-build/pull/1509

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-02-25 14:28:35 +01:00
Sage Weil
a4a3a3c0a0 qa/suites/rados/singleton/all/thrash-eio: whitelist 'slow request'
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-24 08:47:43 -06:00
Sridhar Seshasayee
e527067666 qa: Whitelist 'slow request' within a bunch of tests
Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2020-02-24 19:59:56 +05:30
Sage Weil
3e85a09ad2 Merge PR #33328 into master
* refs/pull/33328/head:
	osd/OSD: Log slow ops/types to cluster logs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-02-23 15:12:48 -06:00
Sage Weil
9bcdc110de Merge PR #33486 into master
* refs/pull/33486/head:
	qa/suites/rados/cephadm/smoke: run a few orch commands
	mgr/orch: fix 'host ls'

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-22 12:56:26 -06:00
Sage Weil
4324bce802 Merge PR #33475 into master
* refs/pull/33475/head:
	qa/suites/rados/cephadm/upgrade: change start version

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-22 12:55:27 -06:00