Commit Graph

6751 Commits

Author SHA1 Message Date
Yuri Weinstein
16abadc59e qa/tests: removed tests 'client-upgrade-octopus-pacific'
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-04-20 15:59:19 -07:00
Yuri Weinstein
5e7391f231 qa/tests: fixed typo
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-04-20 13:57:10 -07:00
Yuri Weinstein
540842d27e qa/tests: added new clients upgrade tests
`client-upgrade-octopus-pacific` for future 'pacific' release

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-04-20 12:44:39 -07:00
Yuri Weinstein
158518fdcf qa/tests: initial checkin for clients upgrades tests for future release of pacific
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-04-20 10:58:57 -07:00
Kefu Chai
c5bd318de6 qa/tasks/cephfs/fuse_mount.py: by python3 compatible
pass `StringIO()` to capture stdout whose value will be interpreted as a
string later on

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-20 19:55:09 +08:00
Kefu Chai
bedea85019 qa/tasks/vstart_runner.py: be python3 compatible
differentiate `str` and `bytes` instances, and drop python2 support from
vstart_runner.py, as we've moved to python3 already

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-20 19:41:09 +08:00
Gregory Farnum
c17f4d9262
Merge pull request #34410 from lxbsz/mds_dirty_parent
tools/cephfs: add accounted_rstat/rstat when building file dentry

Reviewed-by: "Yan, Zheng" <zyan@redhat.com>
2020-04-17 08:27:40 -07:00
Gregory Farnum
2e84275947
Merge pull request #32612 from rishabh-d-dave/fs-qa-UnicodeDecodeError
test_cephfs_shell: fix UnicodeDecodeError

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-04-17 08:21:42 -07:00
Gregory Farnum
b274265acd
Merge pull request #33711 from lxbsz/qa_umount_failed
qa/tasks/cephfs: umount the mountpoints when tearDown

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-04-17 08:20:30 -07:00
Yuri Weinstein
a20f41f225 qa/tests: added octopus-p2p upgrade tests to the mix
Signed-off-by: Yuri Weinstein <yweinste@gmail.com>
2020-04-16 14:18:43 -07:00
Mykola Golub
0f2305d127
Merge pull request #34573 from dillaman/wip-44938-2
test: tx-only peer from heartbeat can race w/ CLI

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-04-16 18:50:47 +03:00
Kefu Chai
9959612854
Merge pull request #34517 from tchaikov/wip-qa-dashboard-telemetry
qa/tasks/mgr/dashboard: set last_opt_revision when setting enabled

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-04-16 22:12:56 +08:00
Venky Shankar
2132cf6ee0
Merge pull request #34210 from kotreshhr/cephfs-subvolume-info
mgr/volumes: Add interface to get subvolume metadata
2020-04-16 18:38:08 +05:30
Kefu Chai
08bec918f7 qa/tasks/mgr/dashboard: set last_opt_revision when setting enabled
telemetry requires user to re opt-in when opt_revision is bumped up

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-16 16:14:47 +08:00
Neha Ojha
61ad12e6ad
Merge pull request #34541 from neha-ojha/wip-balancer-on
mgr: turn on balancer in upmap mode by default

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-15 15:03:28 -07:00
Jason Dillaman
fb4311f597 qa/workunits/rbd: retry the addition of a mirror pool peer
We might race with the remote rbd-mirror daemon creating a
tx-only peer when adding a new peer. Therefore, delete the
tx-only peer and attempt to re-create it.

Fixes: https://tracker.ceph.com/issues/44938
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-04-15 16:27:07 -04:00
Mykola Golub
256ac4b46d
Merge pull request #34549 from dillaman/wip-qa-rbd-read-balance
qa/suites/rbd: tweak 'require_osd_release' to 'pacific'

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-04-15 16:08:08 +03:00
Sebastian Wagner
0cc05d0f22
Merge pull request #34443 from sebastian-philipp/cephadm-revert-33974
cephadm: Update images used

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-04-15 12:54:17 +02:00
Kefu Chai
eff9d0fc9a
Merge pull request #19076 from jecluis/wip-mon-fix-osdmap-lec-trim
mon/OSDMonitor: allow trimming maps even if osds are down

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-15 08:02:51 +08:00
Neha Ojha
ec85af5b19 qa/standalone/mon/osd-pool-df.sh: flush_pg_stats explicitly
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-04-14 19:09:45 +00:00
Sebastian Wagner
de448fafe0 cephadm: Update images used
Print warning when using cephadm from master

See also "use quay octopus tip until 15.2 tag is available"
* a9b15c7e1a0c14376cd66f166370694294398494.

See also  "update default container images"
* 1f05f7578794380f969a7e93db07345626b3e4df.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-14 16:05:14 +02:00
Jason Dillaman
267af5fcae qa/suites/rbd: tweak 'require_osd_release' to 'pacific'
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-04-14 08:43:29 -04:00
Neha Ojha
321faa9c6b qa/standalone/mon/osd-pool-df.sh: fix test to check for the right values
Though the test passed, we weren't checking for the correct values:

.../qa/standalone/mon/osd-pool-df.sh:62: TEST_ceph_df:  ceph df -f json
.../qa/standalone/mon/osd-pool-df.sh:62: TEST_ceph_df:  jq .stats.total_avail_bytes
../qa/standalone/mon/osd-pool-df.sh:62: TEST_ceph_df:  local global_avail=0
.../qa/standalone/mon/osd-pool-df.sh:63: TEST_ceph_df:  ceph df -f json
.../qa/standalone/mon/osd-pool-df.sh:63: TEST_ceph_df:  jq '.pools | map(select(.name == "$rep_poolname"))[0].stats.max_avail'
../qa/standalone/mon/osd-pool-df.sh:63: TEST_ceph_df:  local rep_avail=null
.../qa/standalone/mon/osd-pool-df.sh:64: TEST_ceph_df:  ceph df -f json
.../qa/standalone/mon/osd-pool-df.sh:64: TEST_ceph_df:  jq '.pools | map(select(.name == "$ec_poolname"))[0].stats.max_avail'
../qa/standalone/mon/osd-pool-df.sh:64: TEST_ceph_df:  local ec_avail=null
../qa/standalone/mon/osd-pool-df.sh:66: TEST_ceph_df:  echo '0 >= null*3'
../qa/standalone/mon/osd-pool-df.sh:66: TEST_ceph_df:  bc
1
../qa/standalone/mon/osd-pool-df.sh:67: TEST_ceph_df:  echo '0 >= null*1.5'
../qa/standalone/mon/osd-pool-df.sh:67: TEST_ceph_df:  bc
1

Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-04-14 00:05:02 +00:00
Neha Ojha
480afa61b6 qa/standalone/mgr/balancer.sh: adapt test
Now that the balancer is on by default the test needs these changes.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-04-14 00:05:02 +00:00
Neha Ojha
bca3b3f6e0 qa/workunits/cephtool/test.sh: don't set-require-min-compat-client luminous
This should not be required since mon_osd_initial_require_min_compat_client
is now luminous.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-04-14 00:05:02 +00:00
Casey Bodley
577f211391 test: add ceph_test_cls_cmpomap
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-04-13 09:23:44 -04:00
Xiubo Li
62e9820c3e qa/cephfs: scrub the subdir/ after data scan
This will make sure the rstat between subdir's inode and dirfrag
are matched.

Fixes: https://tracker.ceph.com/issues/44380
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-13 00:13:35 -04:00
Xiubo Li
b24edff02e qa/cephfs: remove the whole subdir/ after test done
Fixes: https://tracker.ceph.com/issues/44380
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-12 22:17:49 -04:00
Xiubo Li
39df09e52b tools/cephfs: Disable dirfrag auto merging and splitting
Make sure that the dirfrag auto merging and splitting are disabled
explicitly.

Fixes: https://tracker.ceph.com/issues/44380
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-12 22:17:48 -04:00
Xiubo Li
b8d34cdbdc tools/cephfs: scan the links to set the proper dnfirst
The ceph code will set the dnfirst=2 as default instead of CEPH_NOSNAP.
And this will avoid the MDS daemon assert crash:

ceph_assert(in->first <= straydn->first)

Fixes: https://tracker.ceph.com/issues/44380
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-12 22:17:47 -04:00
Sage Weil
d3d1ea5507 Merge PR #34272 into master
* refs/pull/34272/head:
	mgr/PyModuleRegistry: ignore 'obsolete' modules
	qa/suites/fs/upgrade: start with msgr2
	qa/suites/fs/upgrade: s/mimic/nautilus/
	qa/suites/upgrade: whitelist when orchestrator_cli can't be loaded
	qa/standalone/mon/msgr-v2-transition: remove test
	mon/MgrMonitor: disable orchestrator_cli if >= octopus
	qa/suites/ugprade: remove mimic -> pacific upgrade tests
	qa/standalone/mon/misc: update TEST_mon_features
	mon/MgrMap: use always_on_modules from most recent release
	mon/MonCommands: require-osd-release pacific
	qa/suites/rados/thrash-old-clients: adjust octopus package list for el7
	doc/dev/release-kickoff-checklist: include ceph-build change
	qa/workunits/cephtool/test.sh: fix require-osd-release test
	mon/MgrMonitor: define mgr modules for pacific
	doc/dev/release-checklists: generalize
	doc/dev/release-kickoff-checklist: quotes
	qa/suites/rados/thrash-old-clients/1-install/octopus
	qa/releases/pacific.yaml
	mds/cephfs_features: CEPHFS_CURRENT_RELEASE
	doc/dev/release-kickoff-checklist: a few other items
	osd: remove redundant check
	mon/OSDMonitor: make pacific changes
	mon/mon_types: add mon pacific feature
	include/ceph_features: define SERVER_PACIFIC
	include/ceph_features: fix whitespace
	mon: persistent INCOMPAT_PACIFIC item
	ceph-volume: __release__ == pacific
	script: update backport scripts for now-released octopus
	common: pacific release constants
	doc/dev/release-kickoff-checklist
	src/ceph_release: pacific, 16, dev
	CMakeLists: 16.0.0

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2020-04-12 17:33:57 -05:00
Kefu Chai
e7ead41ed1
Merge pull request #34487 from tchaikov/wip-test-cronjob-py3
qa/tests: pass "-t 2" to teuthology-suite when testing non-master bra…

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@suse.com>
Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2020-04-10 09:42:42 +08:00
Sebastian Wagner
370f2c033e
Merge pull request #34454 from mgfritch/cephadm-osd-fsid-test
qa/workunits/cephadm/test_cephadm.sh: add fsid to ceph-volume cmds

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-09 16:07:34 +02:00
Kotresh HR
70659ffee1 mgr/volumes: Add interface to get subvolume metadata
The following interface is added

"ceph fs subvolume info <vol_name> <sub_name> [<group_name>]"

The output is in json format with following fields

1. atime: access time of subvolume path in the format "YYYY-MM-DD HH:MM:SS"
2. mtime: modification time of subvolume path in the format "YYYY-MM-DD HH:MM:SS"
3. ctime: change time of subvolume path in the format "YYYY-MM-DD HH:MM:SS"
4. uid: uid of subvolume path
5. gid: gid of subvolume path
6. mode: mode of subvolume path
7. mon_addrs: list of monitor addresses
8. bytes_pcent: quota used in percentage if quota is set, else displays "undefined"
9. bytes_quota: quota size in bytes if quota is set, else displays "infinite"
10. bytes_used: current used size of the subvolume in bytes
11. created_at: time of creation of subvolume in the format "YYYY-MM-DD HH:MM:SS"
12. data_pool: data pool the subvolume belongs to
13. path: absolute path of a subvolume
14. type: subvolume type indicating whether it's clone or subvolume

Fixes: https://tracker.ceph.com/issues/44277
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-04-09 15:24:50 +05:30
Ilya Dryomov
4b04f2ba83
Merge pull request #34471 from idryomov/wip-rbd-fio-rstrip
qa/tasks/rbd_fio: unbreak after the conversion from StringIO

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-09 11:37:14 +02:00
Mykola Golub
978a2e364f
Merge pull request #34408 from dillaman/wip-44727
rbd-mirror: improved replication statistics

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-04-09 10:13:57 +03:00
Kefu Chai
21dacc823b qa/tests: pass "-t 2" to teuthology-suite when testing non-master branches
-t is an alias of "--teuthology-branch" which defaults to master. we
have a "py2" branch in teuthology. that branch is compatible with
python2, and the teuthology-worker is executed in a Python2 environment,
so all qa suites tested using "py2" branch of teuthology should work
fine as long as they are Python2 compatible. currently, all LTS branches
are compatible with Python2, and only master is also compatible with
Python3. but we plan to migrate master and octopus' qa suites to
python3 to ease the pain of maintainance in long term.

to achieve this goal, in this change, all non-master branches are now
tested using the "py2" teuthology branch.

once the python3 compatible changes are backported to octopus, "-t 2"
options will be removed from the command lines testing octopus.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-09 11:19:03 +08:00
Kefu Chai
8c63b26fe8
Merge pull request #34264 from tchaikov/wip-qa-py3
qa/tasks: be python3 compatible

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-09 10:08:44 +08:00
Sage Weil
8aa9c88f3e qa/suites/fs/upgrade: start with msgr2
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 15:46:36 -05:00
Michael Fritch
7e26083d92
qa/workunits/cephadm/test_cephadm.sh: use fsid during dump_log
needed when running with multiple ceph clusters

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-04-08 14:39:50 -06:00
Sage Weil
985c203eec qa/suites/fs/upgrade: s/mimic/nautilus/
Also rename 3-compat_client/mimic -> pacific to match the min_client
setting (the naming here confuses me...).

Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:10:32 -05:00
Sage Weil
be5f525df0 qa/suites/upgrade: whitelist when orchestrator_cli can't be loaded
This happens because mgrs may start before mons, or before mons have
published a new mgrmap that disables orchestrator_cli.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:10:32 -05:00
Sage Weil
731e508bbe qa/standalone/mon/msgr-v2-transition: remove test
v2 was introduced in nautilus, and we don't support mimic -> pacific
upgrades (only mimic -> octopus).  This test can be removed!

Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:10:32 -05:00
Sage Weil
3c7d5291de qa/suites/ugprade: remove mimic -> pacific upgrade tests
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:10:32 -05:00
Sage Weil
279c437994 qa/standalone/mon/misc: update TEST_mon_features
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:10:32 -05:00
Sage Weil
858b3a9c55 qa/suites/rados/thrash-old-clients: adjust octopus package list for el7
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:09:41 -05:00
Sage Weil
6833f89990 qa/workunits/cephtool/test.sh: fix require-osd-release test
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:09:41 -05:00
Sage Weil
80fb39e469 qa/suites/rados/thrash-old-clients/1-install/octopus
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:09:41 -05:00
Sage Weil
ac34cedd13 qa/releases/pacific.yaml
Signed-off-by: Sage Weil <sage@redhat.com>
2020-04-08 08:09:41 -05:00
Kefu Chai
83c632099b mgr/telegraf: catch FileNotFoundError exception
in tasks/module_selftest.yaml, `TestModuleSelftest.test_telegraf()` is
called. but we fail to prepare a unix domain socket to which the telegraf
module can send stats. and telegraf module does not catch
FileNotFoundError exception, so the exception is populated to ceph-mgr
and is found by the test, hence the test is marked a failure whenever
telegraf is tested.

in this change,

* catch this exception, so it won't be caught by ceph-mgr
* whitelist the error message, so the test can pass

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-08 21:07:07 +08:00