Commit Graph

7708 Commits

Author SHA1 Message Date
Patrick Donnelly
ac84e8277e
Merge PR #38037 into master
* refs/pull/38037/head:
	qa: test_readahead add kernel client support

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-23 20:33:47 -08:00
Yuri Weinstein
5ab1e53221
Merge pull request #38707 from ceph/wip-yuriw-octopus-x-4-master
qa/tests: initial check in for octopus-x/parallel tests (try 2)

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-12-23 13:09:51 -08:00
Josh Durgin
c79fa6d780 qa/tasks/cephadm: include first mgr host when applying mgrs
This prevents the first mgr from being shut down due to lack of
appropriate placements.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-12-23 11:30:54 -08:00
Yuri Weinstein
a6e601b7f2 qa/tests: add light octopus-x/copy (cephadm based)
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-12-22 16:20:15 -08:00
Varsha Rao
4c83f93f83 qa/cephfs/nfs: Add test for readonly export
Fixes: https://tracker.ceph.com/issues/48622
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-22 11:47:38 +00:00
Sebastian Wagner
af9dac1ff5
Merge pull request #38650 from dmick/wip-dmick-docker-mirror
qa/distros: configure podman to pull from docker-mirror

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-12-22 01:08:18 +01:00
Ernesto Puerta
23f2604d6f
Merge pull request #38259 from rhcs-dashboard/fix-jwt-token
mgr/dashboard: Use secure cookies to store JWT Token

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2020-12-21 11:23:53 +01:00
Kefu Chai
2d2e71fe0d
Merge pull request #38522 from tchaikov/wip-mon-health-cleanup
mon/HealthMonitor: split large method into smaller ones and cleanups

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-12-19 11:11:36 +08:00
Patrick Donnelly
802fd61bf4
Merge PR #38495 into master
* refs/pull/38495/head:
	doc: add documentation for new multifs feature
	qa: update tests concerning setting of multifs
	mon,mds: mark multifs stable

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-12-18 13:24:43 -08:00
Aashish Sharma
3c72dc3099 mgr/dashboard: Use secure cookies to store JWT Token
This PR intends to store the jwt token in secure cookies instead of local storage

Fixes: https://tracker.ceph.com/issues/44591

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
(cherry picked from commit 36703c63381e6723fff57266235f8230e6af1d92)
2020-12-18 19:33:50 +05:30
Dan Mick
f30c55a242 qa/distros: configure podman to pull from docker-mirror
This also requires a change to cephadm.py to search for
registry entries for docker.io by 'prefix' or 'location',
and to only add the mirror if a mirror isn't already present

Signed-off-by: Dan Mick <dmick@redhat.com>
2020-12-18 09:53:50 +00:00
Ilya Dryomov
fb03fa3766
Merge pull request #38638 from idryomov/wip-krbd-stable-writes-attr
qa: krbd_stable_pages_required.sh: move to stable_writes attribute

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-12-18 10:30:34 +01:00
Xiubo Li
2f4980f394 qa: test_readahead add kernel client support
If the "ceph.cluster_fsid" and "ceph.client_id" vxattrs or the
"metric" debug file are not support yet, will assume the test
succeeds.

Fixes: https://tracker.ceph.com/issues/48053
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-18 09:07:26 +08:00
Ernesto Puerta
b383a1fdf3
Merge pull request #38284 from rhcs-dashboard/48355-read-pwd-from-file
mgr/dashboard: CLI commands: read passwords from file

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
Reviewed-by: knortema <knortema@redhat.com>
2020-12-17 17:36:42 +01:00
Xiubo Li
62426772f5 qa: add ceph iscsi test suite support
Currently this only supports the gwcli tests on CentOS/RHEL 8 with
2 ceph iscsi gateways.

Fixes: https://tracker.ceph.com/issues/47439
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-17 20:49:21 +08:00
Ilya Dryomov
5adfc15b87 qa: krbd_stable_pages_required.sh: move to stable_writes attribute
bdi/stable_pages_required attribute was deprecated in 5.10 and now
always returns 0.  The replacement is queue/stable_writes.  (It is
also writeable, so we can simplify these test cases somewhat in the
future.)

Fixes: https://tracker.ceph.com/issues/48232
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-12-17 13:41:34 +01:00
Xiubo Li
8bcb63877c qa/tasks: get the correct clone_dir for each client
The clone_dir will be overrided in the loop.

Fixes: https://tracker.ceph.com/issues/47439
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-17 20:38:48 +08:00
Xiubo Li
8b0ebe1240 qa/tasks: allow none client prefixed node to run the cram
Fixes: https://tracker.ceph.com/issues/47439
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-17 20:38:48 +08:00
Xiubo Li
cfb86025fa qa/tasks: fix not enough values to unpack value error
Fixes: https://tracker.ceph.com/issues/47439
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-17 20:38:48 +08:00
Alfonso Martínez
5d7ee7c1f0 mgr/dashboard: CLI commands: read passwords from file
Fixes: https://tracker.ceph.com/issues/48355

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2020-12-17 08:36:57 +01:00
Patrick Donnelly
c0a30527db
Merge PR #38236 into master
* refs/pull/38236/head:
	qa: forward scrubbing background task

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-16 20:11:42 -08:00
Patrick Donnelly
123de8cda8
qa: fix tox failures
Fixes: c6121e48ec
Fixes: https://tracker.ceph.com/issues/48633
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-16 12:43:58 -08:00
Patrick Donnelly
c6121e48ec
Merge branch 'CVE-2020-27781' into master
* CVE-2020-27781:
  tasks/cephfs/test_volume_client: Add tests for authorize/deauthorize
  pybind/ceph_volume_client: Optionally authorize existing auth-ids
  pybind/ceph_volume_client: Preserve existing caps while authorize/deauthorize auth-id
  pybind/ceph_volume_client: Disallow authorize auth_id

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
2020-12-16 08:19:21 -08:00
Nizamudeen A
41941f0d28 mgr/dashboard: Temporary User Lockout if 10 Invalid Login attempts
Implemented a user lockout mechanism if the user enters 10 invalid attempts. The attempt count gets resetted to 0 once the user succesfully logins before getting disabled. Once the user gets disabled administrator has to manually enable the user which will also resets the number of attempts.

Fixes: https://tracker.ceph.com/issues/40914
Signed-off-by: Nizamudeen A <nia@redhat.com>
2020-12-16 16:14:47 +05:30
Patrick Donnelly
4bd9ef0965
qa: update tests concerning setting of multifs
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-14 10:42:23 -08:00
Milind Changire
a4757451f2 qa: forward scrubbing background task
Add forward scrubbing thrasher task to scrub file-system while a long
running IO is taking place.

Fixes: https://tracker.ceph.com/issues/17856
Signed-off-by: Milind Changire <mchangir@redhat.com>
2020-12-14 03:32:38 +05:30
Kefu Chai
ea9c14c322
Merge pull request #38020 from mdw-at-linuxbox/teuth-fix-x509-san
qa/tasks/openssl_keys.py: add subjectAltName to certificates

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-12 12:18:16 +08:00
Patrick Donnelly
cd62a8494b
Merge PR #38322 into master
* refs/pull/38322/head:
	test_cephfs_shell: add tests for ls command

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-12-11 18:59:42 -08:00
Patrick Donnelly
0c663e7d4e
Merge PR #38511 into master
* refs/pull/38511/head:
	qa/tasks/cephfs/nfs: Check if host ip is in cluster info output

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-11 09:47:35 -08:00
Kefu Chai
694ed23e9d qa/standalone/misc/ver-health.sh: include the bootup-time
in my test bed, it takes 11 seconds to boot the 3 OSDs and to restart
one of them, this fails the test.

so we need to take the time into consideration. in this change, the
delay is added to the total "warn_older_version_delay", so the monitor
does not start sending warning earlier than expected.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-11 16:14:03 +08:00
Kefu Chai
4bcfa139ab mon/HealthMonitor: use timespan for mon_warn_older_version_delay
for better user experience

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-11 16:12:47 +08:00
Kefu Chai
3f1aa66ee2
Merge pull request #38501 from tchaikov/wip-cmake-crimson-test
test/crimson: do not link against crimson-{os,common}

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-11 15:52:22 +08:00
Kotresh HR
aa4beb3d99
tasks/cephfs/test_volume_client: Add tests for authorize/deauthorize
1. Add testcase for authorizing auth_id which is not added by
   ceph_volume_client
2. Add testcase to test 'allow_existing_id' option
3. Add testcase for deauthorizing auth_id which has got it's caps
   updated out of band

Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-12-10 19:51:58 -08:00
Sebastian Wagner
84a110744c
Merge pull request #38490 from sebastian-philipp/mypy-0.790
src,qa,dashboard: Upgrade to mypy 0.790

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-12-10 22:41:47 +01:00
Kefu Chai
cbaa18e85a
Merge pull request #38524 from tchaikov/wip-crimson-qa-rbd
qa/suites: add crimson-rados/rbd test suites

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-10 22:18:39 +08:00
Sebastian Wagner
56db4fbed8
Merge pull request #38009 from ideepika/wip-48058-cephadm
qa/tasks/cephadm: update_info_yam() only if ctx.archive is valid

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-12-10 15:13:42 +01:00
Jason Dillaman
6f4e3b0dd1
Merge pull request #36551 from CongMinYin/immutable_object_cache_throttle
tools: add throttle mechanism to immutable object cache

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-12-10 09:07:16 -05:00
Kefu Chai
c467027a95 qa/suites: add crimson-rados/rbd test suites
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-10 20:41:30 +08:00
Ernesto Puerta
f977d1acf2
Merge pull request #38435 from votdev/issue_48449_test_standby
mgr/dashboard: test_standby* (tasks.mgr.test_dashboard.TestDashboard) failed locally

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-12-10 13:25:03 +01:00
Kefu Chai
1f5406a752 src/*: do not pass cct to ceph_version_to_str()
in e5b1ae5554, a new option named
"debug_version_for_testing" is introduced to override the version so
we can test version check.

in crimson, we have two families of shared functions.

- one of them is used by alien store. they are compiled with
  -DWITH_SEASTAR and -DWITH_ALIEN, to enable the shim code between
  seastar and POSIX thread.
- another is used by crimson in general. where no lock is allowed.

currently, we use the "crimson" and "ceph" namespace to differentiate
these two families of functions, so they can colocate in the same
executable without violating the ODR. see src/include/common_fwd.h for
more details.

the functions defined in src/common/version.cc are also shared by
alien store and crimson code. and because we have different
implementations of `CephContext` in crimson and in classic OSD (i.e.
alienstore), we have to have different implementations of this function
as well, if we follow the same approach. but since these functions are
very simple and are non-blocking, there is not much value in
differentiating them, it is better to inject the test settings using
environment variable instead of using ceph option subsystem.

in this change, "ceph_debug_version_for_testing" environment variable is
checked instead, so that crimson and alienstore can share the same
compilation unit of version.cc. and "debug_version_for_testing" option
is removed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-10 18:26:39 +08:00
Ronen Friedman
32fb8e9a38
Merge pull request #38472 from ronen-fr/wip-ronenf-qa-scrub
test: cancelling both noscrub *and* nodeep-scrub
2020-12-09 21:41:14 +02:00
Patrick Donnelly
69e073aed3
Merge PR #38407 into master
* refs/pull/38407/head:
	qa: allow arbitrary mount options on kclient mounts

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-12-09 11:29:10 -08:00
Ronen Friedman
43b1129030 test: cancelling both noscrub *and* nodeep-scrub
as part of osd-scrub-test.sh.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2020-12-09 20:16:23 +02:00
Varsha Rao
db50dd29c3 qa/tasks/cephfs/nfs: Check if host ip is in cluster info output
Along with host IP, sometimes Docker container IP's shows up in 'hostname -I'
output. Since this output is variable. Just check if host IP is present in the
cluster info output.

Fixes: https://tracker.ceph.com/issues/48491
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-09 16:52:50 +00:00
Sebastian Wagner
8b55bb6556 src,qa: Upgrade to mypy 0.790
dashboard/tools: Make sure {begin,end}_time are set.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-12-09 09:18:16 +01:00
Patrick Donnelly
7ba3669e88
Merge PR #38419 into master
* refs/pull/38419/head:
	vstart_runner: print result line unless opt_rotate_log is set

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-08 07:35:23 -08:00
Jeff Layton
4181742a3b qa: allow arbitrary mount options on kclient mounts
With this, we can pass a list of mount options to the kclient that will
be added onto the default ones. This is necessary to support testing
with fscache enabled (and other features activated by mount options).

Fixes: https://tracker.ceph.com/issues/6373
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2020-12-04 18:22:28 -05:00
Ernesto Puerta
4ae467e979
Merge pull request #38298 from bk201/wip-43165
mgr/dashboard: refactor /api/orchestrator/* endpoints

Reviewed-by: Courtney Caldwell <ccaldwel@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-12-04 18:24:46 +01:00
Mykola Golub
4939841633
Merge pull request #38379 from dillaman/wip-librbd-migration-5
librbd/migration: add thick-provisioned snapshot support to the raw format

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-04 17:43:59 +02:00
Volker Theile
9d4282e53a mgr/dashboard: test_standby* (tasks.mgr.test_dashboard.TestDashboard) failed locally
Fixes: https://tracker.ceph.com/issues/48449

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-12-04 14:39:37 +01:00