Commit Graph

1391 Commits

Author SHA1 Message Date
Patrick Donnelly
9e59ba40c3
Merge PR #28560 into master
* refs/pull/28560/head:
	cephfs-shell: handle du's arguments elsewhere outside do_du()
	cephfs-shell: reuse code
	cephfs-shell: rewrite call to perror in do_du
	pybind/cephfs: define variable for hexcode used in stat()
	test_cephfs_shell: test cephfs-shell command at invocation
	cephfs-shell: refactor do_du()
	cephfs-shell: option -r is not for reverse
	cephfs-shell: extend to_bytes()
	test_cephfs_shell: test du with no args
	test_cephfs_shell: test du with multiple paths in args
	test_cephfs_shell: test behaviour of "du -r"
	test_cephfs_shell: test du's output for softlinks
	qa/cephfs: add convenience method lstat()
	qa/cephfs: add option to make stat() unfollow symlinks
	test_cephfs_shell: test du's output for hardlinks
	test_cephfs_shell: test du's output for directories
	test_cephfs_shell: test du's output for regular files
	test_cephfs_shell: add a method to get command output
	test_cephfs_shell: allow cmd as list too
	test_cephfs_shell: rename and rewrite _cephfs_shell()
	test_cephfs_shell: copy humanize() from cephfs-shell
	cephfs-shell: print disk usage for non-directory files too
	pybind/cephfs: add method that stats symlinks without following
	cephfs-shell: Fix 'du' command error

Reviewed-by: Varsha Rao <varao@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-13 12:39:39 -07:00
Patrick Donnelly
1874899374
Merge PR #28702 into master
* refs/pull/28702/head:
	qa: update json format from session listing
	mds: recall caps from quiescent sessions
	mds: use Session::dump method uniformly
	mds: use auto to deduce iterator type
	mds: simplify method definition
	mds: remove useless debug message
	mds: use const get_request_count
	mds: use session_info_t socket inst for addr
	mds: refactor session lookup
	mds: add explicit trim flag
	mds: alphabetize tracked config keys
	common: provide method to get half-life
	common: correct variable name

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2019-09-13 08:35:04 -07:00
Rishabh Dave
f9b4d790e5 test_cephfs_shell: test cephfs-shell command at invocation
Verify that "cephfs-shell -c ceph.conf <cephfs-shell-cmd>" works as
expected.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:45:42 +05:30
Rishabh Dave
79c9d91b9a test_cephfs_shell: test du with no args
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:45:39 +05:30
Rishabh Dave
54562691ee test_cephfs_shell: test du with multiple paths in args
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:45:34 +05:30
Rishabh Dave
08c7e2862b test_cephfs_shell: test behaviour of "du -r"
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:45:31 +05:30
Rishabh Dave
7f7aed5506 test_cephfs_shell: test du's output for softlinks
Test that CephFS shell command du prints output for softlinks as
expected

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:45:27 +05:30
Rishabh Dave
a8a159cc40 qa/cephfs: add convenience method lstat()
It's more convenient lstat(path) than stat(path, follow_symlink=False).

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:45:27 +05:30
Rishabh Dave
4a5f7a42e5 qa/cephfs: add option to make stat() unfollow symlinks
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:45:14 +05:30
Rishabh Dave
877a79d8cf test_cephfs_shell: test du's output for hardlinks
Test that CephFS shell command du prints output for directories as
expected.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:45:11 +05:30
Rishabh Dave
7062dd6164 test_cephfs_shell: test du's output for directories
Test that CephFS shell command du prints output for directories as
expected.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:45:08 +05:30
Rishabh Dave
370c97678d test_cephfs_shell: test du's output for regular files
Test that CephFS shell command du prints an output for regular files
correctly.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:45:04 +05:30
Rishabh Dave
d3f895f44a test_cephfs_shell: add a method to get command output
Let run_cephfs_shell_cmd() return the object instead of output in string
format so that stderr, return value, etc. of the command executed
remain available. And add a new method that returns only output of the
CephFS shell command executed.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:44:59 +05:30
Rishabh Dave
f0723d200c test_cephfs_shell: allow cmd as list too
Convert cmd to string if it is passed as list to
run_cephfs_shell_cmd(). Allowing cmd to be list would be nice since
elsewhere, in tests, command to be executed must be a list of arguments
rather than string of arguments separated by spaces.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:44:39 +05:30
Rishabh Dave
e6f3bf8ccd test_cephfs_shell: rename and rewrite _cephfs_shell()
Rename _cephfs_shell() to run_cephfs_shell_cmd() and add a default
client for run_cephfs_shell_cmd() since most of tests in this
testsuite will need only one client.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:44:35 +05:30
Rishabh Dave
e5f30052f9 test_cephfs_shell: copy humanize() from cephfs-shell
Copy the method named humanize from cephfs-shell so that output can be
compared. Unfortunately, importing this method isn't possible since the
dash in "cephfs-shell" leads to an syntax error.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2019-09-13 10:43:55 +05:30
Patrick Donnelly
ea026df1e3
qa: update json format from session listing
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 22:09:17 -07:00
Sage Weil
e071f4cecf qa/tasks/mon_thrash: sync force requires some force flags
AFAICS this has been the case for basically forever.  Not sure why/how
the mon_thrash task hasn't had a problem with that?

Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-12 08:44:46 -05:00
Kefu Chai
00bb401eeb
Merge pull request #30095 from rjfd/wip-fix-progress-qa
qa/mgr/progress: fix timeout error when waiting for osd in event

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-09-10 16:40:09 +08:00
Sage Weil
c3d21f119a Merge PR #30196 into master
* refs/pull/30196/head:
	qa/tasks/ceph: restart: stop osd, mark down, then start

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-09-09 11:19:32 -05:00
Sage Weil
b078dd002f qa/tasks/ceph: restart: stop osd, mark down, then start
If we stop, start, and then mark down, we may (likely) end up marking
the *new* instance down, which is noisy (generates a cluster warning
message) and inefficient.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-09-05 21:25:27 -05:00
Ricardo Dias
b03537949a
qa/mgr/progress: fix timeout error when waiting for osd in event
Fixes: https://tracker.ceph.com/issues/40618

Signed-off-by: Ricardo Dias <rdias@suse.com>
2019-09-03 11:44:05 +01:00
Kiefer Chang
aab092ba10
mgr/dashboard: Add Teuthology tests for orchestrator controllers
- `/api/host`: list hosts (with orchestrator hosts)
- `/api/orchestrator/inventory`: list inventory
- `/api/orchestrator/services`: list services

Depends on https://github.com/ceph/ceph/pull/29595

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-08-30 13:36:21 +08:00
Casey Bodley
9a0740b0d1
Merge pull request #29815 from smanjara/wip-fix-bucket-link
rgw: fix missing tenant prefix in bucket name during bucket link

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-08-28 08:10:11 -04:00
Kefu Chai
b0aec38341
Merge pull request #29090 from liewegas/wip-40792
mon/MonClient: ENXIO when sending command to down mon

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-27 17:34:13 +08:00
Kefu Chai
083c3a5d1f
Merge pull request #29595 from bk201/wip-41151
mgr/test_orchestrator: Allow initializing dummy data

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-08-25 15:13:33 +08:00
Patrick Donnelly
2db3dfdd8a
Merge PR #29760 into master
* refs/pull/29760/head:
	mgr/volumes: cleanup FS subvolume or subvolume group path
	mgr/volumes: give useful error message

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-24 21:31:58 -07:00
Patrick Donnelly
7b58274fda
Merge PR #29843 into master
* refs/pull/29843/head:
	qa/tasks: drop object inherit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-24 21:31:27 -07:00
Patrick Donnelly
f13b3483e7
Merge PR #28855 into master
* refs/pull/28855/head:
	doc: document scrub summary in ceph status output
	test: extend scrub control test to validate mds task status
	mds: send scrub state changes to cluster log.
	mds: periodically sent mds scrub status to ceph manager
	mgr, mon: allow normal ceph services to register with manager

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-23 16:16:16 -07:00
Patrick Donnelly
d30af45a54
Merge PR #29715 into master
* refs/pull/29715/head:
	qa: fix broken ceph.restart marking of OSDs down
	qa: add debugging failed osd-release setting

Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-23 10:09:17 -07:00
Patrick Donnelly
b82e87bda4
Merge PR #29821 into master
* refs/pull/29821/head:
	qa: stop DaemonWatchdog for each cluster in daemon roles

Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-08-23 10:00:52 -07:00
Jos Collin
f13f9f9fc1
qa/tasks: drop object inherit
Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-08-23 15:29:27 +05:30
Lenz Grimmer
d373178c43
mgr/dashboard: run-backend-api-tests.sh CI improvements (#29504)
mgr/dashboard: run-backend-api-tests.sh CI improvements

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-08-23 09:11:39 +00:00
Kefu Chai
ed8a0fb3c6
Merge pull request #29614 from votdev/issue_41205
mgr/dashboard: Access control database does not restore disabled users correctly

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
2019-08-23 13:20:52 +08:00
Patrick Donnelly
231f79030b
qa: stop DaemonWatchdog for each cluster in daemon roles
Fixes: https://tracker.ceph.com/issues/41398
Introduced-by: 08b99eef277b00a3ea423cbf085bd114a805813f
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-22 09:00:49 -07:00
Patrick Donnelly
73c7d14eab
qa: fix broken ceph.restart marking of OSDs down
Sage noticed `osd down` was not being performed. Bug was that the role
format had changed so splitting no longer worked correctly.

Fixes: https://tracker.ceph.com/issues/40773
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-22 08:55:52 -07:00
alfonsomthd
7563f8b6d6 mgr/dashboard: run-backend-api-tests.sh CI improvements
As there is now a jenkins job to run this script
(see https://github.com/ceph/ceph-build/pull/1351),
this refactoring adapt the script to be run in a jenkins job as well as locally.

Signed-off-by: alfonsomthd <almartin@redhat.com>
2019-08-22 15:33:02 +02:00
Shilpa Jagannath
fd86bf726f Test to link/unlink bucket in tenanted user space.
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2019-08-22 16:16:53 +05:30
Kiefer Chang
be8edd2aec
mgr/test_orchestrator: Allow initializing dummy data
- Add test_orchestrator load_data command
- Add QA tests for loading data

Fixes: https://tracker.ceph.com/issues/41151

Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-08-22 16:31:07 +08:00
Sage Weil
662dbf9c6c qa/tasks/ceph: retry several times to tell mons ot stop logging health
If we have any sort of failure injection, one attempt is not enough.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-21 15:12:48 -07:00
Ramana Raja
ecf53a3527 mgr/volumes: cleanup FS subvolume or subvolume group path
... on best effort basis when FS subvolume or subvolumegroup create
command fails.

Fixes: https://tracker.ceph.com/issues/41371
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-08-22 00:46:22 +05:30
Ramana Raja
cbe48308e9 mgr/volumes: give useful error message
... when creating FS subvolume or subvolume group with invalid
data pool layout.

Fixes: https://tracker.ceph.com/issues/41337
Signed-off-by: Ramana Raja <rraja@redhat.com>
2019-08-22 00:46:20 +05:30
Patrick Donnelly
dad94db7ae
Merge PR #28378 into master
* refs/pull/28378/head:
	qa/tasks: introduce Thrasher base class
	qa/tasks: Fix typo
	qa/tasks: manage thrashers
	qa/tasks: start DaemonWatchdog when ceph starts
	qa/tasks: make watch and bark handle more daemons
	qa/tasks: move DaemonWatchdog to new file

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-21 10:57:15 -07:00
Jos Collin
f31791e35d
qa/tasks: introduce Thrasher base class
* Introduced a Thrasher base class.
* Updated thrashers to inherit from Thrasher.
* Replaced the magic variable e with Thrasher.exception as per the discussion.
  Now the exception variable sets by default as the thrashers are inheriting
  from the Thrasher class.

Fixes: https://github.com/ceph/ceph/pull/28378#discussion_r309337928
Fixes: https://tracker.ceph.com/issues/41133
Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-08-21 10:49:46 +05:30
Jos Collin
51d851815e
qa/tasks: fixed typo in the comment
Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-08-20 15:31:07 +05:30
Casey Bodley
f0575a7144
Merge pull request #26787 from soumyakoduri/bucket_name_validation
[rgw]:Validate bucket names as per revised s3 spec

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-08-16 10:53:54 -04:00
Kefu Chai
ebdf419c63
Merge pull request #29597 from tchaikov/wip-qa/tasks/cbt
qa/tasks/cbt.py: use "git --depth 1 for" faster clone

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-16 19:17:58 +08:00
Sage Weil
403f1195b0 qa/tasks/mgr/dashboard/test_health: update schema
Also fix the 'checks' field, which is a list of objects, not strings.  (The
test doesn't notice because it's empty.)

Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-14 20:40:08 -05:00
Volker Theile
1e901e2eab mgr/dashboard: Access control database does not restore disabled users correctly
Fixes: https://tracker.ceph.com/issues/41205

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-08-14 15:02:32 +02:00
Lenz Grimmer
5f8f666c46
Merge pull request #29570 from rhcs-dashboard/new-bucket-utilities-adaptation
mgr/dashboard: adapt bucket tenant API tests to new behaviour

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-08-14 08:19:32 +00:00