Commit Graph

639 Commits

Author SHA1 Message Date
Sage Weil
577737d007 osd: osd_mon_report_interval_min -> osd_mon_report_interval, kill _max
The _max isn't used.  Drop the _min suffix.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-06 11:00:14 -05:00
Patrick Donnelly
ebd0fcd067
Merge PR #16779 into master
* refs/pull/16779/head:
	mds: cleanup MDCache::open_snaprealms()
	mds: make sure snaptable version > 0
	mds: don't consider CEPH_INO_LOST_AND_FOUND as base inode
	mds: replace MAX() with std::max()
	tools/cephfs: make cephfs-data-scan create snaprealm for base inodes
	qa/cephfs: don't run TestSnapshots.test_kill_mdstable on kclient
	qa/cephfs: adjust check of 'cephfs-table-tool all show snap' output
	mds: don't warn unconnected snaplrealms in cluster log
	mds: update CInode/CDentry's first according to global snapshot seq
	qa/cephfs: add tests for snapclient cache
	qa/cephfs: add tests for snaptable transaction
	mds: add asok command that dumps cached snap infos
	qa/cephfs: add tests for multimds snapshot
	client: don't mark snap directory complete when its dirstat is empty
	qa/workunits/snaps: add snaprealm split test
	mds: make sure mds has uptodate mdsmap before checking 'allows_snaps'
	client: fix incorrect snaprealm when adding caps
	qa/workunits/snaps: add hardlink snapshot test
	mds: add incompat feature and bump protocol for snapshot changes
	mds: detach inode with single hardlink from global snaprealm
	mds: record hardlink snaps in inode's snaprealm
	mds: attach inode with multiple hardlinks to dummy global snaprealm
	mds: cleanup rename code
	mds: ensure xlocker has uptodate lock state
	mds: simplify SnapRealm::build_snap_{set,trace}
	mds: record global last_created/last_destroyed in snaptable
	mds: pop projected snaprealm before inode's parent changes
	mds: keep isnap lock in sync state
	mds: handle mksnap vs resolve_snapname race
	mds: cleanup snaprealm past parents open check
	mds: rollback snaprealms when rolling back slave request
	mds: send updated snaprealms along with slave requests
	mds: explict notification for snap update
	mds: send snap related messages centrally during mds recovery
	mds: synchronize snaptable caches when mds recovers
	mds: introduce MDCache::maybe_finish_slave_resolve()
	mds: notify all mds about prepared snaptable update
	mds: record snaps in old snaprealm when moving inode into new snaprealm
	mds: cache snaptable in snapclient
	mds: recover snaptable client when mds enters resolve state

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-03 15:41:19 -07:00
Patrick Donnelly
0186795496
Merge PR #21180 into master
* refs/pull/21180/head:
	vstart_runner: examine check_status before error

Reviewed-by: John Spray <john.spray@redhat.com>
2018-04-03 06:51:18 -07:00
Jason Dillaman
3b08c0609c Merge pull request #20460 from colletj/v1_image_creation_disallow
librbd: disallow creation of v1 image format

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-04-03 09:18:39 -04:00
Patrick Donnelly
9a558c51dc
vstart_runner: examine check_status before error
Issue found by Rishabh Dave. Fix suggested by John Spray.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-02 08:08:43 -07:00
Patrick Donnelly
b7fce64601
Merge PR #20132 into master
* refs/pull/20132/head:
	qa/cephfs: update TestDamage for open file table
	mds: allow storing open file table in multiple omaps
	mds: differentiate Anchor types to clarify purpose
	mds: add perf counter for 'open ino' operation
	mds: protect open file table against partial omap update
	mds: add dirfrags whose child inodes have caps to open file table
	mds: don't try prefetching destroyed inodes
	mds: don't try opening inodes that haven't been created
	mds: don't re-requeue open files to head of log
	mds: use open file table to speed up mds recovery
	mds: introduce open file table
	mds: track how many clients/mds want caps for each inode
	mds: cleanup MDCache::opening_inodes access
	mds: cleanup CInode/CDir states definition

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-03-30 22:25:10 -07:00
Mykola Golub
af15b2cef4 qa/tasks/qemu: add a parameter to wait for workloads detect qemu finished
In the case when a workload needs to detect qemu finished by running a
check with a periodicity of N sec it needs to set time_wait to 2 * N
in order to avoid races on finish.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-03-29 17:43:31 +03:00
Ricardo Dias
5a861f5fb1
Merge pull request #20870 from rjfd/wip-dashboard-tasks
mgr/dashboard: asynchronous task support

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-03-28 08:27:51 +01:00
zouaiguo
4840e899f1 [mgr/dashboard] add image id to rbd info instead of block_name_prefix
when create images use data_pool parameter, such as:
rbd create -p pool1 -s 1G --data-pool pool2  image1

then get image info from mgr use request http://192.7.7.36:7000/rbd_pool_data/pool1
we got the response:
[{"parent_name": "", "parent_pool": 18446744073709551615, "name": "image1", "num_objs": 256, "block_name_prefix": "rbd_data.14.f561643c986", "obj_size": 4194304, "features": 189, "features_name": "fast-diff, layering, exclusive-lock, deep-flatten, object-map, data-pool", "order": 22, "size": 1073741824}]

notice:
since block_name_prefix is deprecated,
from block_name_prefix we can not get image id(the real id is ''f561643c9869')
we need add image id to rbd info instead block_name_prefix

Python 2.7.5 (default, Jun 17 2014, 18:11:42)
[GCC 4.8.2 20140120 (Red Hat 4.8.2-16)] on linux2
Type "help", "copyright", "credits" or "license" for more information.
>>> import rados
>>> import rbd
>>> RADOS_NAME = 'client.admin'
>>> cluster_name="ceph"
>>> cluster_handle = rados.Rados(name=RADOS_NAME, clustername=cluster_name, conffile='')
>>> cluster_handle.connect()
>>> ioctx = cluster_handle.open_ioctx("pool1")
>>> image_inst = rbd.Image(ioctx, "image1")
>>> image_inst.stat()
{'parent_name': '', 'parent_pool': 18446744073709551615L, 'num_objs': 256L, 'block_name_prefix': u'rbd_data.14.f561643c986', 'obj_size': 4194304L, 'order': 22, 'size': 1073741824L}
>>> image_inst.id()
u'f561643c9869'

after fix:

[root@tfg36 site-packages]# curl http://192.7.7.36:7000/rbd_pool_data/pool1
[{"parent_name": "", "parent_pool": 18446744073709551615, "name": "image1", "num_objs": 256, "block_name_prefix": "rbd_data.14.f561643c986", "obj_size": 4194304, "features": 189, "id": "f561643c9869", "features_name": "fast-diff, layering, exclusive-lock, deep-flatten, object-map, data-pool", "order": 22, "size": 1073741824}]

Signed-off-by: zouaiguo <zou.aiguo@zte.com.cn>
2018-03-28 10:14:42 +08:00
Ricardo Dias
067b86eb42
mgr/dashboard: added tasks info to summary controller
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-27 14:08:47 +01:00
Lenz Grimmer
d5e54fda5c
Merge pull request #21024 from s0nea/wip-dashboard-return-features-list
mgr/dashboard: Convert the RBD feature names to a list of strings

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-03-27 11:45:54 +02:00
Lenz Grimmer
914faf2c1e
Merge pull request #21004 from s0nea/wip-dashboard-skip-datapool-testcase
mgr/dashboard: skip data pool testcase for none-bluestore clusters

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-03-27 11:43:18 +02:00
Lenz Grimmer
43e5097c2f
Merge pull request #20873 from sebastian-philipp/dashboard_v2-simple-html-debug
mgr/dashboard: Add minimalistic browsable API

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-03-27 11:31:07 +02:00
Casey Bodley
6b59fbfcc6
Merge pull request #21027 from cbodley/wip-qa-swift-force-branch
qa/tasks/swift: add support for the "force-branch" configurable.

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2018-03-26 14:27:46 -04:00
Sebastian Wagner
7a7a17caa9 mgr/dashboard: New API tests for perf_couters
Added OSD and MDS tests.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-26 17:16:41 +02:00
Ricardo Dias
a392e612cc
Merge pull request #21007 from rjfd/wip-dashboard-fix-py3
mgr/dashboard: fix dashboard python 3 support

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-26 10:59:17 +01:00
Tatjana Dehler
33e15ecd39 mgr/dashboard: convert RBD features to a list of strings
Until now the API returns the features provided by an RBD as one comma
separated string. It's more usable for the frontend to receive a list
of strings instead.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-03-26 09:41:56 +02:00
Radoslaw Zarzynski
c5859f25e6 qa/tasks/swift: add support for the "force-branch" configurable.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-03-23 12:40:05 -04:00
Sebastian Wagner
cbee371958 mgr/dashboard: Add Teuthology test for /api/pool/_info
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-23 16:40:18 +01:00
Sebastian Wagner
dd18675e4f mgr/dashboard: Minor tweak to DashboardTestCase._request
Don't fall through silently.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-23 16:40:18 +01:00
Sebastian Wagner
e6c1056ad5 mgr/dashboard: Add create() to Pool controller
Also:

* Added tests.
* Renamed `DashboardTest` to `PoolTest`.
* Added `delete()`.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-23 16:40:18 +01:00
Yuri Weinstein
6a5bab7dd4
Merge pull request #20981 from cbodley/wip-qa-fix-ssl
qa: fix overrides for openssl_keys task

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2018-03-23 06:55:10 -07:00
Ricardo Dias
d101b33bc7 qa/tasks/mgr/dashboard: Fix login expires too soon
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-23 11:30:16 +01:00
Tatjana Dehler
075102468b mgr/dashboard: skip 'test_create_rbd_in_data_pool' without bluestore
Skip the test case 'test_create_rbd_in_data_pool' only if the cluster
does not support bluestore, otherwise run the test. The Ceph mgr
provides the information if the cluster supports bluestore or not, so
the test will be skipped depending on the current cluster.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-03-23 11:11:27 +01:00
Tatjana Dehler
25a0ed93ec mgr/dashboard: add 'osd metadata' command call
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-03-23 11:11:17 +01:00
Ricardo Dias
25c75a952d
mgr/dashboard: fix dashboard python 3 support
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-22 15:56:20 +00:00
Casey Bodley
cfe4ba6342 qa: fix overrides for openssl_keys task
teuthology looks for overrides by the class name, so overrides weren't
working after the task was renamed

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-03-22 10:31:08 -04:00
Yan, Zheng
ffebd0854e qa/cephfs: update TestDamage for open file table
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2018-03-21 21:08:58 +08:00
Sage Weil
038afcbc2a Merge remote-tracking branch 'gh/mimic-dev2' 2018-03-18 18:39:46 -05:00
Yan, Zheng
84d7414249 qa/cephfs: don't run TestSnapshots.test_kill_mdstable on kclient
this test forcibly kills mount. Killing kernel mount requires reboot,

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-03-18 22:24:42 +08:00
Yan, Zheng
338c3cf4c3 qa/cephfs: adjust check of 'cephfs-table-tool all show snap' output
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-03-18 18:19:08 +08:00
Casey Bodley
1f50f19cc1
Merge pull request #20863 from rjfd/wip-qa-fix-ssl-conflict
qa/rgw: renamed ssl task to openssl_keys

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-03-16 09:04:10 -04:00
Ricardo Dias
aa205a6731
mgr/dashboard: renamed dashboard_v2 to dashboard
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-16 07:23:08 +00:00
Ricardo Dias
ed291d9e4d
mgr/dashboard: remove dashboard module
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-16 07:23:04 +00:00
Julien COLLET
386b752e62 librbd/qa: Permit V1 images in qa tests
Signed-off-by: Julien COLLET <julien.collet@cern.ch>
2018-03-15 15:09:06 +01:00
Tiago Melo
a2033e0845 mgr/dashboard_v2: fix test_perf_counters_mgr_get
Now that we can obtain perf counters for the mgr, we need to assert that we get
more than 0 counters and that they have the desired structure.

Fixes: https://tracker.ceph.com/issues/23378

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-03-15 12:50:58 +00:00
Josh Durgin
360bc69bcf
Merge pull request #20901 from neha-ojha/wip-fix-mgr
qa/tasks/ceph_manager: use set_config on revived osd

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-03-14 15:27:39 -07:00
Neha Ojha
e3899dc901 qa/tasks/ceph_manager: use set_config on revived osd
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-14 12:37:56 -07:00
Lenz Grimmer
78022e13e7
Merge pull request #20751 from s0nea/wip-mgr-dashboard_rbd_add
mgr/dashboard_v2: Add RBD create functionality to the Python backend

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-03-14 15:57:32 +01:00
Tatjana Dehler
5056cbacbf mgr/dashboard: Add RBD create functionality
This commit adds a basic RBD create functionality to the REST API. It enables
the POST request of the http://<host>:<port>/api/rbd API endpoint.

The commit adds also related tests.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-03-14 10:38:43 +01:00
Casey Bodley
2aec7e1f1d qa/rgw: disable s3tests for lifecycle_expiration
the tests are dependent on timing and often fail in teuthology

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-03-13 16:16:06 -04:00
Tiago Melo
e8a1e267af mgr/dashboard_v2: add mgr to the list of perf counters
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-03-13 15:21:43 +00:00
Ricardo Dias
98e4b331aa
qa/rgw: renamed ssl task to openssl_keys
The ssl task located in a python file called `ssl.py` will generate
python module loading conflicts with the `ssl` system module, when
running QA tests using vstart_runner.py.

Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-13 14:41:25 +00:00
Kefu Chai
41ec438413
Merge pull request #20831 from zhsj/fix-spelling
misc: fix various spelling errors

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: iliul <liul.stone@gmail.com>
2018-03-13 08:29:29 +08:00
Casey Bodley
04a73694d6
Merge pull request #20444 from cbodley/wip-qa-ssl
qa/rgw: verify suite tests civetweb with ssl

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-03-12 10:32:55 -04:00
Ricardo Dias
3efc1a834e
mgr/dashboard: Pool controller implementation and tests
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-03-12 11:43:48 +00:00
Shengjing Zhu
2cbba835aa misc: fix various spelling errors
Signed-off-by: Shengjing Zhu <i@zhsj.me>
2018-03-10 23:39:20 +08:00
Casey Bodley
2aca3bd8c6 qa/rgw: loop over clients instead of config keys
we only run radosgw instances on clients that are specified directly in
the rgw task - this list omits entries that are brought in via overrides

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-03-09 16:31:33 -05:00
Casey Bodley
9641b97a32 qa/rgw: s3test task overrides REQUESTS_CA_BUNDLE to use system certs
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-03-09 16:31:33 -05:00
Casey Bodley
aee4924e32 qa/rgw: s3test task conditionally sets is_secure
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-03-09 16:31:33 -05:00