Commit Graph

101994 Commits

Author SHA1 Message Date
Casey Bodley
392d746141 qa/keystone: save keystone config to archive dir
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
020511eb1f qa/tempest: update url for upper-constraints.txt in tox.ini
the tox command fails to invoke tools/tox_install.sh because it passes
a stale url for its extra requirements. patch that url in tox.ini

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
71a87afb5d qa/barbican: pin barbican to 5.0.1 release
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
29ac64304d qa/keystone: hardcode --os-identity-api-version 2.0
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
2dac5c5012 qa/keystone: add requirements.txt with python-openstackclient
works around a VersionConflict error by including the requirements on
jsonschema when installing python-openstackclient

also pin the version of python-openstackclient, because newer clients
don't seem to recognize --os-url

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
7d479d0bf8 qa/keystone: log to a file in the archive dir
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
2144fd8cc7 qa/keystone: pip install bindep
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
86930f3e0f qa/keystone: use bindep to discover keystone's dependencies
downloads the keystone repository first, because we need
keystone/bindep.txt to discover the binary dependencies

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
0cc6a832c3 qa/keystone: add missing ConfigError import
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
c9c3805cd1 qa: barbican task doesn't look for ceph release branches
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
b797418c04 qa: remove unnecessary imports in barbican task
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
53cd9b8dc6 qa/rgw: crypt suite uses clusters/fixed-1.yaml
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Casey Bodley
1c5a12fd9e qa/rgw: abstract out barbican under 2-kms/
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 15:04:43 -04:00
Adam Kupczyk
a5ec971402 tasks/barbican: Added task to deploy and configure barbican
Fixed keystone, rgw and s3tests tasks to work with it.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2019-09-13 15:04:43 -04:00
Patrick Donnelly
05d95c249d
Merge PR #30185 into master
* refs/pull/30185/head:
	mgr/volumes: drop unnecessary size

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-13 12:02:20 -07:00
Casey Bodley
b74f92ce0b
Merge pull request #29037 from zhangsw/rgw-reshard-numshards
rgw: shard number must be non-negative when resharding the bucket

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 14:04:13 -04:00
Kefu Chai
9b2537acb0
Merge pull request #29623 from majianpeng/bluestore-combine-deferred_finisher-and-finisher
os/bluestore: Merge deferred_finisher and finisher.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-09-14 00:35:44 +08:00
Kefu Chai
fef2f7faca
Merge pull request #30342 from ifed01/wip-ifed-fix-blues-alerts
mon/pgmap: fix bluestore alerts output.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-14 00:34:20 +08:00
Kefu Chai
d42c186347
Merge pull request #30372 from tchaikov/wip-crimson-single-pg-peering
crimson/osd: use single-pg peering ops

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-09-13 23:54:22 +08:00
Patrick Donnelly
65996cb314
Merge PR #24794 into master
* refs/pull/24794/head:
	mds: move BatchOp to separate translation unit
	mds: use auto ref during iteration
	mds: answering all pending getattr/lookups targeting the same inode in one go

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-13 08:37:36 -07:00
Patrick Donnelly
1874899374
Merge PR #28702 into master
* refs/pull/28702/head:
	qa: update json format from session listing
	mds: recall caps from quiescent sessions
	mds: use Session::dump method uniformly
	mds: use auto to deduce iterator type
	mds: simplify method definition
	mds: remove useless debug message
	mds: use const get_request_count
	mds: use session_info_t socket inst for addr
	mds: refactor session lookup
	mds: add explicit trim flag
	mds: alphabetize tracked config keys
	common: provide method to get half-life
	common: correct variable name

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2019-09-13 08:35:04 -07:00
Patrick Donnelly
7491296994
Merge PR #29005 into master
* refs/pull/29005/head:
	client: nfs-ganesha with cephfs client, removing dir reports not empty

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-09-13 08:33:48 -07:00
Patrick Donnelly
ff1e341f7b
Merge PR #29594 into master
* refs/pull/29594/head:
	mds: reject sessionless messages

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-13 08:32:10 -07:00
Patrick Donnelly
7de8393238
Merge PR #29752 into master
* refs/pull/29752/head:
	mds: make MDSIOContextBase delete itself when shutting down

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-13 08:30:13 -07:00
Sage Weil
ca742514b0 Merge PR #30361 into master
* refs/pull/30361/head:
	qa/tasks/mon_thrash: sync force requires some force flags

Reviewed-by: João Eduardo Luís <joao@suse.de>
2019-09-13 09:59:01 -05:00
Casey Bodley
0c3247d5b4
Merge pull request #30357 from zhangsw/rgw-cleanup-bilog-status
rgw: add missing bilog status to help info.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-09-13 10:43:14 -04:00
Alfredo Deza
61b3daf4fb
Merge pull request #29081 from wintamute/patch-1
Documentation: Add missing ceph-volume lvm batch argument to ceph-volume.rst

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2019-09-13 10:11:55 -04:00
Sage Weil
609ab5aa85 Merge PR #30352 into master
* refs/pull/30352/head:
	mon: disable min pg per osd warning

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-09-13 08:22:42 -05:00
Kefu Chai
cd9323b3c8
Merge pull request #30284 from Damenly/missing_cmath
tests: add missing header cmath to test/mon/test_mon_memory_target.cc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-13 21:06:12 +08:00
Andreas Krebs
76d3671d03 doc: Add missing ceph-volume lvm batch argument to ceph-volume.rst
The optional argument '--osds-per-device' is missing. Since this is quite helpful when creating NVMe based OSDs, it should be documented.

Signed-off-by: Andreas Krebs <wintamute@gmail.com>
2019-09-13 08:27:53 -04:00
Lenz Grimmer
487858034a
mgr/dashboard: Increase the global value of jasmine timeout (#30359)
mgr/dashboard: Increase the global value of jasmine timeout

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-09-13 12:18:09 +00:00
Kefu Chai
8e9400db9c
Merge pull request #29761 from wjwithagen/wjw-fix-venv-python-version
test/venv: do not hardwire to py2.7 for tox tests

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-13 16:59:27 +08:00
Lenz Grimmer
d6b8cd526d
mgr/dashboard: Fix calculation of PG Status percentage (#30343)
mgr/dashboard: Fix calculation of PG Status percentage

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-09-13 08:45:20 +00:00
Kefu Chai
406522d906 crimson/osd: require_osd_release >= octopus to boot
we assume that crimson will GA after octopus+2, so no need to be
compatible with pre-octopus releases.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-13 16:14:13 +08:00
Kefu Chai
260ab1a5f2 crimson/osd: use single-pg peering ops
classic OSD started to use single-pg peering ops since ce05c172, and it
switched over to these ops since octopus. and it's assumed that
crimson-osd won't be GA until octopus+2 release, so it's not needed to
support pre-octopus releases.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-13 16:14:13 +08:00
Kefu Chai
5a851c679e crimson/osd: pass octopus to PeeringCtx's constructor
to accommodate the change of 77ecc327

classic OSD started to use single-pg peering ops since ce05c172, and it
switched over to these ops since octopus. and it's assumed that
crimson-osd won't be GA until octopus+2 release, so it's not needed to
support pre-octopus releases. hence "octopus" is passed to PeeringCtx's
constructor.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-13 16:14:13 +08:00
Kefu Chai
c3afe6257c
Merge pull request #30285 from IlsooByun/slow_op_report
mgr: do not reset reported if a new metric is not collected

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-13 15:53:30 +08:00
Patrick Donnelly
ea026df1e3
qa: update json format from session listing
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 22:09:17 -07:00
Kefu Chai
b0fe187cad
Merge pull request #30112 from liewegas/wip-autoscaler-on
common: default pg_autoscale_mode=on for new pools

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-13 12:15:05 +08:00
Patrick Donnelly
740f6f99a1
mds: recall caps from quiescent sessions
This introduces two new config options [1,2] that dictate when a session
is considered quiescent by the MDS. (Options are documented fully in
options.cc.) When a session is quiescent, the MDS will preemptively
recall caps to reduce the outstanding capabilities which optimizes for
reducing work during failover.

[1] mds_session_cache_liveness_magnitude
[2] mds_session_cache_liveness_decay_rate

Fixes: https://tracker.ceph.com/issues/22446
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 17:42:03 -07:00
Patrick Donnelly
63f9448947
mds: use Session::dump method uniformly
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 17:42:03 -07:00
Patrick Donnelly
ae8ac528da
mds: use auto to deduce iterator type
This prevents accidental type mismatches.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 17:42:03 -07:00
Patrick Donnelly
42ac34736a
mds: simplify method definition
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 17:42:03 -07:00
Patrick Donnelly
8ad44444a4
mds: remove useless debug message
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 17:42:03 -07:00
Patrick Donnelly
2ddcfbdf64
mds: use const get_request_count
So it can be used from a const dump method. Make the elist mutable
instead.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 17:42:03 -07:00
Patrick Donnelly
e565e7f655
mds: use session_info_t socket inst for addr
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 17:42:03 -07:00
Patrick Donnelly
638fc901a3
mds: refactor session lookup
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 17:42:03 -07:00
Patrick Donnelly
be49866a15
mds: add explicit trim flag
So that the intent of the caller is clear to trim due to the cache being
too full.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 17:42:02 -07:00
Patrick Donnelly
0cbac2f856
mds: alphabetize tracked config keys
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 17:42:02 -07:00
Patrick Donnelly
91fed04c49
common: provide method to get half-life
Print the half-life in Formatter output as it is human understandable
and the value used when configuring the counters.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-12 17:42:02 -07:00