Commit Graph

90876 Commits

Author SHA1 Message Date
Andrew Schoen
a5e8bc97e7 ceph-volume: when using batch --report return journal/data size as ints
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-09-24 16:37:35 -05:00
David Zafman
6847d3fd6f osd: Remove old bft= which has been superceded by backfill=
Fixes: http://tracker.ceph.com/issues/36170
Caused by: 1b4f86cb0

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-09-24 14:25:18 -07:00
Sage Weil
0ae5e9a480 Merge PR #24234 into master
* refs/pull/24234/head:
	qa/suites/rados/thrash-old-clients/workloads/rbd_cls.yaml: skip parents test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:15:52 -05:00
Alfredo Deza
96e29adf72 ceph-volume tests/functional update dmcrypt test playbooks to use --cluster
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-24 15:21:09 -04:00
Jason Dillaman
3e8f16b484 qa/suites/rbd: increase librbd debug level for mirror-thrash
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:12:26 -04:00
Jason Dillaman
157a03f8fd librbd: improve debug logging for create/clone state machines
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:12:26 -04:00
Jason Dillaman
9edcd77a83 rbd-mirror: always send image RPC messages via cluster
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:11:02 -04:00
Jason Dillaman
4bafa00c98 rbd-mirror: permit better tracking between image replayer and bootstrap
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:11:02 -04:00
Jason Dillaman
f80ba2e6a4 rbd-mirror: re-generate new image id upon collision
Fixes: http://tracker.ceph.com/issues/24139
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:11:02 -04:00
Jason Dillaman
5148164af8 librbd: create image should return unique error code on id collision
The image id is composed of the librados global instance id and a random
number. For long-lived clients that create multiple images (basically
only rbd-mirror daemon), it's more likely to hit a collision.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 15:11:02 -04:00
Patrick Donnelly
70844f3f55
qa: cleanup workunit dir for each unit
This was wrongly dropped and moved to the finalizer.

Introduced-by: de824f74dd
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-24 11:29:10 -07:00
Patrick Donnelly
1eaf78a754
qa: use sudo to cleanup workspace
Files in scratch_tmp may not be owned by ubuntu.

Fixes: http://tracker.ceph.com/issues/36165
Introduced-by: de824f74dd
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-24 11:02:49 -07:00
Alfredo Deza
5f72d438da ceph-volume tests/functional/batch update tests to use 'test' cluster name
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-24 13:42:46 -04:00
Alfredo Deza
7b0d2dc669 ceph-volume tests/functional/lvm update tests to use 'test' cluster name
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-24 13:42:46 -04:00
Alfredo Deza
ba10b6820f ceph-volume tests/functional update playbooks to use --cluster
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-24 13:42:46 -04:00
Joao Eduardo Luis
b38b8e980c mon/config-key: increase max key entry size
Turns out the dashboard requires more than 4K bytes on occasion. Instead
of forcing them to split entries, we can afford them a bit more of extra
size. We could go higher, but they tell us they don't need it.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-09-24 17:43:32 +01:00
Alfredo Deza
532908099e ceph-volume main move out the load_ceph_conf_path to the configuration module
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-24 12:29:36 -04:00
Sage Weil
fcb1679eab osd/PG: fix not_ready_to_merge behavior for merge target
Track the *target* not being ready to merge independently from the source,
so that we do not have two PGs fighting over the state of
not_ready_ready_to_merge_source, and so that the map reflects the *source*
PGs readiness only.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-24 11:03:03 -05:00
Sage Weil
9054ed81da Merge PR #24225 into master
* refs/pull/24225/head:
	osd/ECBackend: suppress 'Error -2 reading object' if EC fast reads

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-09-24 11:01:22 -05:00
Sage Weil
757a94b980 qa/suites/rados/thrash-old-clients/workloads/rbd_cls.yaml: skip parents test
We can't (easily) build updated hammer packages, but all this sh script does
it run this one test binary with --gtest_filter arguments, so just do
it directly and skip the test explicitly here.  (Newer version of the .sh
understand the environemnt variable but the hammer version does not.)

Fixes: http://tracker.ceph.com/issues/36104
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-24 10:57:40 -05:00
Alfredo Deza
fe80e5399e ceph-volume tests.devices patch configuration.load to avoid raising non-existing ceph.conf
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-24 10:37:52 -04:00
Alfredo Deza
877ee1a27e ceph-volume tests reset the cluster name after every unit test
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-24 10:37:51 -04:00
Alfredo Deza
e61848dc97 ceph-volume tests.functional add custom cluster name to centos7-filestore-create
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-24 10:37:51 -04:00
Alfredo Deza
a88cbfc73a ceph-volume lvm.activate load the config always by reading the cluster name from the LV
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-24 10:37:51 -04:00
Alfredo Deza
4f8226f359 ceph-volume configuration be able to set conf.ceph
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-09-24 10:37:51 -04:00
Jason Dillaman
24beceef64 doc: ceph-iscsi-api ports should not be public facing
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 10:32:25 -04:00
Jason Dillaman
4b782613f7
Merge pull request #24078 from Songweibin/wip-rbd-trash-state
rbd: not allowed to restore an image when it is being deleted

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 10:19:13 -04:00
Jason Dillaman
762a7ae386
Merge pull request #23743 from trociny/wip-rbd-config-pool
librbd: pool and image level config overrides

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-09-24 10:19:01 -04:00
Lenz Grimmer
4d3f896c89
Merge pull request #23568 from rhcs-dashboard/wip-24573-landing-page
mgr/dashboard: New Landing Page

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kanika Murarka <kmurarka@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-09-24 15:32:48 +02:00
Nathan Cutler
f34677a6e6 tools: backport-create-issue: rate-limit to avoid seeming like a spammer
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-09-24 14:58:13 +02:00
John Spray
194c17c04a
Merge pull request #23570 from jcsp/wip-rook-api
mgr/rook: update for v1beta1 API

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2018-09-24 12:12:10 +01:00
Nick Erdmann
99ce3aaf0b rgw: fix max-size-kb REST quota parameter and add max-size
Signed-off-by: Nick Erdmann <n@nirf.de>
2018-09-24 12:48:57 +02:00
Nick Erdmann
0ef92541d3 rgw/radosgw-admin: allow negative values for --max-size
Fix regression in e664488e.

Signed-off-by: Nick Erdmann <n@nirf.de>
2018-09-24 12:38:30 +02:00
myoungwon oh
5ebda43522 githubmap: update contributors
Signed-off-by: Myoungwon Oh <omwmw@sk.com>
2018-09-24 12:14:20 +09:00
Sage Weil
a9816f31dd Merge PR #24133 into master
* refs/pull/24133/head:
	common/Finisher: convert to ceph::mutex etc
	common/ceph_mutex: ceph::{mutex,condition_variable,lock_guard}
	common/mutex_debug: take const char * to ctor, and require a name
	common/mutex_debug: add lockdep support for recursive_mutex_debug
	common/mutex_debug: fix whitespace
	common/mutex_debug: refactor to remove intermediate class
	common/lockdep: add recursive flag for _will_lock
	do_cmake.sh: default to Debug build
	.gitignore: ignore build.*/

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-09-23 11:17:03 -05:00
Yanhu Cao
bd6ae6f4e2 mds/MDCache: fix mds internal op missing events time
Fixes: http://tracker.ceph.com/issues/36114

Signed-off-by: Yanhu Cao <gmayyyha@gmail.com>
2018-09-23 21:36:39 +08:00
Sage Weil
9ef5a956cb osd/ECBackend: suppress 'Error -2 reading object' if EC fast reads
When fast reads are enabled, it's possible for the ordering of a shard
read to not be enforced with respect to writes that come after because
the read completes on the primary before all shards reply.  This can lead
to an ENOENT on the non-primary, and an ERR message in the cluster log,
even though everything is fine.  (The reply will go back to the primary
with the error but it will be ignored since the read has completed.)

Suppress the error message so we don't see these ERR messages in the
cluster log during the normal course of events.

Fixes: http://tracker.ceph.com/issues/26972
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-22 10:42:20 -05:00
Sage Weil
f90edeb110 Merge PR #24202 into master
* refs/pull/24202/head:
	mon/MonClient: fix wait for monmap+config is non-cephx case

Reviewed-by: Mark Nelson <mnelson@redhat.com>
2018-09-22 10:28:39 -05:00
Sage Weil
47acd45476 Merge PR #24217 into master
* refs/pull/24217/head:
	osd/PG.cc: silence "-Wsign-compare" warnings

Reviewed-by: Erwan Velu <erwan@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-09-22 10:27:41 -05:00
Sage Weil
1ca7535a51 Merge PR #24220 into master
* refs/pull/24220/head:
	test/objectstore: set pool for fsck test

Reviewed-by: Jianpeng Ma <jianpeng.ma@intel.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-09-22 10:26:53 -05:00
Patrick Donnelly
9e9f3ead36
Merge PR #24157 into master
* refs/pull/24157/head:
	qa: cleanup parallel execution of fsstress

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-09-21 13:01:14 -07:00
Patrick Donnelly
1b7cabc732
githubmap: update contributors
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-21 13:01:13 -07:00
Patrick Donnelly
a5c572b13a
Merge PR #24207 into master
* refs/pull/24207/head:
	script/ptl-tool.py: fix BASE_PATH

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-21 11:55:42 -07:00
Patrick Donnelly
de824f74dd
qa: cleanup parallel execution of fsstress
Two instances of fsstress clobber each other. Just build it in the local sandbox.

Fixes: http://tracker.ceph.com/issues/24177

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-09-21 11:34:20 -07:00
Sage Weil
8535965ba4 common/Finisher: convert to ceph::mutex etc
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-21 11:55:58 -05:00
Sage Weil
c3f70dc4a8 common/ceph_mutex: ceph::{mutex,condition_variable,lock_guard}
If CEPH_DEBUG_MUTEX is defined, use the [recursive_]mutex_debug classes
that implement lockdep and a bucnh of other random debug checks.  Also
typedef ceph::condition_variable to std::condition_variable_debug, which
adds addition assertions and debug checks.

If CEPH_DEBUG_MUTEX is not defined, then use the bare-bones C++ std::mutex
primitives... or as close as we can get to them.

Since the [recursive_]mutex_debug classes take a string argument for the
lockdep piece, define factory functions ceph::make_[recursive_]mutex that
either pass arguments to the debug implementations or toss them out.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-21 11:55:56 -05:00
Sage Weil
77acda7219 common/mutex_debug: take const char * to ctor, and require a name
Require a name, like Mutex.

Most callers are passing a C string.  This may avoid a std::string
copy?

Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-21 11:52:56 -05:00
Sage Weil
27c6d283e9 common/mutex_debug: add lockdep support for recursive_mutex_debug
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-21 11:52:08 -05:00
Sage Weil
5900c60623 common/mutex_debug: fix whitespace
Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-21 11:51:09 -05:00
Sage Weil
3ae9e7ad06 common/mutex_debug: refactor to remove intermediate class
I don't see any purpose for this, and it prevents us from knowing whether
the mutex is recursive when _will_lock() is called.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-09-21 11:51:09 -05:00