Commit Graph

96648 Commits

Author SHA1 Message Date
Nathan Cutler
0e63fed768
Merge pull request #27159 from smithfarm/wip-38934
doc: move Developer Guide to its own subdirectory

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-03-27 12:17:37 +01:00
Lenz Grimmer
6daddcb159
Merge pull request #26561 from Devp00l/issue-38418
mgr/dashboard: Make preventDefault work with 400 errors

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-03-27 11:57:34 +01:00
Kefu Chai
cdba92a1e3
Merge pull request #27190 from tchaikov/wip-ceph.in-asan-only-for-debug
ceph.in: only preload asan library for Debug build

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-03-27 14:04:10 +08:00
Kefu Chai
f9e0168e56
Merge pull request #26813 from DengkeDu/master
cmake/FindRocksDB: fix IMPORTED_LOCATION for ROCKSDB_LIBRARIES

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-03-27 14:03:21 +08:00
Kefu Chai
496ffbab22
Merge pull request #27204 from xiexingguo/wip-clean-weird-brace
osd/PG: move '}' to the proper place

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2019-03-27 12:57:16 +08:00
dudengke
7b6e05a030 cmake/FindRocksDB: fix IMPORTED_LOCATION for ROCKSDB_LIBRARIES
Signed-off-by: dudengke <pinganddu90@gmail.com>
2019-03-27 10:18:26 +08:00
Kefu Chai
62a4019b2e ceph.in: only preload asan library if it is enabled
my ceph cli hung when i build ceph using `CMAKE_BUILD_TYPE=RelWithDebInfo` and
`WITH_SEASTAR=ON`. because in that case, seastar detects for Sanitize flags
support of the compiler, but it does not pull in the build flags to enable
sanitizers. while `ceph` cli still preloaded the `asan_lib_path` because
`ASAN_LIBRARY` was set. this is not right, as we should enable ASAN at
runtime only if we enable it at compile-time.

so, in this change, we preload the ASAN library when `CMAKE_BUILD_TYPE`
is `Debug` and `WITH_SEASTAR=ON`, or `WITH_ASAN=ON`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-27 09:55:43 +08:00
Kefu Chai
44cb44425c ceph.in: normalize BOOL values found by get_cmake_variables()
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-27 09:55:43 +08:00
xie xingguo
0fb951963f osd/PG: move '}' to the proper place
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-03-27 09:28:56 +08:00
David Zafman
33357740f5
Merge pull request #26942 from dzafman/wip-38616
Feature: Improvements to auto repair

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-03-26 16:48:09 -07:00
Sage Weil
0247d565d5 Merge PR #27162 into master
* refs/pull/27162/head:
	os/bluestore: nice used space report for bluefs-bdev-sizes command.
	tools/ceph-kvstore-tool: command to show RocksDB compaction stats.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-26 15:06:30 -05:00
Casey Bodley
bf414c3f74
Merge pull request #26852 from theanalyst/wip-stale-instance-multisite
rgw admin: disable stale instance delete in a multiste env

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-03-26 13:33:40 -04:00
Igor Fedotov
b088e4d1b3 os/bluestore: nice used space report for bluefs-bdev-sizes command.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-03-26 20:07:41 +03:00
Igor Fedotov
2ab28aa329 tools/ceph-kvstore-tool: command to show RocksDB compaction stats.
In fact this command will provide zeros for most of compaction stuff as
completed compactions are required to provide most of numbers.
But one can use it to learn per-level DB statistics: (amount of files,
occupied space, etc).

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-03-26 20:07:39 +03:00
Sage Weil
bc5cf86294 Merge PR #26936 into master
* refs/pull/26936/head:
	msg: default to debug_ms=0

Reviewed-by: Mark Nelson <mnelson@redhat.com>
2019-03-26 11:43:19 -05:00
Sage Weil
cbe78646d2 Merge PR #27069 into master
* refs/pull/27069/head:
	mgr: Configure Py root logger for Mgr modules

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-03-26 11:37:48 -05:00
Sage Weil
71c8eb1b9e Merge PR #27084 into master
* refs/pull/27084/head:
	osd: process_copy_chunk remove obc ref before pg unlock

Reviewed-by: Myoungwon Oh <omwmw@sk.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-03-26 11:36:16 -05:00
Sage Weil
c51a3f0c92 Merge PR #27142 into master
* refs/pull/27142/head:
	osd/OSDMap: add log for better debugging
	osd/OSDMap: calc_pg_upmaps - restrict optimization to origin pools only

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-26 11:35:59 -05:00
Sage Weil
1dad9d2fe1 Merge PR #27155 into master
* refs/pull/27155/head:
	mon/ConfigMonitor: make 'config reset' idempotent

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-26 11:35:45 -05:00
Sage Weil
39c84fa52c Merge PR #27172 into master
* refs/pull/27172/head:
	mgr/devicehealth: Fix python 3 incompatiblity

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-03-26 11:07:17 -05:00
Kefu Chai
7d633bae7d ceph.in: use get_cmake_variables(*args)
and return values in a list for better readability and less repeating

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-26 23:47:16 +08:00
Kefu Chai
4f7a5a0651
Merge pull request #27183 from tchaikov/wip-ceph.spec.in-devtoolset-8
rpm: s/devtoolset-7/devtoolset-8/

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2019-03-26 23:41:58 +08:00
Kefu Chai
78396d83b5
Merge pull request #27177 from tchaikov/wip-crimson-stop-before-exit
crimson/osd: call at_exit() before stopping the engine

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-03-26 23:39:29 +08:00
Ilya Dryomov
0ba913ba2c
Merge pull request #27192 from idryomov/wip-krbd-discard-fixups
qa/workunits/rbd: fixups for the new krbd discard behavior

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-03-26 14:09:41 +01:00
Lenz Grimmer
7c1f1efeb5
Merge pull request #26925 from votdev/issue_38265
mgr/dashboard/qa: Improve tasks.mgr.test_dashboard.TestDashboard.test_standby

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-03-26 13:44:19 +01:00
Lenz Grimmer
fe11e7f7f2
Merge pull request #26396 from familyuu/interval
mgr/dashboard: Add refresh  interval to the dashboard landing page

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Kanika Murarka <kmurarka@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-03-26 13:41:35 +01:00
Jason Dillaman
b18acbaabe
Merge pull request #27136 from trociny/wip-38895
librbd: trash move return EBUSY instead of EINVAL for migrating image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-03-26 08:21:37 -04:00
Jason Dillaman
6e32108204
Merge pull request #27137 from trociny/wip-qa-rbd-qos
qa: add RBD QOS functional test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-03-26 08:21:18 -04:00
Jason Dillaman
cd4e793e23
Merge pull request #27151 from trociny/wip-38928
librbd: look for pool metadata in default namespace

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-03-26 08:20:43 -04:00
Sebastian Wagner
933db5639f
Merge pull request #27118 from sebastian-philipp/mypy-gitignore
scrips/run_mypy: add .gitignore

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2019-03-26 11:05:36 +01:00
Sebastian Wagner
f88710f14d scrips/run_mypy: add .gitignore
Co-Authored-by: Patrick Nawracay <pnawracay@suse.com>
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-03-26 09:58:42 +01:00
Kefu Chai
ec018e9244
Merge pull request #27181 from tchaikov/wip-test/test_weighted_shuffle
test/test_weighted_shuffle: enlarge epsilon

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-03-26 16:37:58 +08:00
Kefu Chai
9694a72dae rpm: s/devtoolset-7/devtoolset-8/
should activate devtoolset-8 not devtoolset-7 for enabling GCC-8.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-26 15:20:00 +08:00
Kefu Chai
37b832ca96 test/test_weighted_shuffle: enlarge epsilon
be more permissive to address the following failure:

test_weighted_shuffle.cc:36: Failure
The difference between float(w) / total_weight and float(f.front()) /
samples is 0.010334432125091553, which exceeds epsilon, where
float(w) / total_weight evaluates to 0.53763443231582642,
float(f.front()) / samples evaluates to 0.52730000019073486, and
epsilon evaluates to 0.0099999997764825821

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-26 13:30:55 +08:00
Kefu Chai
d22a1b0e00 crimson/osd: call at_exit() before stopping the engine
if we mkfs and stop the engine, any calls using the engine should/will
fail after `seastar::engine().exit(0)`. in the case of reactor::at_exit(),
it has:

assert(!_stopping);

in this change, we register the at_exit() calls before scheduling the
`engine().exit(0)` call.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-26 11:59:02 +08:00
Kefu Chai
049ce9f40b
Merge pull request #27149 from wjwithagen/wjw-fix-stdFileSystem
cmake: use StdFilesystem::filesystem instead of stdc++fs

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-03-26 11:05:29 +08:00
Kefu Chai
128ce1199f
Merge pull request #27134 from tchaikov/wip-devtools-8
install-dep,rpm: use devtools-8 on amd64

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2019-03-26 09:45:55 +08:00
Kefu Chai
fa14f80e10
Merge pull request #26697 from tchaikov/wip-crimson-pg-fsm
crimon/osd: serve read requests

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-03-26 09:36:12 +08:00
Kefu Chai
40a295814f crimson/osd/pg: specify file variable values for editors
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-26 09:34:04 +08:00
Kefu Chai
4619a9cc49 crimson/osd: add pg backends
* add exceptions.h for EIO, ENOENT error handling
* add PGBackend for serving i/o requests

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-26 09:34:04 +08:00
David Zafman
769cdc8294 doc: Document new pg state and changes to auto repair behavior
Fixes: http://tracker.ceph.com/issues/38616

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-03-25 16:03:36 -07:00
David Zafman
57abdb11fa osd, test: Add num_shards_repaired to osd_stat_t for pushes with repair set 3(3)
Fixes: http://tracker.ceph.com/issues/38616

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-03-25 16:03:36 -07:00
David Zafman
d2ca3d2feb osd: Track num_objects_repaired in pg stats 2(3)
Leave repair pg state on until recovery finishes or a new scrub starts

Fixes: http://tracker.ceph.com/issues/38616

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-03-25 16:03:36 -07:00
Marius Schiffer
4817a621fc mgr/devicehealth: Fix python 3 incompatiblity
Fixes: http://tracker.ceph.com/issues/38939
Signed-off-by: Marius Schiffer <marius@mschiffer.de>
2019-03-25 23:18:01 +01:00
Ilya Dryomov
f3f757aaa3 qa/workunits/rbd: fixups for the new krbd discard behavior
With discard_granularity set to alloc_size, we no longer get object
size alignment from blk_bio_discard_split().

This assumption is pretty deeply ingrained in krbd_data_pool.sh, so
make it explicit.  For krbd_fallocate.sh, just fix the expectation.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-03-25 22:06:14 +01:00
Ilya Dryomov
673673f53d qa: krbd_fallocate.sh: zero can be munged to truncate
The test case is issuing discards that span two objects: the tail of
the first object is truncated, the head of the second object is zeroed.
These discards aren't serial, so there is a race:

  discard i ~ i + 1: truncate i, zero i + 1
  discard i + 1 ~ i + 2: truncate i + 1, zero i + 2

can be executed as

  truncate i + 1, zero i + 2, truncate i, zero i + 1

For object i + 1, the sequence ends up being truncate tail, then zero
head.  This zero op is munged to truncate on the OSD, resulting in size
0 instead of OBJECT_SIZE / 2.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-03-25 22:06:14 +01:00
Sage Weil
c402e51f6c Merge PR #27124 into master
* refs/pull/27124/head:
	osd/pg: use emplace() to construct new element in-place

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-03-25 13:15:16 -05:00
Sage Weil
eeb97a98a4 Merge PR #27079 into master
* refs/pull/27079/head:
	mgr/pg_autoscaler: Fix python3 incompatibility

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-03-25 13:14:41 -05:00
Sage Weil
7003c89bbb Merge PR #27113 into master
* refs/pull/27113/head:
	mgr/diskprediction_cloud: Correct base64 encode translate table

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-25 13:14:11 -05:00
Sage Weil
5118df1da1 Merge PR #27156 into master
* refs/pull/27156/head:
	common/blkdev: get_device_id: behave if model is lvm and id_model_enc isn't there

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-03-25 13:08:56 -05:00