Commit Graph

104870 Commits

Author SHA1 Message Date
Kefu Chai
21dbb99d57
Merge pull request #31962 from bk201/wip-43095
vstart: fix error when getting CMake variables with the same prefix

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-03 15:12:02 +08:00
Kiefer Chang
f4c8cc1293
vstart: fix error when getting CMake variables with the same prefix
The function fails to work when there are multiple variables starts with
the same prefix. e.g.

- WITH_RBD
- WITH_RBD_RGW

Fixes: https://tracker.ceph.com/issues/43095
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2019-12-03 14:15:33 +08:00
Kefu Chai
080d5506ad
Merge pull request #31947 from zdover23/wip-doc-ubuntu-1804-python-minimal
doc: add Python 2 to Ubuntu 18.04 installations

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-03 12:07:42 +08:00
Kefu Chai
aa9e60037c
Merge pull request #31958 from tchaikov/wip-cmake-new-policy
cmake: do not use CMP0074 unless it is supported

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-12-03 10:48:39 +08:00
Kefu Chai
dd0cdb3eb6 cmake: do not use CMP0074 unless it is supported
CMake CMP0074 was introduced by CMake 3.12, but we only require CMake
v3.10.2. so default to check `Boost_ROOT` unless specified otherwise.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-03 09:51:17 +08:00
Sage Weil
2c1235ba69 Merge PR #31913 into master
* refs/pull/31913/head:
	ceph-daemon: Allow env var for setting the used image

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-02 16:26:33 -06:00
Ilya Dryomov
8517268008
Merge pull request #31919 from idryomov/wip-krbd-udev-improvements
krbd: do away with explicit memory management and other cleanups

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-12-02 21:27:31 +01:00
Sage Weil
bfe1370698 Merge PR #31933 into master
* refs/pull/31933/head:
	mgr/ssh: `test_mon_update` needs to set a mon name

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-02 13:58:28 -06:00
Sage Weil
983b872da0 Merge PR #31274 into master
* refs/pull/31274/head:
	osd/OSD: enhance osd numa affinity compatibility

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-02 12:56:05 -06:00
Sage Weil
884c84d844 Merge PR #31348 into master
* refs/pull/31348/head:
	tools/rados: update advisory lock break usage with --lock-cookie required

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-02 12:55:49 -06:00
Sage Weil
7a841ef49c Merge PR #31669 into master
* refs/pull/31669/head:
	bluestore: tiny tracepoints improvement

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2019-12-02 12:55:26 -06:00
Kefu Chai
fa5a908659
Merge pull request #31943 from tchaikov/wip-31224
python-common: move pytest integration from setup.py to tox.ini

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-03 00:52:00 +08:00
Zac Dover
5c5f312a5b doc: add Python 2 to Ubuntu 18.04 installations
This commit updates the "Create a Cluster" section of the
"Storage Cluster Quick Start" document. Ubuntu 18.04 does
not have Python 2 installed by default. This commit instructs
users of Python 18.04 to install the package "python-minimal"
to provide Python 2 prior to running "ceph-deploy".

This commit fixes Bug number 9 in the list here:
https://pad.ceph.com/p/Report_Documentation_Bugs

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2019-12-03 02:21:27 +10:00
Casey Bodley
c794ebb26e
Merge pull request #31361 from hairesis/kms_transit_backend
rgw: extend SSE-KMS with Vault using transit secrets engine

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-12-02 10:20:19 -05:00
Sebastian Wagner
615ec40195 python-common: move pytest integration from setup.py to tox.ini
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-12-02 23:02:04 +08:00
Jason Dillaman
1d866ef37d
Merge pull request #31279 from lixiaoy1/rwl-image-writeback-cache-seq1
rbd/cache: Replicated Write Log core codes part 1

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-12-02 09:16:10 -05:00
Lenz Grimmer
02a2ba865a
mgr/dashboard: Display the aggregated number of request (#31369)
mgr/dashboard: Display the aggregated number of request

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-12-02 12:41:20 +00:00
Lenz Grimmer
6188f6d784
mgr/dashboard: Resolve some npm audit issues (#31845)
mgr/dashboard: Resolve some npm audit issues

Reviewed-by: Volker Theile <vtheile@suse.com>
2019-12-02 12:06:39 +00:00
Lenz Grimmer
05fafb73ce
mgr/dashboard: Trim IQN on iSCSI target form (#31888)
mgr/dashboard: Trim IQN on iSCSI target form

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-12-02 11:40:20 +00:00
Sebastian Wagner
118626e8fd mgr/ssh: test_mon_update needs to set a mon name
... in order to exercise a code path to make use of `_get_services()`

Fixes: https://tracker.ceph.com/issues/43075

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-12-02 11:22:31 +01:00
Lenz Grimmer
95dd54889a
mgr/dashboard: Eye candy updates to datatable pages (#31764)
mgr/dashboard: Eye candy updates to datatable pages 

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-12-02 09:27:33 +00:00
Kefu Chai
897fc1b8df
Merge pull request #31903 from majianpeng/os-bluestore-ceph-assert
os/bluestore: don't round_up_to in apply_for_bitset_range.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-12-02 16:50:38 +08:00
Kefu Chai
2287568138
Merge pull request #31774 from dzafman/wip-balancer3
osd,tools: Balancer fixes without all of the calc_pg_upmaps() rewrites

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-12-02 16:48:38 +08:00
Kefu Chai
c93b0881e6
Merge pull request #31317 from wjwithagen/wjw-update-FindBoost.cmake
cmake: update FindBoost.cmake for 1.71

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-02 16:46:00 +08:00
Kefu Chai
a56efc1610
Merge pull request #31841 from rosinL/wip-support-dpdk-numa
cmake: Add dpdk numa support

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-02 16:45:11 +08:00
Kefu Chai
6592686df4
Merge pull request #31915 from majianpeng/osd-remove-useless-ceph-assert
osd: remove useless ceph_assert.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-02 16:44:27 +08:00
Kefu Chai
af68d427d0
Merge pull request #31723 from rosinL/wip-add-bench-log-usage
test/bench_log: add usage function

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-02 16:43:48 +08:00
Kefu Chai
7b0617109a
Merge pull request #31840 from rosinL/wip-fix-dpdk
msg/async/dpdk: fix compilation errors when WITH_DPDK=on

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-02 16:42:00 +08:00
Kefu Chai
dca9ad1fc3
Merge pull request #30631 from xxhdx1985126/wip-bluefs-sync-leak-fix
BlueFS: prevent BlueFS::dirty_files from being leaked when syncing metadata

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-12-02 16:39:09 +08:00
Sage Weil
c6dd4228e2 Merge PR #31900 into master
* refs/pull/31900/head:
	mgr: fix debug typo

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-12-01 20:16:31 -06:00
Sage Weil
98c09315d9 Merge PR #31442 into master
* refs/pull/31442/head:
	kv/RocksDBStore: Add minimum key limit before invoking DeleteRange.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-12-01 20:12:00 -06:00
Chunsong Feng
f74d97f462 msg/async/dpdk: Porting seastar's init_port_start to fix to resolve compilation errors
Ceph currently uses dpdk19.05, seastar dpdk_device::init_port_start has
been upgraded to DPDK19.05, so porting changes to fix compiler error.

Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
2019-11-29 18:57:47 +08:00
Laura Paduano
2fdc518941
Merge pull request #31165 from votdev/improve_py_unittests
mgr/dashboard: Refactor Python unittests and controller

Reviewed-by: Ernesto Puertat <epuertat@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-11-29 11:04:57 +01:00
Kefu Chai
656c8e8049
Merge pull request #31856 from rzarzynski/wip-crimson-errorator-handle_error
crimson/common/errorator.h: add handle_error() method.

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-11-29 13:49:26 +08:00
Kefu Chai
22160a6854
Merge pull request #31853 from liewegas/fix-rn-typo
PendingReleaseNotes: fix typo

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-11-29 10:27:36 +08:00
Kefu Chai
bfc34b2456
Merge pull request #31918 from rzarzynski/wip-crimson-errorator-simplify_safe_then
crimson/common/errorator.h: simplify the compound safe_then() variant.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-11-29 08:24:01 +08:00
Sage Weil
fa689411d1 Merge PR #31838 into master
* refs/pull/31838/head:
	ceph-daemon: chown uid/gid files during `adopt`
	ceph-daemon: use 'iglob' instead of 'glob'
	ceph-daemon: Fix handling for symlinks on python2

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-11-28 15:28:47 -06:00
Ilya Dryomov
1e67e240f4 krbd: misc cleanups
Introduce get_devnode() and append_unmap_options(); make some functions
static.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-11-28 20:23:21 +01:00
Ilya Dryomov
a1aecba6f4 krbd: make wait_for_udev_add() clearer and a bit more efficient
Collect only /dev/rbd* block events and dispose of them as soon as
possible; match on devnode and assert on major/minor instead of the
other way around.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-11-28 18:40:42 +01:00
Ilya Dryomov
08bf0b6288 krbd: do away with explicit memory management
Wrap udev_monitor, udev_enumerate and udev_device with std::unique_ptr.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-11-28 18:40:42 +01:00
Volker Theile
ac2a894a4d mgr/dashboard: Eye candy updates to datatable pages
- Introduce boolean and array pipes
- Introduce configurable 'badge' datatable column
- Refactor the Inventory, OSD, RBD, iSCSI, ... datatable pages

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-11-28 16:54:06 +01:00
Radoslaw Zarzynski
7518cf91c2 crimson/common/errorator.h: simplify the compound safe_then() variant.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-11-28 16:39:23 +01:00
Radoslaw Zarzynski
33e0dba013 crimson/common/errorator.h: add handle_error() method.
In contrast to `safe_then` it deals only with errors
and, on return, leaves the value type `future<ValueT>`
embodies unchanged.
While being basically a specialization of `safe_then`,
it's also a convenience method to squeeze boilerplate.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-11-28 16:36:08 +01:00
Sage Weil
be6dd892e4 Merge PR #31914 into master
* refs/pull/31914/head:
	mgr/orchestrator: set node labels to empty list if none specified

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
2019-11-28 08:54:19 -06:00
Volker Theile
0cde6a0e6f
mgr/dashboard: support creating OSDs on spare devices (#30921)
mgr/dashboard: support creating OSDs on spare devices

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-11-28 13:18:22 +01:00
luo rixin
32f967b420 cmake: Add shared library as dpdk dependency
librte_eal.a refers to libpthread.so and libdl.so, and libceph-common.so
refers to librte_eal.a. Many test application link libceph-common.so
without linking pthread, it will cause link error.
Such as unittest_interval_set, target_link_libraries (unittest_interval_set
ceph-common)

Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
2019-11-28 20:18:09 +08:00
Chunsong Feng
4f3606f87b cmake: Add dpdk numa support
Find and link the numa library for DPDK.

Fixes: https://tracker.ceph.com/issues/42275

Signed-off-by: Hu Ye <yehu5@huawei.com>
Signed-off-by: Chunsong Feng <fengchunsong@huawei.com>
2019-11-28 20:15:39 +08:00
Laura Paduano
041a71b3e8
Merge pull request #31785 from votdev/cleanup_remove_useless_var
mgr/dashboard: Remove unused variable

Reviewed-by: Kiefer Chang kiefer.chang@suse.com
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-11-28 11:44:50 +01:00
Laura Paduano
b0057c02ba
Merge pull request #31720 from rhcs-dashboard/fix-42708-master
mgr/dashboard: remove traceback/version assertions

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-11-28 11:36:32 +01:00
Laura Paduano
fdf0829d3a
Merge pull request #31843 from votdev/rename_list_pipe
mgr/dashboard: Rename pipe list -> join

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-11-28 11:28:20 +01:00