Commit Graph

104957 Commits

Author SHA1 Message Date
Samuel Just
ffb66d4ad0 crimson/osd: use ObjectContext and take obc locks
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-12-02 21:35:36 -08:00
Samuel Just
fd803498df crimson/osd/pg_backend: factor out load_object_state/snapset
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-12-02 21:35:36 -08:00
Samuel Just
f35c90c7d4 crimson: add ObjectContext/Registry
ObjectContext will hold the ephemeral state and lock status
for an object as in classic osd.

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-12-02 21:35:36 -08:00
Samuel Just
2472b37679 src/osd: factor out RWState, move SnapSetContext, ObjectState, RWState
We'll want to reuse this logic in crimson, but the actual operation
wake/wait mechanics will be different.

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-12-02 21:35:36 -08:00
Samuel Just
fc8f8855e4 common/: introduce intrusive_lru
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-12-02 21:35:36 -08:00
Samuel Just
83eba36c2c osd/: factor OSD::init_op_flags into seperate class
We'll want to reuse this in crimson, extract the logic
for setting flags from MOSDOp into osd_types.h.

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-12-02 21:35:36 -08:00
Samuel Just
260f23b759 crimson/common/errorator.h: add finally method for resource release
This way we can add things like resource handlers which are otherwise
transparent to passing values and errors.

Signed-off-by: Samuel Just <sjust@redhat.com>
2019-12-02 21:35:36 -08:00
Samuel Just
030c057048 vstart: add --debug for crimson if debug is enabled
Signed-off-by: Samuel Just <sjust@redhat.com>
2019-12-02 21:35:36 -08:00
Kefu Chai
080d5506ad
Merge pull request #31947 from zdover23/wip-doc-ubuntu-1804-python-minimal
doc: add Python 2 to Ubuntu 18.04 installations

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-03 12:07:42 +08:00
Kefu Chai
aa9e60037c
Merge pull request #31958 from tchaikov/wip-cmake-new-policy
cmake: do not use CMP0074 unless it is supported

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-12-03 10:48:39 +08:00
Sage Weil
123338acc3 qa/suites/rados/ssh: only install ceph-daemon for packaged mode
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-03 02:26:18 +00:00
Kefu Chai
dd0cdb3eb6 cmake: do not use CMP0074 unless it is supported
CMake CMP0074 was introduced by CMake 3.12, but we only require CMake
v3.10.2. so default to check `Boost_ROOT` unless specified otherwise.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-03 09:51:17 +08:00
Michael Fritch
70a4a1a900
ceph-daemon: drop unneeded mode during tmpfile create
Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-12-02 16:59:05 -07:00
Sage Weil
3f2a5dbf27 ceph-daemon: name mgr the same way mgr/ssh does
(with a random 6-char id, not the hostname)

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-02 17:47:50 -06:00
Michael Fritch
e92929d86d
ceph-daemon: consolidate NamedTemporaryFile logic
Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-12-02 16:17:43 -07:00
Michael Fritch
d0fd6df326
ceph-daemon: chown uid/gid ceph-volume tmpfiles
Signed-off-by: Michael Fritch <mfritch@suse.com>
2019-12-02 16:17:42 -07:00
Sage Weil
2c1235ba69 Merge PR #31913 into master
* refs/pull/31913/head:
	ceph-daemon: Allow env var for setting the used image

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-02 16:26:33 -06:00
Sage Weil
3342436177 tasks/ceph2: add support for packaged ceph-daemon
Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-02 21:19:09 +00:00
Sage Weil
3798a3153b mgr/ssh: fix remove_osds
Broken by the new completions

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-02 15:06:42 -06:00
Sage Weil
77ad9eba7b mgr/ssh: fix service_action
Broken by the new completions

Signed-off-by: Sage Weil <sage@redhat.com>
2019-12-02 15:06:14 -06:00
Jason Dillaman
4f652b5cce rbd-mirror: peer_ping should send the local fsid to the remote
It was previously incorrectly sending the remote cluster's
fsid to the remote cluster.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-12-02 15:45:04 -05:00
Ilya Dryomov
8517268008
Merge pull request #31919 from idryomov/wip-krbd-udev-improvements
krbd: do away with explicit memory management and other cleanups

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-12-02 21:27:31 +01:00
Ilya Dryomov
4fe245cc2f qa: update krbd tests for python3
There is no /usr/bin/python symlink in CentOS 8 even if python2 is
installed.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-12-02 21:13:19 +01:00
Sage Weil
bfe1370698 Merge PR #31933 into master
* refs/pull/31933/head:
	mgr/ssh: `test_mon_update` needs to set a mon name

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-02 13:58:28 -06:00
Sage Weil
983b872da0 Merge PR #31274 into master
* refs/pull/31274/head:
	osd/OSD: enhance osd numa affinity compatibility

Reviewed-by: Sage Weil <sage@redhat.com>
2019-12-02 12:56:05 -06:00
Sage Weil
884c84d844 Merge PR #31348 into master
* refs/pull/31348/head:
	tools/rados: update advisory lock break usage with --lock-cookie required

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-02 12:55:49 -06:00
Sage Weil
7a841ef49c Merge PR #31669 into master
* refs/pull/31669/head:
	bluestore: tiny tracepoints improvement

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2019-12-02 12:55:26 -06:00
Kefu Chai
fa5a908659
Merge pull request #31943 from tchaikov/wip-31224
python-common: move pytest integration from setup.py to tox.ini

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-12-03 00:52:00 +08:00
Zac Dover
5c5f312a5b doc: add Python 2 to Ubuntu 18.04 installations
This commit updates the "Create a Cluster" section of the
"Storage Cluster Quick Start" document. Ubuntu 18.04 does
not have Python 2 installed by default. This commit instructs
users of Python 18.04 to install the package "python-minimal"
to provide Python 2 prior to running "ceph-deploy".

This commit fixes Bug number 9 in the list here:
https://pad.ceph.com/p/Report_Documentation_Bugs

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2019-12-03 02:21:27 +10:00
Casey Bodley
c794ebb26e
Merge pull request #31361 from hairesis/kms_transit_backend
rgw: extend SSE-KMS with Vault using transit secrets engine

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-12-02 10:20:19 -05:00
Sebastian Wagner
615ec40195 python-common: move pytest integration from setup.py to tox.ini
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-12-02 23:02:04 +08:00
Jason Dillaman
1d866ef37d
Merge pull request #31279 from lixiaoy1/rwl-image-writeback-cache-seq1
rbd/cache: Replicated Write Log core codes part 1

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-12-02 09:16:10 -05:00
Sebastian Wagner
4757110564 mgr/ssh: Port raising exceptions from completion handlers to Py2
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-12-02 15:13:14 +01:00
Lenz Grimmer
02a2ba865a
mgr/dashboard: Display the aggregated number of request (#31369)
mgr/dashboard: Display the aggregated number of request

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-12-02 12:41:20 +00:00
Lenz Grimmer
6188f6d784
mgr/dashboard: Resolve some npm audit issues (#31845)
mgr/dashboard: Resolve some npm audit issues

Reviewed-by: Volker Theile <vtheile@suse.com>
2019-12-02 12:06:39 +00:00
Lenz Grimmer
05fafb73ce
mgr/dashboard: Trim IQN on iSCSI target form (#31888)
mgr/dashboard: Trim IQN on iSCSI target form

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-12-02 11:40:20 +00:00
Kefu Chai
42579be473 mgr/orchestrator: add optional "format" param for "orchestrator host ls"
and update the test accordingly

Fixes: https://tracker.ceph.com/issues/43078
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-12-02 19:27:57 +08:00
Sebastian Wagner
118626e8fd mgr/ssh: test_mon_update needs to set a mon name
... in order to exercise a code path to make use of `_get_services()`

Fixes: https://tracker.ceph.com/issues/43075

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-12-02 11:22:31 +01:00
Lenz Grimmer
95dd54889a
mgr/dashboard: Eye candy updates to datatable pages (#31764)
mgr/dashboard: Eye candy updates to datatable pages 

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-12-02 09:27:33 +00:00
Tatjana Dehler
ee46e58e5d mgr/dashboard: fix tests in order to match pg num conventions
Update the tests test_ganesha and test_rbd_mirroring in order
to match the PG num conventions. It prevents the health warning
'POOL_PG_NUM_NOT_POWER_OF_TWO' from being shown.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-12-02 09:56:28 +01:00
Kefu Chai
897fc1b8df
Merge pull request #31903 from majianpeng/os-bluestore-ceph-assert
os/bluestore: don't round_up_to in apply_for_bitset_range.

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-12-02 16:50:38 +08:00
Kefu Chai
2287568138
Merge pull request #31774 from dzafman/wip-balancer3
osd,tools: Balancer fixes without all of the calc_pg_upmaps() rewrites

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-12-02 16:48:38 +08:00
Kefu Chai
c93b0881e6
Merge pull request #31317 from wjwithagen/wjw-update-FindBoost.cmake
cmake: update FindBoost.cmake for 1.71

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-02 16:46:00 +08:00
Kefu Chai
a56efc1610
Merge pull request #31841 from rosinL/wip-support-dpdk-numa
cmake: Add dpdk numa support

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-02 16:45:11 +08:00
Kefu Chai
6592686df4
Merge pull request #31915 from majianpeng/osd-remove-useless-ceph-assert
osd: remove useless ceph_assert.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-02 16:44:27 +08:00
Kefu Chai
af68d427d0
Merge pull request #31723 from rosinL/wip-add-bench-log-usage
test/bench_log: add usage function

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-02 16:43:48 +08:00
Kefu Chai
7b0617109a
Merge pull request #31840 from rosinL/wip-fix-dpdk
msg/async/dpdk: fix compilation errors when WITH_DPDK=on

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-12-02 16:42:00 +08:00
Kefu Chai
dca9ad1fc3
Merge pull request #30631 from xxhdx1985126/wip-bluefs-sync-leak-fix
BlueFS: prevent BlueFS::dirty_files from being leaked when syncing metadata

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-12-02 16:39:09 +08:00
Sage Weil
c6dd4228e2 Merge PR #31900 into master
* refs/pull/31900/head:
	mgr: fix debug typo

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-12-01 20:16:31 -06:00
Sage Weil
98c09315d9 Merge PR #31442 into master
* refs/pull/31442/head:
	kv/RocksDBStore: Add minimum key limit before invoking DeleteRange.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-12-01 20:12:00 -06:00