Commit Graph

92088 Commits

Author SHA1 Message Date
Jan Fajerski
57adfc6bb8 ceph-volume: add inventory command
The inventory command provides information about a nodes disk inventory.
Existing logical volumes on a disk or one of its partitions are scanned
and reported.
The output can be formatted as plain text or json.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-09 13:49:35 +01:00
Lenz Grimmer
b8e4f4eb75
Merge pull request #24934 from votdev/improve_crush_map_viewer
mgr/dashboard: Improve CRUSH map viewer

Reviewed-by: Stephan Müller <smueller@suse.com>
2018-11-09 13:27:46 +01:00
Lenz Grimmer
3ba874004e
Merge pull request #24489 from ricardoasmarques/wip-saml2
mgr/dashboard: SSO - SAML 2.0 support

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-11-09 13:11:22 +01:00
Alexey Stupnikov
bff5a2122f doc: put command template into literal block
``ceph-deploy osd create --data {device} {ceph-node}`` command
is not displayed properly because of missing double colons.

Signed-off-by: Alexey Stupnikov <aleksey.stupnikov@gmail.com>
2018-11-09 10:48:40 +01:00
Matthew Vernon
dd24ddcbf7 debian: correct ceph-common relationship with older radosgw package
Fixes: https://tracker.ceph.com/issues/36741

9fd30b93f7 moved
/etc/bash_completion.d/radosgw-admin from radosgw to ceph-common. This
means that if you try and install a newer ceph-common over an older
radosgw, there's a conflict, and the install fails:

```
Unpacking ceph-common (12.2.8-1xenial) over (10.2.9-0ubuntu0.16.04.1) ...
dpkg: error processing archive ceph-common_12.2.8-1xenial_amd64.deb (--install):
 trying to overwrite '/etc/bash_completion.d/radosgw-admin', which is also in package radosgw 10.2.9-0ubuntu0.16.04.1
```

Per Debian policy (
https://www.debian.org/doc/debian-policy/ch-relationships.html#overwriting-files-in-other-packages
) the correct way to handle a package taking over a file is for a
versioned Replaces and Breaks.

The change went into 12.0.3, so this commit adds Replaces and Breaks
against radosgw less than that version. It should be backported to
Luminous to avoid issues with upgrades from older versions (Jewel and
Kraken).

Signed-off-by: Matthew Vernon <mv3@sanger.ac.uk>
2018-11-09 09:35:35 +00:00
Stephan Müller
3261c4f120 mgr/dashboard: Show info button for crush rules in pool form
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-11-09 09:40:39 +01:00
Stephan Müller
5e4ebf7089 mgr/dashboard: Adds ECP management to the frontend
Now you can create, delete and get information about profiles inside
the pool form.

The erasure code profile form has a lot of tooltips to guide you through
the creation. It can create profiles with different plugins.

Fixes: https://tracker.ceph.com/issues/25156
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-11-09 09:40:39 +01:00
Stephan Müller
3a7f85809a mgr/dashboard: Adds ECP info endpoint
The new info endpoint will provide the frontend with the necessary
information it needs to create new profiles.

Fixes: https://tracker.ceph.com/issues/25156
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-11-09 09:40:39 +01:00
Lenz Grimmer
06fcb754a3
Merge pull request #24928 from rhcs-dashboard/36632-update-python-dependency
mgr/dashboard: update python dependency

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-11-09 09:27:37 +01:00
Mykola Golub
06ac1a63f1
Merge pull request #24963 from dillaman/wip-ceph-iscsi
doc: tweak RBD iSCSI docs to point to merged tooling repo

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-11-09 09:45:43 +02:00
Ranjitha G
badd2a6106 mgr/dashboard: Fix some setup steps in HACKING.rst
Signed-off-by: Ranjitha G <ranjitha.kmg@gmail.com>
2018-11-09 10:15:21 +05:30
David Zafman
a159f162c5 test: osd-scrub-snaps.sh: After snapshot removal wait for snaptrim to complete
Due to deliberate corruptions snaptrim_error means snaptrim is done

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-11-08 14:48:20 -08:00
David Zafman
e37f95ac27 test: osd-scrub-snaps.sh: Testing with new --rmtype in ceph-objectstore-tool
Use --rmtype snapmap with new obj16 to remove snapmap only, check for repair message
Use --rmtype nosnapmap to remove obj5 while leaving snapmap behind

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-11-08 14:48:20 -08:00
David Zafman
f43faf4ad7 test: cleanup: Remove redundant cat of log and handle errors in create_scenario()
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-11-08 14:48:19 -08:00
David Zafman
00e669a173 ceph-objectstore-tool: Add removal options to corrupt objects for testing
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-11-08 14:48:19 -08:00
Sage Weil
2382384532 Merge PR #21511 into master
* refs/pull/21511/head:
	os/bluefs: set logfile w/ WRITE_LIFE_MEDIUM
	os/bluefs: make super block w/ WRITE_LIFE_TIME_SHORT.
	os/bluestore: BlueFS support write_life_time feature of SSD.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-11-08 16:29:00 -06:00
Sage Weil
c3992d8f58 Merge PR #24820 into master
* refs/pull/24820/head:
	os/bluestore/BlueStore.cc: merge overlapping/adjacent regions before read

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-11-08 16:28:44 -06:00
Sage Weil
c8a8dc21fd Merge PR #24828 into master
* refs/pull/24828/head:
	qa/osd-bluefs-volume-ops: use ceph-bluestore-tool for fsck
	qa/osd-bluefs-volume-ops: reduce space usage for the test case

Reviewed-by: David Zafman <dzafman@redhat.com>
2018-11-08 16:26:52 -06:00
Sage Weil
2be6d4e5ec Merge PR #24948 into master
* refs/pull/24948/head:
	os/bluestore: fix wal dir presence verification

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-08 16:26:36 -06:00
Yehuda Sadeh
8409a876ce
Merge pull request #24014 from yehudasa/wip-rgw-svc-2
rgw: initial RGWRados refactoring work

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-11-08 14:00:51 -08:00
Yehuda Sadeh
84764013e4 rgw: shutdown services only if initialized
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 12:56:26 -08:00
Yehuda Sadeh
e0dc5a86cb librados_test_stub: implement move operations
Need to match whatever librados implements.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 12:43:21 -08:00
Alfredo Deza
3e80118cca ceph-volume tests ensure activate behavior with systemd disabling
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
2018-11-08 14:14:17 -05:00
Alfredo Deza
18ddd96211 ceph-volume simple.activate factor out systemd interactions for easier testing
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
2018-11-08 14:13:52 -05:00
Sage Weil
5552971a8b Merge PR #24995 into master
* refs/pull/24995/head:
	doc: use 'proxy' cache mode in "Removing a Writeback Cache" procedure

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-08 12:59:51 -06:00
Kefu Chai
0966f43d98
Merge pull request #24896 from tchaikov/wip-librados-cleanup
librados,rpm,deb: various fixes to address librados3 transition and cleanups in librados

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-08 10:19:57 -08:00
Mykola Golub
ab880ee6ba doc: use 'proxy' cache mode in "Removing a Writeback Cache" procedure
The 'forward' mode is flawed as it allows the reordering of requests.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-11-08 19:23:12 +02:00
Yehuda Sadeh
c3dd80bb2f test/rbd_mirror: fix linking
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:30 -08:00
Yehuda Sadeh
4b043aa380 rgw: svc_notify: call set_enabled() when registering callback
svc_notify starts before svc_sysobj_cache, this way we make sure
svc_sysobj_cache gets the status callback triggered.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:30 -08:00
Yehuda Sadeh
fc860a367b rgw: sysobj_core: filter sysobj attrs
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:30 -08:00
Casey Bodley
cfd66c5f89 librados: add move operations to IoCtx
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-11-08 09:19:30 -08:00
Yehuda Sadeh
238f0ef4a4 rgw: chained cache shouldn't access service after it was unchained
This fixes a cleanup ordering issue. We can now have the chained cache
removed before and after the service is destructed.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:30 -08:00
Casey Bodley
27664f22c4 rgw: AioThrottle uses RGWSI_RADOS::Obj
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-11-08 09:19:30 -08:00
Casey Bodley
d75e7a9fa9 rgw: RADOS::Pool::create() for single pool
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-11-08 09:19:30 -08:00
Casey Bodley
86190327a0 rgw: RADOS::Pool::lookup() uses Pool's pool name
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-11-08 09:19:30 -08:00
Casey Bodley
79eb9a9e5c rgw: add Obj::aio_operate() for read ops
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-11-08 09:19:30 -08:00
Casey Bodley
fa7041126d rgw: rgw_rados_ref uses default copy/move
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-11-08 09:19:30 -08:00
Casey Bodley
9be21f80c5 rgw: fix svc_zone compile with is_started()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-11-08 09:19:30 -08:00
Yehuda Sadeh
d480cbe32a rgw: fix list_realms() and list_zones()
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:30 -08:00
Yehuda Sadeh
b6cfb3f34d rgw: fix chained cache put if cache isn't initialized
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:30 -08:00
Yehuda Sadeh
50e5c08958 rgw: svc: support raw storage init
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:30 -08:00
Yehuda Sadeh
1ad00c9435 rgw: move services shutdown around
fixes ordering

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:29 -08:00
Yehuda Sadeh
0d8185cb96 rgw: services shutdown
Explicitly make sure services are being shut down in appropriate order.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:29 -08:00
Yehuda Sadeh
39258cb4c7 rgw: unregister chained cache on shutdown
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:29 -08:00
Yehuda Sadeh
a7cc961ae7 rgw: svc: hold services in unique_ptr
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:29 -08:00
Yehuda Sadeh
2053556de1 rgw: don't try to canonicalize raw obj
and other minor fixes

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:29 -08:00
Yehuda Sadeh
58680b8860 rgw: remove unneeded code
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:29 -08:00
Yehuda Sadeh
10462d6191 rgw: don't include rgw_zone.h in svc_zone.h
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:29 -08:00
Yehuda Sadeh
4c0675bbc3 rgw: svc: due to popular demand, get rid of service registry
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:29 -08:00
Yehuda Sadeh
cc4ecac031 rgw: api fixes following rebase
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 09:19:29 -08:00