Commit Graph

99947 Commits

Author SHA1 Message Date
Patrick Donnelly
f5dc15db62
Merge PR #28831 into master
* refs/pull/28831/head:
	client: support the fallocate() when fuse version >= 2.9

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-07-12 17:15:01 -07:00
Patrick Donnelly
c586427952
Merge PR #28906 into master
* refs/pull/28906/head:
	cephfs-shell: Fix TypeError in poutput()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-12 17:14:20 -07:00
Patrick Donnelly
2a765ea220
mds: apply configuration changes through MDSRank
This avoids the need to acquire the mds_lock prior to responding to config
changes. The MDSRank can create a finisher context that acquires the lock
later.

Fixes: https://tracker.ceph.com/issues/40694
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-12 17:13:29 -07:00
Patrick Donnelly
f21b08f9b9
common/TrackedOp: make settings atomic
To avoid locks on configuration changes.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-12 17:13:29 -07:00
Patrick Donnelly
a256c42d47
doc/cephfs: improve add/remove MDS section
Include hardware details and update language for modern tools.

Fixes: http://tracker.ceph.com/issues/39620
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-12 17:11:12 -07:00
Neha Ojha
7031fa2ef3 doc/dev/developer_guide/index.rst: add youtube references
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-07-12 16:27:56 -07:00
Sage Weil
01d34051a6 Merge PR #28978 into master
* refs/pull/28978/head:
	qa/tasks/mgr/dashboard/test_health: fix test_full_health test
	mon: use per-pool stats only when all OSDs are reporting
	osd: report whether we have per-pool stats
	osd/osd_types: osd_stat_t: include num_per_pool_osds member

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-07-12 17:21:05 -05:00
Sage Weil
be49d46521 Merge PR #29003 into master
* refs/pull/29003/head:
	qa/standalone/scrub/osd-scrub-snaps.sh: adjust expected output
	osd/SnapMapper: to_raw_key: use hobject pool member, not SnapMapper:pool
	ceph-objectstore-tool: fix use of SnapSet::snaps
	qa/standalone/scrub/osd-scrub-snaps: fix kv grep

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-12 17:20:47 -05:00
Sage Weil
fbc8be423c Merge PR #29013 into master
* refs/pull/29013/head:
	qa/tasks/ceph_manager: 5s -> 15s for 'osd out' to be visible

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-12 17:20:21 -05:00
Andrew Schoen
a632024971
Merge pull request #28998 from alfredodeza/wip-rm40664
ceph-volume  zap always skips block.db, leaves them around

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2019-07-12 13:17:38 -05:00
Mark Nelson
26dc5189e7 common/options: Set concurrent bluestore rocksdb compactions to 2
Signed-off-by: Mark Nelson <mnelson@redhat.com>
2019-07-12 12:45:17 -04:00
Lenz Grimmer
f64c3f6529
mgr/dashboard: controllers/grafana is not Python3 compatible (#28956)
mgr/dashboard: controllers/grafana is not Python3 compatible

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-12 17:02:42 +02:00
Jason Dillaman
fa2d338b80
Merge pull request #28979 from falcon78921/wip-doc-18197
doc: updated OpenStack rbd documentation

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-07-12 11:00:34 -04:00
Sage Weil
ff7813aa14 qa/standalone/scrub/osd-scrub-snaps.sh: adjust expected output
SnapSet now dumps just seq, not a (fake) SnapContext.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 09:55:06 -05:00
Sage Weil
16b9b8f885 osd/SnapMapper: to_raw_key: use hobject pool member, not SnapMapper:pool
Some callers (ceph-objectstore-tool) instantiate SnapMapper with a bogus
pool id (0) and want to use it to adjust mappings.  We have the hobj
available, so use its pool member instead.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 09:55:06 -05:00
Sage Weil
03b9c66080 ceph-objectstore-tool: fix use of SnapSet::snaps
Instead, use clone_snaps to identify clones.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 09:55:06 -05:00
Nathan Cutler
ba390ed050 doc: release notes for nautilus 14.2.2
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-07-12 16:30:28 +02:00
Igor Fedotov
c3968979d0 os/bluestore: proper locking for BlueFS prefetching
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-07-12 17:16:25 +03:00
Lenz Grimmer
910da20065
mgr/dashboard: Minor fixes (#29009)
mgr/dashboard: Minor fixes

- Fix radio input display
- Fix the close button on initiators card
- Fix missing 'fa-' prefix in spinner icon
- Fix label font-weight

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-07-12 16:01:11 +02:00
Sage Weil
bf091fc100 Merge PR #28945 into master
* refs/pull/28945/head:
	os/bluestore: StupidAllocator stucks on 4GB allocations
	os/bluestore: avoid length overflow in extents returned by Stupid

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-12 09:00:23 -05:00
Sage Weil
35d2cbdc54 Merge PR #28990 into master
* refs/pull/28990/head:
	qa: vstart_runner fails because of string index out of range

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-07-12 08:58:45 -05:00
Sage Weil
d014b7924d qa/tasks/ceph_manager: 5s -> 15s for 'osd out' to be visible
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 08:56:50 -05:00
Alfredo Deza
845e62cb4b ceph-volume tests: verify that wipefs tries several times
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2019-07-12 09:17:01 -04:00
Alfredo Deza
b7b8b106fa ceph-volume lvm.zap: retry wipefs several times to prevent race condition failures
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2019-07-12 09:16:55 -04:00
Sage Weil
e0a66c564e qa/tasks/mgr/dashboard/test_health: fix test_full_health test
New fields!

Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 08:15:15 -05:00
Sage Weil
23eaf7c498 qa/standalone/scrub/osd-scrub-snaps: fix kv grep
SnapMapper keys are now SNA_, not MAP_.

Fixes: http://tracker.ceph.com/issues/40725
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-12 08:11:21 -05:00
Lenz Grimmer
1864f1c249
mgr/dashboard: Remove button and badge radius (#29001)
mgr/dashboard: Remove button and badge radius

Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-07-12 14:56:24 +02:00
Lenz Grimmer
541ebb8261
mgr/dashboard: Fix form validation problems in RGW user form (#29000)
mgr/dashboard: Fix form validation problems in RGW user form

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-07-12 14:55:49 +02:00
Juan Miguel Olmo Martínez
ab9bae853d
mgr/ansible: RGW service
RGW basic implementation

- Add one or more hosts running RGW daemon
- Allow to specify a multisite/multizone settings using a config file.
- Remove RGW daemon used to provide service for one zone.

Comments:

I see two use cases:

a. Install/Remove in new hosts the RGW daemons and configure them.
b. RGW management (CRUD zone groups/zones ... etc)

But the current orchestrators API seems to be oriented only to cover use case b.

What i have implemented in this moment covers use case a, despite the API is not friendly with that. I have added the possibility of getting a config file to specify hosts and settings.

rgw-admin commands covers all the functionality for managing RGW... So probably it does not have too much sense to implement anything around RGW management in orchestrators (use case b).

My doubts are:

1. The current API covers RGW management using a default configuration (user cannot configure multisite/multizone). Is this ok?

2. Shoud we add more API endpoints to allow add RGW nodes/hosts and manage the RGW config?

---------------------------------

Modifications suggested by @epuerta:
 Mainly:
 - New Inventory group class for manage hosts in Ansible Roles inside Ansible Inventory.
 - A redundant plus sign was found by @epuerta

Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-07-12 14:03:47 +02:00
Alfredo Deza
0164178909
Merge pull request #28267 from flumm/ceph-volume-zap-fix
ceph-volume lvm.zap fix cleanup for db partitions

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2019-07-12 07:58:08 -04:00
Tiago Melo
5aa075f568 mgr/dashboard: Fix label font-weight
Some labels were not bold, because the css rule didn't apply to them.
I have improved the css rule and also add missing classes in some labels.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-07-12 11:33:46 +00:00
Tiago Melo
c701c4af42 mgr/dashboard: Fix missing 'fa-' prefix in spinner icon
This was causing the submit button to not show the spinner.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-07-12 11:33:46 +00:00
Lenz Grimmer
2101028028
mgr/dashboard: Add nolockdep option to e2e-script (#28981)
mgr/dashboard: Add nolockdep option to e2e-script

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-07-12 13:05:05 +02:00
Tiago Melo
24a78179c7 mgr/dashboard: Fix the close button on initiators card
Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-07-12 10:27:52 +00:00
Tiago Melo
e6e66de334 mgr/dashboard: Fix radio input display
We were using the wrong class for the labels.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-07-12 10:25:14 +00:00
Jos Collin
ae56a91817
rgw: drop getting list-type when get_data is false
Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-07-12 15:53:34 +05:30
Jos Collin
abb2451dd5
rgw: Silence warning: control reaches end of non-void function
Build shows:
[ 53%] Building CXX object src/mds/CMakeFiles/mds.dir/JournalPointer.cc.o
ceph/src/rgw/rgw_rest_s3.cc: In member function ‘RGWOp* RGWHandler_REST_Bucket_S3::get_obj_op(bool)’:
ceph/src/rgw/rgw_rest_s3.cc:3588:5: warning: control reaches end of non-void function [-Wreturn-type]
   }   }
     ^
Fixes: 4ffc765c4c
Fixes: http://tracker.ceph.com/issues/40747
Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-07-12 15:52:54 +05:30
Nathan Cutler
ecbc582caf
Merge pull request #28957 from mgerstner/sfw2
rpm,etc/sysconfig: remove SuSEfirewall2 support

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-07-12 12:09:54 +02:00
Matthias Gerstner
d472e88441
packaging: remove SuSEfirewall2 support
removal of SuSEfirewall2 service, since SuSEfirewall2 has been replaced
by firewalld, see [1].

[1]: https://lists.opensuse.org/opensuse-factory/2019-01/msg00490.html

Fixes: http://tracker.ceph.com/issues/40738
Signed-off-by: Matthias Gerstner <matthias.gerstner@suse.de>
2019-07-12 09:55:35 +02:00
Tim Serong
79d6034f4e mgr/deepsea: gracefully handle nonexistent nodes in {service,device} ls
Signed-off-by: Tim Serong <tserong@suse.com>
2019-07-12 09:36:24 +02:00
Tim Serong
d4726877d1 mgr/deepsea: rejig service cache
The previous implementation didn't work properly when there was more
than once service on a node (e.g. mgr and mon on the same node).

Signed-off-by: Tim Serong <tserong@suse.com>
2019-07-12 09:36:10 +02:00
Tim Serong
2a8536265d mgr/orchestrator: fix some minor typos/kinks in inventory/service cache
Signed-off-by: Tim Serong <tserong@suse.com>
2019-07-12 09:35:51 +02:00
Sebastian Wagner
5af3a975a1 mgr/orchestrator: Impove type hint for describe_service
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-12 09:33:26 +02:00
Sebastian Wagner
5471da50f8 mgr/orchestrator: Introduce OutdatableDictMixin
No need for a persistent cache in DeepSea

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-12 09:31:54 +02:00
Sebastian Wagner
f49a875185 mgr/orchestrator: Add cache for Inventory and Services
mgr/mgr_module: Added persistent dict
  basically a pythonic interface for a k-v store
mgr/orchestrator: Added common code to implement a cache
mgr/ssh: The cache works by manually adding and removing hosts.
  only the data is invalidated
mgr/deepsea: The cache invalidates all at once and only
  valid objects are cache

Fixes https://tracker.ceph.com/issues/39990

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-07-12 09:31:40 +02:00
Kefu Chai
7910bd6f02
Merge pull request #28802 from lixiaoy1/cmake_pmdk
cmake: pmem/pmdk changes to cmake

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-12 14:55:34 +08:00
Kefu Chai
fcfc33b412
Merge pull request #28984 from tchaikov/wip-cmake-rebuild-cleanup
cmake: use BUILD_ALWAYS for rebuilding external project

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-07-12 14:54:30 +08:00
Jos Collin
4d5d6272b3
doc: Update troubleshooting.rst
* Updated troubleshooting.rst as kernel-client-troubleshooting.rst
  is dropped.
* Added troubleshooting references in fuse.rst and kernel.rst

Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-07-12 09:48:22 +05:30
Sage Weil
8cbd27af66 Merge PR #29002 into master
* refs/pull/29002/head:
	qa/tasks/ceph_deploy: do not rely on ceph-create-keys

Reviewed-by: Vasu Kulkarni <vasu@redhat.com>
2019-07-11 19:00:54 -05:00
Patrick Donnelly
6ebd517eab
Merge PR #28643 into master
* refs/pull/28643/head:
	doc: removed old EOL Ceph versions from the list
	doc: added openSUSE distros to the list and updated the releases
	doc: updated the OS recommendations to reflect the Nautilus release

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-11 15:05:41 -07:00