Commit Graph

92062 Commits

Author SHA1 Message Date
Kefu Chai
b4aa2af446
Merge pull request #25039 from tchaikov/wip-install-setuptools
install-deps: install setuptools before upgrading virtualenv

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-11-12 20:05:29 +08:00
Sage Weil
aadb68cc84 Merge PR #25051 into master
* refs/pull/25051/head:
	doc/governance: reference the new Ceph Foundation

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2018-11-12 02:50:23 -06:00
Sage Weil
d578d4af1b doc/governance: reference the new Ceph Foundation
Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-12 01:32:45 -06:00
Jerry Lee
b09aefc2d6 ceph-mgr: hold lock while accessing the request list and submitting request
The request creation can fire up the notify event early and it can cause
a race condition where the actual request was not yet added to the
self.requests list which makes the submit_request() function waits
forever without accepting new requests.

https://marc.info/?l=ceph-devel&m=154104291714160&w=2

Fixes: https://tracker.ceph.com/issues/36764

Signed-off-by: Jerry Lee <leisurelysw24@gmail.com>
2018-11-12 14:27:53 +08:00
Kefu Chai
95386752ab install-deps: install setuptools before upgrading virtualenv
this should address the failures when running install-deps.sh, like

Downloading/unpacking virtualenv
  Running setup.py egg_info for package virtualenv
    /usr/lib64/python2.7/distutils/dist.py:267: UserWarning: Unknown
distribution option: 'python_requires'
      warnings.warn(msg)
    error in virtualenv setup command: 'extras_require' must be a
dictionary whose values are strings or lists of strings containing valid
project/version requirement specifiers.
    Complete output from command python setup.py egg_info:
    /usr/lib64/python2.7/distutils/dist.py:267: UserWarning: Unknown
distribution option: 'python_requires'

  warnings.warn(msg)

error in virtualenv setup command: 'extras_require' must be a dictionary
whose values are strings or lists of strings containing valid
project/version requirement specifiers.

this only happens on very old virtualenv shipped with RHEL7.4

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-10 13:47:13 -08:00
Sage Weil
3b4970053c Merge PR #25033 into master
* refs/pull/25033/head:
	doc/governance: update CLT membership

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2018-11-10 14:07:11 -06:00
Kefu Chai
fa5012af5c
Merge pull request #25038 from yuriw/wip-yuriw-crontab-master
qa/tests: added "-n 7" to make sure mimic-x runs on built master branch

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-10 11:46:19 -08:00
Yuri Weinstein
5127d0166e qa/tests: added "-n 7" to make sure mimic-x runs on built master branch
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-11-10 10:18:49 -08:00
Sage Weil
2b38ce9a36 doc/governance: update CLT membership
- Neha is the new RADOS lead, but Josh is sticking around on the CLT
- John is leaving Red Hat and the Ceph project (we will miss him!)
- alphabetize

Signed-off-by: Sage Weil <sage@redhat.com>
2018-11-10 10:28:47 -06:00
Kefu Chai
f10fc004bc qa: add librados3 to exclude_packages for ugprade tests
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-10 07:17:24 -08:00
Sage Weil
d3aea056d3 Merge PR #25023 into master
* refs/pull/25023/head:
	doc/governance: Add Sebastian to CLT

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-10 07:46:53 -06:00
Sebastian Wagner
e0eb2dbd98 doc/governance: Add Sebastian to CLT
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-11-10 11:59:46 +01:00
Mykola Golub
56412bf6d2
Merge pull request #24830 from dillaman/wip-rbd-pool-stats
rbd: expose pool stats summary tool

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-11-10 12:23:40 +02:00
Jason Dillaman
43840db329
Merge pull request #24265 from trociny/wip-36091
osd: collect client perf stats when query is enabled

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-11-09 19:56:11 -05:00
Jason Dillaman
6ac41ccbaf
Merge pull request #24214 from iridescent-rsy/bursting_io
librbd: reduce the TokenBucket fill cycle and support bursting io configuration

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-11-09 19:53:55 -05:00
Josh Durgin
fd2a4c5733
Merge pull request #22476 from dzafman/wip-23875
Removal of snapshot with corrupt replica crashes osd

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-11-09 15:15:01 -08:00
Sage Weil
919aa37f82 Merge PR #24806 into master
* refs/pull/24806/head:
	os/filestore: fix merge_collection replay guards

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-09 14:53:56 -06:00
Sage Weil
130e6625eb Merge PR #24843 into master
* refs/pull/24843/head:
	osd/osd_types: fix notify-ack string rendering

Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-11-09 14:53:16 -06:00
Jason Dillaman
1a14963aeb rbd: added new 'pool stats' action
This provides a quick summary of provisioned pool usage.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-11-09 12:40:41 -05:00
Jason Dillaman
f07fb350af librbd: new pool init/stat API methods
The init method is a stub for handling new pool initialization. It
currently only handles setting the application tag. The stats method
will quickly calculate the number of images and provisioned space for
those images within the pool. Querying the pool stats on a pool with
10,000 images only required approximately 2 seconds as compared to
over 2 minutes for a "rbd ls -l" scan.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-11-09 12:40:39 -05:00
Ranjitha G
1fb39dbe6f mgr/dashboard: Add unit test case for controller/erasure_code_profile.py
Signed-off-by: Ranjitha G <ranjitha.kmg@gmail.com>
2018-11-09 22:45:26 +05:30
Andrew Schoen
91dd98112b
Merge pull request #24998 from alfredodeza/wip-rm36470
ceph-volume enable  --no-systemd flag for simple sub-command

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-11-09 09:44:44 -06:00
Lenz Grimmer
5b0a957961
Merge pull request #24627 from Devp00l/wip-manage-ec-profiles
mgr/dashboard: Adds ECP management to the frontend

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-11-09 16:29:43 +01:00
Sage Weil
e6556f4662 Merge PR #24459 into master
* refs/pull/24459/head:
	os: Transaction uses append_hole() to minimize bl:_buffers inflation.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-09 09:24:57 -06:00
Sage Weil
f21d56aa9c Merge PR #24890 into master
* refs/pull/24890/head:
	mon: fix 'log last' missing out latest event

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-09 08:38:33 -06:00
Sage Weil
644f91f5e4 Merge PR #24904 into master
* refs/pull/24904/head:
	common: point of this may be called after released

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-11-09 08:38:14 -06:00
Sage Weil
8f3d7a6d56 Merge PR #24925 into master
* refs/pull/24925/head:
	Avoid import _strptime failed
	Avoid exception if remote plugin not enabled
	Separate diskprediction local plugin from the diskprediction plugin

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-09 08:37:10 -06:00
Alfredo Deza
974bd43461
Merge pull request #24859 from jan--f/ceph-volume-inventory
ceph-volume: add inventory command

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-11-09 08:49:55 -05:00
Jan Fajerski
57adfc6bb8 ceph-volume: add inventory command
The inventory command provides information about a nodes disk inventory.
Existing logical volumes on a disk or one of its partitions are scanned
and reported.
The output can be formatted as plain text or json.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2018-11-09 13:49:35 +01:00
Lenz Grimmer
b8e4f4eb75
Merge pull request #24934 from votdev/improve_crush_map_viewer
mgr/dashboard: Improve CRUSH map viewer

Reviewed-by: Stephan Müller <smueller@suse.com>
2018-11-09 13:27:46 +01:00
Lenz Grimmer
3ba874004e
Merge pull request #24489 from ricardoasmarques/wip-saml2
mgr/dashboard: SSO - SAML 2.0 support

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-11-09 13:11:22 +01:00
Alexey Stupnikov
bff5a2122f doc: put command template into literal block
``ceph-deploy osd create --data {device} {ceph-node}`` command
is not displayed properly because of missing double colons.

Signed-off-by: Alexey Stupnikov <aleksey.stupnikov@gmail.com>
2018-11-09 10:48:40 +01:00
Matthew Vernon
dd24ddcbf7 debian: correct ceph-common relationship with older radosgw package
Fixes: https://tracker.ceph.com/issues/36741

9fd30b93f7 moved
/etc/bash_completion.d/radosgw-admin from radosgw to ceph-common. This
means that if you try and install a newer ceph-common over an older
radosgw, there's a conflict, and the install fails:

```
Unpacking ceph-common (12.2.8-1xenial) over (10.2.9-0ubuntu0.16.04.1) ...
dpkg: error processing archive ceph-common_12.2.8-1xenial_amd64.deb (--install):
 trying to overwrite '/etc/bash_completion.d/radosgw-admin', which is also in package radosgw 10.2.9-0ubuntu0.16.04.1
```

Per Debian policy (
https://www.debian.org/doc/debian-policy/ch-relationships.html#overwriting-files-in-other-packages
) the correct way to handle a package taking over a file is for a
versioned Replaces and Breaks.

The change went into 12.0.3, so this commit adds Replaces and Breaks
against radosgw less than that version. It should be backported to
Luminous to avoid issues with upgrades from older versions (Jewel and
Kraken).

Signed-off-by: Matthew Vernon <mv3@sanger.ac.uk>
2018-11-09 09:35:35 +00:00
Stephan Müller
3261c4f120 mgr/dashboard: Show info button for crush rules in pool form
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-11-09 09:40:39 +01:00
Stephan Müller
5e4ebf7089 mgr/dashboard: Adds ECP management to the frontend
Now you can create, delete and get information about profiles inside
the pool form.

The erasure code profile form has a lot of tooltips to guide you through
the creation. It can create profiles with different plugins.

Fixes: https://tracker.ceph.com/issues/25156
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-11-09 09:40:39 +01:00
Stephan Müller
3a7f85809a mgr/dashboard: Adds ECP info endpoint
The new info endpoint will provide the frontend with the necessary
information it needs to create new profiles.

Fixes: https://tracker.ceph.com/issues/25156
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-11-09 09:40:39 +01:00
Lenz Grimmer
06fcb754a3
Merge pull request #24928 from rhcs-dashboard/36632-update-python-dependency
mgr/dashboard: update python dependency

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-11-09 09:27:37 +01:00
Mykola Golub
06ac1a63f1
Merge pull request #24963 from dillaman/wip-ceph-iscsi
doc: tweak RBD iSCSI docs to point to merged tooling repo

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-11-09 09:45:43 +02:00
Ranjitha G
badd2a6106 mgr/dashboard: Fix some setup steps in HACKING.rst
Signed-off-by: Ranjitha G <ranjitha.kmg@gmail.com>
2018-11-09 10:15:21 +05:30
David Zafman
a159f162c5 test: osd-scrub-snaps.sh: After snapshot removal wait for snaptrim to complete
Due to deliberate corruptions snaptrim_error means snaptrim is done

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-11-08 14:48:20 -08:00
David Zafman
e37f95ac27 test: osd-scrub-snaps.sh: Testing with new --rmtype in ceph-objectstore-tool
Use --rmtype snapmap with new obj16 to remove snapmap only, check for repair message
Use --rmtype nosnapmap to remove obj5 while leaving snapmap behind

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-11-08 14:48:20 -08:00
David Zafman
f43faf4ad7 test: cleanup: Remove redundant cat of log and handle errors in create_scenario()
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-11-08 14:48:19 -08:00
David Zafman
00e669a173 ceph-objectstore-tool: Add removal options to corrupt objects for testing
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-11-08 14:48:19 -08:00
Sage Weil
2382384532 Merge PR #21511 into master
* refs/pull/21511/head:
	os/bluefs: set logfile w/ WRITE_LIFE_MEDIUM
	os/bluefs: make super block w/ WRITE_LIFE_TIME_SHORT.
	os/bluestore: BlueFS support write_life_time feature of SSD.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-11-08 16:29:00 -06:00
Sage Weil
c3992d8f58 Merge PR #24820 into master
* refs/pull/24820/head:
	os/bluestore/BlueStore.cc: merge overlapping/adjacent regions before read

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-11-08 16:28:44 -06:00
Sage Weil
c8a8dc21fd Merge PR #24828 into master
* refs/pull/24828/head:
	qa/osd-bluefs-volume-ops: use ceph-bluestore-tool for fsck
	qa/osd-bluefs-volume-ops: reduce space usage for the test case

Reviewed-by: David Zafman <dzafman@redhat.com>
2018-11-08 16:26:52 -06:00
Sage Weil
2be6d4e5ec Merge PR #24948 into master
* refs/pull/24948/head:
	os/bluestore: fix wal dir presence verification

Reviewed-by: Sage Weil <sage@redhat.com>
2018-11-08 16:26:36 -06:00
Yehuda Sadeh
8409a876ce
Merge pull request #24014 from yehudasa/wip-rgw-svc-2
rgw: initial RGWRados refactoring work

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-11-08 14:00:51 -08:00
Yehuda Sadeh
84764013e4 rgw: shutdown services only if initialized
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 12:56:26 -08:00
Yehuda Sadeh
e0dc5a86cb librados_test_stub: implement move operations
Need to match whatever librados implements.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2018-11-08 12:43:21 -08:00