Commit Graph

88561 Commits

Author SHA1 Message Date
Kefu Chai
abb3e2bedf
Merge pull request #22975 from tone-zhang/vstart-spdk
vstart.sh: Support SPDK in Ceph development deployment

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-07-20 22:00:26 +08:00
Casey Bodley
a52d430bff
Merge pull request #22790 from joke-lee/WIP-admin-rest-api-user-info-with-access-key
rgw: support admin rest api get user info through user's access-key

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-07-20 09:59:24 -04:00
Casey Bodley
db59ee3bd0
Merge pull request #23099 from adamemerson/wip-all-your-fault
rgw: All Your Fault

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2018-07-20 09:57:10 -04:00
Casey Bodley
6a65439b38
Merge pull request #23058 from mkogan1/cont-19282-fix-rgw-multisite-datasync_v2
rgw: add curl_low_speed_limit and curl_low_speed_time config to avoid

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-07-20 09:52:31 -04:00
Casey Bodley
1c1e766cdc
Merge pull request #23119 from cbodley/wip-rgw-link-tenant
rgw: RGWBucket::link supports tenant

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-07-20 09:51:01 -04:00
Kefu Chai
a119734502
Merge pull request #23010 from noahdesu/mgr-expose-ec-profiles
mgr: expose ec profiles through manager

Reveiwed-by: John Spray <john.spray@redhat.com>
2018-07-20 20:54:13 +08:00
Kefu Chai
066b3f8cf3
Merge pull request #23016 from rzarzynski/wip-osd-cleanup-log_op_stats
osd: clean up and avoid extra ref-counting in PrimaryLogPG::log_op_stats.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-07-20 20:53:35 +08:00
Kefu Chai
b7d5506916
Merge pull request #22993 from jcsp/wip-progress
mgr/progress: introduce the `progress` module

Reviewed-by: Noah Watkins <nwatkins@redhat.com>
2018-07-20 20:49:38 +08:00
yuliyang
df98196912 rgw: return valid Location element, PostObj
PostResponse should contain ETag and urlencode bucket name
object name and tenant name and correct Location uri

Fixes: http://tracker.ceph.com/issues/22927

Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
2018-07-20 13:21:17 +08:00
Yan, Zheng
d249581df9 mds: avoid using g_conf().get_val<...>(...) in hot path
g_conf->get_val<>()'s overhead is high

Fixes: http://tracker.ceph.com/issues/24820
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-07-20 10:36:25 +08:00
tone.zhang
71639aee00 vstart.sh: Support SPDK in Ceph development deployment
Support SPDK in vstart.sh, the developer can debug SPDK within
development deployment with the option
"--bluestore-spdk <vendor>:<device>".

Signed-off-by: tone.zhang <tone.zhang@arm.com>
2018-07-20 08:44:19 +08:00
Dan Mick
2365d597bf
Merge pull request #23121 from noahdesu/mgr-crash-history
mgr/crash: add hour granularity crash summary
2018-07-19 15:21:25 -07:00
Patrick Donnelly
5282af61c4
mds: refactor ostream passing
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-19 13:58:38 -07:00
Jason Dillaman
fbd6ea1ffd librbd: deep-copy should not write to objects that cannot exist
If an image has a snapshot and is subsequently shrunk, ensure that
discard ops are not sent to the deep-copy objects beyond the bounds
of the image at a given snapshot/HEAD. Only a remove op should be
expected in such cases.

Fixes: http://tracker.ceph.com/issues/25000
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-07-19 13:23:00 -04:00
Noah Watkins
caa121b5f0 mgr/crash: json report of recent crashes
reports crashes per entity type with hour granularity. primarily for
consumption by the insights module.

Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-07-19 09:38:17 -07:00
Noah Watkins
4dda7cb5dd mgr/crash: add timestamp filter helper
Signed-off-by: Noah Watkins <nwatkins@redhat.com>
2018-07-19 09:38:07 -07:00
Alfredo Deza
12f1ffe784
Merge pull request #23129 from alfredodeza/wip-rm24952
ceph-volume lvm.listing only include devices if they exist

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-07-19 12:36:40 -04:00
Patrick Donnelly
fa4c0309c1
Merge PR #23097 into master
* refs/pull/23097/head:
	vstart_runner: pass ctx to FuseMount and load mount info

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2018-07-19 08:55:49 -07:00
Nathan Cutler
9b53c0d4fc
Merge pull request #23077 from smithfarm/wip-etc-sudoers
build/ops: rpm: make sudo a build dependency

Reviewed-by: Tim Serong <tserong@suse.com>
2018-07-19 16:26:20 +02:00
Nathan Cutler
9f54233104 build/ops: rpm: make sudo a build dependency
ede36df325 added sudo as a runtime dependency,
but that commit also causes OBS builds to fail with:

[10666s] ... checking filelist
[10667s] ceph-osd-14.0.0-lp150.1332.1.x86_64.rpm: directories not owned by a package:
[10667s]  - /etc/sudoers.d

Since the "sudo" package is a runtime dependency of ceph-osd, it is guaranteed
to be installed on the target system and there is no reason for ceph-osd to own
this directory.

Having sudo as a build dependency makes OBS happy, and does no harm.

Follow-on fix for https://github.com/ceph/ceph/pull/22745

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-19 14:15:05 +02:00
Nathan Cutler
50dbef2d0e script: new ceph_backport.sh script
Once the local backport git branch has been prepared (i.e. after cherry-picking
stage), this script automates the process of opening the backport PR and
updating the backport tracker issue.

Parts of this script were written by Loic Dachary.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-19 14:12:50 +02:00
Nathan Cutler
78a4f681de
Merge pull request #23089 from smithfarm/wip-seastar-build-deps
build/ops: rpm: fix seastar build dependencies for SUSE

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-07-19 14:10:31 +02:00
Nathan Cutler
7c9229e787 doc: use :command: for subcommands in ceph-bluestore-tool manpage
Older versions of Sphinx, such as the one in CentOS 7, do not render "..
option::" lines correctly if the option contains a hyphen but does not start
with a hyphen. And ceph-bluestore-tool appears to be the only Ceph manpage
affected by this bug.

Fixes: http://tracker.ceph.com/issues/24800
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-19 14:08:00 +02:00
Nathan Cutler
aeb974b913 build/ops: rpm: fix seastar build dependencies for SUSE
cryptopp-devel is called libcryptopp-devel on SUSE.

/usr/bin/protoc is included in protobuf-devel on SUSE.

numactl-devel is called libnuma-devel on SUSE

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-07-19 10:08:41 +02:00
Yan, Zheng
5e843162da qa/tasks/cephfs: add test for discontinuous mdsmap
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-07-19 14:34:29 +08:00
Yan, Zheng
7de9da4a43 mds: handle discontinuous mdsmap
There are two cases that a mds can get discontinuous mdsmap:
 - the mdsmap was sent by other mds
 - connection to monitor was reset

Monitor does not preserve old version mdsmap. There is no easy way to
ensure mds always gets continuous mdsmap. Instead, making mds handle
discontinuous mdsmap is not difficult. When failover happens in multimds
cluster, survivor mds may miss the mdsmap that indicates old mds failed
and/or the mdsmap that indicates new mds started to replay. But the
survivor mds always get the mdsmap that indicates the new mds entered
resolve state.

Fixes: http://tracker.ceph.com/issues/24856
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-07-19 13:10:42 +08:00
Yuri Weinstein
f40ea9709f qa/tests: Set ansible-version: 2.5
Fixes http://tracker.ceph.com/issues/24926
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-07-18 17:28:34 -07:00
Igor Fedotov
25ff71813c tests/fio: add dependency for tests target from fio-ceph-objectstore
plugin.
This will make sure it's built by run-make-check.sh and hence avoid
build failures after incomplete code updates.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-07-19 00:46:04 +03:00
Igor Fedotov
1f42011a6a tests/fio: fix build failure
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-07-19 00:10:17 +03:00
Alfredo Deza
37565f8163 ceph-volume lvm.listing only include devices if they exist
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-07-18 16:50:25 -04:00
Casey Bodley
1fd5320485 rgw: RGWBucket::link supports tenant
use tenant-aware helper functions to generate metadata keys/oids

this allows 'radosgw-admin bucket link' to succeed for a tenanted user,
provided that the bucket belongs to the same tenant

Fixes: http://tracker.ceph.com/issues/22666

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-07-18 16:35:57 -04:00
Alfredo Deza
158ed6105d
Merge pull request #23117 from ceph/wip-rm24796
ceph-volume: unmount lvs correctly before zapping

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-07-18 16:03:49 -04:00
Josh Durgin
1f780ef736
Merge pull request #23098 from neha-ojha/wip-limit-pglog
osd: limit pg log length under all circumstances

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-07-18 11:10:00 -07:00
Casey Bodley
4a00c16c4a
Merge pull request #22347 from cbodley/wip-24367
rgw: fixes for sync of versioned objects

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-07-18 13:25:58 -04:00
Casey Bodley
541d72d568
Merge pull request #23032 from cbodley/wip-24873
radosgw-admin: 'sync error trim' loops until complete

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-07-18 13:25:01 -04:00
Andrew Schoen
7bfc29d1ef
Merge pull request #23116 from alfredodeza/wip-rm24961
ceph-volume tests/functional run lvm list after OSD provisioning

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-07-18 17:11:20 +00:00
Alfredo Deza
e01fb206d6 ceph-volume tests/functional run lvm list after OSD provisioning
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-07-18 12:39:01 -04:00
Adam C. Emerson
7df69486f4 rgw: Cache notify fault injection
Allow a configured probability of dropping a notify message on the
floor without processing or acking it.

Fixes: http://tracker.ceph.com/issues/24962

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2018-07-18 12:20:18 -04:00
Andrew Schoen
5b175a5bb6 ceph-volume: unmount lvs correctly before zapping
If the lv found does not include the meatadata to construct an osd path,
then we should try to unmount it's path instead.

Fixes: http://tracker.ceph.com/issues/24796

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-07-18 11:08:15 -05:00
Alfredo Deza
ffa86bc07d
Merge pull request #23075 from alfredodeza/wip-24492
ceph-volume batch command

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-07-18 12:04:11 -04:00
David Zafman
48ae3d0844
Merge pull request #23083 from dzafman/wip-disable-skip-dd
osd: Change osd_skip_data_digest default to false and make it LEVEL_DEV

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-07-18 11:23:07 -04:00
Boris Ranto
2e4c8896b8
Merge pull request #22732 from b-ranto/wip-metric-reset
prometheus: Fix metric resets

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-07-18 16:20:57 +02:00
Patrick Donnelly
f973f9cac5
Merge PR #23040 into master
* refs/pull/23040/head:
	ceph-debug-docker: install python3 cephfs/rados packages

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2018-07-18 06:43:13 -07:00
Patrick Donnelly
8620c4caf5
vstart_runner: pass ctx to FuseMount and load mount info
Credit to Venky for finding the problem.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-18 06:42:16 -07:00
Jason Dillaman
67c8b6e0d0
Merge pull request #23008 from tchaikov/wip-rbd-silence-gcc-warning
tools/rbd: assert(g_ceph_context) not g_conf

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-07-18 08:10:07 -04:00
Lenz Grimmer
2c783ebe8b
Merge pull request #22902 from alfonsomthd/24778-dashboard-info-cards-refactor
mgr/dashboard: Dashboard info cards refactoring

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kanika Murarka <kmurarka@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-07-18 12:33:19 +02:00
Kefu Chai
3817e30d68
Merge pull request #23108 from tchaikov/wip-install-deps-seastar
run-make-check: set WITH_SEASTAR with a non-empty string

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2018-07-18 11:53:07 +08:00
Kefu Chai
4ca636f9b6 install-deps: set DEBIAN_FRONTEND for apt-get
so it won't complain if the tty is not an interactive one.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-18 10:28:08 +08:00
Kefu Chai
45bca777aa run-make-check: set WITH_SEASTAR with a non-empty string
otherwise "test -n $WITH_SEASTAR" fails, and the dependencies won't be
installed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-07-18 10:25:21 +08:00
Patrick Donnelly
3e18ac7217
Merge PR #22966 into master
* refs/pull/22966/head:
	mds: clarify doc string for mds_beacon_grace

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-07-17 18:47:35 -07:00