Commit Graph

101780 Commits

Author SHA1 Message Date
Yuval Lifshitz
923799fd96 rgw/pubsub: support deletion markers and multipart upload
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-09-10 18:54:05 +03:00
Yuval Lifshitz
c345566831 rgw/pubsub: push notifications documentation
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-09-10 18:54:05 +03:00
Yuval Lifshitz
dc31b030ea rgw/pubsub: push notifications from ops
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-09-10 18:54:05 +03:00
Yuval Lifshitz
a14353496d rgw/pubsub: allow pubsub REST API on master
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-09-10 18:54:05 +03:00
Kefu Chai
f7cef51a27
Merge pull request #30287 from tchaikov/wip-run-cbt
script/run-cbt.sh: check option correctly

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-09-10 23:47:51 +08:00
Kefu Chai
df9094682c
Merge pull request #30290 from tchaikov/wip-doc-cbt
doc/dev/crimson.rst: document CBT testing

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-09-10 23:47:04 +08:00
Kefu Chai
614c811d0e
Merge pull request #30289 from wjwithagen/wjw-fix-pylint-dashboard-progress.py
dashboard/services: fix lint error

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-10 22:53:21 +08:00
Willem Jan Withagen
f56a8eb689 dashboard/services: fix lint error
```
lint run-test: commands[0] | flake8
 many blank lines (3)
1     E303 too many blank lines (3)
```

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2019-09-10 22:47:56 +08:00
Sage Weil
eec51eb756 Merge PR #30155 into master
* refs/pull/30155/head:
	mgr/MgrClient: send MMgrCommand for octopus+ mgrs
	mon/MgrMap: include mgr_features in mgrmap
	mgr: accept MMgrCommand[Reply] messages (in addition to MCommand[Reply])

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-09-10 07:14:27 -05:00
Kefu Chai
a07e7c356b
Merge pull request #30162 from cyx1231st/wip-seastar-msgr-test-failover-crimson
crimson/test: v2 failover tests with crimson FailoverTestPeer

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-10 19:37:59 +08:00
Kefu Chai
fb24938e33 doc/dev/crimson.rst: document CBT testing
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-10 19:30:54 +08:00
Kefu Chai
ba9ab22acc script/run-cbt.sh: check option correctly
* s/source_dir/source-dir/: as the option is named "--source-dir", not
  "--source_dir"
* cd $build_dir, before launching/stopping vstart. as vstart.sh is
  supposed to run from the build directory

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-10 18:29:20 +08:00
Lenz Grimmer
45b017f8cd
Merge pull request #30111 from tspmelo/wip-nfs-read
mgr/dashboard: Set RO as the default access_type for RGW NFS exports

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-09-10 09:00:56 +00:00
Lenz Grimmer
708d78370d
mgr/dashboard: progress: support rbd_support module async tasks (#29424)
mgr/dashboard: progress: support rbd_support module async tasks

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-09-10 08:53:14 +00:00
Kefu Chai
00bb401eeb
Merge pull request #30095 from rjfd/wip-fix-progress-qa
qa/mgr/progress: fix timeout error when waiting for osd in event

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-09-10 16:40:09 +08:00
Kefu Chai
686cee8833
Merge pull request #30078 from rhcs-dashboard/fix-41602-master
mgr/dashboard: disable pylint's --py3k flag

Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
2019-09-10 16:33:31 +08:00
Kefu Chai
4d72fba539
Merge pull request #30126 from dvanders/dvanders_spec
ceph.spec.in: reserve more memory per build job

Reviewed-By: Nathan Cutler <nculter@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-10 16:30:09 +08:00
Kefu Chai
8dfb9dbae4
Merge pull request #30258 from tchaikov/wip-41721
test/cls_rbd/test_cls_rbd: update TestClsRbd.sparsify

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-09-10 16:27:13 +08:00
Nathan Cutler
0589dbb1ca
Merge pull request #30273 from neha-ojha/wip-documenting-ceph
doc/start/documenting-ceph.rst: make better doc recommendations

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-09-10 00:52:00 +02:00
Neha Ojha
07aef79693 doc/start/documenting-ceph.rst: make better doc recommendations
I do not think "Editors" is relevant anymore.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-09-09 15:40:45 -07:00
Patrick Donnelly
e1e962d28a
Merge PR #30187 into master
* refs/pull/30187/head:
	script/backport-resolve-issue: better error message

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-09-09 11:33:40 -07:00
Neha Ojha
009057e154
Merge pull request #30226 from neha-ojha/wip-41385-2
osd/MissingLoc.cc: do not rely on missing_loc_sources only

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed By: Xie Xingguo <xie.xingguo@zte.com.cn>
2019-09-09 09:48:45 -07:00
Sage Weil
c3d21f119a Merge PR #30196 into master
* refs/pull/30196/head:
	qa/tasks/ceph: restart: stop osd, mark down, then start

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-09-09 11:19:32 -05:00
Casey Bodley
781c7e71b7
Merge pull request #30268 from cbodley/wip-41719
cls/rgw: fix bilog trim tests in ceph_test_cls_rgw

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-09-09 12:18:39 -04:00
Sage Weil
9b082434af Merge PR #30220 into master
* refs/pull/30220/head:
	test: Allow fractional milliseconds to make test possible

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-09 11:09:04 -05:00
Casey Bodley
faf9cb384d cls/rgw: fix bilog trim tests in ceph_test_cls_rgw
the bucket index prepare step no longer writes a bilog entry, so the
tests were expecting more entries

Fixes: https://tracker.ceph.com/issues/41719

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-09-09 10:14:51 -04:00
Kefu Chai
583b09f30a
Merge pull request #29127 from bk201/wip-40337
mgr/dashboard: orchestrator integration initial works

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-09-09 22:01:58 +08:00
Kefu Chai
855d84d283 test/cls_rbd/test_cls_rbd: update TestClsRbd.sparsify
after #30061, extents returned by sparse read will always be
an empty map as long as the extents to be read is empty or the extent(s)
in it are empty, even of the objectstorage does not support sparse read.

Fixes: https://tracker.ceph.com/issues/41721
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-09 21:44:53 +08:00
Alfredo Deza
68f061401d
Merge pull request #30115 from alfredodeza/wip-rm41378-2
ceph-volume: pre-install python-apt and its variants before test runs

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2019-09-09 09:32:03 -04:00
Kefu Chai
670a9a564f
Merge pull request #30142 from votdev/issue_41648
mgr/dashboard: Handle always-on Ceph Manager modules correctly

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-09 20:32:30 +08:00
Kefu Chai
e584866216
Merge pull request #30079 from uweigand/issue-41605-fixes
Fix big-endian handling

Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-09 20:29:39 +08:00
Kefu Chai
8b88ab0f2c
Merge pull request #30087 from egggHang/ec_benchmark
test/erasure-code: add exception handling to k & m

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-09 20:24:20 +08:00
Kefu Chai
72bd45ae65
Merge pull request #29892 from Yan-waller/wip-yanj-fixreed_sol_r6_op
osd: fix the missing default value m=2 of reed_sol_r6_op in profile

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-09 20:22:08 +08:00
Kefu Chai
45392a202b
Merge pull request #30125 from majianpeng/msg-protocolv1-reduece-swap
msg/async/ProtocolV1: avoid unnecessary bufferlist::swap.

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-09 20:11:46 +08:00
Yan Jun
aed94cf203 PendingReleaseNotes: note about changes in ceph osd erasure-code-profile set
Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
2019-09-09 20:02:08 +08:00
Yan Jun
1032b981da osd: add sanity check for invalid m/w of liber8tion
Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
2019-09-09 20:00:20 +08:00
Yan Jun
87c20c39b2 ec/jerasure: save the default m=2 of reed_sol_r6_op in profile
save the default value of m to profile so that it could be dumped
in command 'ceph osd erasure-code-profile get xxx', which is more
useful and friendly to user.

Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
2019-09-09 20:00:20 +08:00
Kefu Chai
a8c710ef19
Merge pull request #30109 from rzarzynski/wip-bug-25098-bluefs_layout_t
os/bluestore: verify disk layout of BlueFS

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-09 19:53:53 +08:00
Kefu Chai
3c0400e518
Merge pull request #30197 from bk201/wip-41675
mgr/orchestrator: fix refs property of progresses

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-09-09 19:19:44 +08:00
Volker Theile
8ac6559637 mgr/dashboard: Handle always-on Ceph Manager modules correctly
Currently always-on modules are not marked as enabled in the WebUI and can be disabled. This PR will fix that.
Note, this PR will NOT implement code that will prevent a developer from trying to disable an always-on module through the REST API. The Mgr Python extension will throw an adequate exception.

This PR will also do:
* Remove old code fragments from a previous Mgr Module management UI that is obsolete now.
* Cleanup code in BaseMgrModule code.

Fixes: https://tracker.ceph.com/issues/41648

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-09-09 11:12:55 +02:00
Kefu Chai
9e7ecf708a
Merge pull request #30199 from IlsooByun/cmake_ptyhon_var
build/ops: fix build fail related to PYTHON_EXECUTABLE variable

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-09 00:02:20 +08:00
Sage Weil
cdb8df13cb Merge PR #29986 into master
* refs/pull/29986/head:
	mgr/pg_autoscaler: use 'stored' for pool_logical_used

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-07 15:09:25 -05:00
Sage Weil
8d94dc7f0f Merge PR #30139 into master
* refs/pull/30139/head:
	mgr/DaemonServer: skip adjusting pgp_num when merging is in-progress

Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-07 15:08:57 -05:00
Xie Xingguo
8c99f815f3
Merge pull request #30061 from xiexingguo/wip-sparse-read
os, osd: readv

Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-07 10:34:09 +08:00
Xie Xingguo
8971bc7ba9
Merge pull request #30059 from xiexingguo/wip-clean-vs-repair
osd/PG: fix _finish_recovery vs repair race

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-09-07 10:31:28 +08:00
Kefu Chai
dd9c4e0b2a
Merge pull request #30190 from tchaikov/wip-python-rpm-macro
install-deps.sh: install `python*-devel` for python*rpm-macros

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-09-07 08:57:11 +08:00
Neha Ojha
5906a57320 osd/MissingLoc.cc: do not rely on missing_loc_sources only
In 624ade487e, we relied on missing_loc_sources
to check for strays and remove an OSD from missing_loc. However, it is
possible that missing_loc_sources is empty while there are still OSDs
present in missing_loc. Since the aim is to just remove a stray OSD from
missing_loc, we do not need to rely on missing_loc_sources. We still
clean missing_loc_sources if any stray is present in it.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-09-06 15:49:36 -07:00
David Zafman
6d2e4cb109 test: Allow fractional milliseconds to make test possible
Fixes: https://tracker.ceph.com/issues/41689

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-09-06 11:23:52 -07:00
Kefu Chai
0b2be2b671 install-deps.sh: install python*-devel for python*rpm-macros
in 087ea813, we installed '*rpm-macros' for the macros, so we can have
access to the latest python packaging related macros for preparing the
build dependencies.

but we could run into https://bugs.centos.org/view.php?id=16379, if
we already have an old version of python-devel installed. as the newer
version of python-rpm-macros conflicts with it.

it was a chicken-and-egg problem, as we don't know the exact name of
*rpm-macros packages. that's why we chose to install all of them. but
we have to upgrade the existing python-devel package to resolve the
conflict. but the since there is no python3-devel in RHEL7/CentOS7,
what they have is python36-devel. so we have to hardwire the
`%{python3_pkgversion}` to "36" even before we have access to this
macro, and upgrade the python36-devel package beforehand. but this
renders installing the rpm-macro package less useful -- we intend to
use the macro offered by the package to figure out "36".

as a workaround, we pretend that we know the "main" version of python3
in current RHEL/CentOS. and always install python36-devel for
python-rpm-macros. as the former requires the latter.

once all python3*-devel on all builders are upgraded, we will be safe
to install '*rpm-macros' again without installing python36-devel first.
by then, we could revert this change, or continue installing
python36-devel until the distro bumps up the "main" python version to 3.7

Fixes: https://tracker.ceph.com/issues/41603
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-07 02:15:00 +08:00
Kefu Chai
89f5b8a01a
Merge pull request #22574 from aclamk/bs-allocator-ageing-test
bluestore/allocator: Ageing test for bluestore allocators.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-07 01:53:07 +08:00