Commit Graph

97260 Commits

Author SHA1 Message Date
Yuri Weinstein
ab8d671723 qa/tests: run luminous-x and mimic-x 2 times a week but with high priority
hope is it will help with locking 5 nodes for tests

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-04-11 09:36:26 -07:00
Kefu Chai
f3b4246f27
Merge pull request #27504 from tchaikov/wip-qa-use-python36-for-py3-tests
qa/tasks/ceph_deploy: install python3.6 instead of python3.4 for py3 tests

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
2019-04-11 23:16:58 +08:00
Sage Weil
8d5fb2fcd7 Merge PR #27323 into master
* refs/pull/27323/head:
	msg/async: avoid creating unnecessary AsyncConnectionRef

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-11 08:36:00 -05:00
Kefu Chai
d06407f015
Merge pull request #27444 from ifed01/wip-ifed-fix-21312
os/bluestore: call fault_range prior to looking for blob to reuse

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-04-11 21:33:36 +08:00
Kefu Chai
9d42f80300
Merge pull request #27445 from ifed01/wip-ifed-fix-39143
os/ceph-bluestore-tool: bluefs-bdev-expand asserts if no WAL

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-11 21:24:20 +08:00
Lenz Grimmer
2b6f306bcf
Merge pull request #27438 from Devp00l/wip-issue-37701
mgr/dashboard: Removes distracting search behavior

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-04-11 12:58:47 +02:00
Lenz Grimmer
ea92eb4660
Merge pull request #27348 from Devp00l/wip-issue-39086
mgr/dashboard: Enable read only users to read again

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-04-11 11:04:33 +02:00
Kefu Chai
42167b8790 qa/tasks/ceph_deploy: install python3.6 instead of python3.4 for py3 tests
EPEL7 has switched over to python3.6 as the main python3. and we started
packaging python bindings for python3.6 since
https://github.com/ceph/ceph-build/pull/1283

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-11 10:03:56 +08:00
Sage Weil
e29e2029c3 Merge PR #27495 into master
* refs/pull/27495/head:
	doc/releases/nautilus: fix config update step

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-10 17:41:49 -05:00
Sage Weil
b17adcf3e8 doc/releases/nautilus: fix config update step
'ceph ... > /etc/ceph/ceph.conf' fails because bash truncates ceph.conf
before the ceph cli invocation is able to use it to connect to the cluster.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-10 11:25:11 -05:00
Sebastian Wagner
ac904e0439
Merge pull request #27290 from sebastian-philipp/rook-system-namespace
mgr/rook: Support other system namespaces

Reviewed-by: Blaine Gardner <blaine.gardner@suse.com>
Reviewed-by: Rohan Gupta <rohanrgupta1996@gmail.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
2019-04-10 15:20:40 +02:00
Lenz Grimmer
28d8bceeff
Merge pull request #27408 from nathan-weinberg/reformat
mgr/dashboard: Updated existing E2E tests to match new format

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-04-10 14:56:08 +02:00
Sage Weil
e6297f8f87 Merge PR #27490 into master
* refs/pull/27490/head:
	PendingReleaseNotes: note on python3.6 changes

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-10 07:27:27 -05:00
Kefu Chai
77c5ee0631 PendingReleaseNotes: note on python3.6 changes
Fixes: http://tracker.ceph.com/issues/39164
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-10 18:11:00 +08:00
Ricardo Marques
933facec75
Merge pull request #27406 from rhcs-dashboard/fix-39125-master
mgr/dashboard: Add whitelist to guard

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-04-10 10:53:27 +01:00
Sebastian Wagner
15839da5ff
Merge pull request #27289 from sebastian-philipp/rook-fix-osd-create
mgr/rook: Fix creation of bluestore OSDs

Reviewed-by: Blaine Gardner <blaine.gardner@suse.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
2019-04-10 10:50:22 +02:00
Sage Weil
2f3a22e23c Merge PR #27464 into master
* refs/pull/27464/head:
	msg/async/frames_v2.h: fix warning

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-04-09 13:49:42 -05:00
Mykola Golub
decf508c77
Merge pull request #27357 from dillaman/wip-39021
librbd: fixed several race conditions related to copyup

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-04-09 20:34:16 +03:00
Casey Bodley
48070a387f
Merge pull request #27466 from wjwithagen/wjw-fix-/src/test/rgw/CMakeLists.txt
build/rgw: unittest_rgw_dmclock_scheduler does not need Boost_LIBRARIES

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-04-09 13:03:15 -04:00
Boris Ranto
0f6bb11250
Merge pull request #27468 from tchaikov/wip-rpm-python3
rpm: add "Provides: python3-*" for python packages and cleanup

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
2019-04-09 18:53:07 +02:00
Kefu Chai
8ae1947728 rpm: add "Provides: python3-*" for python packages
so user can install python3-rados, instead of python36-rados, without
specifying the minor version of python. also, we should not break our
teuthology tests with this naming scheme change. for instance, our
cephfs qa suite installs `python3-cephfs` for testing the `cephfs-shell`

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-10 00:21:02 +08:00
Casey Bodley
1f6167621e
Merge pull request #27309 from pritha-srivastava/wip-rgw-non-existent-object
rgw: Evaluating bucket policies also while reading permissions for an…

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-04-09 12:02:36 -04:00
Kefu Chai
11f0b8d5a8 rpm: always use 3 as the default python3_{pkgversion,version}
as we have the rpm macros installed in
https://github.com/ceph/ceph-build/pull/1283 .

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-09 23:15:18 +08:00
Willem Jan Withagen
d24aa4f36b build/rgw: unittest_rgw_dmclock_scheduler does not need Boost_LIBRARIES
Redo fix, also see #26799

Otherwise linking could error like:
```
/usr/local/bin/ld: /usr/local/lib/libboost_python27.so: undefined reference to `PyUnicodeUCS4_FromEncodedObject'
/usr/local/bin/ld: /usr/local/lib/libboost_python27.so: undefined reference to `PyNumber_InPlaceDivide'
........
/usr/local/bin/ld: /usr/local/lib/libboost_python27.so: undefined reference to `PyStaticMethod_Type'
/usr/local/bin/ld: /usr/local/lib/libboost_python27.so: undefined reference to `PyTuple_Size'
c++: error: linker command failed with exit code 1 (use -v to see invocation)
gmake[2]: *** [src/test/rgw/CMakeFiles/unittest_rgw_dmclock_scheduler.dir/build.make:147: bin/unittest_rgw_dmclock_scheduler] Error 1
```

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2019-04-09 16:49:34 +02:00
Sage Weil
f1cf408412 msg/async/frames_v2.h: fix warning
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-09 09:31:24 -05:00
Kefu Chai
2662ae8f3c
Merge pull request #27455 from wjwithagen/wjw-fix-test_weighted_shuffle.cc
test: Add `#include <array>`

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-09 22:29:55 +08:00
Sebastian Wagner
559b2e7402
Merge pull request #27431 from sebastian-philipp/rook-doc-update-mon
doc/mgr/orchestrator_cli: Rook orch supports mon update

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-04-09 16:19:53 +02:00
Casey Bodley
f2bb87b7ec
Merge pull request #25985 from l-vo/update_php_doc
doc/radosgw: update documentation examples with the current S3 PHP client

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-04-09 09:40:42 -04:00
Patrick Donnelly
11bf2d36ad
Merge PR #27051 into master
* refs/pull/27051/head:
	mds: open import bounding dirfrags in batch
	mds: remove superfluous error in StrayManager::advance_delayed()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-09 06:18:26 -07:00
Patrick Donnelly
c5e8c22ab6
Merge PR #27412 into master
* refs/pull/27412/head:
	doc: add doc for blacklisting older CephFS clients

Reviewed-by: Barbora Ančincová <bara@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-04-09 06:17:43 -07:00
Jason Dillaman
42ac6ac442
Merge pull request #27194 from trociny/wip-38661
librbd: do not allow to deep copy migrating image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-04-09 08:58:50 -04:00
Jason Dillaman
f42d3ffb31
Merge pull request #27268 from trociny/wip-38364
librbd: support EC data pool images sparsify

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-04-09 08:57:53 -04:00
Stephan Müller
35a75d0889 mgr/dashboard: Enable read only users to read again
The dashboards Prometheus receiver API needed to receive a POST from the
frontend, but POSTs aren't allowed by default by any read only
users. As a result the receiver API call had thrown a 403 error which
redirected the user to the 403 error page. Now you can get the last
notifications via GET. This prevents the redirection for read only
users, as a result they can get the last notifications and also
see all other allowed pages again.

Fixes: https://tracker.ceph.com/issues/39086
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-04-09 13:25:18 +02:00
Kefu Chai
2bde981fa9
Merge pull request #27452 from tchaikov/wip-crimson-auth-server
crimson: move dummy impl of AuthServer to DummyAuth

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-04-09 19:16:50 +08:00
Ernesto Puerta
c64b815386
mgr/dashboard: Add whitelist to guard
After PR https://github.com/ceph/ceph/pull/26572, when RGW is not
  configured, accessing /rgw drop-down (daemons, users or buckets)
  results in nothing apparently happening (not even an error).

  Under the curtains, what is happening is that the ModuleStatusGuard
  has redirected the route to the rgw/501, but as this route is now
  under parent rgw route handler, which sets CanActivateChild guards,
  this results in a new ModuleStatusGuard invokation, a subsequent
  failure and a new redirection to rgw/501.

  Several approaches could be taken here:
  - Remove error pages from lazy-loaded modules. Probably it does not
  make sense to have a 501 page per component.
  - Add some whitelist to avoid this kind of loop (e.g.: 501, or any
      error page).
  - Set a max number of redirections (cautionary measure).

Fixes: https://tracker.ceph.com/issues/39125
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-04-09 12:18:31 +02:00
Sebastian Wagner
2ed1dac040 mgr/rook: Support other system namespaces
Fixes http://tracker.ceph.com/issues/38799

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-04-09 11:28:01 +02:00
Willem Jan Withagen
3b5c7be852 test: Add includefile for arrays
Otherwise Clang will complain on FreeBSD:
```
/home/jenkins/workspace/ceph-master/src/test/test_weighted_shuffle.cc:9:23: error: implicit instantiation of undefined template 'std::__1::array<char, 5>'
  std::array<char, 5> choices{'a', 'b', 'c', 'd', 'e'};
                      ^
/usr/include/c++/v1/__tuple:223:64: note: template is declared here
template <class _Tp, size_t _Size> struct _LIBCPP_TEMPLATE_VIS array;
                                                               ^
/home/jenkins/workspace/ceph-master/src/test/test_weighted_shuffle.cc:10:22: error: implicit instantiation of undefined template 'std::__1::array<int, 5>'
  std::array<int, 5> weights{100, 50, 25, 10, 1};
                     ^
/usr/include/c++/v1/__tuple:223:64: note: template is declared here
template <class _Tp, size_t _Size> struct _LIBCPP_TEMPLATE_VIS array;
```

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2019-04-09 11:24:49 +02:00
Kefu Chai
4f9e1e2499 crimson/mon: implement AuthServer methods
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-09 14:36:45 +08:00
Kefu Chai
abb374aec4 crimson/auth: move dummy impl of AuthServer to DummyAuth
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-09 14:35:24 +08:00
Kefu Chai
7cbbe9acea
Merge pull request #27416 from tchaikov/wip-crimson-auth
crimson: update osd when peer gets authenticated

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-04-09 11:39:28 +08:00
Kefu Chai
e2f2a7f606 crimson: update osd when peer gets authenticated
* common/auth_handler.h: add an abstract class of AuthHandler, the one who is interested in
  an authenticated peer should implement this class
* mon/MonClient: let mon::Client implement AuthServer, as it has access the keyring. it
  will update the registered AuthHandler if the client (peer) is
  authenticated.
* osd: implement AuthHandler class. we will keep track of the connected
  sessions along their caps in a follow-up change.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-09 11:38:04 +08:00
Kefu Chai
a866d16095
Merge pull request #27426 from tchaikov/wip-crimson-setup-msgr
crimson/osd: consolidate the code to initialize msgrs

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-04-09 11:31:19 +08:00
Kefu Chai
6ca92572da
Merge pull request #27286 from tchaikov/wip-strncpy-with-nul
osdc/Objecter: always add `\0' after strncpy()

Reviewed-by: David Zafman <dzafman@redhat.com>
2019-04-09 11:30:05 +08:00
Kefu Chai
539b8b40e1
Merge pull request #27429 from cyx1231st/wip-seastar-msgr-perf2
test/crimson: include writes in perf_crimson/async_server

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-09 11:27:52 +08:00
Yingxin Cheng
e289ec8521 test/crimson: wrap perf parameters as structured data
Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
2019-04-09 16:37:40 +08:00
Yingxin Cheng
478e9e8395 test/crimson: perf_crimson/async_server write test support
Allow server to have write/send workload with specified block size.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
2019-04-09 16:06:39 +08:00
Xie Xingguo
a0e1519f31
Merge pull request #27422 from iotcg/doc_pg
doc: fix parameter to set pg autoscale mode

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-09 08:58:41 +08:00
Patrick Donnelly
56c52e6894
Merge PR #27427 into master
* refs/pull/27427/head:
	cephfs-shell: Use colorama module instead of colorize

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-08 17:09:45 -07:00
Patrick Donnelly
07a557411d
Merge PR #27369 into master
* refs/pull/27369/head:
	docs: Add note to execute cephfs-shell

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-08 16:16:06 -07:00
Patrick Donnelly
40c06914de
Merge PR #27256 into master
* refs/pull/27256/head:
	mds: drop reconnect message from non-existent session

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-04-08 16:13:00 -07:00