Commit Graph

87537 Commits

Author SHA1 Message Date
Sage Weil
aea215103c os/bluestore: make bad symlink target error messages more informative
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-08 08:35:14 -05:00
Kefu Chai
89ed08569b
Merge pull request #22439 from shaba/devel/fix-rocksdb
cmake: fix find system rockdb

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-08 21:22:45 +08:00
Kefu Chai
0259e9af38 debian: drop '-DUSE_CRYPTOPP=OFF' from cmake options
cryptopp dependency was dropped in a18f0589

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-08 21:18:25 +08:00
Kefu Chai
ebffb3e23f test: add test for seastar denc
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-08 20:58:15 +08:00
Kefu Chai
65d72a4e48 denc: genenalize denc interface for seastar::temporary_buffer
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-08 20:58:15 +08:00
Kefu Chai
c16eb098d5 denc: specialize for denc(const T&, size_t&, uint64_t)
otherwise GCC complains that 'unsigned long int' is not a class or
namespace when trying to materialize is_const_iterator_v<>. not sure why
SFINAE does not work here, though.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-08 20:58:15 +08:00
Casey Bodley
d064aeaede test: add unit test for seastar buffer
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-06-08 20:58:15 +08:00
Casey Bodley
f0bd4cf06e buffer: add conversion operators for seastar types
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-06-08 20:58:15 +08:00
Casey Bodley
669b4c446b buffer: add raw type for seastar buffers
new buffer_seastar.cc implements the buffer::raw types for seastar,
built in an object library outside of libcommon

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-06-08 20:58:15 +08:00
Casey Bodley
13cba39868 buffer: move buffer::raw to new header
this allows new raw buffer types to live outside of buffer.cc, and
potentially outside of libcommon entirely

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-06-08 20:58:15 +08:00
Kefu Chai
8aac132dc4 cmake: update for accomodate seastar
* add unit_test_framework for appease seastar's find_package() call,
  even we don't build seastar's tests
* some seastar functions declare their return value like:
  const size_t str_len(...). and GCC does not like the "const" in it.
  so silence it

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-08 20:58:15 +08:00
Casey Bodley
37de3cad4d cmake: add WITH_SEASTAR option
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-06-08 20:58:15 +08:00
Kefu Chai
7c2107cbc2 seastar: add seastar as a submodule
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-08 20:58:15 +08:00
Kefu Chai
e61c186baa
Merge pull request #22430 from tchaikov/wip-find_package-oath
cmake: find liboath using the correct name

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Erwan Velu <erwan@redhat.com>
2018-06-08 20:50:28 +08:00
Stephan Müller
7253b97d42 mgr/dashboard: Resolve TestBed performance issue
With this helper function you can easily resolve the TestBed resetting
performance issue. If more tests exists in a test suite, it makes sense
to configure TestBed only once if you are not doing a lot of TestBed
specific stuff (haven't hit the limitation). It will reduce the test
run time by around $tests * 50 %. In my case it was a test suite with
47 tests with a run time of over 30s after using the static test bed
method it ran in 1.2s. The run time was reduced to 0.04 %! This is
equivalent to a speed increase of 2500% (100/0.04)!

For our own security the normal way will be taken if you not
set the _DEV_ configuration variable to true. It will be false when
"run-frontend-unittests.sh" is run.

Signed-off-by: Stephan Müller <smueller@suse.com>
2018-06-08 14:50:25 +02:00
Mykola Golub
9e5b87c193 librbd: deep_copy: resize head object map if needed
Fixes: http://tracker.ceph.com/issues/24399
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-06-08 13:10:11 +03:00
Lenz Grimmer
be651ca759
Merge pull request #22453 from tspmelo/fix-pool-usage
mgr/dashboard: Fix pool usage not displaying on filesystem page

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-08 11:46:42 +02:00
Mykola Golub
2aa43e8f11
Merge pull request #22443 from dillaman/wip-doc-rbd-openstack
doc/rbd: corrected OpenStack Cinder permissions for Glance pool

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-06-08 09:11:02 +03:00
Sage Weil
18159851f4 Merge PR #22447 into master
* refs/pull/22447/head:
	osd/OSDMap: fix pre-addrvec compat
	mon/MgrMap: fix pre-addrvec compat
	messages/MMgrBeacon: fix pre-addrvec compat

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-07 17:25:48 -05:00
Sage Weil
4e14a380be osd/PG: normalize query processing in Stray and ReplicaActive
A stray PG may end up in ReplicaActive if it is participating in backfill.
However, whether it is or isn't, we should treat queries the same.
Otherwise we end up with weird behaviors like:

 - osd's stray pg moves to ReplicaActive (gets info+log from primary)
 - osd goes down and back up
 - primary restarts peering, request FULLLOG to find missing objects
 - osd ignores FULLLOG because it is ReplicaActive and not Stray

Fixes: http://tracker.ceph.com/issues/24373
Reported-by: Kouya Shimura <kouya@jp.fujitsu.com>
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-07 14:20:56 -05:00
Sage Weil
856fd02433 osd/PG: move send_notify() into RecoveryCtx
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-07 14:20:55 -05:00
Sage Weil
8d3b4ca591 osd/PG: reset PG peering if osd transitions from down -> up
Consider a PG that is stray and ends up in ReplicaActive (because it is
participating as a recovery source).  If it is marked down wrongly and
then comes back up, then the PG will not reset, because there was not
an interval change (the PG is not part of the up or acting sets).
This can leave the PG in an odd state, leading to questionable behavior.
(For example, a stray might be in ReplicaActive and then ignore some
types of query messages.)

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-07 14:20:55 -05:00
Sage Weil
4d513a0183 ceph-dencoder: add bluefs types
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-07 13:46:29 -05:00
Sage Weil
ef510e43f0 os/bluestore: don't store/use path_block.{db,wal} from meta
This reverts most of 8d07fa5ad0.

ceph-volume goes to great lengths to ensure that the symlinks in the
osd dir are accurate.  Having these values here is an opportunity to
get them out of sync.  And that can happen very easily if the initial
mkfs was performed using a /dev/sdX device name (which is unstable
across reboots).  Even after ceph-volume corrects the symlink, bluestore
will continue to use the stale device path.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-07 12:12:46 -05:00
Sage Weil
697d98dafc qa/suites/rados/upgrade: remove stray link
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-07 11:25:55 -05:00
Lenz Grimmer
5b1a58a6f6
Merge pull request #22403 from ricardoasmarques/wip-http-401
mgr/dashboard: Login failure should return HTTP 400

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-07 17:09:33 +02:00
Andrew Schoen
7b642cdc62
Merge pull request #22437 from alfredodeza/wip-cv-osd-destroy
ceph-volume tests destroy osds on monitor hosts

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-06-07 14:47:21 +00:00
Patrick Donnelly
84860eff46
Merge PR #22445 into master
* refs/pull/22445/head:
	doc: fix release notes on snapshot upgrades

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-06-07 06:06:56 -07:00
Alexey Shabalin
2ac26bd0e0 cmake: fix find system rockdb
- fix path for version.h
- fix typo ROCKDB -> ROCKSDB

Signed-off-by: Alexey Shabalin <shaba@altlinux.org>
2018-06-07 14:19:41 +03:00
Tiago Melo
22669872f1 mgr/dashboard: Fix pool usage not displaying on filesystem page
Reference to the template was undefined during the init of the component.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-06-07 12:04:31 +01:00
Kefu Chai
bfbbb0fb60
Merge pull request #22451 from wwformat/wip-gcc7-aarch64
install-deps.sh: support install gcc7 in xenial aarch64

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-07 17:39:48 +08:00
Yunchuan Wen
f92f256f45 install-deps.sh: support install gcc7 in xenial aarch64
Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2018-06-07 15:51:31 +08:00
Zhi Zhang
2516627376 common/DecayCounter: set last_decay to current time when decoding decay counter
The last_decay in the msg might be 0 (utime_t()), so the eclipse time is very
large and the original value would be decayed to 0. We should set last_decay
to current time when decoding decay counter.

Fixes: http://tracker.ceph.com/issues/24440

Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>
2018-06-07 14:18:15 +08:00
Sage Weil
f99c2a9fec osd/OSDMap: fix pre-addrvec compat
This was broken by b47d9135d5.  Old code
does not decode an addrvec as an addr.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-06 20:07:27 -05:00
Sage Weil
7e321d2d48 mon/MgrMap: fix pre-addrvec compat
This was broken by 7f787704cd.  Old code
does not decode an addrvec as an addr.

Take the opportunity to remove the old_available_modules field.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-06 20:06:23 -05:00
Sage Weil
90513f1bd1 messages/MMgrBeacon: fix pre-addrvec compat
This was broken by 7f787704cd.  Old code
doesn't not decode an addrvec as an addr.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-06 20:05:17 -05:00
Patrick Donnelly
95723e7d19
Merge PR #22388 into master
* refs/pull/22388/head:
	ceph-mds: Fix usage
	doc: ceph-mds option updates

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-06 15:31:12 -07:00
Patrick Donnelly
2f7918488b
Merge PR #22338 into master
* refs/pull/22338/head:
	doc: update toctree for add-remove-mds.rst
	doc: create add/remove metadata server

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-06 15:27:19 -07:00
Patrick Donnelly
c1ed37c825
doc: fix release notes on snapshot upgrades
Fixes: https://tracker.ceph.com/issues/24435
Introduced-by: d78dda7b81.
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-06 14:22:03 -07:00
Mykola Golub
f087db5709 librbd: force 'invalid object map' flag on-disk update
when called by object_map::RefreshRequest. Since we really only open
the object map when we own the exclusive lock.

Fixes: http://tracker.ceph.com/issues/24434
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-06-06 23:48:07 +03:00
Alfredo Deza
953c7ef549 ceph-volume tests functional osd destroy on mons only for dmcrypt
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-06-06 15:30:11 -04:00
Jason Dillaman
f692fd3581 doc/rbd: corrected OpenStack Cinder permissions for Glance pool
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-06-06 14:50:24 -04:00
Lenz Grimmer
43e7032418
Merge pull request #22282 from rjfd/wip-dashboard-api-docs
mgr/dashboard: Swagger-UI based Dashboard REST API page

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-06 19:28:46 +02:00
Lenz Grimmer
032360d866
Merge pull request #22387 from votdev/missing_space_value_unit
mgr/dashboard: Print a blank space between value and unit

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-06-06 19:20:44 +02:00
Alfredo Deza
41277c65b4 ceph-volume tests/functional destroy filestore osds on the monitors
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-06-06 12:40:49 -04:00
Ricardo Dias
0d2c7a1b63
mgr/dashboard: Swagger-UI based Dashboard REST API page
Fixes: http://tracker.ceph.com/issues/23898

Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-06 16:53:13 +01:00
Kefu Chai
ca238f77d7
Merge pull request #21279 from sungjunyoung/master
doc: erasure-code-jerasure: removed default section of crush-device-class

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-06 22:55:44 +08:00
Kefu Chai
ca78ab2254 cmake: find liboath using the correct name
we should reference liboath by the $name in Find${name}.cmake, also the
$name should be consistent when calling find_package_handle_standard_args().
in this change
* rename Findliboath.cmake to FindOATH.cmake to be consistent with other
  find_package() moduless.
* use "OATH" in find_package_handle_standard_args() instead of "oath"
* set the interface properties for OATH::OATH, so the target linking
  against it can reference its header directories and libraries automatically.
* remove the stale comment for find_package_handle_standard_args()
* set OATH_INCLUDE_DIRS and OATH_LIBRARIES to follow the convention of
  find_package(), even they are not used directly in this project.

Reported-by: Erwan Velu <erwan@redhat.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-06 22:49:35 +08:00
Alfredo Deza
b665e1caa7 ceph-volume tests/functional destroy bluestore osds on the monitors
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-06-06 08:59:34 -04:00
Volker Theile
bc44383672 mgr/dashboard: Print a blank space between value and unit.
When displaying values with their unit a blank space must be shown between them, see #15 at https://physics.nist.gov/cuu/Units/checklist.html.

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-06-06 13:10:34 +02:00