Commit Graph

87623 Commits

Author SHA1 Message Date
Alfredo Deza
6c8c855d17
Merge pull request #22604 from alfredodeza/wip-bluestore-config-ref
doc/bluestore: data doesn't use two partitions (ceph-disk era)

Reviewed-by: Sage Weil sage@redhat.com
2018-06-19 09:03:42 -04:00
Sage Weil
daf14eda35 Merge PR #22595 into master
* refs/pull/22595/head:
	common/options: dump flags

Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-06-19 07:38:03 -05:00
Sage Weil
0f38951ea3 Merge PR #22582 into master
* refs/pull/22582/head:
	mon: destroy-new -> purge-new
	mon/OSDMonitor: fix NEW flag adjustment in destroy[-new]

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-06-19 07:37:39 -05:00
Sage Weil
38bb4d1d3b Merge PR #22602 into master
* refs/pull/22602/head:
	doc/releases/mimic: note lack of debian builds for mimic

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2018-06-19 07:21:26 -05:00
Sage Weil
4994f38774 githubmap: update contributors
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-19 07:21:25 -05:00
Sage Weil
47ce9db56d Merge PR #22489 into master
* refs/pull/22489/head:
	ceph-volume lvm.common use destroy-new, doesn't need admin keyring

Reviewed-by: Sage Weil <sage@redhat.com>
2018-06-19 07:18:52 -05:00
Sage Weil
3cd7d5eb22 Merge PR #22343 into master
* refs/pull/22343/head:
	qa/standalone remove ceph-disk from activate_osd helper
	cmake: remove subman.sh tests
	test remove ceph-disk directory
	debian: remove ceph_detect_init python files from base
	qa/standalone remove virtualenv paths for ceph-disk and ceph-detect-init
	debian: remove ceph-disk ceph-detect-init python files
	rpm: remove ceph-disk ceph-detect-init python files
	alpine: remove ceph-disk ceph-detect-init python files
	alpine: remove ceph-osd and parttypeuuid udev rules
	debian: remove ceph-osd and parttypeuuid udev rules
	rpm: remove ceph-osd and parttypeuuid udev rules
	ceph-helpers.sh: remove ceph-disk, set up osds directly
	CMakeLists.txt: add back CEPH_BUILD_VIRTUALENV
	alpine: remove ceph-disk, add ceph-volume in APKBUILD.in
	upstart: remove ceph-disk activation call
	doc/install add anchor for manual osd deployment in freebsd guide
	doc/dev remove ceph-disk from freebsd guide, link to manual reference
	doc/dev/config-key remove ceph-disk references
	doc/dev remove ceph-disk.rst
	doc/dev: change ceph-disk suite examples for ceph-deploy
	doc/man_index: remove ceph-disk, ceph-detect-init refs
	doc/install: remove ceph-disk from freebsd examples
	doc/rados remove ceph-disk from man references
	doc/man remove ceph-disk ref from ceph-volume-systemd
	doc/man: update reference from ceph-disk to ceph-volume
	doc/man: remove ceph-disk, ceph-detect-init from cmake
	doc/man/ceph-volume remove doc reference to ceph-disk
	doc/man: remove ceph-disk, ceph-detect-init
	qa/suites: remove ceph-disk
	qa/run-standalone.sh: remove requirement for ceph-detect-init virtualenv
	qa/workunits: remove ceph-detect-init from rbdmapfile test
	qa/workunits: remove ceph-detect-init from ceph-helpers-root.sh
	qa/workunits: remove ceph-disk
	build: remove ceph-disk from freebsd script
	cmake: remove ceph-disk, ceph-detect-init tox tests
	init-ceph: remove ceph-disk
	cmake: remove top-level entries for ceph-disk, ceph-detect-init
	debian: remove ceph-detect-init references
	debian: remove ceph-disk references
	src: remove ceph-detect-init tool
	rpm: remove ceph-disk, ceph-detect-init from spec file
	test: remove subman script
	script: remove subman script
	udev: remove parttypeuuid rules for ceph-disk
	tool remove ceph-disk from ps-ceph.pl
	upstart: remove ceph-disk conf file
	systemd: remove ceph-disk from CMakeLists
	systemd: remove ceph-disk service
	udev: remove ceph-disk rules
	src: remove ceph-disk tool
2018-06-19 07:07:55 -05:00
John Spray
8e99e58ae5
Merge pull request #22622 from jcsp/wip-doc-mgr
doc/mgr: note need for module.py file in plugins

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2018-06-19 12:43:18 +01:00
Lenz Grimmer
43bc677c5b
Merge pull request #22600 from votdev/issue_24525_improvements
mgr/dashboard: Fix more layout issues in UI

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-06-19 12:37:20 +02:00
John Spray
c731f2a170 doc/mgr: note need for module.py file in plugins
This is kind of a kludgy thing but let's at least
document it!

Signed-off-by: John Spray <john.spray@redhat.com>
2018-06-19 10:19:06 +01:00
Volker Theile
9f44dc387a mgr/dashboard: Fix layout issues in UI
Improve the CSS3 selectors and use the margin-left values from 'btn-toolbar' Bootstrap.

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-06-19 10:20:40 +02:00
David Zafman
33c773a810
Merge pull request #22480 from dzafman/wip-standalone
Fixes for standalone tests

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-18 18:15:18 -04:00
David Zafman
ea75e03d22 test: run-standalone move aside cores found before testing starts
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-06-18 14:10:10 -07:00
David Zafman
fe09fc5e9d test: Fail immediately if some operations fail
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-06-18 14:09:14 -07:00
David Zafman
33538aca35 test: Fix standalone main usage
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-06-18 14:09:14 -07:00
David Zafman
f886ebba08 test: Fix some function desciptions
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-06-18 14:09:14 -07:00
David Zafman
39fc43556f test: Put files in private test directory
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-06-18 14:08:23 -07:00
Sage Weil
e5e4af662c doc/releases/mimic: note lack of debian builds for mimic
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-18 15:07:40 -05:00
Alfredo Deza
fda9b6cf0d doc/bluestore: data doesn't use two partitions (ceph-disk era)
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-06-18 15:21:50 -04:00
Lenz Grimmer
2d22939480
Merge pull request #22597 from votdev/bug_24525
mgr/dashboard: Fix layout issues in UI

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-06-18 17:22:01 +02:00
Lenz Grimmer
ae4f4d315a
Merge pull request #22416 from votdev/get_rgw_api_user_via_rest
mgr/dashboard: Get user ID via RGW Admin Ops API

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-06-18 17:17:33 +02:00
Alfredo Deza
57fb124ce7 ceph-volume lvm.common use destroy-new, doesn't need admin keyring
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-06-18 08:37:23 -04:00
Sage Weil
6c4d76ca0c common/options: dump flags
Also document.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-18 07:01:24 -05:00
Volker Theile
080fc030f5 mgr/dashboard: Add missing blanks to fix layout issue of various texts.
This behaviour starts to occur after switching to Angular 6.

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-06-18 13:55:39 +02:00
Lenz Grimmer
3d34add1e2
Merge pull request #22473 from Devp00l/wip-static-testbed-changes
mgr/dashboard: Removed unnecessary fake services from unit tests

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-06-18 10:48:41 +02:00
John Spray
badaa66133
Merge pull request #21850 from jan--f/add-monitoring-grafana-dash
add monitoring subdir and Grafana cluster dashboard

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2018-06-18 09:01:41 +01:00
Kefu Chai
851498450d
Merge pull request #22521 from tchaikov/wip-cmake-seastar-cleanup
cmake: only build extra boost libraries only if WITH_SEASTAR

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2018-06-17 13:07:47 +08:00
Sage Weil
dce659ca2a Merge PR #22583 into master
* refs/pull/22583/head:
	test/objectstore/CMakefiles: fix unittest_alloc_bench build

Reviewed-by: Mark Nelson <mnelson@redhat.com>
2018-06-15 15:29:23 -05:00
Casey Bodley
6db5bf58d1
Merge pull request #21494 from theanalyst/rgw-reorder-auth
rgw: have a configurable authentication order

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-15 15:54:34 -04:00
Sage Weil
3efd4f7209 test/objectstore/CMakefiles: fix unittest_alloc_bench build
Broken by 434589a320.  The add_ceph_unittest
helper does more than just add this to the list of tests--it also adjusts
linking and build options.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-15 14:22:01 -05:00
Sage Weil
761f68dc0d mon: destroy-new -> purge-new
What we actually want is a purge, not a destroy.  Destroy leaves the OSD
ID in used and allows it to be recreated.  What ceph-volume wants is to
purge all trace of the failed OSD setup.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-15 14:11:01 -05:00
Sage Weil
13393f6108 mon/OSDMonitor: fix NEW flag adjustment in destroy[-new]
Only set the NEW flag if it isn't already set.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-15 13:51:03 -05:00
Kefu Chai
9551fc8585
Merge pull request #22577 from ErwanAliasr1/evelu-parallel
src/test: Using gtest-parallel to speedup unittests

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-16 00:15:30 +08:00
Lenz Grimmer
93e7717cfe
Merge pull request #21998 from p-na/osd-flags-wip
mgr/dashboard: Add ability to list,set and unset cluster-wide OSD flags to the backend

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-15 16:49:51 +02:00
Patrick Donnelly
c2311e1aeb
Merge PR #22340 into master
* refs/pull/22340/head:
	doc: update description of mount options for cephfs

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-06-15 07:31:34 -07:00
Volker Theile
ed0750699e mgr/dashboard: Get user ID via RGW Admin Ops API.
The RGW API user id (set via 'ceph dashboard set-rgw-api-user-id <xxx>') is optional but the user ID is required internally for some situations. Because of that the user ID is requested via a RGW Admin Ops API call if it is not configured via CLI.

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-06-15 16:24:33 +02:00
Patrick Donnelly
4c3bf7132f
Merge PR #22464 into master
* refs/pull/22464/head:
	mds: print dir decay counters on hit
	DecayCounter: removed unused velocity
	DecayCounter: remove unnecessary delta member
	mds: use monotonic time for DecayCounter

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-06-15 07:05:40 -07:00
Patrick Donnelly
8db4bedabd
Merge PR #22512 into master
* refs/pull/22512/head:
	client: fix bug #24491 _ll_drop_pins may access invalid iterator

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-06-15 07:05:36 -07:00
Patrick Donnelly
35a7c01d51
mds: print dir decay counters on hit
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:04:42 -07:00
Patrick Donnelly
201cc8ea01
DecayCounter: removed unused velocity
It's not actually used anywhere and it's not accurate.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:04:42 -07:00
Patrick Donnelly
50c573910b
DecayCounter: remove unnecessary delta member
We can just add/sub to val directly (especially now that decay can be called on
a const DecayCounter).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:04:42 -07:00
Patrick Donnelly
bc7cb57985
mds: use monotonic time for DecayCounter
This commit has a few side-effects:
- Decaying the DecayCounter is more accurate, we do not need to "skip" decaying
  the counter if it's been less than a second since the last decay. The time
  delta is now at the granularity of the monotonic clock.
- Any check of the DecayCounter results in updating the current value, even
  const checks.
- DecayRate is now established when the DecayCounter is created. There's no longer
  a need to pass the DecayRate whenever interacting with the counter.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:04:42 -07:00
Patrick Donnelly
9a3f8a14bb
Merge PR #22357 into master
* refs/pull/22357/head:
	common/DecayCounter: set last_decay to current time when decoding decay counter

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-06-15 07:02:02 -07:00
Patrick Donnelly
c7951d8f36
Merge PR #22289 into master
* refs/pull/22289/head:
	mds: put Capability in map container

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:01:57 -07:00
Patrick Donnelly
88bf596a35
Merge PR #22266 into master
* refs/pull/22266/head:
	client:  update inode fields according to issued caps

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:01:52 -07:00
Patrick Donnelly
94445e64cf
Merge PR #22234 into master
* refs/pull/22234/head:
	mds: add magic to header of open file table

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:01:48 -07:00
Erwan Velu
434589a320 ctest: Removing unittest_alloc_bench
unittest_alloc_bench is very cpu consuming and can take up to 20mn to
run. As per a discussion with the original author of this code, this
test is only about testing the performance while there is no validation
code in it.

To save time from people doing make check often or even the CI itself,
removing this test will save a lot of time while not reducing the test
coverage.

This commit is only removing the test from the make check but keep the
binary being compiled for those who want to run it manually.

Signed-off-by: Erwan Velu <erwan@redhat.com>
2018-06-15 15:59:51 +02:00
Kefu Chai
eb615410d3 run-make-check: enable WITH_GTEST_PARALLEL
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-15 15:55:27 +02:00
Kefu Chai
4c0a2b9373 cmake: add WITH_GTEST_PARALLEL option
and remove src/test/gtest-parallel submodule, because gtest-parallel is
only useful for running tests. and not all end-users are interested in
running test not to mention running them in parallel. so, to avoid
including gtest-parallel scripts in the dist tarball. it'd be better to
make it optional, and an external project.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-15 15:55:15 +02:00
Erwan Velu
13bc625b5f src/test: Using gtest-parallel to speedup unittests
Unittests are run sequentially and could take a long while to run.

This commit is about using gtest-parallel on some of them which are
known to be very slow due to this sequentiality.

To enable the parallel features, the 'parallel' argument just have to be
added to the add_ceph_unittest() call like in :
    -add_ceph_unittest(unittest_throttle)
    +add_ceph_unittest(unittest_throttle parallel)

This commit impact the following tests :

Test name                          Before   After (in seconds)
unittest_erasure_code_shec_all:       212      43
unittest_throttle                      15       5
unittest_crush                          9       6
unittest_rbd_mirror                    79      21

Total                                 315      75

This commit saves 240 seconds (4 minutes) per build.

Note it exist several other long tests but can't be parallelized since
there is explicit dependencies in the order to run the subtests.
Those stay sequential.

Signed-off-by: Erwan Velu <erwan@redhat.com>
2018-06-15 15:53:30 +02:00