Commit Graph

87771 Commits

Author SHA1 Message Date
Sage Weil
e37e6407b9 debian,rpm: /var/lib/ceph/crash
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-15 14:39:18 -05:00
Sage Weil
3efd4f7209 test/objectstore/CMakefiles: fix unittest_alloc_bench build
Broken by 434589a320.  The add_ceph_unittest
helper does more than just add this to the list of tests--it also adjusts
linking and build options.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-15 14:22:01 -05:00
Sage Weil
fd3036d2e1 os/bluestore: more debug output
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-15 14:13:14 -05:00
Sage Weil
761f68dc0d mon: destroy-new -> purge-new
What we actually want is a purge, not a destroy.  Destroy leaves the OSD
ID in used and allows it to be recreated.  What ceph-volume wants is to
purge all trace of the failed OSD setup.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-15 14:11:01 -05:00
Sage Weil
13393f6108 mon/OSDMonitor: fix NEW flag adjustment in destroy[-new]
Only set the NEW flag if it isn't already set.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-15 13:51:03 -05:00
Sage Weil
b308b6b155 os/bluestore: print cnode from _open_collections
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-15 12:38:49 -05:00
Sage Weil
f3c89ef6e7 os/bluestore: print cnode on fsck
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-15 12:38:29 -05:00
Kefu Chai
9551fc8585
Merge pull request #22577 from ErwanAliasr1/evelu-parallel
src/test: Using gtest-parallel to speedup unittests

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-16 00:15:30 +08:00
Lenz Grimmer
93e7717cfe
Merge pull request #21998 from p-na/osd-flags-wip
mgr/dashboard: Add ability to list,set and unset cluster-wide OSD flags to the backend

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-15 16:49:51 +02:00
Patrick Donnelly
c2311e1aeb
Merge PR #22340 into master
* refs/pull/22340/head:
	doc: update description of mount options for cephfs

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-06-15 07:31:34 -07:00
Volker Theile
ed0750699e mgr/dashboard: Get user ID via RGW Admin Ops API.
The RGW API user id (set via 'ceph dashboard set-rgw-api-user-id <xxx>') is optional but the user ID is required internally for some situations. Because of that the user ID is requested via a RGW Admin Ops API call if it is not configured via CLI.

Signed-off-by: Volker Theile <vtheile@suse.com>
2018-06-15 16:24:33 +02:00
Patrick Donnelly
4c3bf7132f
Merge PR #22464 into master
* refs/pull/22464/head:
	mds: print dir decay counters on hit
	DecayCounter: removed unused velocity
	DecayCounter: remove unnecessary delta member
	mds: use monotonic time for DecayCounter

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-06-15 07:05:40 -07:00
Patrick Donnelly
8db4bedabd
Merge PR #22512 into master
* refs/pull/22512/head:
	client: fix bug #24491 _ll_drop_pins may access invalid iterator

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-06-15 07:05:36 -07:00
Igor Fedotov
dbbe12fe6f os/bluestore: provide a rough estimate for bitmap allocator
fragmentation.
The approach is counting 'partial' and 'free' slots at L1 on the fly and
use partial / (partial+free) value as rough fragmentation estimate.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-06-15 17:04:57 +03:00
Patrick Donnelly
35a7c01d51
mds: print dir decay counters on hit
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:04:42 -07:00
Patrick Donnelly
201cc8ea01
DecayCounter: removed unused velocity
It's not actually used anywhere and it's not accurate.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:04:42 -07:00
Patrick Donnelly
50c573910b
DecayCounter: remove unnecessary delta member
We can just add/sub to val directly (especially now that decay can be called on
a const DecayCounter).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:04:42 -07:00
Patrick Donnelly
bc7cb57985
mds: use monotonic time for DecayCounter
This commit has a few side-effects:
- Decaying the DecayCounter is more accurate, we do not need to "skip" decaying
  the counter if it's been less than a second since the last decay. The time
  delta is now at the granularity of the monotonic clock.
- Any check of the DecayCounter results in updating the current value, even
  const checks.
- DecayRate is now established when the DecayCounter is created. There's no longer
  a need to pass the DecayRate whenever interacting with the counter.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:04:42 -07:00
Patrick Donnelly
9a3f8a14bb
Merge PR #22357 into master
* refs/pull/22357/head:
	common/DecayCounter: set last_decay to current time when decoding decay counter

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-06-15 07:02:02 -07:00
Patrick Donnelly
c7951d8f36
Merge PR #22289 into master
* refs/pull/22289/head:
	mds: put Capability in map container

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:01:57 -07:00
Patrick Donnelly
88bf596a35
Merge PR #22266 into master
* refs/pull/22266/head:
	client:  update inode fields according to issued caps

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:01:52 -07:00
Patrick Donnelly
94445e64cf
Merge PR #22234 into master
* refs/pull/22234/head:
	mds: add magic to header of open file table

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-15 07:01:48 -07:00
Erwan Velu
434589a320 ctest: Removing unittest_alloc_bench
unittest_alloc_bench is very cpu consuming and can take up to 20mn to
run. As per a discussion with the original author of this code, this
test is only about testing the performance while there is no validation
code in it.

To save time from people doing make check often or even the CI itself,
removing this test will save a lot of time while not reducing the test
coverage.

This commit is only removing the test from the make check but keep the
binary being compiled for those who want to run it manually.

Signed-off-by: Erwan Velu <erwan@redhat.com>
2018-06-15 15:59:51 +02:00
Kefu Chai
eb615410d3 run-make-check: enable WITH_GTEST_PARALLEL
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-15 15:55:27 +02:00
Kefu Chai
4c0a2b9373 cmake: add WITH_GTEST_PARALLEL option
and remove src/test/gtest-parallel submodule, because gtest-parallel is
only useful for running tests. and not all end-users are interested in
running test not to mention running them in parallel. so, to avoid
including gtest-parallel scripts in the dist tarball. it'd be better to
make it optional, and an external project.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-15 15:55:15 +02:00
Erwan Velu
13bc625b5f src/test: Using gtest-parallel to speedup unittests
Unittests are run sequentially and could take a long while to run.

This commit is about using gtest-parallel on some of them which are
known to be very slow due to this sequentiality.

To enable the parallel features, the 'parallel' argument just have to be
added to the add_ceph_unittest() call like in :
    -add_ceph_unittest(unittest_throttle)
    +add_ceph_unittest(unittest_throttle parallel)

This commit impact the following tests :

Test name                          Before   After (in seconds)
unittest_erasure_code_shec_all:       212      43
unittest_throttle                      15       5
unittest_crush                          9       6
unittest_rbd_mirror                    79      21

Total                                 315      75

This commit saves 240 seconds (4 minutes) per build.

Note it exist several other long tests but can't be parallelized since
there is explicit dependencies in the order to run the subtests.
Those stay sequential.

Signed-off-by: Erwan Velu <erwan@redhat.com>
2018-06-15 15:53:30 +02:00
Stephan Müller
0e3e2671f3 mgr/dashboard: Remove unnecessary fake services
Removed unnecessary fake services.

Signed-off-by: Stephan Müller <smueller@suse.com>
2018-06-15 15:13:49 +02:00
Orit Wasserman
42ff13c776
Merge pull request #22390 from votdev/rgw_metadata_self
rgw: Get the user metadata of the user used to sign the request
2018-06-15 12:21:41 +03:00
Patrick Nawracay
ef5756b5ff mgr/dashboard: Extend dev scripts for API testing
Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-06-15 10:26:30 +02:00
Patrick Nawracay
0d8176acb6 mgr/dashboard: Make noise when AuthRequired used incorrectly
Don't fail silently when AuthRequired is used incorrectly, namely
without parentheses.

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-06-15 10:26:30 +02:00
Patrick Nawracay
cce9a0f229 mgr/dashboard: Extend RestController.bulk_set test
Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-06-15 10:26:30 +02:00
Patrick Nawracay
d7de1fa067 mgr/dashboard/backend: Enable get/set of cluster-wide OSD settings
Add ability to list, set and unset cluster-wide OSD flags.

Flags can be listed and changed through the `/api/osd/flags` API
resource. By using a GET request, the list is retrieved. By using a PUT
request, the flags are updated (all at once). Flags not contained in the
data of the PUT are removed, additional once are added. Note that the
PUT requests require a JSON body with the data contained as value of the
'flags' key like so:

    {"flags": ["flag1", "flag2", ...]}

Fixes: http://tracker.ceph.com/issues/24056

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-06-15 10:26:29 +02:00
Ricardo Dias
c3465e03ad
mgr/dashboard: .pylintrc: ignore too-many-statements check
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-15 09:04:11 +01:00
Lenz Grimmer
ac8f5c75ec
Merge pull request #22459 from p-na/grafana-token-auth
mgr/dashboard: Add token authentication to Grafana proxy

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-15 09:44:46 +02:00
Lenz Grimmer
85908e280f
Merge pull request #22014 from Devp00l/wip-task-wrapper
mgr/dashboard: Task wrapper service

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-15 09:40:17 +02:00
zhengyin
de505e7da4 pybind/rbd: add assert_raise in test set_snap
Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>
2018-06-15 13:45:56 +08:00
taodd
f3d484b8df mds: add dump inode command
dump inode with an specific inode number
this is useful when we only known the inode number.

Signed-off-by: dongdong tao <tdd21151186@gmail.com>
2018-06-15 13:24:09 +08:00
Kefu Chai
3234db0649
Merge pull request #22524 from tchaikov/wip-history-les-bound
osd/PG: unset history_les_bound if local-les is used

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2018-06-15 10:08:20 +08:00
Kefu Chai
a20ca03042
Merge pull request #22472 from majianpeng/bluestore-misc-cleanup
os/bluestore: misc cleanup

Reviewed-by: Sage Weil <sage@redhat.com>
2018-06-15 10:07:12 +08:00
Kefu Chai
3071cb8997
Merge pull request #22538 from alimaredia/wip-vstart-cmake-cls-opt
cmake: Add cls_opt for vstart target

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-15 09:24:19 +08:00
Sage Weil
921d8902b8 tools/rbd/action: align column headers left
Even if the column content is right-aligned, we should align the column
header left.  That way intead of

  SNAPID NAME  SIZE TIMESTAMP                NAMESPACE
       4 snap 1 GiB Mon Jun  4 16:27:17 2018 user

which has makes it hard to visually parse what that 1 belongs to (NAME or
SIZE?), we get

  SNAPID NAME SIZE  TIMESTAMP                NAMESPACE
       4 snap 1 GiB Mon Jun  4 16:27:17 2018 user

Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-14 17:03:21 -05:00
Ali Maredia
f824161a3a cmake: Add cls_opt for vstart target
Adding a dependency on cls_opt for the radosgw so
that when the vstart target is made, `radosgw-admin
mfa` commands work.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2018-06-14 14:40:07 -04:00
Sage Weil
70ba58e9e8 Merge PR #22554 into master
* refs/pull/22554/head:
	qa/standalone/ceph-helpers.sh: Fixing comment for wait_for_health()
	tests: Protecting rados bench against endless loop
	qa/standalone/ceph-helpers.sh: Defining custom timeout for wait_for_clean()

Reviewed-by: Piotr Dałek <piotr.dalek@corp.ovh.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2018-06-14 13:04:56 -05:00
Kefu Chai
4040e2acad
Merge pull request #22491 from tchaikov/wip-seastar-msgr
crimson: port messenger to seastar

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-14 23:24:42 +08:00
Kefu Chai
ae5fde0240
Merge pull request #22547 from tchaikov/wip-spdk
spdk: update to latest spdk-18.05 branch

Tested-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-06-14 23:23:01 +08:00
Stephan Müller
f62ab0ed5b mgr/dashboard: Executing messages for tasks
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-06-14 16:46:35 +02:00
Stephan Müller
fbfdbdc0d9 mgr/dashboard: Use task wrapper in RBD list
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-06-14 16:46:35 +02:00
Stephan Müller
260dad1729 mgr/dashboard: Use task wrapper in RBD form
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-06-14 16:46:35 +02:00
Stephan Müller
3201ba6f7d mgr/dashboard: Task wrapper service
Has a method to wrap an API call into a task.

Fixes: https://tracker.ceph.com/issues/24134

Signed-off-by: Stephan Müller <smueller@suse.com>
2018-06-14 16:46:35 +02:00
Lenz Grimmer
d785010a35
Merge pull request #22303 from ricardoasmarques/wip-help-menu
mgr/dashboard: Add help menu entry

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-14 15:56:39 +02:00