Commit Graph

87893 Commits

Author SHA1 Message Date
Dan Mick
7fc8714a27 qa/tasks/{ceph_manager.py,vstart_runner.py}: allow kwargs in raw_*
Allow passing kwargs (like stdin=) to the local and teuthology
clusters when running tests

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-06-29 14:51:34 -07:00
Dan Mick
29209a3ea8 mgr/pybind/crash: handle crashdumps
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-06-29 14:51:35 -07:00
Patrick Donnelly
5494e7229a
Merge PR #22719 into master
* refs/pull/22719/head:
	qa: fix symlinks indirectly pointing at qa to .qa
	qa: add .qa helper link

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-06-27 12:50:33 -07:00
Casey Bodley
302669ebbe
Merge pull request #22631 from tianshan/fix_notify_thread
rgw: fix meta and data notify thread miss stop cr manager

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-27 15:39:02 -04:00
Casey Bodley
b8a7e537af
Merge pull request #22632 from tianshan/fix_index_zones_trace
rgw: fix index complete miss zones_trace set

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-27 14:29:52 -04:00
Casey Bodley
58337afb75
Merge pull request #22660 from cfanz/wip-rgw-fix-24603
rgw-multisite: fix endless loop in RGWBucketShardIncrementalSyncCR

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-27 14:29:28 -04:00
Patrick Donnelly
f28cc3a082
Merge PR #22725 into master
* refs/pull/22725/head:
	qa/workunits/suites/blogbench.sh: use correct dir name

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-06-27 11:13:37 -07:00
Patrick Donnelly
73ef69cac4
Merge PR #22656 into master
* refs/pull/22656/head:
	doc: update experimental features - snapshots
	doc: highlight the flags

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-27 10:31:30 -07:00
Casey Bodley
c7f2cad6a2
Merge pull request #22698 from cbodley/wip-async-shared-mutex
common: reintroduce async SharedMutex

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2018-06-27 12:55:32 -04:00
Alfredo Deza
6e5e5bde30
Merge pull request #22724 from ceph/rm-23941
ceph-volume: error on commands that need ceph.conf to operate

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-06-27 11:56:09 -04:00
Kefu Chai
804b94181e
Merge pull request #22710 from tchaikov/wip-config-without-lock
common: add lockless `md_config_t`

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-06-27 21:28:20 +08:00
Lenz Grimmer
fa18aee15e
Merge pull request #22712 from tspmelo/wip-package-version
mgr/dashboard: fix the version of all frontend dependencies

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-27 15:12:54 +02:00
Jos Collin
dcca848213
Merge pull request #22734 from s0nea/wip-update-map
githubmap, organizationmap: cleanup and add/update contributors/affiliation

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-06-27 18:38:40 +05:30
Kefu Chai
572a740a03
Merge pull request #20297 from tanghaodong25/rdma-cm
msg/async/rdma: add iWARP RDMA protocol support

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-27 20:37:48 +08:00
Andrew Schoen
de8b301ac2 ceph-volume: error on commands that need ceph.conf to operate
We had been ignoring the failure to load ceph.conf for all subcommands
but most of them require that a ceph.conf be present. This changes that
so only commands that do not need ceph.conf ignore the failure to find
it.

Fixes: http://tracker.ceph.com/issues/23941

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-06-27 07:31:24 -05:00
Tatjana Dehler
7b396ed6f0 organizationmap: add openATTIC team affiliation
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-06-27 14:02:20 +02:00
Tatjana Dehler
0255fa5fdb organizationmap: fix typo
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-06-27 14:02:20 +02:00
Tatjana Dehler
34710cb6e1 githubmap: update contributors
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-06-27 14:02:08 +02:00
Tatjana Dehler
ef4735f0de githubmap: cleanup alphabetical order
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-06-27 13:31:52 +02:00
Jos Collin
9ed1158e1d doc: update experimental features - snapshots
* drop the experimental warning of multi-MDS
* update snapshotting blocked off version
* update Multiple filesystems availability in Jewel

Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-06-27 14:21:33 +05:30
Mykola Golub
40617ad18b
Merge pull request #22673 from dillaman/wip-24558
rbd: basic support for images within namespaces

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-06-27 11:40:23 +03:00
Kefu Chai
987faacc66
Merge pull request #22701 from falcon78921/wip-docs-falcon78921
doc: remove documentation for installing google-perftools on Debian systems

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-27 13:00:16 +08:00
Kefu Chai
10a3f15429 cmake: link librbd_test against Boost::thread
otherwise we will have:

[ 83%] Building CXX object src/tools/rbd/CMakeFiles/rbd.dir/Utils.cc.o
../../../lib/librbd_test.a(test_ImageWatcher.cc.o): In function
`boost:🧵:do_try_join_until(timespec const&)':
/home/kchai/ceph/build/boost/include/boost/thread/detail/thread.hpp:789:
undefined reference to
`boost:🧵:do_try_join_until_noexcept(timespec const&, bool&)'
collect2: error: ld returned 1 exit status
src/test/librbd/CMakeFiles/ceph_test_librbd.dir/build.make:137: recipe
for target 'bin/ceph_test_librbd' failed
make[2]: *** [bin/ceph_test_librbd] Error 1

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-27 12:53:37 +08:00
Kefu Chai
2df0a50e07 common: add LockPolicy to md_config_t
before this change, we guard all read/write access to md_config_t with a
lock. after this change, this policy is optional. and is controled by a
enum named `LockPolicy`. we will use `md_config_impl<LockPolicy::SINGLE>`
to implement the lockless config used by crimson/osd.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-27 12:53:37 +08:00
Kefu Chai
cc758a7eca
Merge pull request #22418 from wido/mgr-telegraf-generator
mgr/telegraf: Use Python generator and catch OSError

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-27 12:24:07 +08:00
Kefu Chai
4a85c89aca
Merge pull request #22434 from wido/zabbix-pgs
mgr/zabbix: Send more PG information to Zabbix

Reviewed-by: John Spray <john.spray@redhat.com>
2018-06-27 12:22:47 +08:00
Kefu Chai
7d54bdd027
Merge pull request #22436 from wido/mgr-telegraf-pg-stats
mgr/telegraf: Send more PG status information to Telegraf

Reviewed-by: John Spray <john.spray@redhat.com>
2018-06-27 12:21:46 +08:00
Kefu Chai
a2d2711a0d
Merge pull request #22556 from majianpeng/bluestore-misc-cleanup2
os/bluestore: cleanups

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-06-27 12:20:59 +08:00
Kefu Chai
289f7aba56
Merge pull request #22728 from majianpeng/fio-compiler-error
test/fio: fix compiler failure

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-27 11:52:24 +08:00
Jianpeng Ma
3fcd8290ba test/fio: fix compiler error.
Compile  with -DWITH_FIO=ON, met the following bug.
/home/ceph/src/test/fio/fio_ceph_objectstore.cc:148:9: error: ‘unique_ptr’ in namespace ‘ceph’ does not name a template type
   ceph::unique_ptr<std::mutex> lock;
         ^~~~~~~~~~
/home/ceph/src/test/fio/fio_ceph_objectstore.cc: In constructor ‘{anonymous}::Collection::Collection(const spg_t&, ObjectStore::CollectionHandle)’:
/home/ceph/src/test/fio/fio_ceph_objectstore.cc:158:9: error: class ‘{anonymous}::Collection’ does not have any field named ‘lock’
         lock(new std::mutex) {
         ^~~~
/home/ceph/src/test/fio/fio_ceph_objectstore.cc: In function ‘fio_q_status {anonymous}::fio_ceph_os_queue(thread_data*, io_u*)’:
/home/ceph/src/test/fio/fio_ceph_objectstore.cc:604:38: error: ‘struct {anonymous}::Collection’ has no member named ‘lock’
  std::lock_guard<std::mutex> l(*coll.lock);

This bug introduct by commit da5d156b6b.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-06-27 18:04:44 +08:00
James McClune
476f855567
doc: updated documentation for installing google-perftools
Made updated changes per @tchaikov's request

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-06-26 22:59:48 -04:00
Neha Ojha
24513c39f1 qa/workunits/suites/blogbench.sh: use correct dir name
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-06-26 18:30:38 -04:00
Sage Weil
af13810872 Merge PR #22294 into master
* refs/pull/22294/head:
	common/performance: Now hobject_t's hash no longer depends directly on oid.
	common/performance: improved hash calculation for hobject_t and ghobject_t

Reviewed-by: Paul Emmerich <paul.emmerich@croit.io>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-06-26 16:57:37 -05:00
Sage Weil
3cba9805a3 githubmap: update contributors
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-26 16:57:36 -05:00
Sage Weil
264c8ce325 Merge PR #22696 into master
* refs/pull/22696/head:
	mgr/DaemonServer: avoid dereferencing end() iterator

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-26 16:56:49 -05:00
Patrick Donnelly
e7147fb34c
Merge PR #21544 into master
* refs/pull/21544/head:
	common/config: support to save and re-expand special metavariables

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 14:07:49 -07:00
Patrick Donnelly
fd92f27098
Merge PR #22580 into master
* refs/pull/22580/head:
	mds: improve error handling in PurgeQueue

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-06-26 13:25:35 -07:00
Patrick Donnelly
ad3aee3a57
Merge PR #22611 into master
* refs/pull/22611/head:
	client: fix use-after-free in Client::link()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 13:25:29 -07:00
Casey Bodley
9f0f8f3c62 common: SharedMutex uses ref-counted implementation
add a reference-counted SharedMutexImpl so that lock guards can outlive
the SharedMutex itself. this is required because the lock guards are
passed with async completions, and there is no guarantee that the
executor will process those completions before the SharedMutex
destructs. this case is exercised by the async_destruct unit test

Fixes: http://tracker.ceph.com/issues/24124

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-06-26 15:03:42 -04:00
Patrick Donnelly
b39f9d06dc
qa: fix symlinks indirectly pointing at qa to .qa
Building on the previous commit.

Command used:

$ find suites/ -type l -and -not -name .qa -execdir ~/fix.sh {} \;

fix.sh:
    #!/bin/bash

    link="$(readlink "$1")"

    echo $link
    dirlink="$(dirname "$link")"
    baselink="$(basename "$link")"

    while true; do
        echo $dirlink
        if [ "$dirlink" -ef ~/ceph/qa ]; then
            ln -nsf ".qa/$baselink" "$1"
            exit
        else
            baselink="$(basename "$dirlink")/$baselink"
            dirlink="$(dirname "$dirlink")"
            if [ "$dirlink" -ef . ]; then
                break
            fi
        fi
    done

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:48:38 -07:00
Patrick Donnelly
716db6e2fd
qa: add .qa helper link
This utilizes the recent feature in teuthology [1] to skip hidden files in
suites when building the job matrix.

Idea of this change is to enable referring to the top-level qa directory in a
position-independent way such that copies of a suite to another location do not
break any symlinks.

[1] https://github.com/ceph/teuthology/pull/1185

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:33:48 -07:00
Kefu Chai
6c8a3dea4a
Merge pull request #20734 from tchaikov/wip-s-libs-lib
test,qa: s/.libs/lib/

Reviewed-by: Sage Weil <sage@redhat.com>
2018-06-27 01:29:56 +08:00
Kefu Chai
0e95a2893d
Merge pull request #22690 from tchaikov/wip-no-memory.h
include/memory.h: remove memory.h

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-06-27 00:04:16 +08:00
Lenz Grimmer
cfcfa10a5b
Merge pull request #22672 from tspmelo/wip-encode-uri
mgr/dashboard: Add support for URI encode

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-26 17:03:29 +02:00
Kefu Chai
8ab02bc1b8 test,qa: s/.libs/lib/
after switching to cmake, the libraries are put in build/lib, instead of
.libs. so point the default settings to ".lib".

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-26 22:36:09 +08:00
Casey Bodley
be5a6d7f34
Merge pull request #22312 from ZVampirEM77/wip-default-zonegroup-apiname
rgw: fix CreateBucket with BucketLocation parameter failed under default zonegroup

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-26 09:58:16 -04:00
Tiago Melo
f21d0da5a3 mgr/dashboard: Add support for URI encode
Created a decorator and pipe to help encode special URI components in the
frontend.

Modified the backend request handler to decode all the string args.

fixes: http://tracker.ceph.com/issues/24621

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-06-26 14:35:15 +01:00
Tiago Melo
44ea47404b mgr/dashboard: Prettify some frontend files
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-06-26 14:35:15 +01:00
Lenz Grimmer
261a4cc9f9
Merge pull request #22715 from LenzGr/mgr-dashboard-24623
mgr/dashboard: Replaced "Pool" with "Pools" in navigation bar

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-26 15:31:23 +02:00
Lenz Grimmer
057d602589
Merge pull request #22283 from rjfd/wip-dashboard-user-roles
mgr/dashboard: role based authentication/authorization system

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-26 15:18:12 +02:00