Commit Graph

87947 Commits

Author SHA1 Message Date
Kefu Chai
10a3f15429 cmake: link librbd_test against Boost::thread
otherwise we will have:

[ 83%] Building CXX object src/tools/rbd/CMakeFiles/rbd.dir/Utils.cc.o
../../../lib/librbd_test.a(test_ImageWatcher.cc.o): In function
`boost:🧵:do_try_join_until(timespec const&)':
/home/kchai/ceph/build/boost/include/boost/thread/detail/thread.hpp:789:
undefined reference to
`boost:🧵:do_try_join_until_noexcept(timespec const&, bool&)'
collect2: error: ld returned 1 exit status
src/test/librbd/CMakeFiles/ceph_test_librbd.dir/build.make:137: recipe
for target 'bin/ceph_test_librbd' failed
make[2]: *** [bin/ceph_test_librbd] Error 1

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-27 12:53:37 +08:00
Kefu Chai
2df0a50e07 common: add LockPolicy to md_config_t
before this change, we guard all read/write access to md_config_t with a
lock. after this change, this policy is optional. and is controled by a
enum named `LockPolicy`. we will use `md_config_impl<LockPolicy::SINGLE>`
to implement the lockless config used by crimson/osd.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-27 12:53:37 +08:00
Kefu Chai
cc758a7eca
Merge pull request #22418 from wido/mgr-telegraf-generator
mgr/telegraf: Use Python generator and catch OSError

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-27 12:24:07 +08:00
Kefu Chai
4a85c89aca
Merge pull request #22434 from wido/zabbix-pgs
mgr/zabbix: Send more PG information to Zabbix

Reviewed-by: John Spray <john.spray@redhat.com>
2018-06-27 12:22:47 +08:00
Kefu Chai
7d54bdd027
Merge pull request #22436 from wido/mgr-telegraf-pg-stats
mgr/telegraf: Send more PG status information to Telegraf

Reviewed-by: John Spray <john.spray@redhat.com>
2018-06-27 12:21:46 +08:00
Kefu Chai
a2d2711a0d
Merge pull request #22556 from majianpeng/bluestore-misc-cleanup2
os/bluestore: cleanups

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-06-27 12:20:59 +08:00
Kefu Chai
289f7aba56
Merge pull request #22728 from majianpeng/fio-compiler-error
test/fio: fix compiler failure

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-27 11:52:24 +08:00
Jianpeng Ma
3fcd8290ba test/fio: fix compiler error.
Compile  with -DWITH_FIO=ON, met the following bug.
/home/ceph/src/test/fio/fio_ceph_objectstore.cc:148:9: error: ‘unique_ptr’ in namespace ‘ceph’ does not name a template type
   ceph::unique_ptr<std::mutex> lock;
         ^~~~~~~~~~
/home/ceph/src/test/fio/fio_ceph_objectstore.cc: In constructor ‘{anonymous}::Collection::Collection(const spg_t&, ObjectStore::CollectionHandle)’:
/home/ceph/src/test/fio/fio_ceph_objectstore.cc:158:9: error: class ‘{anonymous}::Collection’ does not have any field named ‘lock’
         lock(new std::mutex) {
         ^~~~
/home/ceph/src/test/fio/fio_ceph_objectstore.cc: In function ‘fio_q_status {anonymous}::fio_ceph_os_queue(thread_data*, io_u*)’:
/home/ceph/src/test/fio/fio_ceph_objectstore.cc:604:38: error: ‘struct {anonymous}::Collection’ has no member named ‘lock’
  std::lock_guard<std::mutex> l(*coll.lock);

This bug introduct by commit da5d156b6b.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-06-27 18:04:44 +08:00
Yan, Zheng
162b1ed5f9 qa/fs/upgrade/snaps: whitelist inconsistent rstat
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-06-27 11:14:34 +08:00
James McClune
476f855567
doc: updated documentation for installing google-perftools
Made updated changes per @tchaikov's request

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2018-06-26 22:59:48 -04:00
David Zafman
ebb05b2542 test: When possible show side-by-side diff in addition to regular diff
Fixes: https://tracker.ceph.com/issues/21664

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-06-26 18:23:07 -07:00
Yuri Weinstein
298065df29 qa/tests - added mimic-p2p suite
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-06-26 16:05:44 -07:00
Neha Ojha
24513c39f1 qa/workunits/suites/blogbench.sh: use correct dir name
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-06-26 18:30:38 -04:00
Sage Weil
af13810872 Merge PR #22294 into master
* refs/pull/22294/head:
	common/performance: Now hobject_t's hash no longer depends directly on oid.
	common/performance: improved hash calculation for hobject_t and ghobject_t

Reviewed-by: Paul Emmerich <paul.emmerich@croit.io>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-06-26 16:57:37 -05:00
Sage Weil
3cba9805a3 githubmap: update contributors
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-26 16:57:36 -05:00
Sage Weil
264c8ce325 Merge PR #22696 into master
* refs/pull/22696/head:
	mgr/DaemonServer: avoid dereferencing end() iterator

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-26 16:56:49 -05:00
Patrick Donnelly
e7147fb34c
Merge PR #21544 into master
* refs/pull/21544/head:
	common/config: support to save and re-expand special metavariables

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 14:07:49 -07:00
Patrick Donnelly
fd92f27098
Merge PR #22580 into master
* refs/pull/22580/head:
	mds: improve error handling in PurgeQueue

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-06-26 13:25:35 -07:00
Patrick Donnelly
ad3aee3a57
Merge PR #22611 into master
* refs/pull/22611/head:
	client: fix use-after-free in Client::link()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 13:25:29 -07:00
Casey Bodley
9f0f8f3c62 common: SharedMutex uses ref-counted implementation
add a reference-counted SharedMutexImpl so that lock guards can outlive
the SharedMutex itself. this is required because the lock guards are
passed with async completions, and there is no guarantee that the
executor will process those completions before the SharedMutex
destructs. this case is exercised by the async_destruct unit test

Fixes: http://tracker.ceph.com/issues/24124

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-06-26 15:03:42 -04:00
Patrick Donnelly
b39f9d06dc
qa: fix symlinks indirectly pointing at qa to .qa
Building on the previous commit.

Command used:

$ find suites/ -type l -and -not -name .qa -execdir ~/fix.sh {} \;

fix.sh:
    #!/bin/bash

    link="$(readlink "$1")"

    echo $link
    dirlink="$(dirname "$link")"
    baselink="$(basename "$link")"

    while true; do
        echo $dirlink
        if [ "$dirlink" -ef ~/ceph/qa ]; then
            ln -nsf ".qa/$baselink" "$1"
            exit
        else
            baselink="$(basename "$dirlink")/$baselink"
            dirlink="$(dirname "$dirlink")"
            if [ "$dirlink" -ef . ]; then
                break
            fi
        fi
    done

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:48:38 -07:00
Patrick Donnelly
716db6e2fd
qa: add .qa helper link
This utilizes the recent feature in teuthology [1] to skip hidden files in
suites when building the job matrix.

Idea of this change is to enable referring to the top-level qa directory in a
position-independent way such that copies of a suite to another location do not
break any symlinks.

[1] https://github.com/ceph/teuthology/pull/1185

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-26 11:33:48 -07:00
Kefu Chai
6c8a3dea4a
Merge pull request #20734 from tchaikov/wip-s-libs-lib
test,qa: s/.libs/lib/

Reviewed-by: Sage Weil <sage@redhat.com>
2018-06-27 01:29:56 +08:00
Kefu Chai
0e95a2893d
Merge pull request #22690 from tchaikov/wip-no-memory.h
include/memory.h: remove memory.h

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-06-27 00:04:16 +08:00
Lenz Grimmer
cfcfa10a5b
Merge pull request #22672 from tspmelo/wip-encode-uri
mgr/dashboard: Add support for URI encode

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-26 17:03:29 +02:00
Kefu Chai
8ab02bc1b8 test,qa: s/.libs/lib/
after switching to cmake, the libraries are put in build/lib, instead of
.libs. so point the default settings to ".lib".

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-26 22:36:09 +08:00
Casey Bodley
be5a6d7f34
Merge pull request #22312 from ZVampirEM77/wip-default-zonegroup-apiname
rgw: fix CreateBucket with BucketLocation parameter failed under default zonegroup

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-26 09:58:16 -04:00
Tiago Melo
f21d0da5a3 mgr/dashboard: Add support for URI encode
Created a decorator and pipe to help encode special URI components in the
frontend.

Modified the backend request handler to decode all the string args.

fixes: http://tracker.ceph.com/issues/24621

Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-06-26 14:35:15 +01:00
Tiago Melo
44ea47404b mgr/dashboard: Prettify some frontend files
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-06-26 14:35:15 +01:00
Lenz Grimmer
261a4cc9f9
Merge pull request #22715 from LenzGr/mgr-dashboard-24623
mgr/dashboard: Replaced "Pool" with "Pools" in navigation bar

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-26 15:31:23 +02:00
Lenz Grimmer
057d602589
Merge pull request #22283 from rjfd/wip-dashboard-user-roles
mgr/dashboard: role based authentication/authorization system

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-06-26 15:18:12 +02:00
Jos Collin
3310565e85
Merge pull request #22663 from joscollin/wip-doc-dashboard
doc: updated get-involved.rst for ceph-dashboard

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2018-06-26 17:51:33 +05:30
Ricardo Marques
f73119df2c
mgr/dashboard: User permissions control (frontend)
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-06-26 12:29:08 +01:00
Ricardo Dias
9a49013287
mgr/dashboard: controllers: fix endpoint return type when method returns bytes
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:55 +01:00
Ricardo Dias
8ab752e916
mgr/dashboard: controllers: fix controllers endpoints initialization order
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:55 +01:00
Ricardo Dias
cc21d270c2
qa/tasks/mgr/dashboard: test_cluster_conf: restore original value of mon_allow_pool_delete
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:54 +01:00
Ricardo Dias
d9cf75ae54
mgr/dashboard: hacking.rst: update controller access control instructions
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:54 +01:00
Ricardo Dias
1538d570ad
doc/mgr/dashboard: user and role management documentation
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:54 +01:00
Ricardo Dias
76f89edee0
mgr/dashboard: auth: return user permissions on login
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:54 +01:00
Ricardo Dias
01a1a1ff84
qa/tasks/mgr/dashboard: Adapted tests to work with new authentication system
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:54 +01:00
Ricardo Dias
1e91d40474
mgr/dashboard: configured security info for each controller
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:54 +01:00
Ricardo Dias
3c2f451b24
mgr/dashboard: removed @AuthRequired decorator
Now all controllers require authentication by default.
No disable authentication, a boolean parameter can be passed
in the `@ApiController` decorator.

Fixes: http://tracker.ceph.com/issues/23796

Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:53 +01:00
Ricardo Dias
5edfec5f31
mgr/dashboard: auth: remove single user authentication
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:53 +01:00
Ricardo Dias
1d9ec3b9e4
mgr/dashboard: pylint: updated list of files to verify
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:53 +01:00
Ricardo Dias
dccd7d84be
mgr/dashboard: tests: local role-based authorization
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:53 +01:00
Ricardo Dias
2823013b45
mgr/dashboard: load and cofigure authorization system
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:53 +01:00
Ricardo Dias
d53272cc65
mgr/dashboard: authmanager: authorization handling cherrypy tool
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:53 +01:00
Ricardo Dias
603f715b73
mgr/dashboard: local role-based authorization system implementation
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:53 +01:00
Ricardo Dias
70b567f78d
mgr/dashboard: security: static scopes and permissions
Signed-off-by: Ricardo Dias <rdias@suse.com>
2018-06-26 12:28:50 +01:00
Jos Collin
675fc8ac38 doc: updated get-involved.rst for ceph-dashboard
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-06-26 16:49:25 +05:30