Commit Graph

98069 Commits

Author SHA1 Message Date
Brad Hubbard
35dfd7c3b5
Merge pull request #27665 from badone/wip-improve-dump_pgstate_history-json
osd: Improve dump_pgstate_history json output

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-05-08 11:59:37 +10:00
Kefu Chai
7c52e4b71b
Merge pull request #28015 from tchaikov/wip-install-deps.sh
install-deps.sh: install libboost-test for seastar

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-05-08 09:41:20 +08:00
Kefu Chai
9b796a181a install-deps.sh: install libboost-test for seastar
see
5858fe30c1/cmake/SeastarDependencies.cmake (L58-L68)

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-08 08:22:27 +08:00
Yuri Weinstein
43ef3cfbb6
Merge pull request #27979 from yuriw/wip-yuriw-crontab-master
qa/test: reduce over all number of runs
2019-05-07 12:43:11 -07:00
Josh Durgin
2021af8e73
Merge pull request #27941 from dzafman/wip-39011
doc: Describe recovery and backfill prioritizations

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-05-07 12:34:18 -07:00
Mykola Golub
a3de279923
Merge pull request #27981 from dillaman/wip-39598
qa/workunits/rbd: wait for rbd-nbd unmap to complete

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-05-07 20:58:01 +03:00
Sage Weil
5de99ed394 Merge PR #27911 into master
* refs/pull/27911/head:
	os/bluestore: dump onode meta before "no spanning blob" assertion.
	os/bluestore: move _dump_xxx methods out of BlueStore class

Reviewed-by: Sage Weil <sage@redhat.com>
2019-05-07 12:48:33 -05:00
Sage Weil
44c355709b Merge PR #27929 into master
* refs/pull/27929/head:
	os/bluestore: be verbose about objects that existing on rmcoll
	osd/PrimaryLogPG: disallow ops on objects with an empty name
	osd/PG: fix cleanup of pgmeta-like objects on PG deletion

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-05-07 12:48:16 -05:00
Joao Eduardo Luis
28c70208d8
Merge pull request #26488 from mogeb/per-pool-scrub-status
mon: show no[deep-]scrub flags per pool in the status

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2019-05-07 17:50:52 +01:00
Yuri Weinstein
544d13d851 qa/test: reduce over all number of runs
We kill thousands of queued jobs every week, so why do we even schedule them ?
Another point was that we run numerous of tests as part of PRs testing on released versions anyway, so it's duplicating effort

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-05-07 09:49:58 -07:00
Lenz Grimmer
21f058dcce
mgr/dashboard: All RBD features are supported by 'tcmu:runner' (#28000)
mgr/dashboard: All RBD features are supported by 'tcmu:runner'

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-05-07 18:04:37 +02:00
David Zafman
827ced407e
Merge pull request #27830 from dzafman/wip-38124
osd: Don't include user changeable flag in snaptrim related assert

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-05-07 08:47:26 -07:00
Kefu Chai
b906e95e39
Merge pull request #27841 from richael02/multiNVMESSD
vstart.sh: enable creating multiple OSDs backed by spdk backend

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-07 23:44:04 +08:00
Kefu Chai
d7efa54983
Merge pull request #28008 from tchaikov/wip-seastar
seastar: pick up changes for better performance

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-07 23:34:31 +08:00
Kefu Chai
ad86669dc3 cmake: do not build unit test of seastar
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-07 23:05:20 +08:00
Kefu Chai
a2ce72fe4f seastar: pick up changes for better performance
to be specific, a78fb44c96e2912c6f39b2151f94a0bb2b5796a6 helps to
improve the performance of future implementation -- with this change
future can always reference its local state without checking its `_promise`
and dereferencing it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-07 22:32:36 +08:00
Lenz Grimmer
6455f96c49
mgr/dashboard/qa: Fix a few linting issues in dashboard backend tests (#27865)
mgr/dashboard/qa: Fix a few linting issues in dashboard backend tests

Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-05-07 15:01:04 +02:00
Nathan Cutler
7962f7e8e6
Merge pull request #27947 from smithfarm/wip-39579
pybind/tox: pass additional command line arguments through to tox

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-05-07 14:02:28 +02:00
Ricardo Marques
f971270a22 mgr/dashboard: All RBD features are supported by 'tcmu:runner'
Fixes: https://tracker.ceph.com/issues/39607

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-05-07 12:28:19 +01:00
Yuval Lifshitz
9a3fbdb4c0
Merge pull request #27969 from yuvalif/wip-yuval-add-tenant-to-user
rgw: add tenant as parameter to User in multisite tests
2019-05-07 14:05:46 +03:00
Kefu Chai
4f97ddca62
Merge pull request #27987 from tchaikov/wip-crimson-osd-shutdown
crimson/osd: shutdown services in the right order

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-05-07 18:42:44 +08:00
Yuval Lifshitz
2d410b5a2e
Merge pull request #27931 from yuvalif/pubsub_info_update_fix
rgw/pubsub: fix doc on updates. fix multi-notifications
2019-05-07 12:18:53 +03:00
Yuval Lifshitz
4def929395 rgw: add tenant as parameter to User in multisite tests
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-05-07 12:05:33 +03:00
Kefu Chai
5d31861aa8 crimson/osd: shutdown services in the right order
we should stop config service *after* osd is stopped, as osd depends on
a working and alive config subsystem when stopping itself. for instance,
the destructor of AuthRegistry unregisters itself from the ObserverMgr,
which is in turn a member variable of ConfigProxy, so if ConfigProxy is
destroyed before we destroy mon::Client, we will have a segfault with
following backtrace

ObserverMgr<ceph::md_config_obs_impl<ceph::common::ConfigProxy>
>::remove_observer(ceph::md_config_obs_impl<ceph::common::ConfigProxy>*)
at /var/ssd/ceph/build/../src/common/config_obs_mgr.h:78
AuthRegistry::~AuthRegistry() at
/var/ssd/ceph/build/../src/crimson/common/config_proxy.h:101
 (inlined by) AuthRegistry::~AuthRegistry() at
/var/ssd/ceph/build/../src/auth/AuthRegistry.cc:28
ceph::mon::Client::~Client() at
/var/ssd/ceph/build/../src/crimson/mon/MonClient.h:44
ceph::mon::Client::~Client() at
/var/ssd/ceph/build/../src/crimson/mon/MonClient.h:44
OSD::~OSD() at /usr/include/c++/9/bits/unique_ptr.h:81

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-07 15:06:43 +08:00
Brad Hubbard
4825072720 osd: Improve dump_pgstate_history json output
Fixes: http://tracker.ceph.com/issues/38846

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-05-07 14:36:06 +10:00
Kefu Chai
4a8d366672
Merge pull request #27975 from tchaikov/wip-pidfile_write
global/pidfile: pass string_view instead of ConfigProxy to pidfile_wr…

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-05-07 11:19:13 +08:00
Sage Weil
55d5ed4f77 Merge PR #27932 into master
* refs/pull/27932/head:
	osd: clean up osdmap sharing
	osd: minor cleanup in dequeue_op

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-05-06 21:40:11 -05:00
Richael Zhuang
40c97b91b3 vstart.sh: enable creating multiple OSDs backed by spdk backend
Currently vstart.sh only support deploying one OSD based on NVMe SSD.
The following two cases will cause errors:
1.There are 2 more NVMe SSDs from the same vendor on the machine
2.Trying to deploy 2 more OSDs if we only get 1 pci_id available

Add the support for allowing deploying multiple OSDs on a machine with
multiple NVME SSDs.

Change-Id: I6016435c1438bb4d16aff31f4575e03ccd3c9b3d

Signed-off-by: Richael Zhuang <richael.zhuang@arm.com>
2019-05-07 10:11:19 +08:00
Gregory Farnum
6dbe49605e
Merge pull request #26152 from noonedeadpunk/mgr/zabbix_discovery
mgr/zabbix Added pools discovery and per-pool statistics

Reviewed-by: Wido den Hollander <wido@42on.com>
2019-05-06 13:15:54 -07:00
Yuval Lifshitz
10b8b57d72 rgw/pubsub: revert the RGWSysObjectCtx change
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-05-06 23:08:48 +03:00
Jason Dillaman
87278548a5 qa/workunits/rbd: wait for rbd-nbd unmap to complete
The "unmap" request is asynchronous, so wait for a short amount
of time for the "rbd-nbd" daemon process to exit.

Fixes: http://tracker.ceph.com/issues/39598
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-06 15:16:03 -04:00
Sebastian Wagner
5affd3b943 Apply suggestions from code review
Signed-off-by: Dmitriy Rabotjagov <noonedeadpunk@ya.ru>
2019-05-06 20:33:22 +03:00
Casey Bodley
f5c515e72a
Merge pull request #27967 from liewegas/wip-fix-rgw-bias
rgw/rgw_tools: fix 'osd pool set' json syntax

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-06 13:05:54 -04:00
Lenz Grimmer
22d6a82ad9
mgr/dashboard: Allow the decrease of pg's of an existing pool (#27785)
mgr/dashboard: Allow the decrease of pg's of an existing pool

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-05-06 17:38:34 +02:00
Casey Bodley
1da57c3aa7
Merge pull request #27977 from cbodley/wip-39597
doc/rgw: document CreateBucketConfiguration for s3 PUT Bucket api

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2019-05-06 10:50:07 -04:00
Kefu Chai
4276ee233a
Merge pull request #27968 from iotcg/master
vstart.sh: correct ceph-run path

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-06 21:39:16 +08:00
Casey Bodley
e97668bb7a doc/rgw: document CreateBucketConfiguration for s3 PUT Bucket api
Fixes: http://tracker.ceph.com/issues/39597

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-05-06 09:33:07 -04:00
Kefu Chai
89d62afcdf global/pidfile: pass string_view instead of ConfigProxy to pidfile_write()
there is no need to pass ConfigProxy to this function. and passing a
string_view also make it easier to reuse this function.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-06 21:04:27 +08:00
Casey Bodley
c2b0fa3c79
Merge pull request #27970 from Liuchang0812/duplicate-tags-bl
rgw: eliminates duplicated tags_bl var

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-06 08:43:46 -04:00
Nathan Cutler
d04b448160 pybind/tox: pass additional command line arguments through to tox
Fixes: 9426f1f204
Fixes: https://tracker.ceph.com/issues/39579
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-05-06 12:36:19 +02:00
Lenz Grimmer
1991495a22
doc: fix small typo in dashboard documentation (#27850)
doc: fix small typo in dashboard documentation

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2019-05-06 10:22:39 +02:00
Changcheng Liu
ce534b4f63 vstart.sh: correct ceph-run path
ceph-run is in the same directory as vstart.sh. It's often that
vstart.sh is run under build directory. Without giving the right
directory, ceph-run file can't be found.

Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
2019-05-06 15:17:33 +08:00
Chang Liu
533ba85d17 rgw: eliminates duplicated tags_bl var
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-05-06 15:05:50 +08:00
Kefu Chai
1b414e8281
Merge pull request #27538 from iotcg/radosgw
init-radosgw: use ceph-conf to get cluster configuration value

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-06 13:29:46 +08:00
Sage Weil
e387cbc450 os/bluestore: be verbose about objects that existing on rmcoll
This is always a bug (OSD doesn't try to remove a collection unless it
thinks it is empty), and not seeing it at default debug levels makes it
hard to track down.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-05 21:14:18 -05:00
Sage Weil
bf6e8a4a4d osd/PrimaryLogPG: disallow ops on objects with an empty name
These may conflict with pgmeta objects.  And are going to cause other
problems later (e.g., https://tracker.ceph.com/issues/38724).

Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-05 21:14:18 -05:00
Sage Weil
a0f48db5cb osd/PG: fix cleanup of pgmeta-like objects on PG deletion
If an object has an empty 'name' field, it "looks" like a pgmeta object,
and the PG cleanup code was skipping it.  However, we were letting these
objects get created.

Fix by only skipping *our* pgmeta object.  If there are other pgmeta-like
objects in the PG collection, clean them up.

Fixes: https://tracker.ceph.com/issues/38724
Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-05 21:14:17 -05:00
Sage Weil
3ee793d603 rgw/rgw_tools: fix 'osd pool set' json syntax
Fixes af30e3a512

Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-05 20:31:09 -05:00
Yuval Lifshitz
b4005db82d rgw/pubsub: cleanup tests for multiple notifications
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-05-05 11:31:20 +03:00
Casey Bodley
c0b9d10901 rgw: RGWUserPubSub::write invalidates its obj_ctx
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-05-05 10:06:48 +03:00