Commit Graph

98100 Commits

Author SHA1 Message Date
Ricardo Marques
f243f7a531 mgr/dashboard: Fix iSCSI form when using IPv6
Fixes: https://tracker.ceph.com/issues/39578

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-05-07 09:38:41 +01:00
Kefu Chai
5d31861aa8 crimson/osd: shutdown services in the right order
we should stop config service *after* osd is stopped, as osd depends on
a working and alive config subsystem when stopping itself. for instance,
the destructor of AuthRegistry unregisters itself from the ObserverMgr,
which is in turn a member variable of ConfigProxy, so if ConfigProxy is
destroyed before we destroy mon::Client, we will have a segfault with
following backtrace

ObserverMgr<ceph::md_config_obs_impl<ceph::common::ConfigProxy>
>::remove_observer(ceph::md_config_obs_impl<ceph::common::ConfigProxy>*)
at /var/ssd/ceph/build/../src/common/config_obs_mgr.h:78
AuthRegistry::~AuthRegistry() at
/var/ssd/ceph/build/../src/crimson/common/config_proxy.h:101
 (inlined by) AuthRegistry::~AuthRegistry() at
/var/ssd/ceph/build/../src/auth/AuthRegistry.cc:28
ceph::mon::Client::~Client() at
/var/ssd/ceph/build/../src/crimson/mon/MonClient.h:44
ceph::mon::Client::~Client() at
/var/ssd/ceph/build/../src/crimson/mon/MonClient.h:44
OSD::~OSD() at /usr/include/c++/9/bits/unique_ptr.h:81

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-07 15:06:43 +08:00
Brad Hubbard
4825072720 osd: Improve dump_pgstate_history json output
Fixes: http://tracker.ceph.com/issues/38846

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2019-05-07 14:36:06 +10:00
Kefu Chai
4a8d366672
Merge pull request #27975 from tchaikov/wip-pidfile_write
global/pidfile: pass string_view instead of ConfigProxy to pidfile_wr…

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-05-07 11:19:13 +08:00
Sage Weil
55d5ed4f77 Merge PR #27932 into master
* refs/pull/27932/head:
	osd: clean up osdmap sharing
	osd: minor cleanup in dequeue_op

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-05-06 21:40:11 -05:00
Richael Zhuang
40c97b91b3 vstart.sh: enable creating multiple OSDs backed by spdk backend
Currently vstart.sh only support deploying one OSD based on NVMe SSD.
The following two cases will cause errors:
1.There are 2 more NVMe SSDs from the same vendor on the machine
2.Trying to deploy 2 more OSDs if we only get 1 pci_id available

Add the support for allowing deploying multiple OSDs on a machine with
multiple NVME SSDs.

Change-Id: I6016435c1438bb4d16aff31f4575e03ccd3c9b3d

Signed-off-by: Richael Zhuang <richael.zhuang@arm.com>
2019-05-07 10:11:19 +08:00
Gregory Farnum
6dbe49605e
Merge pull request #26152 from noonedeadpunk/mgr/zabbix_discovery
mgr/zabbix Added pools discovery and per-pool statistics

Reviewed-by: Wido den Hollander <wido@42on.com>
2019-05-06 13:15:54 -07:00
Yuval Lifshitz
10b8b57d72 rgw/pubsub: revert the RGWSysObjectCtx change
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-05-06 23:08:48 +03:00
Jason Dillaman
87278548a5 qa/workunits/rbd: wait for rbd-nbd unmap to complete
The "unmap" request is asynchronous, so wait for a short amount
of time for the "rbd-nbd" daemon process to exit.

Fixes: http://tracker.ceph.com/issues/39598
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-05-06 15:16:03 -04:00
Sebastian Wagner
5affd3b943 Apply suggestions from code review
Signed-off-by: Dmitriy Rabotjagov <noonedeadpunk@ya.ru>
2019-05-06 20:33:22 +03:00
Casey Bodley
f5c515e72a
Merge pull request #27967 from liewegas/wip-fix-rgw-bias
rgw/rgw_tools: fix 'osd pool set' json syntax

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-06 13:05:54 -04:00
Lenz Grimmer
22d6a82ad9
mgr/dashboard: Allow the decrease of pg's of an existing pool (#27785)
mgr/dashboard: Allow the decrease of pg's of an existing pool

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-05-06 17:38:34 +02:00
Casey Bodley
1da57c3aa7
Merge pull request #27977 from cbodley/wip-39597
doc/rgw: document CreateBucketConfiguration for s3 PUT Bucket api

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2019-05-06 10:50:07 -04:00
Kefu Chai
4276ee233a
Merge pull request #27968 from iotcg/master
vstart.sh: correct ceph-run path

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-06 21:39:16 +08:00
Casey Bodley
e97668bb7a doc/rgw: document CreateBucketConfiguration for s3 PUT Bucket api
Fixes: http://tracker.ceph.com/issues/39597

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-05-06 09:33:07 -04:00
Kefu Chai
89d62afcdf global/pidfile: pass string_view instead of ConfigProxy to pidfile_write()
there is no need to pass ConfigProxy to this function. and passing a
string_view also make it easier to reuse this function.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-06 21:04:27 +08:00
Casey Bodley
c2b0fa3c79
Merge pull request #27970 from Liuchang0812/duplicate-tags-bl
rgw: eliminates duplicated tags_bl var

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-06 08:43:46 -04:00
Nathan Cutler
d04b448160 pybind/tox: pass additional command line arguments through to tox
Fixes: 9426f1f204
Fixes: https://tracker.ceph.com/issues/39579
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-05-06 12:36:19 +02:00
Lenz Grimmer
1991495a22
doc: fix small typo in dashboard documentation (#27850)
doc: fix small typo in dashboard documentation

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2019-05-06 10:22:39 +02:00
Changcheng Liu
ce534b4f63 vstart.sh: correct ceph-run path
ceph-run is in the same directory as vstart.sh. It's often that
vstart.sh is run under build directory. Without giving the right
directory, ceph-run file can't be found.

Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
2019-05-06 15:17:33 +08:00
Chang Liu
533ba85d17 rgw: eliminates duplicated tags_bl var
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2019-05-06 15:05:50 +08:00
Kefu Chai
1b414e8281
Merge pull request #27538 from iotcg/radosgw
init-radosgw: use ceph-conf to get cluster configuration value

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-06 13:29:46 +08:00
Sage Weil
e387cbc450 os/bluestore: be verbose about objects that existing on rmcoll
This is always a bug (OSD doesn't try to remove a collection unless it
thinks it is empty), and not seeing it at default debug levels makes it
hard to track down.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-05 21:14:18 -05:00
Sage Weil
bf6e8a4a4d osd/PrimaryLogPG: disallow ops on objects with an empty name
These may conflict with pgmeta objects.  And are going to cause other
problems later (e.g., https://tracker.ceph.com/issues/38724).

Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-05 21:14:18 -05:00
Sage Weil
a0f48db5cb osd/PG: fix cleanup of pgmeta-like objects on PG deletion
If an object has an empty 'name' field, it "looks" like a pgmeta object,
and the PG cleanup code was skipping it.  However, we were letting these
objects get created.

Fix by only skipping *our* pgmeta object.  If there are other pgmeta-like
objects in the PG collection, clean them up.

Fixes: https://tracker.ceph.com/issues/38724
Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-05 21:14:17 -05:00
Sage Weil
3ee793d603 rgw/rgw_tools: fix 'osd pool set' json syntax
Fixes af30e3a512dd1e5c51639d1f823b99ed9b43fb50

Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-05 20:31:09 -05:00
Yuval Lifshitz
b4005db82d rgw/pubsub: cleanup tests for multiple notifications
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-05-05 11:31:20 +03:00
Casey Bodley
c0b9d10901 rgw: RGWUserPubSub::write invalidates its obj_ctx
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-05-05 10:06:48 +03:00
Kefu Chai
ba970314fe
Merge pull request #27885 from b-ranto/wip-restful-perf-counters
restful: Expose perf counters

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-05-04 13:28:13 +08:00
Kefu Chai
382a3efddf
Merge pull request #27891 from tchaikov/wip-mgr-pgp-num-change-throttling
mgr/DaemonServer: refactor pgp_num changes throttling

Reviewed-by: Sage Weil <sage@redhat.com>
2019-05-04 13:26:39 +08:00
Yuri Weinstein
bb4bceb3b2
Merge pull request #27960 from yuriw/wip-yuriw-crontab-master
qa/tests: removed all runs on ovh
2019-05-03 13:36:56 -07:00
J. Eric Ivancich
a7b4667954
Merge pull request #27896 from ivancich/wip-add-rgw-period-comments
rgw: add some comments to rgw code to help explain functionality

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-03 16:12:48 -04:00
Yuri Weinstein
e96f61a205
Merge pull request #27956 from yuriw/wip-yuriw-smoke-master
qa/tests - cleaned up distro settings
2019-05-03 13:06:11 -07:00
Yuri Weinstein
e699d9026d qa/tests: removed all runs on ovh
and consolidated `smoke` runs re: https://github.com/ceph/ceph/pull/27956

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-05-03 12:40:59 -07:00
J. Eric Ivancich
8111dd712b rgw: add some comments to rgw code to help explain functionality
Comments to explain the role of RGWPeriod and the use of prefixes in
gc log entries are added. Some other comments are reformatted for 80
columns.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2019-05-03 15:29:59 -04:00
Casey Bodley
10e9fa3df0
Merge pull request #27838 from yuvalif/wip-yuval-pubsub_teuthology-new
rgw/pubsub: add multisite pubsub tests to teuthology

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-03 14:49:25 -04:00
Yuri Weinstein
52fdf23026 qa/tests - cleaned up distro settings
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-05-03 08:21:42 -07:00
Lenz Grimmer
9b99ed9157
Merge pull request #27448 from ricardoasmarques/upgrade-ceph-iscsi-version
mgr/dashboard: Support ceph-iscsi config v9

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-05-03 13:10:23 +02:00
Nathan Cutler
9b5815f505
Merge pull request #27887 from smithfarm/wip-bci-len255plus
script/backport-create-issue: handle long Redmine issue names

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-03 13:06:08 +02:00
Mykola Golub
7f80660068
Merge pull request #27895 from dillaman/wip-librbd-zero-copy
librbd: support zero-copy writes via the C API

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-05-03 10:19:06 +03:00
Kefu Chai
dfdb1d0810
Merge pull request #16929 from amitkumar50/cov-rgw-1
rgw: Initialize member variables in rgw_sync.h, rgw_rados.h

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-05-03 13:25:42 +08:00
David Zafman
bc300055e7 doc: Describe recovery and backfill prioritizations
Fixes: http://tracker.ceph.com/issues/39011

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-05-02 21:58:44 -07:00
Kefu Chai
88d2f975af
Merge pull request #27927 from tchaikov/wip-util.collect_sys_info-is-optional
test/common/test_util: skip it if /etc/os-release does not exist

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-05-03 10:34:49 +08:00
Sage Weil
573913c2e8 osd: clean up osdmap sharing
- always use the Session::last_sent_epoch value, both for clients and osds
- get rid of the stl map<> of peer epochs
- consolidate all map sharing into a single maybe_share_map()
- optionally take a lower bound on the peer's epoch, for use when it is
  available (e.g., when we are handling a message that specifies what
  epoch the peer had when it sent the message)
- use const OSDMapRef& where possible
- drop osd->is_active() check, since we no longer have any dependency on
  OSD[Service] state beyond our osdmap

The old callchain was convoluted, partly because it was needlessly
separated into several layers of helpers, and partly because the tracking
for clients and peer OSDs was totally different.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-02 14:44:49 -05:00
Sage Weil
7472219695 osd: minor cleanup in dequeue_op
Signed-off-by: Sage Weil <sage@redhat.com>
2019-05-02 14:32:09 -05:00
Casey Bodley
7a28272c34
Merge pull request #27897 from ivancich/wip-add-editor-comments-rgw-services
rgw: add editor directive comments to rgw services source files

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-05-02 14:23:33 -04:00
Abhishek L
ae8fe24b6f
Merge pull request #27820 from smithfarm/wip-39361
rgw: drop cloud sync module logs attrs from the log

Reviewed-By: Casey Bodley <cbodley@redhat.com>
Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2019-05-02 19:52:57 +02:00
Kefu Chai
66de7bd8cc test: do not conditionize on GTEST_HAS_PARAM_TEST
value-parameterized is supported on all platforms, so drop this check

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-03 01:38:27 +08:00
Kefu Chai
71f5f3e8da test: s/INSTANTIATE_TEST_CASE_P/INSTANTIATE_TEST_SUITE_P/
the former is deprecated

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-05-03 01:35:04 +08:00
Yuval Lifshitz
3279a786ba rgw/pubsub: fix doc on updates. attempt to fix multi-notifications
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-05-02 20:33:34 +03:00