Commit Graph

92923 Commits

Author SHA1 Message Date
Gregory Farnum
dca5001b4e
Merge pull request #25230 from runsisi/wip-cleanup-objecter
osdc/Objecter: no need null pointer check for op->session anymore

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-12-05 15:37:53 -08:00
Sage Weil
59d0844c12 Merge PR #23550 into master
* refs/pull/23550/head:
	auth: Kerberos authentication
2018-12-05 13:42:17 -06:00
Jason Dillaman
fb0ea62ba1 test/cli-integration/rbd: added new parent image attributes
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-12-05 14:12:48 -05:00
J. Eric Ivancich
8cd7ff99dd rgw: fix bad user stats on versioned bucket after reshard
User stats should only count bucket index entries that refer to actual
data. So only count entries with categories MAIN or MULTIMETA.

Note: the full solution is provided by the combination of the fixes in
PR 25333 (https://github.com/ceph/ceph/pull/25333) and these changes.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2018-12-05 13:26:47 -05:00
Jason Dillaman
241896c660
Merge pull request #25166 from kungf/journal_remove_full
journal: allow remove set when jounal pool is full

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-05 13:25:31 -05:00
Jason Dillaman
493dc89d08
Merge pull request #25175 from trociny/wip-36710
librbd: restart io if migration parent gone

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-05 13:24:55 -05:00
Jason Dillaman
4bc7e0aa84
Merge pull request #25260 from trociny/wip-24609
rbd-nbd: support namespaces

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-05 13:24:36 -05:00
Jason Dillaman
74d939799c
Merge pull request #25371 from trociny/wip-osd-query-subkey-types
osd: support more dynamic perf query subkey types

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-05 13:24:23 -05:00
Jason Dillaman
bf5b75679e
Merge pull request #25151 from trociny/wip-osd-perf-query-limit
mgr: add limit param to osd perf query

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-05 13:24:10 -05:00
Jason Dillaman
2a64af8928
Merge pull request #25379 from tchaikov/wip-37508
librbd: reset snaps in rbd_snap_list()

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-05 13:23:33 -05:00
Sage Weil
269910fc8b qa/suites: fix bluestore links
Signed-off-by: Sage Weil <sage@redhat.com>
2018-12-05 10:30:14 -06:00
Kefu Chai
2919ada413
Merge pull request #24882 from rzarzynski/wip-bl-hypercombined
common: hypercombined bufferlist

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
2018-12-06 00:16:55 +08:00
Casey Bodley
c7bf1be10e rgw: store ref to librados::IoCtx in rgw::AioResult
the IoCtx has to outlive its aio completions

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-12-05 11:16:54 -05:00
Casey Bodley
7e6c232843 rgw: add const overload of RGWSI_RADOS::Obj::get_ref()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-12-05 11:16:54 -05:00
Casey Bodley
a4d3977cfa rgw: rgw_rados_ref contains rgw_raw_obj
rgw_rados_ref duplicated each of the fields from rgw_raw_obj

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-12-05 11:16:54 -05:00
Casey Bodley
046769848d rgw: use AioThrottle for Object::Read::iterate() ops
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-12-05 11:16:54 -05:00
Casey Bodley
693dfd6b9e rgw: clean up iterate_obj() callbacks
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-12-05 11:16:54 -05:00
Casey Bodley
f5a64fd9b4 rgw: add append_atomic_test() overload for RGWObjState
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-12-05 11:16:54 -05:00
Casey Bodley
e81cedcf73 rgw: add id to distinguish between Aio results
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-12-05 11:16:54 -05:00
Casey Bodley
81e79fe7a7 rgw: Aio reads return bufferlist in result
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-12-05 11:16:54 -05:00
Casey Bodley
85fb04416e rgw: move aio throttles to namespace rgw
they're useful outside of putobj

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-12-05 11:16:54 -05:00
Kefu Chai
8ffe31a6e2
Merge pull request #25365 from xiexingguo/wip-37493
osd/OSDMap: fix upmap mis-killing for erasure-coded PGs
2018-12-06 00:13:28 +08:00
Kefu Chai
d80000fcf0
Merge pull request #25262 from aclamk/wip-kvstore-tool-dump
ceph-kvstore-tool: dump fixes

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-06 00:13:00 +08:00
Kefu Chai
52e4315c63
Merge pull request #25383 from dmick/wip-container-name
common/util.cc: add CONTAINER_NAME processing for metadata

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-06 00:02:49 +08:00
Kefu Chai
9a4d0ac754
Merge pull request #25400 from dillaman/wip-ceph-cli
ceph: do not raise StopIteration within generator

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-06 00:01:43 +08:00
Willem Jan Withagen
eabeaf5fbc rbd: workaround for llvm linker proplem, avoid std:pair dtor
When linking with llvm linker on FreeBSD:
```
/usr/bin/ld.lld: error: undefined symbol: std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, bool>::~pair()
>>> referenced by Image.cc:349 (/home/jenkins/workspace/ceph-master/src/librbd/api/Image.cc:349)
>>>               Image.cc.o:(librbd::api::Image<librbd::ImageCtx>::list_children(librbd::ImageCtx*, cls::rbd::ParentImageSpec const&, std::__1::vector<librbd::linked_image_spec_t, std::__1::allocator<librbd::linked_image_spec_t> >*)) in archive ../../../lib/librbd_internal.a
```

Which is probably because the compiler calls a dtor on the just created pair.
But the FreeBSD linker does not find a dtor in the any of the libraries.
This rewrite build and links without the linker error.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2018-12-05 15:35:37 +01:00
Tatjana Dehler
984164d37a mgr/dashboard: show config option description via cd-helper
Fixes: https://tracker.ceph.com/issues/37406
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-12-05 14:20:36 +01:00
Tatjana Dehler
c7b82c3999 mgr/dashboard: add OSD recovery speed form
Add a form to set the OSD recovery speed. There are three predefined
priorities available: 'Low', 'Default' and 'High'.
By setting the priority the config options 'osd_max_backfills',
'osd_recovery_max_active', 'osd_recovery_max_single_start',
'osd_recovery_sleep' will be updated with predefined values.
It's also possible to set custom values.

Fixes: https://tracker.ceph.com/issues/35540
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-12-05 14:20:33 +01:00
Kefu Chai
6f447d0662
Merge pull request #25392 from majianpeng/async-rdma
msg/async/rdma: Delete duplicate header file

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-05 18:47:53 +08:00
taoCH
e611be8dac rgw_file: user info never synced since librgw init
Fixed: https://tracker.ceph.com/issues/37527

Signed-off-by: Tao Chen <chentao@umcloud.com>
2018-12-05 18:20:20 +08:00
Kanika Murarka
7793b38c19 mgr/dashboard: Validation for duplicate RGW user email
Fixes: http://tracker.ceph.com/issues/37369
Signed-off-by: Kanika Murarka <kmurarka@redhat.com>
2018-12-05 13:58:34 +05:30
YongSheng Zhang
e058bdc595 async/dpdk: when enable dpdk, multiple message queue defect
when enable dpdk, if set ms_async_op_threads
value greater than 1 at "ceph.conf" file,
then osd can not work.

Signed-off-by: zhangyongsheng <ptozys@gmail.com>
2018-12-05 14:52:43 +08:00
Tim Serong
b9bf629325 mgr/deepsea: check for inflight completions when starting event reader
This handles the case where an operation is inflight, but salt-api dies
(or the connection to salt-api has failed for some reason).  The next time
we're able to connect, we first check if there's any outstanding completions,
and look up matching salt jobs to see if they finished in the meantime.

Signed-off-by: Tim Serong <tserong@suse.com>
2018-12-05 16:37:44 +11:00
Tim Serong
0c9dd842d3 mgr/deepsea: mention DeepSea 0.9.9 in docs, cleanup logging & comments
Signed-off-by: Tim Serong <tserong@suse.com>
2018-12-05 16:37:44 +11:00
Sage Weil
f390704b46 qa/objectstore: bluestore -> bluestore-{bitmap,stupid}
The new default is bitmap, so we were testing bitmap twice.  Instead,
explicitly call out stupid and bitmap cases so a future default change
won't break coverage.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-12-04 14:05:49 -06:00
Jason Dillaman
4fbb67203a ceph: do not raise StopIteration within generator
This is implicit when a generator exits and under Python 3
it results in a "StopIteration" exception being raised when
"ceph --help" is run.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-12-04 15:00:38 -05:00
Sage Weil
948efa96bb Merge PR #24129 into master
* refs/pull/24129/head:
	common: drop ::length() from other implementations of the OpQueue.
	common, osd: kill OpQueue::length() to minimize inter-core traffic.

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2018-12-04 14:00:06 -06:00
Sage Weil
c5b5847ad3 Merge PR #25388 into master
* refs/pull/25388/head:
	mon/OSDMonitor: do not no_reply on ready_to_merge message

Reviewed-by: João Eduardo Luís <joao@suse.de>
2018-12-04 13:59:01 -06:00
Sage Weil
9f35081ae2 osd: requeue waiting peering events from deleted slots in unprime_split_children
These child slots we are deleting may have queued events that should be
requeued and reexamined.  For example, a pg query may be waiting for the
split and then discarded, instead of being reexamined and processed via
handle_pg_query_nopg().

Fixes: http://tracker.ceph.com/issues/37525
Signed-off-by: Sage Weil <sage@redhat.com>
2018-12-04 13:57:47 -06:00
Stephan Müller
b32feea6f4 mgr/dashboard: Settings service
The settings service handles settings that are set
within the dashboard.

The service has a helpful function and a good memory. The function will
allow to check if a certain option is set, if it's set the callback will
be triggered. If the API request was made before for this particular
option, no API request is made anymore, as the service will remember if
the state is set or not.

Fixes: https://tracker.ceph.com/issues/37471
Signed-off-by: Stephan Müller <smueller@suse.com>
2018-12-04 17:42:01 +01:00
Mykola Golub
5561ffc864 mgr/osd_perf_query: example how limit can be used
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-04 17:36:14 +02:00
Mykola Golub
0d0919fe06 osd: make use of osd perf query's limit param
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-04 17:36:14 +02:00
Mykola Golub
b1f1267118 mgr: add limit param to osd perf query
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-04 17:36:14 +02:00
Jason Dillaman
c80882919c
Merge pull request #25192 from ProgVal/doc-rbd-features
rbd: Document new RBD feature flags and version support

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-04 09:47:15 -05:00
Tatjana Dehler
f71e4f15e5 mgr/dashboard: add config option bulk_set
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-12-04 15:15:19 +01:00
Lenz Grimmer
cce8d7672f
Merge pull request #25359 from zmc/wip-dashboard-fix-teuth-runner
mgr/dashboard: Fix PYTHONPATH for test runner

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-12-04 15:06:48 +01:00
Lenz Grimmer
8d7112b603
Merge pull request #25231 from rhcs-dashboard/37371-logs-links-permissions
mgr/dashboard: 'Logs' links permission in Landing Page

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-12-04 15:01:54 +01:00
Lenz Grimmer
3fa3060253
Merge pull request #25322 from Devp00l/wip-issue-37468
mgr/dashboard: Document custom RESTController endpoints

Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-12-04 15:00:23 +01:00
Zengran Zhang
c6ff879d9b osd: avoid using null agent_state
the agent_state has no lock guard,so need to check if it is null

Signed-off-by: Zengran Zhang <zhangzengran@sangfor.com.cn>
2018-12-04 21:19:18 +08:00
Jianpeng Ma
87cfbcac13 msg/async/rdma: Delete duplicate header file
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-12-04 20:31:07 +08:00