Commit Graph

78050 Commits

Author SHA1 Message Date
Patrick Donnelly
2b2b3d2035
mds: reset Formatter on error
This prevents partial results from concatenating with the error message.

Fixes: http://tracker.ceph.com/issues/21252

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-05 14:45:07 -07:00
Sage Weil
444f5aa085 qa/objectstore/bluestore*: less debug output
Let's see if this makes the spurious MON_DOWN failures go away?  (See
http://tracker.ceph.com/issues/20910)

Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-05 17:43:28 -04:00
Jason Dillaman
27194c30c5 qa/suites/rbd: reduce monitor requirements for mirroring tests
Fixes: http://tracker.ceph.com/issues/21251
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-09-05 16:43:34 -04:00
Jason Dillaman
98061bb3d7 qa/suites/rbd: fixed cache override
Fixes: http://tracker.ceph.com/issues/21251
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-09-05 16:43:34 -04:00
Jason Dillaman
763f1877ec qa/suites/rbd: reduce OSD debug log levels
The teuthology machines are periodically running out of space
due to the aggressive log settings.

Fixes: http://tracker.ceph.com/issues/21251
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-09-05 16:43:30 -04:00
Patrick Donnelly
f0f93c6645
Merge PR #17373 into master
* refs/remotes/upstream/pull/17373/head:
	doc/cephfs: add info on using EC pools with CephFS

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-05 12:48:41 -07:00
Sage Weil
6bd9db304f os/bluestore/BlueFS: prevent _compact_log_async reentry
_should_compact_log uses new_log != nullptr to tell whether compaction is
already in progress, but we don't set it until we are midway through the
process.  Set it at the top of the method to prevent reentry.

See 455cc6cea2, which failed to implement
this properly.

Fixes: http://tracker.ceph.com/issues/21250
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-05 15:01:59 -04:00
Kefu Chai
dd702cc94e ceph: collect all mds in mdsids()
otherwise, only the active mds are returned.

Fixes: http://tracker.ceph.com/issues/21230
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-06 01:49:20 +08:00
Kefu Chai
b682e61ddc ceph: always populate targets with ids_by_service()
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-06 01:49:20 +08:00
Kefu Chai
25639f6691 ceph: extract ids_by_service() so it can be reused
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-06 01:49:20 +08:00
Jason Dillaman
4a75ee43d3 librbd: rename of non-existent image results in seg fault
Fixes: http://tracker.ceph.com/issues/21248
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-09-05 12:11:45 -04:00
Casey Bodley
683212ae1f Merge pull request #17141 from theanalyst/doc-civetweb-ports
doc: rgw: mention the civetweb support for binding to multiple ports

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-09-05 11:39:12 -04:00
Jason Dillaman
149778edde Merge pull request #17436 from ashishkumsingh/wip-doc-fix-snapshot-flatten-example
doc: Fixes rbd snapshot flatten example

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-09-05 10:13:50 -04:00
Sage Weil
06ed8ee832 Merge pull request #17457 from batrick/githubmap
githubmap: add map for GitHub contributor lookup

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-05 09:05:46 -05:00
Jos Collin
9aab943015 Merge pull request #17489 from mychoxin/yuanxin_deep_copy
include/buffer.h: fix typo in comment

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-09-05 12:12:30 +00:00
xin.yuan
2c5442a1d5 include/buffer.h: fix comment 'no not allow' -> 'do not allow'
Signed-off-by: mychoxin <mychoxin@gmail.com>
2017-09-05 19:25:39 +08:00
yang.wang
80ee9c2a2b osd_types: define max in eversion_t::max() to static
max in eversion_t::max() can be static, no need to re constructs
it every time when calling eversion_t::max(), and max can be
constructed using eversion_t(epoch_t e, version_t v), it better than
firstly construct it by eversion_t() and then reassign it to (-1,-1)

Change-Id: I85de5685024e61ebc2d1816b0969be67bdaf45f5
Signed-off-by: yang.wang yang.wang@easystack.cn
2017-09-05 18:50:11 +08:00
Yan, Zheng
584241285f qa: whitelist expected MDS_READ_ONLY for kcephfs test
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-09-05 17:13:59 +08:00
Kefu Chai
a9e015261b Merge pull request #17430 from Songweibin/wip-osd-misc
osd: misc cleanups 

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-05 13:43:05 +08:00
Kefu Chai
c46220e682 Merge pull request #16476 from renhwztetecs/renhw-wip-mgr-standby-ip
mgr: add the ip addr of standbys

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-05 13:02:03 +08:00
Kefu Chai
e99c535c61 Merge pull request #17431 from tchaikov/wip-da-SCA-20170510
Coverity and SCA fixes

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-05 12:52:57 +08:00
xie xingguo
cd1225634c os/bluestore: add bluestore_prefer_deferred_size_hdd/ssd to tracked keys
To make these two keys can be changed online:

./bin/ceph tell osd.* injectargs "--bluestore_prefer_deferred_size_hdd 0"
osd.0: bluestore_prefer_deferred_size_hdd = '0' (not observed, change may require restart)
osd.1: bluestore_prefer_deferred_size_hdd = '0' (not observed, change may require restart)
osd.2: bluestore_prefer_deferred_size_hdd = '0' (not observed, change may require restart)

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-05 12:29:19 +08:00
Kefu Chai
4162ae05ca test/coredumpctl: support freebsd
setrlimit() on platforms without prctl()

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-05 11:39:26 +08:00
Kefu Chai
10fedb208c Merge pull request #17437 from tchaikov/wip-refactor-build_initial_pg_history
osd: update info only if new_interval

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-05 10:05:09 +08:00
Kefu Chai
a0052516b2 Merge pull request #17393 from tchaikov/wip-cmake-disable-vta
cmake: disable VTA on options.cc

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-05 09:33:24 +08:00
Patrick Donnelly
f6fa38e9be
githubmap: add map for GitHub contributor lookup
Idea of this is to allow scripts to lookup the contributor name/email by GitHub
username. This is useful in particular for adding appropriate "Reviewed-by"s
for each GitHub style "review".

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-04 12:11:16 -07:00
Patrick Donnelly
d0747a37fd
mds: print subtrees only after merge
During up:resolve, the MDS tries to merge each subtree with its parent. During
testing, QE found that many thousands of subtrees in a directory (made possible
using pins) would cause the MDS to spend minutes printing out subtree maps to
the debug log. This causes the heartbeat code to consider the MDS as stalled so
beacons are no longer sent to the mons resulting in the MDS being removed from
the rank.

A more complete solution to this problem is to selectively print subtrees
relating to the operation (e.g. the subtree and its parents).

Fixes: http://tracker.ceph.com/issues/21221
Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1485783

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-04 11:37:40 -07:00
Jianyu Li
178ca58fec Make standby-replay mds not migrate empty subtree when trimming cache
Signed-off-by: Jianyu Li <joannyli@tencent.com>
2017-09-04 23:41:41 +08:00
Jianyu Li
790c34138f Make standby-replay mds avoid initiating subtree export
Signed-off-by: Jianyu Li <joannyli@tencent.com>
2017-09-04 23:08:34 +08:00
Pan Liu
16f64a4c01 rbd-nbd: fix generic option issue
Fixes: http://tracker.ceph.com/issues/20426
Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
2017-09-04 22:16:18 +08:00
xie xingguo
948f4bc325 src/vstart.sh: default os to filestore for FreeBSD
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-04 21:09:12 +08:00
Nathan Cutler
be4d6b1a74 build/ops: rpm: do not create librbd.so.1 symlink in /usr/lib64/qemu
As reported by Ademar de Souza Reis Jr <areis@redhat.com>:

This symlink should not be necessary anymore. QEMU is properly linked to
ceph/librbd these days (look at the qemu-block-rbd sub-package in Fedora and
the respective package in RHEL).

The symlink was a hack from a time when librbd was distributed and supported by
ceph and the rbd driver would be enabled at runtime only when/if the symlink
was present.

So the right fix is to actually get rid of the symlink altogether and never
touch (much less own) /usr/lib64/qemu.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-09-04 15:00:47 +02:00
Xie Xingguo
aa27ac7791 Merge pull request #15705 from xiexingguo/wip-fix-blob-tracker-check
os/bluestore: pass strict flag to bluestore_blob_use_tracker_t::equal()

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-09-04 19:53:14 +08:00
Ashish Singh
fec61eb5cc doc: Fixes rbd snapshot flatten example
Snapshot flatten example has incorrect image name, fixing the same.

Fixes: #17723

Signed-off-by: Ashish Singh <assingh@redhat.com>
2017-09-04 16:51:57 +05:30
Xie Xingguo
b1e31f5e3f Merge pull request #15363 from ShiqiCooperation/master
test/unittest_bluefs: check whether rmdir success

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-04 19:01:59 +08:00
iliul
ac23940e09 rgw: remove the useless output when list zones
Signed-off-by: iliul <liul124@chinaunicom.cn>
2017-09-04 15:38:51 +08:00
Kefu Chai
4ae053439e osd: update info only if new_interval
refactor OSD::build_initial_pg_history() so we update the info only if a
new interval is identified. also, this is consistent with
OSD::build_past_intervals_parallel().

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-04 13:51:52 +08:00
Haomai Wang
09561004a1 Merge pull request #17435 from liupan1111/wip-fix-spdk-perf
bluestore/NVMEDevice: accurate the latency perf counter of queue latency

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-09-03 22:33:43 -07:00
Pan Liu
ddc96a8e68 bluestore/NVMEDevice: accurate the latency of queue latency.
Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
2017-09-04 11:33:03 +08:00
Pan Liu
cc4596803c bluestore/NVMEDevice: remove mm_pause according to the example givn by
spdk.

Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
2017-09-04 11:31:59 +08:00
huanwen ren
389d676b5d mgr: add the ip addr of standbys
we need to manage the ip addr of the "standbys" state,
because the hostname/gid is insufficient to locate the
Standby node. we add ip of the mgr standby to metadata.

Signed-off-by: huanwen ren <ren.huanwen@zte.com.cn>
2017-09-04 11:00:27 +08:00
Pan Liu
90bd1961cc bluestore/NVMEDevice: rename the perf counter *aio_write* to *write*,
because it will also statistic the latency of sync write

Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
2017-09-04 10:57:24 +08:00
Pan Liu
cba229e987 bluestore/NVMEDevice.cc: rename the thread from ceph-osd to
nvme-device-manager, to avoid name duplication with main thread
"ceph-osd"

Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
2017-09-04 10:49:11 +08:00
Xie Xingguo
c93c20fea5 Merge pull request #17409 from liewegas/wip-21207
os/bluestore: separate finisher for deferred_try_submit

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Varada Kari <varada.kari@sandisk.com>
2017-09-04 09:20:40 +08:00
Xie Xingguo
5ac0969b8a Merge pull request #17395 from theanalyst/cli-rados-stat2
cli: rados: support for high precision time using stat2

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-04 09:18:20 +08:00
Xie Xingguo
659f8912e6 Merge pull request #17100 from mychoxin/yuanxin_vstart_default_bluestore
vstart.sh: use bluestore as default osd objectstore backend

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-04 09:17:07 +08:00
Yehuda Sadeh
f609c0eb3a Merge pull request #16855 from amitkumar50/rgw_module
rgw: Initializes uninitialized members

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-09-03 08:25:42 +03:00
Yehuda Sadeh
1970d8fbc0 Merge pull request #17129 from C2python/clear_para
rgw: Remove unused Parameter in Function RGWConf::init()

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-09-03 08:23:59 +03:00
Sage Weil
c30ef8760d Merge pull request #15341 from chardan/jfw-wip-rand_makes_puppies_cry
common: implement random number generator (following N3551)

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
2017-09-02 13:37:37 -05:00
Sage Weil
6ad99a7e6c Merge pull request #15565 from gmayyyha/ceph-osd-help-output
ceph-osd: some flags are not documented in the help output

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-02 13:36:53 -05:00