Commit Graph

80299 Commits

Author SHA1 Message Date
Yan, Zheng
7de37382ac mds: trim 'N' log segments according to how many log segments are there
Config 'mds_log_max_expiring' is 20 by default. It means that at most
20 log segments get trimmed in each tick. For busy cluster, this can
cause mds behind on trimming log segments.

Fixes: fixes: http://tracker.ceph.com/issues/21975
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-11-01 10:59:48 +08:00
Kefu Chai
db89b2c1b0
Merge pull request #18329 from ifed01/wip-fix-mempool-dump
mempool: fix lack of pool names in mempool:dump output for JSON format

Reviewed-By: Kefu Chai <kchai@redhat.com>
2017-11-01 10:54:26 +08:00
Kefu Chai
d07ba9016b
Merge pull request #18575 from majianpeng/msg-cleanup-2
msg/async:  misc cleanup.

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-11-01 10:53:43 +08:00
Kefu Chai
cc484b2606
Merge pull request #18581 from wzliao/wip-drop-unused-parameter
osd/PrimaryLogPG: drop unused parameters

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-11-01 10:53:09 +08:00
Kefu Chai
c5fdce5422
Merge pull request #18588 from mogeb/rados-bench-clock
tools/rados: use the monotonic clock in rados bench

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-01 10:52:40 +08:00
Kefu Chai
737ef1b275
Merge pull request #18595 from batrick/mon-clock
mon: a few conversions to monotonic clock

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-01 10:50:52 +08:00
Kefu Chai
8818a1939d
Merge pull request #18636 from tchaikov/wip-osdmap-cleanup
osd/OSDMap: remove the unnecessary checks for null

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-01 10:48:56 +08:00
Kefu Chai
0827af8f4d
Merge pull request #18647 from tchaikov/wip-pgmap-cleanup
mon/PGMap: use new-style options and cleanup

Reviewed-by: John Spray <john.spray@redhat.com>
2017-11-01 10:48:24 +08:00
Kefu Chai
5632c23838
Merge pull request #18648 from tchaikov/wip-vstart-drop-num-opts
vstart.sh: drop --{mon,osd,mds,rgw,mgr}_num options

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-01 10:48:03 +08:00
Kefu Chai
371d3f4091 qa: stop testing deprecated "ceph osd create"
"ceph osd create" is not idempotent, and is considered deprecated.

Fixes: http://tracker.ceph.com/issues/21993
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-01 10:45:11 +08:00
Patrick Donnelly
f2efd4de4d
Merge PR #18618 into master
* refs/pull/18618/head:
	mds: pass a reference of function to sanitize() not a copy

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
2017-10-31 16:27:44 -07:00
Casey Bodley
be3990c2f5
Merge pull request #18572 from linuxbox2/wip-rgwfile-env
rgw_log, rgw_file: account for new required envvars

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-31 16:57:42 -04:00
Yuri Weinstein
20a62e1c91
Merge pull request #18327 from PCzhangPC/clonelostmeta
librbd: cannot clone all image-metas if we have more than 64 key/value pairs

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-31 13:56:56 -07:00
Yuri Weinstein
87cfeae774
Merge pull request #18546 from liewegas/wip-deprecate-features
include/ceph_features: deprecate a bunch of features

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-10-31 13:56:20 -07:00
Yuri Weinstein
85bef1e107
Merge pull request #18616 from xiexingguo/wip-hunt-scrub-mismatch
osd/PrimaryLogPG: more oi.extents fixes

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-31 13:51:31 -07:00
Andrew Schoen
f8b114be61 ceph-volume tests: adds objecstore as a testing factor
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2017-10-31 15:25:23 -05:00
Andrew Schoen
b49a19a977 ceph-volume: enable the centos7-bluestore and xenial-bluestore tests
This also updates the ansible and testinfra version to match the current
ceph-ansible master branch.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2017-10-31 15:10:28 -05:00
Andrew Schoen
38372890c9 ceph-volume: adds the xenial-bluestore testing scenario
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2017-10-31 15:09:52 -05:00
Andrew Schoen
45e4b0c9d7 ceph-volume: adds the centos7-bluestore testing scenario
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2017-10-31 15:05:46 -05:00
vasukulkarni
e12f7a980b
Merge pull request #18634 from tchaikov/wip-qa-add-restful
qa: add "restful" to ceph_mgr_modules in ceph-ansible suite
2017-10-31 12:36:06 -07:00
Patrick Donnelly
76a950b2ec
ceph.in: pass RADOS inst to LibCephFS
This avoids multiple instances of the admin socket and other redundancies.

Fixes: http://tracker.ceph.com/issues/21967
Fixes: http://tracker.ceph.com/issues/21406

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-31 12:06:08 -07:00
Sage Weil
e90eef1336 os/filestore: implement get_devices()
Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-31 12:30:44 -05:00
Sage Weil
cb6bfbeb19 os/bluestore: implement get_devices()
Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-31 12:30:44 -05:00
Sage Weil
b67c259f11 osd: return rolled-up 'devices' list as part of metadata
Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-31 12:30:43 -05:00
Sage Weil
805fcee0ae os/bluestore/BlockDevice: add get_devname(), get_devices()
Enumerate device(s) that we are backed by.  It may be plural because of
DM, which might mask an underlying device, or because the dm device is
combining multiple other devices.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-31 12:30:43 -05:00
Sage Weil
9db3ef8d05
Merge pull request #18520 from alram/kube-helm-doc
doc: Kube + Helm installation
2017-10-31 12:09:18 -05:00
Sage Weil
f709da6f2c os/ObjectStore: add get_devices() method
The intent here is to return the set of hardware storage devices, as
identified by the "devname" (i.e., the directory name for the device in
/sys/block/).  For example, "sda", "nvme0n1", etc.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-31 11:54:42 -05:00
Sage Weil
6b3b0afc28
Merge pull request #18639 from yaozongyou/make-readme-properly-align
doc: make the commands in README.md properly aligned

Reviewed-by: Amit Kumar <amitkuma@redhat.com>
2017-10-31 11:44:33 -05:00
John Spray
3160ef2c0a mds: clean up clog damage message when repairing
If we've repaired then we don't need to be at WRN
and we don't need to advise the user to look up
the damage detail.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-31 16:37:36 +00:00
John Spray
7e52729699 mds: flush after scrub repairs
Otherwise, if we restart the MDS right after the scrub,
then scrub again, it will see the same inconsistency when
it looks at the on-disk state.

This involves adapting the use of ScrubHeader to be something
writeable during scrub to record whether repair happened.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-31 16:37:36 +00:00
John Spray
444382c337 mds: don't report repaired backtraces in damagetable
Fixes: http://tracker.ceph.com/issues/18743
Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-31 16:37:36 +00:00
John Spray
5fd00a6e1b mds: cleaner scrub complete log msg
People often are not using a tag with their scrub,
let's not have the ugly "with tag ''" in that case.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-31 16:37:36 +00:00
Casey Bodley
9e94244db2 cmake/cls: add install() for ceph_test_cls_log
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-10-31 12:26:07 -04:00
Jos Collin
42b2cc1a2a
Merge pull request #18499 from batrick/ptl-tool-testing-time
ptl-tool: make branch name configurable

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-31 15:42:20 +00:00
Jason Dillaman
e55ef24c91 mgr/dashboard: added iSCSI IOPS/throughput metrics
Fixes: http://tracker.ceph.com/issues/21391
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-31 11:12:25 -04:00
Jason Dillaman
e62f186613 mgr/dashboard: include A/O start relative timestamp for iSCSI
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-31 11:11:30 -04:00
Patrick Donnelly
9902f5c51d
ptl-tool: make branch name configurable
Also, include hours/minutes in branch so multiple branches in a day have
different names.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-31 08:01:03 -07:00
Casey Bodley
7d3023d8e6
Merge pull request #18642 from zhangsw/cleanup-rgwputobj-getdata
rgw: add logs if get_data returns error in RGWPutObj::execute.

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2017-10-31 10:14:52 -04:00
Ilya Dryomov
c4888ddc1f qa/workunits/rbd: remove set_ro.py
This test is incomplete and has been obsoleted by krbd_blkroset.t.
It's also not wired up, so it's not actually being run.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-10-31 13:40:16 +01:00
Ilya Dryomov
2275381286 qa/suites/krbd: add krbd BLKROSET test
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-10-31 13:40:16 +01:00
Jason Dillaman
a4ae621fb7
Merge pull request #18645 from tchaikov/wip-cmake-Findgperftools
cmake: should use the value of GPERFTOOLS_LIBRARIES as REQUIRED_VARS

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-31 07:56:21 -04:00
Myna V
23e8882882 Changed ECUtil::decode to handle the case where there is more helper data than needed.
Made all the helper information uniform across all helper nodes.
Authors: Myna, Elita.
Signed-off-by: Myna Vajha <mynaramana@gmail.com>
2017-10-31 16:36:05 +05:30
Kefu Chai
b4ffd03ca3
Merge pull request #18283 from tchaikov/wip-laggy-mgr
qa: reduce mon-client-hunt-interval-max-multiple to 2

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-10-31 19:03:13 +08:00
Kefu Chai
eb022652c6 vstart.sh: drop --{mon,osd,mds,rgw,mgr}_num options
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-31 18:53:16 +08:00
Kefu Chai
84ec741673 mon/PGMap: drop unused PGMap::update_global_delta()
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-31 18:45:13 +08:00
Kefu Chai
7a23097c34 mon/PGMap: use new-style options
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-31 18:44:13 +08:00
Kefu Chai
70b5b4bfbf cmake: should check the availability of aligned_alloc() by running the test
this mimics the failure of rocksdb without a working
aligned_alloc()/free().

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-31 17:39:09 +08:00
Yan, Zheng
6c1543dfc5 mds: fix MDS_FEATURE_INCOMPAT_FILE_LAYOUT_V2 definition
Fixes: http://tracker.ceph.com/issues/21985
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-10-31 16:59:06 +08:00
Kefu Chai
599a9ef3ca cmake: should use the value of GPERFTOOLS_LIBRARIES as REQUIRED_VARS
otherwise it's always true, even if the libaries are not found. also
the cmake output will be wrong without this change:

without this change, it is:

-- Found gperftools: GPERFTOOLS_TCMALLOC_LIBRARY;GPERFTOOLS_TCMALLOC_MINIMAL_LIBRARY;GPERFTOOLS_PROFILER_LIBRARY (found version "2.5.93")

with this change, it would be:

-- Found gperftools: /tmp/gperf/lib/libtcmalloc.so (found version "2.5.93")

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-31 16:58:04 +08:00
Yan, Zheng
990088ef16 mds: remove useless incompat feature definination in FSMap.h
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-10-31 16:54:19 +08:00