Commit Graph

78220 Commits

Author SHA1 Message Date
Kefu Chai
1c47369fb2 Merge pull request #17667 from scienceluo/wip-luo-fix-cli-output-branch
pybind/ceph_argparse: fix cli output info

Reviewed-by: Chang Liu <liuchang0812@gmail.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-15 19:52:08 +08:00
Kefu Chai
3643063cd8 Merge pull request #17664 from Yan-waller/wip-walle-0912moninjectargs
common: fix daemon abnormal exit at parsing invalid arguments

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-15 19:51:31 +08:00
Kefu Chai
7f37f80679 Merge pull request #17655 from optimistyzy/911_2
src/bluestore/NVMEDevice: make all read use aio_submit

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Pan Liu <liupan1111@gmail.com>
2017-09-15 19:51:01 +08:00
Kefu Chai
f18e0fef87 Merge pull request #17611 from chardan/jfw-wip-atomic_t-cleanup
follow-up fixups for atomic_t spinlocks

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2017-09-15 19:49:52 +08:00
Kefu Chai
d35991bd0f Merge pull request #17605 from jcsp/wip-21253
mgr: fix py calls for dne service perf counters

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-15 19:49:02 +08:00
Kefu Chai
f65c186540 Merge pull request #17568 from amitkumar50/cov-msg-2
msg: Initializing class members in module msg

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-09-15 19:48:40 +08:00
Kefu Chai
d154a9d818 Merge pull request #16699 from jcsp/wip-mgr-perf-threshold
mgr: apply a threshold to perf counter prios

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-15 19:48:08 +08:00
Dan Mick
65df66fe52 Merge pull request #17361 from kungf/ulimit_setup
run-make-check.sh: run ulimit without sudo

Reviewed-by: Dan Mick <dmick@redhat.com>
2017-09-14 20:38:36 -07:00
yang.wang
4e16380ab7 run-make-check.sh: run ulimit without sudo
ulimit is a shell builtin like cd, not a separate program.
sudo looks for a binary to run, but there is no ulimit binary,
then you will get an error message like:
          "sudo: ulimit: command not found"
ulimit can only be run with root if you want raise the ulimit -n

Change-Id: I59ab09240cb15cabe5b0a7342c3f562cd50c75e9
Signed-off-by: yang.wang <yang.wang@easystack.cn>
2017-09-15 10:11:03 +08:00
Dan Mick
eee54243a0 Merge pull request #17713 from tchaikov/wip-ceph.in-python
ceph.in: execv using the same python
2017-09-14 19:07:11 -07:00
Josh Durgin
520a5a218c Merge pull request #17583 from neha-ojha/wip-cbt-teuthology-integration
qa: add cbt task for performance testing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-09-14 16:36:26 -07:00
vasukulkarni
fc196abd37 Merge pull request #17680 from ceph/wip-smoke-whitelist
qa/tests: Various whitelists for smoke suite
2017-09-14 16:13:37 -07:00
Vasu Kulkarni
1f5aba674c Various whitelists for tests to pass
See tracker http://tracker.ceph.com/issues/21376 for details

Signed-off-by: Vasu Kulkarni <vasu@redhat.com>
2017-09-14 13:32:25 -07:00
Kefu Chai
d3dd77880a Merge pull request #17733 from yaozongyou/fix-doc-boolean-type-zero-to-false
doc: change boolean option default value from zero to false.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-14 22:53:47 +08:00
Sage Weil
1587f87b6b Merge pull request #17610 from liewegas/wip-bluestore-fm-mas
os/bluestore: set bitmap freelist resolution to min_alloc_size

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Varada Kari <varada.kari@gmail.com>
2017-09-14 09:18:41 -05:00
Kefu Chai
eb8bfd1955 Merge pull request #17617 from liewegas/wip-drop-disk-log
mon/PGMap: drop DISK LOG column

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-14 21:42:56 +08:00
Yao Zongyou
69129b73a5 doc: change boolean option default value from zero to false.
Signed-off-by: Yao Zongyou yaozongyou@vip.qq.com
2017-09-14 21:37:04 +08:00
Sage Weil
c1bb53aaba Merge pull request #17628 from majianpeng/bluestore-narrow-deferred-lock
os/bluestore/BlueStore: narrow deferred_lock in _deferred_submit_unlock.

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-14 08:30:17 -05:00
Xie Xingguo
9b71d98ff6 Merge pull request #17627 from majianpeng/bluefs-exce-debug-code
os/bluestore/BlueFS: Don't call debug related code under any condition.

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-14 18:27:02 +08:00
Xie Xingguo
b4bb7ce2da Merge pull request #17371 from xiexingguo/wip-per-pool-full-control
mon, osd: per pool space-full flag support

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-14 18:26:12 +08:00
Xie Xingguo
78acfcf05b Merge pull request #17368 from xiexingguo/wip-nice-data
mon/PGMap: nice numbers for 'data' section of 'ceph df' command

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-14 18:25:24 +08:00
Kefu Chai
d803576002 ceph.in: execv using the same python
otherwise we could be using another python when respawing the ceph cli.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-09-14 11:33:48 +08:00
Patrick Donnelly
d929dae49b
Merge PR #17657 into master
* refs/remotes/upstream/pull/17657/head:
	mds: optimize MDCache::rejoin_scour_survivor_replicas()
	mds: fix MDSCacheObject::clear_replica_map
	mds: support limiting cache by memory
	common: refactor of lru
	mds: resolve unsigned coercion compiler warning
	common: use safer uint64_t for list size
	common: add bytes2str pretty print function
	mds: check if waiting is allocated before use
	mds: go back to compact_map for replicas
	mds: use mempool for cache objects
	mds: cleanup replica_map access
	common: add alloc_ptr smart pointer
	common: add warning on base class use of mempool
	common: use atomic uin64_t for counter

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-09-13 20:08:51 -07:00
Patrick Donnelly
f818905e0f
Merge PR #17689 into master
* refs/remotes/upstream/pull/17689/head:
	ceph: fix "stopping mds can't export subtree"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-13 18:29:20 -07:00
Patrick Donnelly
d89653dc56
Merge PR #17545 into master
* refs/remotes/upstream/pull/17545/head:
	client: fix request reference leak

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2017-09-13 18:29:18 -07:00
vasukulkarni
f1ffcaed6d Merge pull request #17700 from cbodley/wip-qa-smoke-s3tests
qa/smoke: add rgw crypto config for s3tests
2017-09-13 17:44:24 -07:00
Patrick Donnelly
a73ad7676a
Merge PR #17608 into master
* refs/remotes/upstream/pull/17608/head:
	doc/cephfs/posix: put posix notes in perspective

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-13 13:37:57 -07:00
Yuri Weinstein
796ca1235d Merge pull request #17641 from amitkumar50/cov-messages-12
messages: Initialization of variable beat

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-09-13 12:57:45 -07:00
Yuri Weinstein
1985345c9a Merge pull request #10460 from weiqiaomiao/wqm-wip-rgw-dellc
rgw: add tenant to shard_id in RGWDeleteLC::execute()

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-09-13 08:30:03 -07:00
Yuri Weinstein
06b8556f17 Merge pull request #17061 from shashalu/fix-rgw-lc
rgw: fix lc process only schdule the first item of lc objects

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: fang.yuxiang <fang.yuxiang@eisoo.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2017-09-13 08:28:24 -07:00
Casey Bodley
72b08e8f96 qa/smoke: add rgw crypto config for s3tests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-09-13 11:22:28 -04:00
Yuri Weinstein
b7e9473e74 Merge pull request #17631 from joke-lee/RGW-CORS-Access-Control-Allow-Origin-HEADER
rgw: return 'Access-Control-Allow-Origin' header when the set bucket versioning through XMLHttpRequest

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-09-13 08:20:38 -07:00
Yuri Weinstein
e680ed47fc Merge pull request #17632 from joke-lee/RGW-CORS-Access-Control-Allow-Origin-HEADER-WEBSITE
rgw: return 'Access-Control-Allow-Origin' header when the set and delete bucket website through XMLHttpRequest

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-09-13 08:20:17 -07:00
Yuri Weinstein
ef188a6a15 Merge pull request #17663 from shashalu/fix-rgw-LCFilter
rgw: Fix closing tag for Prefix

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-09-13 08:19:33 -07:00
Sage Weil
2496470df3 Merge pull request #17543 from iliul/fix-dup-global-section
vstart.sh: Remove duplicate global section

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-13 09:38:19 -05:00
iliul
549c910715 vstart.sh: Remove duplicate global section
Signed-off-by: iliul <liul124@chinaunicom.cn>
2017-09-13 14:04:17 +00:00
Sage Weil
28c1ce209d Merge pull request #17544 from joelin/wip-delete-forgot-mark
msg: remove the ),it's redundant.

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2017-09-13 08:19:26 -05:00
Xie Xingguo
0e604b112e Merge pull request #17515 from xiexingguo/wip-data-digest
osd/PrimaryLogPG: do not set data digest for bluestore

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-13 18:31:10 +08:00
Yan Jun
ccaba817dc test/config: regulate parameter order of ASSERT_EQ
Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
2017-09-13 18:15:33 +08:00
Yan Jun
3f075372d1 common: fix daemon abnormal exit at parsing invalid arguments
Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
2017-09-13 17:58:40 +08:00
Yan, Zheng
d32a237604 mds: optimize MDCache::rejoin_scour_survivor_replicas()
avoid iterating dentries if dirfrag is non-auth

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-09-13 15:55:46 +08:00
Yan, Zheng
fd447405be mds: fix MDSCacheObject::clear_replica_map
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-09-13 15:54:45 +08:00
Nathan Cutler
07159477ee Merge pull request #17366 from smithfarm/wip-21176
build/ops: python-numpy-devel build dependency for SUSE

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Ewaznazari <Nazari@keyinternational.academy>
2017-09-13 09:05:01 +02:00
Jos Collin
c383f03b3e Merge pull request #17685 from ygtzf/HashIndex-clerical-error
os/filestore/HashIndex.h: fixed a typo in comment

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-09-13 05:29:35 +00:00
Haomai Wang
9bf9a4189a Merge pull request #17688 from TsaiJin/wip-fix-assert-bug
msg/asyc/rmda: fix the bug of assert when Infiniband::recv_msg receives disconnect message

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-09-12 22:25:26 -07:00
xie xingguo
5345afa5d5 osd/osd_types.h: default to no data/omap digest for new object
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-13 12:17:16 +08:00
xie xingguo
afcb617dc9 osd/PrimaryLogPG: do not generate data digest for BlueStore by default
BlueStore enables CRC by default, so this is a dup and gains
no more benefits.

Turn this off by default, which is good for performance.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-13 12:17:16 +08:00
Yan, Zheng
c294051987 ceph: fix "stopping mds can't export subtree"
caused by commit
790c34138f "Make standby-replay mds avoid initiating subtree export"

Fixes: http://tracker.ceph.com/issues/21378
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-09-13 11:40:37 +08:00
Jos Collin
52d09e8c1b Merge pull request #17687 from yonghengdexin735/wip-zzz-error
common: fix typo deamon in comments

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-09-13 03:39:23 +00:00
Patrick Donnelly
06c94de584
mds: support limiting cache by memory
This introduces two config parameters:

    mds_cache_memory_limit: Sets the soft maximum of the cache to the given
    byte count. (Like mds_cache_size, this doesn't actually limit the maximum
    size of the cache. It just dictates the steady-state size.)

    mds_cache_reservation: This replaces mds_health_cache_threshold everywhere
    except the Beacon heartbeat sent to the mons. The idea here is to specify a
    reservation of memory (5% by default) for operations and the MDS tries to
    always maintain that reservation. So, the MDS will recall caps from clients
    when it begins dipping into its reservation of memory.

mds_cache_size still limits the cache by Inode count but is now by-default 0
(i.e. unlimited). The new preferred way of specifying cache limits is by memory
size. The default is 1GB.

Fixes: http://tracker.ceph.com/issues/20594
Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1464976

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-12 20:02:41 -07:00