Commit Graph

79376 Commits

Author SHA1 Message Date
myoungwon oh
e968c64795 osd_types: add manifest type (chunked)
Signed-off-by: Myoungwon Oh <omwmw@sk.com>
2017-11-02 19:51:05 +09:00
Patrick Donnelly
3455a38f73
Merge PR #18309 into master
* refs/pull/18309/head:
	mds: prevent trim count from underflowing

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-10-15 17:02:54 -07:00
Kefu Chai
44074027de Merge pull request #18292 from xiexingguo/wip-recovery-order
osd/PrimaryLogPG: arrange recovery order by number of missing objects

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-15 06:55:11 +08:00
Patrick Donnelly
452bdd8b35
mds: prevent trim count from underflowing
Fixes: http://tracker.ceph.com/issues/21807

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-14 13:47:53 -07:00
Jos Collin
45abc927ce Merge pull request #18295 from adamwg/awg/update-orgmap
organizationmap: Add Adam Wolfe Gordon's affiliation

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-14 12:09:51 +00:00
Patrick Donnelly
5a96d19fc0
Merge PR #18139 into master
* refs/pull/18139/head:
	test: make the LibCephFS.ShutdownRacer test even more thrashy
	lockdep: free_ids and lock_ref hashes must be truly global
	common: add a clear_g_str_vec() function to clear g_str_vec
	common: make it safe to call env_to_vec multiple times

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-13 16:51:36 -07:00
Patrick Donnelly
bf64ac0510
Merge PR #18183 into master
* refs/pull/18183/head:
	osdc/ObjectCacher: limit memory usage of BufferHead

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:31 -07:00
Patrick Donnelly
78391ec8d9
Merge PR #18215 into master
* refs/pull/18215/head:
	mds: update client metadata for already open session

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:27 -07:00
Patrick Donnelly
7904cf8ee6
Merge PR #18261 into master
* refs/pull/18261/head:
	mds: keep CInode::STATE_QUEUEDEXPORTPIN state when exporting inode

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:22 -07:00
Patrick Donnelly
4541ad7a4d
Merge PR #18244 into master
* refs/pull/18244/head:
	mds: additional damage handling case in EImportStart

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:18 -07:00
Sage Weil
bf239fced7 Merge pull request #18229 from liewegas/wip-21753
ceph-objectstore-tool: fix import of post-split pg from pre-split ancestor

Reviewed-by: David Zafman <dzafman@redhat.com>
2017-10-13 15:40:48 -05:00
Sage Weil
6e7f7b4797 Merge pull request #18224 from liewegas/wip-pglog-cf
os/bluestore: dynamic CF configuration; put pglog omap in separate CF

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2017-10-13 15:32:40 -05:00
Sage Weil
5d3de8f678 Merge pull request #18186 from xiexingguo/wip-miss-loc
osd/PG: reduce some overhead on operating MissingLoc

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-13 15:31:38 -05:00
Sage Weil
10e6ad4af8 Merge pull request #16030 from myoungwon/wip-revamp-opwq
osd: generalize queueing and lock interface for OpWq

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-13 15:31:21 -05:00
Yuri Weinstein
e8e6256182 Merge pull request #17541 from mikulely/log-time-msecs
rgw: fix total_time to msec as per AWS S3

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-13 12:52:15 -07:00
Yuri Weinstein
c3b2b6c541 Merge pull request #18214 from shashalu/fix-null-data-mtime
rgw: don't change rados object's mtime when update olh

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-13 12:51:50 -07:00
Yuri Weinstein
a8e91ce102 Merge pull request #18245 from yaozongyou/wip-radosgw-admin-bi-fix
rgw: udpate radosgw-admin usage with bi purge

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-13 12:51:26 -07:00
Yuri Weinstein
3c4f2351ea Merge pull request #18248 from ivancich/wip-rgw-unify-bi-hash-calc
rgw: consolidate code that implements hashing algorithms

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-13 12:50:59 -07:00
Kefu Chai
9462f98d5e Merge pull request #18272 from cbodley/wip-compressor-random
compressor: use generate_random_number() for type="random"

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-14 01:16:01 +08:00
Kefu Chai
67cc862396 Merge pull request #18240 from tchaikov/wip-21716
test: fix misc fiemap testing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-14 01:14:51 +08:00
Kefu Chai
a214be9bc7 Merge pull request #18221 from tchaikov/wip-kvstore-tool-cleanup
ceph-kvstore-tool: use unique_ptr<> to manage the lifecycle of bluestore

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Chang Liu <liuchang0812@gmail.com>
2017-10-14 01:13:58 +08:00
Adam Wolfe Gordon
acfb717c79 organizationmap: Add Adam Wolfe Gordon's affiliation (DigitalOcean)
Signed-off-by: Adam Wolfe Gordon <awg@digitalocean.com>
2017-10-13 16:13:26 +00:00
Ali Maredia
756d539d92 Merge pull request #18285 from tchaikov/wip-cmake
cmake: bump up required cmake version to 2.8.12
2017-10-13 10:47:34 -04:00
Matt Benjamin
a8ce6e23c4 Merge pull request #18273 from cbodley/wip-21775
rgw: 'zone placement' commands validate compression type
2017-10-13 09:56:04 -04:00
xie xingguo
590c4979d4 osd/PrimaryLogPG: arrange recovery order by number of missing objects
Replica which has the shortest missing list (smallest amount of
objects to recover) should go recovering first, since it can be
technically brought back to normal sooner than others.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-13 19:26:26 +08:00
Kefu Chai
caae3c4757 cmake: fix gperftools version detection
there is chance that its "patch" version is empty. in that case, do not
include it in its version string. otherwise, we will have something
like:

Found gperftools:
GPERFTOOLS_TCMALLOC_LIBRARY;GPERFTOOLS_TCMALLOC_MINIMAL_LIBRARY;GPERFTOOLS_PROFILER_LIBRARY
(found version "2.4.#define TC_VERSION_PATCH  """)

when running cmake

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 15:11:09 +08:00
Xie Xingguo
44afda439f Merge pull request #18286 from tchaikov/wip-kill-bluestore-warning
os/bluestore: silence -Wreturn-type warning

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-13 15:10:43 +08:00
Mykola Golub
9607a52edd Merge pull request #18277 from dillaman/wip-librbd-unused-variables
librbd: remove unused variables from ReadResult refactor

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-10-13 09:46:46 +03:00
Kefu Chai
8717eac498 cmake: use CXX_VISIBILITY_PRESET and VISIBILITY_INLINES_HIDDEN
instead of using "-fvisibility=hidden -fvisibility-inlines-hidden", more
cmake-ish this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 14:32:32 +08:00
Kefu Chai
3f27dbbdb0 cmake: s/LINK_PRIVATE/PRIVATE/
as 2.8.12 is required not, no need to be compatible with 2.8.11 anymore.

this reverts 457f023.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 14:32:32 +08:00
Kefu Chai
77ab5eb821 cmake: refactor -fsanitize=... options
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 14:32:32 +08:00
Kefu Chai
65cac51630 os/bluestore: silence -Wreturn-type warning
this silences following warning:

ceph/src/os/bluestore/bluestore_types.h: In member function ‘bool bluestore_blob_t::_validate_range(uint64_t, uint64_t, bool) const’:
ceph/src/os/bluestore/bluestore_types.h:664:3: warning: control reaches end of non-void function [-Wreturn-type]
   }
   ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 14:12:47 +08:00
Kefu Chai
055ae5c476 cmake: use CMAKE_POSITION_INDEPENDENT_CODE not -fPIC
we use the global setting of CMAKE_POSITION_INDEPENDENT_CODE for
defining this flag.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 14:02:59 +08:00
Kefu Chai
966898329c cmake: bump up the required version to 2.8.12
as both trusty and centos 7.3 offer 2.8.12

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 14:02:59 +08:00
Kefu Chai
33b8797ffe Merge pull request #17793 from amitkumar50/cov-misc-6
librbd,os: address coverity false positives

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-13 12:17:37 +08:00
Kefu Chai
c7784e2dce Merge pull request #17825 from amitkumar50/cov-misc-9
librbd,test: address coverity false positives

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-13 12:17:10 +08:00
Kefu Chai
f7822816db Merge pull request #17972 from cbodley/wip-21401
auth: keep /dev/urandom open for get_random_bytes

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2017-10-13 12:16:26 +08:00
Kefu Chai
5f021b2d36 Merge pull request #18204 from ownedu/wip-fix-async-rdma-coredump
msg/async/rdma: fix a coredump introduced by PR #18053

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-13 12:15:27 +08:00
Kefu Chai
d94730fb19 Merge pull request #18217 from liewegas/wip-pg-clang
osd/PG: fix clang build vs private state events

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-13 12:14:31 +08:00
Kefu Chai
cedfc34b95 Merge pull request #18259 from xiexingguo/wip-blue-reclaim
os/bluestore/BlueFS: sanity check that alloc->allocate() won't return 0

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-13 12:12:45 +08:00
Kefu Chai
eaf1e21f88 Merge pull request #18262 from tchaikov/wip-rocksdb
rocksdb: sync with upstream

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2017-10-13 12:10:57 +08:00
Sage Weil
234700a0f3 os/bluestore: dynamically configure CFs and options via bluestore_rocksdb_cfs
Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-12 21:39:47 -05:00
Sage Weil
3e56a4d056 os/bluestore: put pglog omap in a separate CF
Signed-off-by: Sage Weil <sage@redhat.com>
2017-10-12 21:39:47 -05:00
Jason Dillaman
7a3c51352f librbd: remove unused variables from ReadResult refactor
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-12 18:35:28 -04:00
Yuri Weinstein
5cfe11e11d Merge pull request #18210 from shangfufei/wip-async-fix
msg/async: fix bug of data type conversion when uint64_t -> int -> uint64_t

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Amit Kumar amitkuma@redhat.com
2017-10-12 12:54:24 -07:00
Yuri Weinstein
862463dbfc Merge pull request #18246 from liewegas/wip-seesaw-warning
qa/suites/rados/singleton/all/mon-seesaw: whitelist MON_DOWN

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-12 12:52:42 -07:00
Mykola Golub
914c99717e Merge pull request #18270 from dillaman/wip-21391
cls/journal: possible infinite loop within tag_list class method

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-10-12 22:39:55 +03:00
Casey Bodley
acc6960040 compressor: use generate_random_number for type="random"
use an existing thread-local random engine instead of constructing,
seeding, and locking a separate engine

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-10-12 13:30:16 -04:00
Casey Bodley
33f8ee8b6f rgw: 'zone placement' commands validate compression type
Fixes: http://tracker.ceph.com/issues/21775

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-10-12 13:28:07 -04:00
Jason Dillaman
9e7475f8fb cls/journal: fixed possible infinite loop which could kill the OSD
Fixes: http://tracker.ceph.com/issues/21771
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-10-12 09:00:30 -04:00