Commit Graph

79385 Commits

Author SHA1 Message Date
liuchang0812
51b5ba1aa2 doc: introduce repair subcommon of ceph-kvstore-tool
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-10-16 22:52:10 +08:00
liuchang0812
4849ce3cc9 common, tool: update kvstore-tool to repair our key/value database
Fixes: http://tracker.ceph.com/issues/17730

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-10-16 22:52:10 +08:00
Abhishek L
2a9cbc353f Merge pull request #15941 from oritwas/wip-rgw-dynamic-resharding-doc
rgw: Add dynamic resharding documentation

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-By: Alfredo Deza <adeza@redhat.com>
2017-10-16 15:58:58 +02:00
Kefu Chai
e5eead34bc Merge pull request #18209 from tchaikov/wip-new-style-opt-mon
mon/OSDMonitor: use new style options

Reviewed-by: John Spray <john.spray@redhat.com>
2017-10-16 21:01:33 +08:00
John Spray
c21765a450 Merge pull request #18093 from jcsp/wip-mgr-gil-safety
mgr: safety checks on pyThreadState usage

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2017-10-16 13:22:07 +01:00
John Spray
625e1b5cfb mgr: safety checks on pyThreadState usage
Previously relied on the caller of Gil() to
pass new_thread=true if they would be
calling from a different thread.

Enforce this with an assertion, by wrapping
PyThreadState in a SafeThreadState class
that remembers which POSIX thread
it's meant to be used in.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-16 07:06:23 -04:00
John Spray
23c3a075ee mgr: move Gil implementation into .cc
The inclusion of Python.h in the .h was awkward
for other files including Gil.h.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-16 07:06:23 -04:00
John Spray
987612a975 mgr: reduce Gil verbosity at level 20
Even at 20, it's pretty heavy to be logging
every lock acquire/release.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-16 07:06:22 -04:00
Patrick Donnelly
3455a38f73
Merge PR #18309 into master
* refs/pull/18309/head:
	mds: prevent trim count from underflowing

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-10-15 17:02:54 -07:00
Orit Wasserman
4f3ab7cda0 rgw: Add dynamic resharding documentation
Fixes: http://tracker.ceph.com/issues/21553
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-10-15 15:02:46 +03:00
Kefu Chai
44074027de Merge pull request #18292 from xiexingguo/wip-recovery-order
osd/PrimaryLogPG: arrange recovery order by number of missing objects

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-15 06:55:11 +08:00
Patrick Donnelly
452bdd8b35
mds: prevent trim count from underflowing
Fixes: http://tracker.ceph.com/issues/21807

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-14 13:47:53 -07:00
Jos Collin
45abc927ce Merge pull request #18295 from adamwg/awg/update-orgmap
organizationmap: Add Adam Wolfe Gordon's affiliation

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-14 12:09:51 +00:00
Patrick Donnelly
5a96d19fc0
Merge PR #18139 into master
* refs/pull/18139/head:
	test: make the LibCephFS.ShutdownRacer test even more thrashy
	lockdep: free_ids and lock_ref hashes must be truly global
	common: add a clear_g_str_vec() function to clear g_str_vec
	common: make it safe to call env_to_vec multiple times

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-13 16:51:36 -07:00
Patrick Donnelly
bf64ac0510
Merge PR #18183 into master
* refs/pull/18183/head:
	osdc/ObjectCacher: limit memory usage of BufferHead

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:31 -07:00
Patrick Donnelly
78391ec8d9
Merge PR #18215 into master
* refs/pull/18215/head:
	mds: update client metadata for already open session

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:27 -07:00
Patrick Donnelly
7904cf8ee6
Merge PR #18261 into master
* refs/pull/18261/head:
	mds: keep CInode::STATE_QUEUEDEXPORTPIN state when exporting inode

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:22 -07:00
Patrick Donnelly
4541ad7a4d
Merge PR #18244 into master
* refs/pull/18244/head:
	mds: additional damage handling case in EImportStart

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:18 -07:00
Sage Weil
bf239fced7 Merge pull request #18229 from liewegas/wip-21753
ceph-objectstore-tool: fix import of post-split pg from pre-split ancestor

Reviewed-by: David Zafman <dzafman@redhat.com>
2017-10-13 15:40:48 -05:00
Sage Weil
6e7f7b4797 Merge pull request #18224 from liewegas/wip-pglog-cf
os/bluestore: dynamic CF configuration; put pglog omap in separate CF

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2017-10-13 15:32:40 -05:00
Sage Weil
5d3de8f678 Merge pull request #18186 from xiexingguo/wip-miss-loc
osd/PG: reduce some overhead on operating MissingLoc

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-13 15:31:38 -05:00
Sage Weil
10e6ad4af8 Merge pull request #16030 from myoungwon/wip-revamp-opwq
osd: generalize queueing and lock interface for OpWq

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-13 15:31:21 -05:00
Yuri Weinstein
e8e6256182 Merge pull request #17541 from mikulely/log-time-msecs
rgw: fix total_time to msec as per AWS S3

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-13 12:52:15 -07:00
Yuri Weinstein
c3b2b6c541 Merge pull request #18214 from shashalu/fix-null-data-mtime
rgw: don't change rados object's mtime when update olh

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-13 12:51:50 -07:00
Yuri Weinstein
a8e91ce102 Merge pull request #18245 from yaozongyou/wip-radosgw-admin-bi-fix
rgw: udpate radosgw-admin usage with bi purge

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-13 12:51:26 -07:00
Yuri Weinstein
3c4f2351ea Merge pull request #18248 from ivancich/wip-rgw-unify-bi-hash-calc
rgw: consolidate code that implements hashing algorithms

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-13 12:50:59 -07:00
Kefu Chai
9462f98d5e Merge pull request #18272 from cbodley/wip-compressor-random
compressor: use generate_random_number() for type="random"

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-14 01:16:01 +08:00
Kefu Chai
67cc862396 Merge pull request #18240 from tchaikov/wip-21716
test: fix misc fiemap testing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-14 01:14:51 +08:00
Kefu Chai
a214be9bc7 Merge pull request #18221 from tchaikov/wip-kvstore-tool-cleanup
ceph-kvstore-tool: use unique_ptr<> to manage the lifecycle of bluestore

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Chang Liu <liuchang0812@gmail.com>
2017-10-14 01:13:58 +08:00
Adam Wolfe Gordon
acfb717c79 organizationmap: Add Adam Wolfe Gordon's affiliation (DigitalOcean)
Signed-off-by: Adam Wolfe Gordon <awg@digitalocean.com>
2017-10-13 16:13:26 +00:00
Ali Maredia
756d539d92 Merge pull request #18285 from tchaikov/wip-cmake
cmake: bump up required cmake version to 2.8.12
2017-10-13 10:47:34 -04:00
Matt Benjamin
a8ce6e23c4 Merge pull request #18273 from cbodley/wip-21775
rgw: 'zone placement' commands validate compression type
2017-10-13 09:56:04 -04:00
Kefu Chai
582e567c93 mon/OSDMonitor: use new style options
* also mark "mon_osd_reporter_subtree_level" safe.
* change "mon_osd_min_down_reporters" to unsigned
* change "osd_pool_default_size" to unsigned
* change "osd_pool_default_min_size" to unsigned
* change "osd_pool_default_pg_num" to unsigned
* change "osd_pool_default_pgp_num" to unsigned

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 21:34:40 +08:00
xie xingguo
590c4979d4 osd/PrimaryLogPG: arrange recovery order by number of missing objects
Replica which has the shortest missing list (smallest amount of
objects to recover) should go recovering first, since it can be
technically brought back to normal sooner than others.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-13 19:26:26 +08:00
Kefu Chai
caae3c4757 cmake: fix gperftools version detection
there is chance that its "patch" version is empty. in that case, do not
include it in its version string. otherwise, we will have something
like:

Found gperftools:
GPERFTOOLS_TCMALLOC_LIBRARY;GPERFTOOLS_TCMALLOC_MINIMAL_LIBRARY;GPERFTOOLS_PROFILER_LIBRARY
(found version "2.4.#define TC_VERSION_PATCH  """)

when running cmake

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 15:11:09 +08:00
Xie Xingguo
44afda439f Merge pull request #18286 from tchaikov/wip-kill-bluestore-warning
os/bluestore: silence -Wreturn-type warning

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-13 15:10:43 +08:00
Mykola Golub
9607a52edd Merge pull request #18277 from dillaman/wip-librbd-unused-variables
librbd: remove unused variables from ReadResult refactor

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-10-13 09:46:46 +03:00
Kefu Chai
8717eac498 cmake: use CXX_VISIBILITY_PRESET and VISIBILITY_INLINES_HIDDEN
instead of using "-fvisibility=hidden -fvisibility-inlines-hidden", more
cmake-ish this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 14:32:32 +08:00
Kefu Chai
3f27dbbdb0 cmake: s/LINK_PRIVATE/PRIVATE/
as 2.8.12 is required not, no need to be compatible with 2.8.11 anymore.

this reverts 457f023.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 14:32:32 +08:00
Kefu Chai
77ab5eb821 cmake: refactor -fsanitize=... options
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 14:32:32 +08:00
Kefu Chai
65cac51630 os/bluestore: silence -Wreturn-type warning
this silences following warning:

ceph/src/os/bluestore/bluestore_types.h: In member function ‘bool bluestore_blob_t::_validate_range(uint64_t, uint64_t, bool) const’:
ceph/src/os/bluestore/bluestore_types.h:664:3: warning: control reaches end of non-void function [-Wreturn-type]
   }
   ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 14:12:47 +08:00
Kefu Chai
055ae5c476 cmake: use CMAKE_POSITION_INDEPENDENT_CODE not -fPIC
we use the global setting of CMAKE_POSITION_INDEPENDENT_CODE for
defining this flag.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 14:02:59 +08:00
Kefu Chai
966898329c cmake: bump up the required version to 2.8.12
as both trusty and centos 7.3 offer 2.8.12

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 14:02:59 +08:00
Kefu Chai
33b8797ffe Merge pull request #17793 from amitkumar50/cov-misc-6
librbd,os: address coverity false positives

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-13 12:17:37 +08:00
Kefu Chai
c7784e2dce Merge pull request #17825 from amitkumar50/cov-misc-9
librbd,test: address coverity false positives

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-13 12:17:10 +08:00
Kefu Chai
f7822816db Merge pull request #17972 from cbodley/wip-21401
auth: keep /dev/urandom open for get_random_bytes

Reviewed-by: Adam Emerson <aemerson@redhat.com>
2017-10-13 12:16:26 +08:00
Kefu Chai
5f021b2d36 Merge pull request #18204 from ownedu/wip-fix-async-rdma-coredump
msg/async/rdma: fix a coredump introduced by PR #18053

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-13 12:15:27 +08:00
Kefu Chai
d94730fb19 Merge pull request #18217 from liewegas/wip-pg-clang
osd/PG: fix clang build vs private state events

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-13 12:14:31 +08:00
Kefu Chai
cedfc34b95 Merge pull request #18259 from xiexingguo/wip-blue-reclaim
os/bluestore/BlueFS: sanity check that alloc->allocate() won't return 0

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-13 12:12:45 +08:00
Kefu Chai
eaf1e21f88 Merge pull request #18262 from tchaikov/wip-rocksdb
rocksdb: sync with upstream

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2017-10-13 12:10:57 +08:00