Commit Graph

79414 Commits

Author SHA1 Message Date
Kefu Chai
c6b71ebf6b osd: print osd as "osd.$osdid" in log message
easier to read this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-17 11:15:32 +08:00
Kefu Chai
34f524c96b Merge pull request #18332 from rzarzynski/wip-testfio-fix-build-error
test/fio: fix building of the fio_ceph_objectstore plugin.

Reviewed-By: Casey Bodley <cbodley@redhat.com>
Reviewed-By: Kefu Chai <kchai@redhat.com>
2017-10-17 10:21:15 +08:00
Jason Dillaman
ecec3217b6 Merge pull request #17134 from PCzhangPC/metaexin
rbd: export/import image-meta when we export/import an image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 21:00:08 -04:00
Jason Dillaman
be8e006c17 Merge pull request #18249 from PCzhangPC/addrwpro
rbd: show read:write proportion in the infomation of readwrite bench test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 20:59:49 -04:00
Yuri Weinstein
44c89bd0f0 Merge pull request #18271 from cbodley/wip-21772
rgw: fix bilog entries on multipart complete

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-10-16 12:58:37 -07:00
Yuri Weinstein
f880c5d961 Merge pull request #18212 from shashalu/clean-up-radosgw-admin
rgw: drop "realm remove" in radosgw-admin

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-16 12:58:05 -07:00
Radoslaw Zarzynski
23f018c859 test/fio: fix building of the fio_ceph_objectstore plugin.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-10-16 19:11:17 +02:00
Jason Dillaman
43b94729ed Merge pull request #18313 from Carbenium/rbd-map-crash
rbd: fix crash during map when "rw" option is specified

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 12:02:27 -04:00
Josh Durgin
804f07f3cb Merge pull request #18238 from tchaikov/wip-bufferlist-test
test/unittest_bufferlist: check retvals of syscalls

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-16 08:54:40 -07:00
Jason Dillaman
78e5c0fbd8 Merge pull request #18129 from dragonylffly/wip-fix-coverity-warning-for-uninialized-member
librbd: fix coverity warning for uninitialized member

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 11:01:13 -04:00
Jason Dillaman
6a64eef39d Merge pull request #18314 from MahatiC/example_librbd
examples: add new librbd example

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 10:54:10 -04:00
Jason Dillaman
717792ee61 Merge pull request #18265 from majianpeng/lirbd-cleanup
librbd: drop redundant check for null ImageCtx

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 10:53:00 -04:00
Kefu Chai
211fa02579 Merge pull request #18326 from joscollin/wip-log-sign-compare-warning
log: silence warning from -Wsign-compare

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-16 22:52:25 +08:00
Jason Dillaman
80bb052aa3 Merge pull request #18288 from trociny/wip-metadata
test/librbd: test metadata_set/remove is applied

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 10:51:50 -04:00
Abhishek L
2a9cbc353f Merge pull request #15941 from oritwas/wip-rgw-dynamic-resharding-doc
rgw: Add dynamic resharding documentation

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-By: Alfredo Deza <adeza@redhat.com>
2017-10-16 15:58:58 +02:00
PCzhangPC
c7a9b385b4 rbd:show read:write proportion in the infomation of readwrite bench test
Signed-off-by: PCzhangPC <pengcheng.zhang@easystack.cn>
2017-10-16 21:26:17 +08:00
Kefu Chai
e5eead34bc Merge pull request #18209 from tchaikov/wip-new-style-opt-mon
mon/OSDMonitor: use new style options

Reviewed-by: John Spray <john.spray@redhat.com>
2017-10-16 21:01:33 +08:00
John Spray
c21765a450 Merge pull request #18093 from jcsp/wip-mgr-gil-safety
mgr: safety checks on pyThreadState usage

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2017-10-16 13:22:07 +01:00
Jos Collin
e380221a45 log: silence warning from -Wsign-compare
This warning appears in jenkins build:

/home/jenkins-build/build/workspace/ceph-pull-requests/src/log/test.cc:266:232:   required from here
/home/jenkins-build/build/workspace/ceph-pull-requests/src/googletest/googletest/include/gtest/gtest.h:1392:11: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
   if (lhs == rhs) {

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-10-16 17:49:13 +05:30
John Spray
625e1b5cfb mgr: safety checks on pyThreadState usage
Previously relied on the caller of Gil() to
pass new_thread=true if they would be
calling from a different thread.

Enforce this with an assertion, by wrapping
PyThreadState in a SafeThreadState class
that remembers which POSIX thread
it's meant to be used in.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-16 07:06:23 -04:00
John Spray
23c3a075ee mgr: move Gil implementation into .cc
The inclusion of Python.h in the .h was awkward
for other files including Gil.h.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-16 07:06:23 -04:00
John Spray
987612a975 mgr: reduce Gil verbosity at level 20
Even at 20, it's pretty heavy to be logging
every lock acquire/release.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-16 07:06:22 -04:00
Patrick Donnelly
3455a38f73
Merge PR #18309 into master
* refs/pull/18309/head:
	mds: prevent trim count from underflowing

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-10-15 17:02:54 -07:00
Mahati Chamarthy
6e9b62b600 examples: add new librbd example
Adds a librbd example

Signed-off-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
2017-10-15 19:43:45 +05:30
Peter Keresztes Schmidt
9e49c41244 rbd: fix crash during map
Currently the iterator isn't advanced after the erase call leading to a
second call on the iterator, which crashes due to a double free.
Since C++11 the map::erase function returns an iterator pointing to the
next element. Use the return value to set the iterator after erasing.

Fixes: http://tracker.ceph.com/issues/21808

Signed-off-by: Peter Keresztes Schmidt <carbenium@outlook.com>
2017-10-15 14:37:25 +02:00
Orit Wasserman
4f3ab7cda0 rgw: Add dynamic resharding documentation
Fixes: http://tracker.ceph.com/issues/21553
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-10-15 15:02:46 +03:00
Kefu Chai
44074027de Merge pull request #18292 from xiexingguo/wip-recovery-order
osd/PrimaryLogPG: arrange recovery order by number of missing objects

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-15 06:55:11 +08:00
Patrick Donnelly
452bdd8b35
mds: prevent trim count from underflowing
Fixes: http://tracker.ceph.com/issues/21807

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-14 13:47:53 -07:00
Jos Collin
45abc927ce Merge pull request #18295 from adamwg/awg/update-orgmap
organizationmap: Add Adam Wolfe Gordon's affiliation

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-14 12:09:51 +00:00
Patrick Donnelly
5a96d19fc0
Merge PR #18139 into master
* refs/pull/18139/head:
	test: make the LibCephFS.ShutdownRacer test even more thrashy
	lockdep: free_ids and lock_ref hashes must be truly global
	common: add a clear_g_str_vec() function to clear g_str_vec
	common: make it safe to call env_to_vec multiple times

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-13 16:51:36 -07:00
Patrick Donnelly
bf64ac0510
Merge PR #18183 into master
* refs/pull/18183/head:
	osdc/ObjectCacher: limit memory usage of BufferHead

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:31 -07:00
Patrick Donnelly
78391ec8d9
Merge PR #18215 into master
* refs/pull/18215/head:
	mds: update client metadata for already open session

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:27 -07:00
Patrick Donnelly
7904cf8ee6
Merge PR #18261 into master
* refs/pull/18261/head:
	mds: keep CInode::STATE_QUEUEDEXPORTPIN state when exporting inode

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:22 -07:00
Patrick Donnelly
4541ad7a4d
Merge PR #18244 into master
* refs/pull/18244/head:
	mds: additional damage handling case in EImportStart

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:18 -07:00
Sage Weil
bf239fced7 Merge pull request #18229 from liewegas/wip-21753
ceph-objectstore-tool: fix import of post-split pg from pre-split ancestor

Reviewed-by: David Zafman <dzafman@redhat.com>
2017-10-13 15:40:48 -05:00
Sage Weil
6e7f7b4797 Merge pull request #18224 from liewegas/wip-pglog-cf
os/bluestore: dynamic CF configuration; put pglog omap in separate CF

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2017-10-13 15:32:40 -05:00
Sage Weil
5d3de8f678 Merge pull request #18186 from xiexingguo/wip-miss-loc
osd/PG: reduce some overhead on operating MissingLoc

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-13 15:31:38 -05:00
Sage Weil
10e6ad4af8 Merge pull request #16030 from myoungwon/wip-revamp-opwq
osd: generalize queueing and lock interface for OpWq

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-13 15:31:21 -05:00
Yuri Weinstein
e8e6256182 Merge pull request #17541 from mikulely/log-time-msecs
rgw: fix total_time to msec as per AWS S3

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-13 12:52:15 -07:00
Yuri Weinstein
c3b2b6c541 Merge pull request #18214 from shashalu/fix-null-data-mtime
rgw: don't change rados object's mtime when update olh

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-13 12:51:50 -07:00
Yuri Weinstein
a8e91ce102 Merge pull request #18245 from yaozongyou/wip-radosgw-admin-bi-fix
rgw: udpate radosgw-admin usage with bi purge

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-13 12:51:26 -07:00
Yuri Weinstein
3c4f2351ea Merge pull request #18248 from ivancich/wip-rgw-unify-bi-hash-calc
rgw: consolidate code that implements hashing algorithms

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-13 12:50:59 -07:00
Kefu Chai
9462f98d5e Merge pull request #18272 from cbodley/wip-compressor-random
compressor: use generate_random_number() for type="random"

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-14 01:16:01 +08:00
Kefu Chai
67cc862396 Merge pull request #18240 from tchaikov/wip-21716
test: fix misc fiemap testing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-14 01:14:51 +08:00
Kefu Chai
a214be9bc7 Merge pull request #18221 from tchaikov/wip-kvstore-tool-cleanup
ceph-kvstore-tool: use unique_ptr<> to manage the lifecycle of bluestore

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Chang Liu <liuchang0812@gmail.com>
2017-10-14 01:13:58 +08:00
Adam Wolfe Gordon
acfb717c79 organizationmap: Add Adam Wolfe Gordon's affiliation (DigitalOcean)
Signed-off-by: Adam Wolfe Gordon <awg@digitalocean.com>
2017-10-13 16:13:26 +00:00
Ali Maredia
756d539d92 Merge pull request #18285 from tchaikov/wip-cmake
cmake: bump up required cmake version to 2.8.12
2017-10-13 10:47:34 -04:00
Matt Benjamin
a8ce6e23c4 Merge pull request #18273 from cbodley/wip-21775
rgw: 'zone placement' commands validate compression type
2017-10-13 09:56:04 -04:00
Kefu Chai
582e567c93 mon/OSDMonitor: use new style options
* also mark "mon_osd_reporter_subtree_level" safe.
* change "mon_osd_min_down_reporters" to unsigned
* change "osd_pool_default_size" to unsigned
* change "osd_pool_default_min_size" to unsigned
* change "osd_pool_default_pg_num" to unsigned
* change "osd_pool_default_pgp_num" to unsigned

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-13 21:34:40 +08:00
xie xingguo
590c4979d4 osd/PrimaryLogPG: arrange recovery order by number of missing objects
Replica which has the shortest missing list (smallest amount of
objects to recover) should go recovering first, since it can be
technically brought back to normal sooner than others.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-13 19:26:26 +08:00