Commit Graph

79418 Commits

Author SHA1 Message Date
Kefu Chai
4c7df944c7 osd: add max-pg-per-osd limit
osd will refused to create new pgs, until its pg number is lower
than the max-pg-per-osd upper bound setting.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-17 23:08:40 +08:00
Kefu Chai
ac1e13ce63 qa/tasks/ceph: add "create_rbd_pool" option
True by default, but we can opt not to create the "rbd" pool.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-17 11:15:32 +08:00
Kefu Chai
da6f7a8100 mon/OSDMonitor: bypass checks if pg_temp.forced
originally, monitor ignores the pg_temp messages sent from replica osds,
but to re-trigger peering if replica osd's pg number drops down below
the setting, we need to bypass the checks.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-17 11:15:32 +08:00
Kefu Chai
6335bf7910 messages/MOSDPGTemp: add forced field
the monitor is supposed to bypass some checks if `forced` is true.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-17 11:15:32 +08:00
Kefu Chai
c6b71ebf6b osd: print osd as "osd.$osdid" in log message
easier to read this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-17 11:15:32 +08:00
Kefu Chai
34f524c96b Merge pull request #18332 from rzarzynski/wip-testfio-fix-build-error
test/fio: fix building of the fio_ceph_objectstore plugin.

Reviewed-By: Casey Bodley <cbodley@redhat.com>
Reviewed-By: Kefu Chai <kchai@redhat.com>
2017-10-17 10:21:15 +08:00
Jason Dillaman
ecec3217b6 Merge pull request #17134 from PCzhangPC/metaexin
rbd: export/import image-meta when we export/import an image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 21:00:08 -04:00
Jason Dillaman
be8e006c17 Merge pull request #18249 from PCzhangPC/addrwpro
rbd: show read:write proportion in the infomation of readwrite bench test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 20:59:49 -04:00
Yuri Weinstein
44c89bd0f0 Merge pull request #18271 from cbodley/wip-21772
rgw: fix bilog entries on multipart complete

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-10-16 12:58:37 -07:00
Yuri Weinstein
f880c5d961 Merge pull request #18212 from shashalu/clean-up-radosgw-admin
rgw: drop "realm remove" in radosgw-admin

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-16 12:58:05 -07:00
Radoslaw Zarzynski
23f018c859 test/fio: fix building of the fio_ceph_objectstore plugin.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-10-16 19:11:17 +02:00
Jason Dillaman
43b94729ed Merge pull request #18313 from Carbenium/rbd-map-crash
rbd: fix crash during map when "rw" option is specified

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 12:02:27 -04:00
Josh Durgin
804f07f3cb Merge pull request #18238 from tchaikov/wip-bufferlist-test
test/unittest_bufferlist: check retvals of syscalls

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-16 08:54:40 -07:00
Jason Dillaman
78e5c0fbd8 Merge pull request #18129 from dragonylffly/wip-fix-coverity-warning-for-uninialized-member
librbd: fix coverity warning for uninitialized member

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 11:01:13 -04:00
Jason Dillaman
6a64eef39d Merge pull request #18314 from MahatiC/example_librbd
examples: add new librbd example

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 10:54:10 -04:00
Jason Dillaman
717792ee61 Merge pull request #18265 from majianpeng/lirbd-cleanup
librbd: drop redundant check for null ImageCtx

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 10:53:00 -04:00
Kefu Chai
211fa02579 Merge pull request #18326 from joscollin/wip-log-sign-compare-warning
log: silence warning from -Wsign-compare

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-16 22:52:25 +08:00
Jason Dillaman
80bb052aa3 Merge pull request #18288 from trociny/wip-metadata
test/librbd: test metadata_set/remove is applied

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-10-16 10:51:50 -04:00
Abhishek L
2a9cbc353f Merge pull request #15941 from oritwas/wip-rgw-dynamic-resharding-doc
rgw: Add dynamic resharding documentation

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-By: Alfredo Deza <adeza@redhat.com>
2017-10-16 15:58:58 +02:00
PCzhangPC
c7a9b385b4 rbd:show read:write proportion in the infomation of readwrite bench test
Signed-off-by: PCzhangPC <pengcheng.zhang@easystack.cn>
2017-10-16 21:26:17 +08:00
Kefu Chai
e5eead34bc Merge pull request #18209 from tchaikov/wip-new-style-opt-mon
mon/OSDMonitor: use new style options

Reviewed-by: John Spray <john.spray@redhat.com>
2017-10-16 21:01:33 +08:00
John Spray
c21765a450 Merge pull request #18093 from jcsp/wip-mgr-gil-safety
mgr: safety checks on pyThreadState usage

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2017-10-16 13:22:07 +01:00
Jos Collin
e380221a45 log: silence warning from -Wsign-compare
This warning appears in jenkins build:

/home/jenkins-build/build/workspace/ceph-pull-requests/src/log/test.cc:266:232:   required from here
/home/jenkins-build/build/workspace/ceph-pull-requests/src/googletest/googletest/include/gtest/gtest.h:1392:11: warning: comparison between signed and unsigned integer expressions [-Wsign-compare]
   if (lhs == rhs) {

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-10-16 17:49:13 +05:30
John Spray
625e1b5cfb mgr: safety checks on pyThreadState usage
Previously relied on the caller of Gil() to
pass new_thread=true if they would be
calling from a different thread.

Enforce this with an assertion, by wrapping
PyThreadState in a SafeThreadState class
that remembers which POSIX thread
it's meant to be used in.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-16 07:06:23 -04:00
John Spray
23c3a075ee mgr: move Gil implementation into .cc
The inclusion of Python.h in the .h was awkward
for other files including Gil.h.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-16 07:06:23 -04:00
John Spray
987612a975 mgr: reduce Gil verbosity at level 20
Even at 20, it's pretty heavy to be logging
every lock acquire/release.

Signed-off-by: John Spray <john.spray@redhat.com>
2017-10-16 07:06:22 -04:00
Patrick Donnelly
3455a38f73
Merge PR #18309 into master
* refs/pull/18309/head:
	mds: prevent trim count from underflowing

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-10-15 17:02:54 -07:00
Mahati Chamarthy
6e9b62b600 examples: add new librbd example
Adds a librbd example

Signed-off-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
2017-10-15 19:43:45 +05:30
Peter Keresztes Schmidt
9e49c41244 rbd: fix crash during map
Currently the iterator isn't advanced after the erase call leading to a
second call on the iterator, which crashes due to a double free.
Since C++11 the map::erase function returns an iterator pointing to the
next element. Use the return value to set the iterator after erasing.

Fixes: http://tracker.ceph.com/issues/21808

Signed-off-by: Peter Keresztes Schmidt <carbenium@outlook.com>
2017-10-15 14:37:25 +02:00
Orit Wasserman
4f3ab7cda0 rgw: Add dynamic resharding documentation
Fixes: http://tracker.ceph.com/issues/21553
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-10-15 15:02:46 +03:00
Kefu Chai
44074027de Merge pull request #18292 from xiexingguo/wip-recovery-order
osd/PrimaryLogPG: arrange recovery order by number of missing objects

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-15 06:55:11 +08:00
Patrick Donnelly
452bdd8b35
mds: prevent trim count from underflowing
Fixes: http://tracker.ceph.com/issues/21807

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-14 13:47:53 -07:00
Jos Collin
45abc927ce Merge pull request #18295 from adamwg/awg/update-orgmap
organizationmap: Add Adam Wolfe Gordon's affiliation

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-14 12:09:51 +00:00
Patrick Donnelly
5a96d19fc0
Merge PR #18139 into master
* refs/pull/18139/head:
	test: make the LibCephFS.ShutdownRacer test even more thrashy
	lockdep: free_ids and lock_ref hashes must be truly global
	common: add a clear_g_str_vec() function to clear g_str_vec
	common: make it safe to call env_to_vec multiple times

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-13 16:51:36 -07:00
Patrick Donnelly
bf64ac0510
Merge PR #18183 into master
* refs/pull/18183/head:
	osdc/ObjectCacher: limit memory usage of BufferHead

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:31 -07:00
Patrick Donnelly
78391ec8d9
Merge PR #18215 into master
* refs/pull/18215/head:
	mds: update client metadata for already open session

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:27 -07:00
Patrick Donnelly
7904cf8ee6
Merge PR #18261 into master
* refs/pull/18261/head:
	mds: keep CInode::STATE_QUEUEDEXPORTPIN state when exporting inode

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:22 -07:00
Patrick Donnelly
4541ad7a4d
Merge PR #18244 into master
* refs/pull/18244/head:
	mds: additional damage handling case in EImportStart

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-13 16:51:18 -07:00
Sage Weil
bf239fced7 Merge pull request #18229 from liewegas/wip-21753
ceph-objectstore-tool: fix import of post-split pg from pre-split ancestor

Reviewed-by: David Zafman <dzafman@redhat.com>
2017-10-13 15:40:48 -05:00
Sage Weil
6e7f7b4797 Merge pull request #18224 from liewegas/wip-pglog-cf
os/bluestore: dynamic CF configuration; put pglog omap in separate CF

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2017-10-13 15:32:40 -05:00
Sage Weil
5d3de8f678 Merge pull request #18186 from xiexingguo/wip-miss-loc
osd/PG: reduce some overhead on operating MissingLoc

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-13 15:31:38 -05:00
Sage Weil
10e6ad4af8 Merge pull request #16030 from myoungwon/wip-revamp-opwq
osd: generalize queueing and lock interface for OpWq

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-13 15:31:21 -05:00
Yuri Weinstein
e8e6256182 Merge pull request #17541 from mikulely/log-time-msecs
rgw: fix total_time to msec as per AWS S3

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-13 12:52:15 -07:00
Yuri Weinstein
c3b2b6c541 Merge pull request #18214 from shashalu/fix-null-data-mtime
rgw: don't change rados object's mtime when update olh

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-13 12:51:50 -07:00
Yuri Weinstein
a8e91ce102 Merge pull request #18245 from yaozongyou/wip-radosgw-admin-bi-fix
rgw: udpate radosgw-admin usage with bi purge

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-10-13 12:51:26 -07:00
Yuri Weinstein
3c4f2351ea Merge pull request #18248 from ivancich/wip-rgw-unify-bi-hash-calc
rgw: consolidate code that implements hashing algorithms

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-10-13 12:50:59 -07:00
Kefu Chai
9462f98d5e Merge pull request #18272 from cbodley/wip-compressor-random
compressor: use generate_random_number() for type="random"

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-14 01:16:01 +08:00
Kefu Chai
67cc862396 Merge pull request #18240 from tchaikov/wip-21716
test: fix misc fiemap testing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-14 01:14:51 +08:00
Kefu Chai
a214be9bc7 Merge pull request #18221 from tchaikov/wip-kvstore-tool-cleanup
ceph-kvstore-tool: use unique_ptr<> to manage the lifecycle of bluestore

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Chang Liu <liuchang0812@gmail.com>
2017-10-14 01:13:58 +08:00
Adam Wolfe Gordon
acfb717c79 organizationmap: Add Adam Wolfe Gordon's affiliation (DigitalOcean)
Signed-off-by: Adam Wolfe Gordon <awg@digitalocean.com>
2017-10-13 16:13:26 +00:00