xie xingguo
a776f5a68c
build: drop dryrun of autogen.sh from run-cmake-check.sh script
...
Introduced by https://github.com/ceph/ceph/pull/11007 .
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-08 14:14:22 +08:00
Sage Weil
f8abb628a4
Merge pull request #10978 from chhabaramesh/extent_alloc
...
os/bluestore: Hint based allocation in bitmap Allocator
Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-07 13:00:42 -05:00
Kefu Chai
4508448889
Merge pull request #11007 from liewegas/wip-autotools-must-die
...
remove autotools
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-09-08 01:06:07 +08:00
Sage Weil
bc0de8bc7a
Merge pull request #11008 from liewegas/wip-libaio
...
test/objectstore/CMakeLists.txt: fix libaio conditional
2016-09-07 11:41:27 -05:00
Sage Weil
578668f128
test/objectstore/CMakeLists.txt: fix libaio conditional
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 12:40:53 -04:00
Sage Weil
fba798dcad
remove autotools
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:50:14 -04:00
Sage Weil
68cf9d82c0
Merge pull request #10963 from liewegas/wip-bluestore-sharded-extent-map
...
os/bluestore: shard extent map
Reviewed-by: Allen Samuels <allen.samuels@sandisk.com>
2016-09-07 10:36:34 -05:00
Sage Weil
fad3d99853
os/bluestore: assert shared blob cache cleared on split
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:07 -04:00
Sage Weil
2d8a145d02
os/bluestore: dump some stats after fsck
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:07 -04:00
Sage Weil
f69af0b885
os/bluestore: instrument onode reshard events
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:07 -04:00
Sage Weil
3fb6c5c18c
os/bluestore: instrument transaction count
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:07 -04:00
Sage Weil
e152e97ce1
os/bluestore: instrument big/small writes
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:06 -04:00
Sage Weil
2df9aa8e79
os/bluestore: make blob_t unused helpers use logical length
...
These were taking min_alloc_size, but this can change
across mounts; better to use the logical blob length
instead (that's what we want anyway!).
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:06 -04:00
Sage Weil
dcc58c9b93
os/bluestore: use block_size for allocator unit
...
We need to handle objects written during previous mounts
that may have had a smaller min_alloc_size. Use
block_size, which is a safe lower bound.
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:06 -04:00
Sage Weil
6e251cfd47
os/bluestore: fix fsck used_block bitmap
...
This has to be block_size bits because min_alloc_size
can vary over mounts.
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:06 -04:00
Sage Weil
7f35725fdb
os/bluestore: optimize compress_extent_map
...
Only examine the range we just wrote to (and to the left
and right).
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:06 -04:00
Sage Weil
ec58b21acd
os/bluestore: make nid and blobid allocation less racy
...
We could bump the _max value for a TransContext in it's
prepare state, have it wait for a long time on IO, and
let another txc allocate and commit something with
an id higher than the previous max.
Fix this first by pushing the max ids into the
TransContext where we can deal with them at commit time,
and then making _kv_sync_thread bump the committed
max in a safe way.
Note that this will need to change if/when we do
these commits in parallel.
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:05 -04:00
Sage Weil
4fbb1efd1d
os/bluestore: shard extent map
...
Rewrote much of the persistence of onode metadata. The
highlights:
- extents and blobs stored together (the blob with the
first referencing extent).
- extents sharded across multiple k/v keys
- if a blob if referenced from multiple blobs, it's
stored in the onode key (called a "spanning blob").
- when we clone a blob we copy the metadata, but mark
it shared and put (just) the ref_map on the underlying
blocks in a shared_blob key. at this point we also
assign a globally unique id (sbid = shared blob id)
so the key has a unique name.
- we instantiate a SharedBlob in memory regardless of
whether we need to load the ref_map (which is only
needed for deallocations!). the BufferSpace is
attached to this SharedBlob so we get unified caching
across clones.
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:05 -04:00
Kefu Chai
b307a64330
Merge pull request #10973 from wjwithagen/wip-wjw-freebsd-cmake-excludes-2
...
cmake: FreeBSD specific excludes in CMakeLists.txt
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-09-07 23:19:47 +08:00
Ramesh Chander
3c06717ac6
Hint argument in alloc_blocks + test case changes
...
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-09-07 08:05:48 -07:00
Ramesh Chander
89afb56f7d
remove wrap argument and handle in wrappers
...
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-09-07 08:05:48 -07:00
Ramesh Chander
2eed1ef196
hint in extent_alloc code
...
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-09-07 08:05:48 -07:00
John Spray
6594022072
Merge pull request #10996 from jcsp/wip-16973
...
mds: log path with CDir damage messages
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-09-07 15:43:14 +01:00
Sage Weil
4fe06e9509
Merge pull request #10928 from stiopaa1/rbd_mirror_imagesyncthrottler
...
rbd_mirror/ImageSynceThrottler: move struct to .cc
Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-07 09:23:02 -05:00
Sage Weil
e2a75328dd
Merge pull request #10947 from atheism/radosgw-admin-help
...
rgw: right parenthesis is missing in radosgw-admin help message on caps
Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-07 09:20:35 -05:00
Sage Weil
b2af44111a
Merge pull request #10954 from stiopaa1/rgw_rgwrados_removeUnneededClassCTick
...
rgw/rgw_rados.h: remove unneeded class C_Tick
Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-07 09:18:52 -05:00
Sage Weil
7794830362
Merge pull request #10967 from stiopaa1/osd_replicatedbackend_moveClasses
...
osd/ReplicatedBackend: move classes to cc file
Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-07 09:16:55 -05:00
Sage Weil
2a5255fc5c
Merge pull request #10971 from stiopaa1/osd_replicatedpg_moveContextClasses
...
osd/ReplicatedPG: move classes to .cc file
Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-07 09:15:39 -05:00
Sage Weil
5e7e22bc4c
Merge pull request #10979 from wjwithagen/wip-wjw-cephtool-test
...
qa/workunits/cephtool/test.sh: fix omission of ceph-command
2016-09-07 09:13:34 -05:00
Sage Weil
04405b6c74
Merge pull request #10988 from jazeltq/fix-compile-error
...
autogen: Fix rocksdb error when make dist
2016-09-07 09:13:18 -05:00
John Spray
439cd5e1b4
mds: log path with CDir damage messages
...
Previously you just got the inode number, which
wasn't terribly useful for e.g. a missing fragment
object, as you couldn't readily resolve the parent
path.
Fixes: http://tracker.ceph.com/issues/16973
Signed-off-by: John Spray <john.spray@redhat.com>
2016-09-07 15:02:51 +01:00
Daniel Gryniewicz
0f0c16bfed
Merge pull request #10930 from atheism/rgw-lc-fix-sleep-time
...
rgw/rgw_lc.cc: fix sleep time according to the error message
2016-09-07 09:48:39 -04:00
Willem Jan Withagen
2e9809aeae
src/test/objectstore/CMakeLists.txt: conditionaly build tests
...
- Honor WITH_AIO tests that depend on bluestore parts
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-09-07 12:44:03 +02:00
Willem Jan Withagen
8ecd55ca63
src/tools/CMakeLists.txt: conditionaly build ceph-client-debug
...
- Honor WITH_LIBCEPHFS
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-09-07 12:44:03 +02:00
Willem Jan Withagen
1ce0e75c55
src/pybind/CMakeLists.txt: conditionaly build cython tools
...
- honor the WITH_RBD and WITH_LIBCEPHFS flags
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-09-07 12:44:02 +02:00
Willem Jan Withagen
c7c07da5a2
src/CMakeLists.txt: exclude parts not buildable on FreeBSD
...
- FreeBSD does not have keyutils or any kernel type security store
So using secret.c is not really relevant here
- Have common/secret.c depend on KEYUTILS_FOUND
- This also excludes building mount.cephfs,
Next to the fact that this is 100% linux bases mount stuff
- krbd is the Linux kernel version for RBD based disks, but again
completely Linux based and porting to FreeBSD, if any, has to follow
a different route
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-09-07 12:43:02 +02:00
tianqing
42bf1d0a5c
Makfile: Fix rocksdb error when make dist
...
Rocksdb delete some files, so we should change another way
to get rocksdb's files.
Currently, if we do not run configure in googletest/googlemock,
we also will get a error when make dist. So fix it too.
Signed-off-by: tianqing <tianqing@unitedstack.com>
2016-09-07 17:52:52 +08:00
Kefu Chai
3942ac4d27
Merge pull request #10972 from wjwithagen/wip-wjw-cmake-resolv
...
CmakeLists.txt: use LIB_RESOLV instead of resolv.
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-09-07 14:53:08 +08:00
Jason Dillaman
c2a5e70338
Merge pull request #10378 from trociny/wip-14738
...
librbd: optionally unregister "laggy" journal clients
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-09-06 22:50:15 -04:00
Sage Weil
58030cc03c
ceph_test_objectstore: test shards for longer
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-06 17:58:38 -04:00
Sage Weil
933a1da6d7
ceph_test_objectstore: occasional umount/fsck/mount
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-06 17:58:38 -04:00
Sage Weil
025bbc6220
ceph_test_objectstore: add SyntheticMatrixSharding
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-06 17:58:38 -04:00
Casey Bodley
ebf289a6e7
Merge pull request #10870 from ceph/wip_build_cls_rbd
...
cmake: add dependency from ceph_smalliobenchrbd to cls libraries
Reviewed-by: Jason Dillaman <jdillama@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-09-06 17:47:32 -04:00
Jason Dillaman
40df120bd0
Merge pull request #10912 from stiopaa1/journal_journaltimer_moveCRemoveSet
...
journal: move JournalTrimmer::C_RemoveSet struct
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-09-06 16:20:54 -04:00
J. Eric Ivancich
33e241e7c4
Add dependencies from ceph_smalliobenchrbd on cls_rbd, cls_journal,
...
and cls_lock.
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2016-09-06 15:13:42 -04:00
Jason Dillaman
4b000c9fd9
Merge pull request #10984 from ceph/wip-kfsx-exclusive-lock
...
test/librbd/fsx: enable exclusive-lock feature in krbd mode
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-09-06 11:39:32 -04:00
Sage Weil
da9b0e7c50
Merge pull request #10964 from liewegas/wip-bluefs-compaction
...
os/bluestore/BlueFS: fix async compaction logging bug
2016-09-06 10:10:43 -05:00
Sage Weil
3a036c79bf
Merge pull request #10966 from liewegas/wip-bluefs-runway
...
os/bluestore/BlueFS: factor unflushed log into runway calculation
Reviewed-by: Varada Kari <varada.kari@sandisk.com>
Reviewed-by: Somnath Roy <somnath.roy@sandisk.com>
2016-09-06 09:12:53 -05:00
Sage Weil
e6a39aeb72
Merge pull request #10970 from xiexingguo/xxg-wip-honour-alloweio-flag
...
os/bluestore: honour allow-eio flag; use global compressor if possible
Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-06 09:11:28 -05:00
Mykola Golub
9a95536429
Merge pull request #10974 from dillaman/wip-17210
...
librbd: potential double-unwatch of watch handle upon error
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-09-06 15:38:43 +03:00