Commit Graph

57385 Commits

Author SHA1 Message Date
xie xingguo
a776f5a68c build: drop dryrun of autogen.sh from run-cmake-check.sh script
Introduced by https://github.com/ceph/ceph/pull/11007.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-08 14:14:22 +08:00
Sage Weil
f8abb628a4 Merge pull request #10978 from chhabaramesh/extent_alloc
os/bluestore: Hint based allocation in bitmap Allocator

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-07 13:00:42 -05:00
Kefu Chai
4508448889 Merge pull request #11007 from liewegas/wip-autotools-must-die
remove autotools

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ali Maredia <amaredia@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-09-08 01:06:07 +08:00
Sage Weil
bc0de8bc7a Merge pull request #11008 from liewegas/wip-libaio
test/objectstore/CMakeLists.txt: fix libaio conditional
2016-09-07 11:41:27 -05:00
Sage Weil
578668f128 test/objectstore/CMakeLists.txt: fix libaio conditional
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 12:40:53 -04:00
Sage Weil
fba798dcad remove autotools
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:50:14 -04:00
Sage Weil
68cf9d82c0 Merge pull request #10963 from liewegas/wip-bluestore-sharded-extent-map
os/bluestore: shard extent map

Reviewed-by: Allen Samuels <allen.samuels@sandisk.com>
2016-09-07 10:36:34 -05:00
Sage Weil
fad3d99853 os/bluestore: assert shared blob cache cleared on split
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:07 -04:00
Sage Weil
2d8a145d02 os/bluestore: dump some stats after fsck
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:07 -04:00
Sage Weil
f69af0b885 os/bluestore: instrument onode reshard events
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:07 -04:00
Sage Weil
3fb6c5c18c os/bluestore: instrument transaction count
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:07 -04:00
Sage Weil
e152e97ce1 os/bluestore: instrument big/small writes
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:06 -04:00
Sage Weil
2df9aa8e79 os/bluestore: make blob_t unused helpers use logical length
These were taking min_alloc_size, but this can change
across mounts; better to use the logical blob length
instead (that's what we want anyway!).

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:06 -04:00
Sage Weil
dcc58c9b93 os/bluestore: use block_size for allocator unit
We need to handle objects written during previous mounts
that may have had a smaller min_alloc_size.  Use
block_size, which is a safe lower bound.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:06 -04:00
Sage Weil
6e251cfd47 os/bluestore: fix fsck used_block bitmap
This has to be block_size bits because min_alloc_size
can vary over mounts.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:06 -04:00
Sage Weil
7f35725fdb os/bluestore: optimize compress_extent_map
Only examine the range we just wrote to (and to the left
and right).

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:06 -04:00
Sage Weil
ec58b21acd os/bluestore: make nid and blobid allocation less racy
We could bump the _max value for a TransContext in it's
prepare state, have it wait for a long time on IO, and
let another txc allocate and commit something with
an id higher than the previous max.

Fix this first by pushing the max ids into the
TransContext where we can deal with them at commit time,
and then making _kv_sync_thread bump the committed
max in a safe way.

Note that this will need to change if/when we do
these commits in parallel.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:05 -04:00
Sage Weil
4fbb1efd1d os/bluestore: shard extent map
Rewrote much of the persistence of onode metadata.  The
highlights:

 - extents and blobs stored together (the blob with the
   first referencing extent).
 - extents sharded across multiple k/v keys
 - if a blob if referenced from multiple blobs, it's
   stored in the onode key (called a "spanning blob").
 - when we clone a blob we copy the metadata, but mark
   it shared and put (just) the ref_map on the underlying
   blocks in a shared_blob key.  at this point we also
   assign a globally unique id (sbid = shared blob id)
   so the key has a unique name.
 - we instantiate a SharedBlob in memory regardless of
   whether we need to load the ref_map (which is only
   needed for deallocations!).  the BufferSpace is
   attached to this SharedBlob so we get unified caching
   across clones.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-07 11:26:05 -04:00
Kefu Chai
b307a64330 Merge pull request #10973 from wjwithagen/wip-wjw-freebsd-cmake-excludes-2
cmake: FreeBSD specific excludes in CMakeLists.txt

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-09-07 23:19:47 +08:00
Ramesh Chander
3c06717ac6 Hint argument in alloc_blocks + test case changes
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-09-07 08:05:48 -07:00
Ramesh Chander
89afb56f7d remove wrap argument and handle in wrappers
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-09-07 08:05:48 -07:00
Ramesh Chander
2eed1ef196 hint in extent_alloc code
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-09-07 08:05:48 -07:00
John Spray
6594022072 Merge pull request #10996 from jcsp/wip-16973
mds: log path with CDir damage messages

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-09-07 15:43:14 +01:00
Sage Weil
4fe06e9509 Merge pull request #10928 from stiopaa1/rbd_mirror_imagesyncthrottler
rbd_mirror/ImageSynceThrottler: move struct to .cc

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-07 09:23:02 -05:00
Sage Weil
e2a75328dd Merge pull request #10947 from atheism/radosgw-admin-help
rgw: right parenthesis is missing in radosgw-admin help message on caps

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-07 09:20:35 -05:00
Sage Weil
b2af44111a Merge pull request #10954 from stiopaa1/rgw_rgwrados_removeUnneededClassCTick
rgw/rgw_rados.h: remove unneeded class C_Tick

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-07 09:18:52 -05:00
Sage Weil
7794830362 Merge pull request #10967 from stiopaa1/osd_replicatedbackend_moveClasses
osd/ReplicatedBackend: move classes to cc file

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-07 09:16:55 -05:00
Sage Weil
2a5255fc5c Merge pull request #10971 from stiopaa1/osd_replicatedpg_moveContextClasses
osd/ReplicatedPG: move classes to .cc file

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-07 09:15:39 -05:00
Sage Weil
5e7e22bc4c Merge pull request #10979 from wjwithagen/wip-wjw-cephtool-test
qa/workunits/cephtool/test.sh: fix omission of ceph-command
2016-09-07 09:13:34 -05:00
Sage Weil
04405b6c74 Merge pull request #10988 from jazeltq/fix-compile-error
autogen: Fix rocksdb error when make dist
2016-09-07 09:13:18 -05:00
John Spray
439cd5e1b4 mds: log path with CDir damage messages
Previously you just got the inode number, which
wasn't terribly useful for e.g. a missing fragment
object, as you couldn't readily resolve the parent
path.

Fixes: http://tracker.ceph.com/issues/16973
Signed-off-by: John Spray <john.spray@redhat.com>
2016-09-07 15:02:51 +01:00
Daniel Gryniewicz
0f0c16bfed Merge pull request #10930 from atheism/rgw-lc-fix-sleep-time
rgw/rgw_lc.cc: fix sleep time according to the error message
2016-09-07 09:48:39 -04:00
Willem Jan Withagen
2e9809aeae src/test/objectstore/CMakeLists.txt: conditionaly build tests
- Honor WITH_AIO tests that depend on bluestore parts

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-09-07 12:44:03 +02:00
Willem Jan Withagen
8ecd55ca63 src/tools/CMakeLists.txt: conditionaly build ceph-client-debug
- Honor WITH_LIBCEPHFS

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-09-07 12:44:03 +02:00
Willem Jan Withagen
1ce0e75c55 src/pybind/CMakeLists.txt: conditionaly build cython tools
- honor the WITH_RBD and WITH_LIBCEPHFS flags

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-09-07 12:44:02 +02:00
Willem Jan Withagen
c7c07da5a2 src/CMakeLists.txt: exclude parts not buildable on FreeBSD
- FreeBSD does not have keyutils or any kernel type security store
   So using secret.c is not really relevant here
 - Have common/secret.c depend on KEYUTILS_FOUND
 - This also excludes building mount.cephfs,
   Next to the fact that this is 100% linux bases mount stuff
 - krbd is the Linux kernel version for RBD based disks, but again
   completely Linux based and porting to FreeBSD, if any, has to follow
   a different route

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-09-07 12:43:02 +02:00
tianqing
42bf1d0a5c Makfile: Fix rocksdb error when make dist
Rocksdb delete some files, so we should change another way
to get rocksdb's files.

Currently, if we do not run configure in googletest/googlemock,
we also will get a error when make dist. So fix it too.

Signed-off-by: tianqing <tianqing@unitedstack.com>
2016-09-07 17:52:52 +08:00
Kefu Chai
3942ac4d27 Merge pull request #10972 from wjwithagen/wip-wjw-cmake-resolv
CmakeLists.txt: use LIB_RESOLV instead of resolv.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-09-07 14:53:08 +08:00
Jason Dillaman
c2a5e70338 Merge pull request #10378 from trociny/wip-14738
librbd: optionally unregister "laggy" journal clients

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-09-06 22:50:15 -04:00
Sage Weil
58030cc03c ceph_test_objectstore: test shards for longer
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-06 17:58:38 -04:00
Sage Weil
933a1da6d7 ceph_test_objectstore: occasional umount/fsck/mount
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-06 17:58:38 -04:00
Sage Weil
025bbc6220 ceph_test_objectstore: add SyntheticMatrixSharding
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-06 17:58:38 -04:00
Casey Bodley
ebf289a6e7 Merge pull request #10870 from ceph/wip_build_cls_rbd
cmake: add dependency from ceph_smalliobenchrbd to cls libraries

Reviewed-by: Jason Dillaman <jdillama@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-09-06 17:47:32 -04:00
Jason Dillaman
40df120bd0 Merge pull request #10912 from stiopaa1/journal_journaltimer_moveCRemoveSet
journal: move JournalTrimmer::C_RemoveSet struct

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-09-06 16:20:54 -04:00
J. Eric Ivancich
33e241e7c4 Add dependencies from ceph_smalliobenchrbd on cls_rbd, cls_journal,
and cls_lock.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2016-09-06 15:13:42 -04:00
Jason Dillaman
4b000c9fd9 Merge pull request #10984 from ceph/wip-kfsx-exclusive-lock
test/librbd/fsx: enable exclusive-lock feature in krbd mode

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-09-06 11:39:32 -04:00
Sage Weil
da9b0e7c50 Merge pull request #10964 from liewegas/wip-bluefs-compaction
os/bluestore/BlueFS: fix async compaction logging bug
2016-09-06 10:10:43 -05:00
Sage Weil
3a036c79bf Merge pull request #10966 from liewegas/wip-bluefs-runway
os/bluestore/BlueFS: factor unflushed log into runway calculation

Reviewed-by: Varada Kari <varada.kari@sandisk.com>
Reviewed-by: Somnath Roy <somnath.roy@sandisk.com>
2016-09-06 09:12:53 -05:00
Sage Weil
e6a39aeb72 Merge pull request #10970 from xiexingguo/xxg-wip-honour-alloweio-flag
os/bluestore: honour allow-eio flag; use global compressor if possible

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-06 09:11:28 -05:00
Mykola Golub
9a95536429 Merge pull request #10974 from dillaman/wip-17210
librbd: potential double-unwatch of watch handle upon error

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-09-06 15:38:43 +03:00