Willem Jan Withagen
6f0e717e6b
qa/workunits/cephtool/test.sh: fix omision of ceph-command
...
- The script fails with these commands, but not for the correct reason.
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-09-05 12:04:55 +02:00
Mykola Golub
249f9e067c
Merge pull request #10945 from dillaman/wip-17188
...
librbd: deadlock when replaying journal during image open
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-09-02 22:00:41 +03:00
Sage Weil
6df9577ebc
Merge pull request #10746 from ceph/wip-async-default
...
msg: make async backend default
2016-09-02 13:02:57 -05:00
Sage Weil
76eab5dc55
Merge pull request #10938 from liewegas/wip-bluestore-csum-error
...
os/bluestore: fix/improve csum error message
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-09-02 11:23:40 -05:00
Sage Weil
7b77a8e82a
Merge pull request #10961 from xiexingguo/xxg-wip-bluestore-09-02
...
os/bluestore: add cache-related stats
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-02 11:23:27 -05:00
Igor Fedotov
e08ea46371
Merge pull request #10953 from liewegas/wip-bluestore-fixes
...
os/bluestore: misc fixes
Reviewed- by: Igor Fedotov ifedotov@mirantis.com
2016-09-02 18:26:07 +03:00
xie xingguo
9483e8105c
os/bluestore: trivial cleanups
...
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-02 18:10:33 +08:00
xie xingguo
5addd84436
os/bluestore: don't overwrite type if it does already exist and at desired type
...
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-02 17:48:39 +08:00
Kefu Chai
5e804bafa0
Merge pull request #10956 from ceph/wip-cmake
...
cmake: pass -DINTEL* to gf-complete cflags
Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-09-02 17:22:37 +08:00
xie xingguo
38797fa5e2
os/bluestore: conditional checking label of bluefs devices
...
As NVMe devices may not support to do so.
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-02 16:50:12 +08:00
Kefu Chai
367755e7f7
cmake: pass -DINTEL* to gf-complete cflags
...
* in addition to the -march=foobar, we also need to pass -DFOOBAR to
gf-complete sources' cflags, so that the SIMD instructions can be
generated as expected.
* also extract the compiler support for instruction extensions detections
into SIMDExt.cmake.
* and only check the compiler support if CMAKE_SYSTEM_PROCESSOR matches
with the instruction-set/arch to be checked.
Signed-off-by: tone.zhang <tone.zhang@linaro.org>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-09-02 16:23:54 +08:00
Brad Hubbard
293778ac57
Merge pull request #10934 from tchaikov/wip-kill-warnings
...
Wip kill warnings
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2016-09-02 17:32:45 +10:00
xie xingguo
aa8cc2b5c2
os/bluestore: end scope of std::hex properly
...
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-02 14:11:41 +08:00
xie xingguo
0319573d6c
os/bluestore: add onode/buffer cache statistics
...
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-02 14:11:41 +08:00
Kefu Chai
a80af03fbf
Merge pull request #10517 from wjwithagen/wip-wjw-freebsd-cmake-execludes
...
cmake: FreeBSD specific excludes in CMakeLists.txt files
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-09-02 01:38:44 +08:00
Sage Weil
cc366de7cc
ceph_test_objectstore: fix TryMoveRename test
...
Put the objects in the right pool.
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-01 12:37:44 -04:00
Sage Weil
51910f04a2
ceph_test_objectstore: clean up Rename test a bit
...
Drop useless remove calls.
Leave in the no-op setattr call since it triggered a
bluestore bug :)
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-01 12:04:42 -04:00
Sage Weil
a2d279fac8
ceph_test_objectstore: assert umount succeeds
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-01 11:45:40 -04:00
Sage Weil
0210f1fde6
os/bluestore: make object existence check robust
...
We may have the OnodeRef defined but the object may have
exists==false. Move the check out of the lookup block
so that we get the right behavior.
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-01 11:45:36 -04:00
Sage Weil
d19b59668d
os/bluestore: use _setattr for SETATTR
...
This is a bit faster.
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-01 11:45:31 -04:00
Sage Weil
903f94e7b9
Merge pull request #10843 from liewegas/wip-osdmap-reencode
...
messages/MOSDMap: mark as enlighten OSDMap encoder
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-09-01 09:56:36 -05:00
Sage Weil
e3d1a0d069
Merge pull request #10950 from xiexingguo/xxg-wip-blue-09-01
...
os/bluestore: gifting bluefs more carefully
Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-01 09:22:56 -05:00
xie xingguo
8bab52275a
os/bluestore: don't over-gift if bluefs free is smaller than bluestore_bluefs_min
...
- If free space of bluefs is smaller than bluestore_bluefs_min, then raise it
exactly up to bluestore_bluefs_min.
- Pre-check if bluestore_bluefs_min will exceed bluestore_bluefs_max_ratio * bluefs_total,
so if free space of bluefs is smaller than bluestore_bluefs_min_ratio * bluefs_total,
we'll still be able to gift.
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-01 18:42:58 +08:00
xie xingguo
f9b083ec9e
os/bluestore: end scope of std::hex properly
...
So it does not extend to the following output stream and
causes unexpected behaviour.
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-01 11:33:25 +08:00
Jason Dillaman
3dc13067f5
librbd: deadlock when replaying journal during image open
...
Fixes: http://tracker.ceph.com/issues/17188
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-08-31 21:33:54 -04:00
Jason Dillaman
c71182a731
librbd: improve image state machine debug log messages
...
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-08-31 20:56:54 -04:00
Sage Weil
990a920206
Merge pull request #10404 from ilc/build_fix
...
make-dist/ceph.spec.in: Fix srpm build breakage.
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2016-08-31 16:19:40 -05:00
Gregory Farnum
a421f4c034
Merge pull request #10846 from stiopaa1/mds_mdstable_addConstToMemFun
...
mds/MDSTable: add const to member functions
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-08-31 14:05:21 -07:00
Gregory Farnum
4b008415b8
Merge pull request #10781 from stiopaa1/osdc_objectcacher_moveClassesToCC
...
osdc/ObjectCacher: move C_ReadFinish, C_RetryRead
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-08-31 14:04:03 -07:00
Gregory Farnum
7cbc7a5c4f
Merge pull request #10744 from stiopaa1/osdc_journaler_moveCDelayFlushClass
...
osdc/Journaler: move C_DelayFlush class to .cc
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-08-31 14:03:50 -07:00
Gregory Farnum
9292ecf257
Merge pull request #10668 from stiopaa1/mon_mdsmonitor_moveCUpdatedClass
...
mon/MDSMonitor: move C_Updated class to .cc file
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-08-31 14:03:43 -07:00
Gregory Farnum
8b721b9634
Merge pull request #10628 from jcsp/wip-16909
...
mon: tear down standby replays on MDS rank stop
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-08-31 14:02:57 -07:00
Ali Maredia
9a5cfe2e8e
Merge pull request #10937 from ceph/dang-build
...
Allow compressor build without YASM
Reviewed-by: Ali Maredia <amaredia@redhat.com>
2016-08-31 15:53:39 -04:00
Sage Weil
dd10c836d2
os/bluestore: improve failed csum debug output
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-08-31 14:06:12 -04:00
Sage Weil
3285dcb4a7
script/bdev_grep: update to use hex
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-08-31 14:05:58 -04:00
Daniel Gryniewicz
57fa3b351f
Allow compressor build without YASM
...
The isa-l compressors need YASM to build. Conditionalize on that.
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2016-08-31 12:00:42 -04:00
Igor Fedotov
55f1bbe3e9
Merge pull request #10931 from xiexingguo/xxg-wip-fix-isa-l-assert
...
os/bluestore: get rid off "isa-l" type in ZLibCompressor ctor
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-31 17:29:42 +03:00
Sage Weil
1c78764a22
Merge pull request #10923 from xiexingguo/xxg-wip-bluefs-08-30
...
os/bluestore/bluefs: use map to track dirty files
Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-31 09:21:03 -05:00
xie xingguo
54e16f107b
os/bluestore: get rid off "isa-l" type in ZLibCompressor ctor
...
This is introduced by https://github.com/ceph/ceph/pull/10158 and causes
the following failure:
/home/xxg/ceph-dev/src/os/bluestore/bluestore_types.h: 284: FAILED assert(0 == "invalid compression algorithm")
ceph version v11.0.0-1941-g47c8a21 (47c8a21435
)
1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f5668c1ad45]
2: (BlueStore::_do_alloc_write(BlueStore::TransContext*, BlueStore::WriteContext*)+0x1a65) [0x7f5668b19d55]
3: (BlueStore::_do_write(BlueStore::TransContext*, boost::intrusive_ptr<BlueStore::Collection>&, boost::intrusive_ptr<BlueStore::Onode>, unsigned long, unsigned long, ceph::buffer::list&, unsigned int)+0x4ac) [0x7f5668b3b3fc]
4: (BlueStore::_write(BlueStore::TransContext*, boost::intrusive_ptr<BlueStore::Collection>&, boost::intrusive_ptr<BlueStore::Onode>&, unsigned long, unsigned long, ceph::buffer::list&, unsigned int)+0x10f) [0x7f5668b3bf2f]
5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0x1067) [0x7f5668b405f7]
6: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, std::shared_ptr<TrackedOp>, ThreadPool::TPHandle*)+0x382) [0x7f5668b42432]
7: (SyntheticWorkloadState::write()+0x3a5) [0x7f5668a2ace5]
8: (doSyntheticTest(boost::scoped_ptr<ObjectStore>&, unsigned long, unsigned long, unsigned long)+0xb9d) [0x7f56689dfa7d]
9: (do_matrix_choose(char const* (*) [10], int, int, int, boost::scoped_ptr<ObjectStore>&)+0x29d) [0x7f56689dfffd]
10: (do_matrix_choose(char const* (*) [10], int, int, int, boost::scoped_ptr<ObjectStore>&)+0x9e) [0x7f56689dfdfe]
11: (do_matrix_choose(char const* (*) [10], int, int, int, boost::scoped_ptr<ObjectStore>&)+0x9e) [0x7f56689dfdfe]
12: (do_matrix_choose(char const* (*) [10], int, int, int, boost::scoped_ptr<ObjectStore>&)+0x9e) [0x7f56689dfdfe]
13: (do_matrix_choose(char const* (*) [10], int, int, int, boost::scoped_ptr<ObjectStore>&)+0x9e) [0x7f56689dfdfe]
14: (do_matrix_choose(char const* (*) [10], int, int, int, boost::scoped_ptr<ObjectStore>&)+0x9e) [0x7f56689dfdfe]
15: (do_matrix(char const* (*) [10], boost::scoped_ptr<ObjectStore>&)+0x317) [0x7f56689e0347]
16: (()+0x297f3c) [0x7f56689e0f3c]
17: (StoreTest_SyntheticMatrixCompressionAlgorithm_Test::TestBody()+0x118) [0x7f56689e1078]
18: (void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*)+0x43) [0x7f5668d673e3]
19: (testing::Test::Run()+0xb7) [0x7f5668d5a127]
20: (testing::TestInfo::Run()+0x9e) [0x7f5668d5a1ce]
21: (testing::TestCase::Run()+0xa5) [0x7f5668d5a2d5]
22: (testing::internal::UnitTestImpl::RunAllTests()+0x278) [0x7f5668d5a5b8]
23: (testing::UnitTest::Run()+0x68) [0x7f5668d5a888]
24: (main()+0x2f4) [0x7f566895be84]
25: (__libc_start_main()+0xf5) [0x7f5663e5ab15]
26: (()+0x265ba5) [0x7f56689aeba5]
NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-08-31 21:46:00 +08:00
Kefu Chai
19ea38d5ca
test/perf_local: fix -Wmaybe-uninitialized warnings
...
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-08-31 18:46:53 +08:00
Kefu Chai
1f0c6e29c7
test,pybind: silence -Wsign-compare warnings
...
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-08-31 18:44:36 +08:00
Willem Jan Withagen
148fb82a79
os/CMakeLists.txt: undubble kv.cc usage.
...
- kv.cc is both in bluestore and in kstore.
But atm. both are the same
- Bluestore is not build on FreeBSD (no AIO)
So use the kstore one to be the one to build against.
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-08-31 11:23:06 +02:00
xie xingguo
47c8a21435
os/bluestore/bluefs: drop redundant eof check for read_random()
...
Because we have done the sanity check and fixed the length
at the entrance, so we don't have to check it again,
especially in the while loop, which is less efficient.
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-08-31 11:30:35 +08:00
xie xingguo
3ea32042dd
os/bluestore/bluefs: update mtime of inode in unified path
...
To reduce code redundancy.
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-08-31 10:36:41 +08:00
xie xingguo
1e5a5d0ba4
os/bluestore/bluefs: use map to track dirty files
...
So dirty files are arranged by dirty_seq and then
those of same dirty_seq are grouped into list and
as a result we can clean up dirty files much faster
during _flush_and_sync_log().
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-08-31 09:24:54 +08:00
Dan Mick
6209c42324
Merge pull request #10158 from Ved-vampir/zlib_isal_extension
...
Isa-l extention for zlib compression plugin
2016-08-30 15:22:08 -07:00
Matt Benjamin
de4ddd9e66
Merge pull request #10858 from atheism/rgw_getattr-return
...
rgw: remove duplicated calls to getattr
verified: f23
2016-08-30 15:38:19 -04:00
Alfredo Deza
5dbabd2146
Merge pull request #10927 from liewegas/wip-0.94.9
...
doc/release-notes: v0.94.9
Reviewed-by: Alfredo Deza <adeza@redhat.com>
2016-08-30 15:11:05 -04:00
Sage Weil
8df6bf89b2
doc/release-notes: v0.94.9
...
Signed-off-by: Sage Weil <sage@redhat.com>
2016-08-30 15:08:49 -04:00
Casey Bodley
97ca0fae43
Merge pull request #10745 from linuxbox2/rgw-nfs-31
...
rgw nfs v3 completions
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-08-30 14:59:45 -04:00