Commit Graph

57256 Commits

Author SHA1 Message Date
Willem Jan Withagen
6f0e717e6b qa/workunits/cephtool/test.sh: fix omision of ceph-command
- The script fails with these commands, but not for the correct reason.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-09-05 12:04:55 +02:00
Mykola Golub
249f9e067c Merge pull request #10945 from dillaman/wip-17188
librbd: deadlock when replaying journal during image open

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-09-02 22:00:41 +03:00
Sage Weil
6df9577ebc Merge pull request #10746 from ceph/wip-async-default
msg: make async backend default
2016-09-02 13:02:57 -05:00
Sage Weil
76eab5dc55 Merge pull request #10938 from liewegas/wip-bluestore-csum-error
os/bluestore: fix/improve csum error message

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-09-02 11:23:40 -05:00
Sage Weil
7b77a8e82a Merge pull request #10961 from xiexingguo/xxg-wip-bluestore-09-02
os/bluestore: add cache-related stats

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-02 11:23:27 -05:00
Igor Fedotov
e08ea46371 Merge pull request #10953 from liewegas/wip-bluestore-fixes
os/bluestore: misc fixes

Reviewed- by: Igor Fedotov ifedotov@mirantis.com
2016-09-02 18:26:07 +03:00
xie xingguo
9483e8105c os/bluestore: trivial cleanups
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-02 18:10:33 +08:00
xie xingguo
5addd84436 os/bluestore: don't overwrite type if it does already exist and at desired type
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-02 17:48:39 +08:00
Kefu Chai
5e804bafa0 Merge pull request #10956 from ceph/wip-cmake
cmake: pass -DINTEL* to gf-complete cflags

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-09-02 17:22:37 +08:00
xie xingguo
38797fa5e2 os/bluestore: conditional checking label of bluefs devices
As NVMe devices may not support to do so.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-02 16:50:12 +08:00
Kefu Chai
367755e7f7 cmake: pass -DINTEL* to gf-complete cflags
* in addition to the -march=foobar, we also need to pass -DFOOBAR to
  gf-complete sources' cflags, so that the SIMD instructions can be
  generated as expected.
* also extract the compiler support for instruction extensions detections
  into SIMDExt.cmake.
* and only check the compiler support if CMAKE_SYSTEM_PROCESSOR matches
  with the instruction-set/arch to be checked.

Signed-off-by: tone.zhang <tone.zhang@linaro.org>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-09-02 16:23:54 +08:00
Brad Hubbard
293778ac57 Merge pull request #10934 from tchaikov/wip-kill-warnings
Wip kill warnings

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2016-09-02 17:32:45 +10:00
xie xingguo
aa8cc2b5c2 os/bluestore: end scope of std::hex properly
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-02 14:11:41 +08:00
xie xingguo
0319573d6c os/bluestore: add onode/buffer cache statistics
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-02 14:11:41 +08:00
Kefu Chai
a80af03fbf Merge pull request #10517 from wjwithagen/wip-wjw-freebsd-cmake-execludes
cmake: FreeBSD specific excludes in CMakeLists.txt files

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-09-02 01:38:44 +08:00
Sage Weil
cc366de7cc ceph_test_objectstore: fix TryMoveRename test
Put the objects in the right pool.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-01 12:37:44 -04:00
Sage Weil
51910f04a2 ceph_test_objectstore: clean up Rename test a bit
Drop useless remove calls.

Leave in the no-op setattr call since it triggered a
bluestore bug :)

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-01 12:04:42 -04:00
Sage Weil
a2d279fac8 ceph_test_objectstore: assert umount succeeds
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-01 11:45:40 -04:00
Sage Weil
0210f1fde6 os/bluestore: make object existence check robust
We may have the OnodeRef defined but the object may have
exists==false.  Move the check out of the lookup block
so that we get the right behavior.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-01 11:45:36 -04:00
Sage Weil
d19b59668d os/bluestore: use _setattr for SETATTR
This is a bit faster.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-01 11:45:31 -04:00
Sage Weil
903f94e7b9 Merge pull request #10843 from liewegas/wip-osdmap-reencode
messages/MOSDMap: mark as enlighten OSDMap encoder

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-09-01 09:56:36 -05:00
Sage Weil
e3d1a0d069 Merge pull request #10950 from xiexingguo/xxg-wip-blue-09-01
os/bluestore: gifting bluefs more carefully

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-01 09:22:56 -05:00
xie xingguo
8bab52275a os/bluestore: don't over-gift if bluefs free is smaller than bluestore_bluefs_min
- If free space of bluefs is smaller than bluestore_bluefs_min, then raise it
  exactly up to bluestore_bluefs_min.

- Pre-check if bluestore_bluefs_min will exceed bluestore_bluefs_max_ratio * bluefs_total,
  so if free space of bluefs is smaller than bluestore_bluefs_min_ratio * bluefs_total,
  we'll still be able to gift.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-01 18:42:58 +08:00
xie xingguo
f9b083ec9e os/bluestore: end scope of std::hex properly
So it does not extend to the following output stream and
causes unexpected behaviour.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-01 11:33:25 +08:00
Jason Dillaman
3dc13067f5 librbd: deadlock when replaying journal during image open
Fixes: http://tracker.ceph.com/issues/17188
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-08-31 21:33:54 -04:00
Jason Dillaman
c71182a731 librbd: improve image state machine debug log messages
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-08-31 20:56:54 -04:00
Sage Weil
990a920206 Merge pull request #10404 from ilc/build_fix
make-dist/ceph.spec.in: Fix srpm build breakage.

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2016-08-31 16:19:40 -05:00
Gregory Farnum
a421f4c034 Merge pull request #10846 from stiopaa1/mds_mdstable_addConstToMemFun
mds/MDSTable: add const to member functions

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-08-31 14:05:21 -07:00
Gregory Farnum
4b008415b8 Merge pull request #10781 from stiopaa1/osdc_objectcacher_moveClassesToCC
osdc/ObjectCacher: move C_ReadFinish, C_RetryRead

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-08-31 14:04:03 -07:00
Gregory Farnum
7cbc7a5c4f Merge pull request #10744 from stiopaa1/osdc_journaler_moveCDelayFlushClass
osdc/Journaler: move C_DelayFlush class to .cc

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-08-31 14:03:50 -07:00
Gregory Farnum
9292ecf257 Merge pull request #10668 from stiopaa1/mon_mdsmonitor_moveCUpdatedClass
mon/MDSMonitor: move C_Updated class to .cc file

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-08-31 14:03:43 -07:00
Gregory Farnum
8b721b9634 Merge pull request #10628 from jcsp/wip-16909
mon: tear down standby replays on MDS rank stop

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-08-31 14:02:57 -07:00
Ali Maredia
9a5cfe2e8e Merge pull request #10937 from ceph/dang-build
Allow compressor build without YASM

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2016-08-31 15:53:39 -04:00
Sage Weil
dd10c836d2 os/bluestore: improve failed csum debug output
Signed-off-by: Sage Weil <sage@redhat.com>
2016-08-31 14:06:12 -04:00
Sage Weil
3285dcb4a7 script/bdev_grep: update to use hex
Signed-off-by: Sage Weil <sage@redhat.com>
2016-08-31 14:05:58 -04:00
Daniel Gryniewicz
57fa3b351f Allow compressor build without YASM
The isa-l compressors need YASM to build.  Conditionalize on that.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2016-08-31 12:00:42 -04:00
Igor Fedotov
55f1bbe3e9 Merge pull request #10931 from xiexingguo/xxg-wip-fix-isa-l-assert
os/bluestore: get rid off "isa-l" type in ZLibCompressor ctor

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-31 17:29:42 +03:00
Sage Weil
1c78764a22 Merge pull request #10923 from xiexingguo/xxg-wip-bluefs-08-30
os/bluestore/bluefs: use map to track dirty files

Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-31 09:21:03 -05:00
xie xingguo
54e16f107b os/bluestore: get rid off "isa-l" type in ZLibCompressor ctor
This is introduced by https://github.com/ceph/ceph/pull/10158 and causes
the following failure:

/home/xxg/ceph-dev/src/os/bluestore/bluestore_types.h: 284: FAILED assert(0 == "invalid compression algorithm")

 ceph version v11.0.0-1941-g47c8a21 (47c8a21435)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x85) [0x7f5668c1ad45]
 2: (BlueStore::_do_alloc_write(BlueStore::TransContext*, BlueStore::WriteContext*)+0x1a65) [0x7f5668b19d55]
 3: (BlueStore::_do_write(BlueStore::TransContext*, boost::intrusive_ptr<BlueStore::Collection>&, boost::intrusive_ptr<BlueStore::Onode>, unsigned long, unsigned long, ceph::buffer::list&, unsigned int)+0x4ac) [0x7f5668b3b3fc]
 4: (BlueStore::_write(BlueStore::TransContext*, boost::intrusive_ptr<BlueStore::Collection>&, boost::intrusive_ptr<BlueStore::Onode>&, unsigned long, unsigned long, ceph::buffer::list&, unsigned int)+0x10f) [0x7f5668b3bf2f]
 5: (BlueStore::_txc_add_transaction(BlueStore::TransContext*, ObjectStore::Transaction*)+0x1067) [0x7f5668b405f7]
 6: (BlueStore::queue_transactions(ObjectStore::Sequencer*, std::vector<ObjectStore::Transaction, std::allocator<ObjectStore::Transaction> >&, std::shared_ptr<TrackedOp>, ThreadPool::TPHandle*)+0x382) [0x7f5668b42432]
 7: (SyntheticWorkloadState::write()+0x3a5) [0x7f5668a2ace5]
 8: (doSyntheticTest(boost::scoped_ptr<ObjectStore>&, unsigned long, unsigned long, unsigned long)+0xb9d) [0x7f56689dfa7d]
 9: (do_matrix_choose(char const* (*) [10], int, int, int, boost::scoped_ptr<ObjectStore>&)+0x29d) [0x7f56689dfffd]
 10: (do_matrix_choose(char const* (*) [10], int, int, int, boost::scoped_ptr<ObjectStore>&)+0x9e) [0x7f56689dfdfe]
 11: (do_matrix_choose(char const* (*) [10], int, int, int, boost::scoped_ptr<ObjectStore>&)+0x9e) [0x7f56689dfdfe]
 12: (do_matrix_choose(char const* (*) [10], int, int, int, boost::scoped_ptr<ObjectStore>&)+0x9e) [0x7f56689dfdfe]
 13: (do_matrix_choose(char const* (*) [10], int, int, int, boost::scoped_ptr<ObjectStore>&)+0x9e) [0x7f56689dfdfe]
 14: (do_matrix_choose(char const* (*) [10], int, int, int, boost::scoped_ptr<ObjectStore>&)+0x9e) [0x7f56689dfdfe]
 15: (do_matrix(char const* (*) [10], boost::scoped_ptr<ObjectStore>&)+0x317) [0x7f56689e0347]
 16: (()+0x297f3c) [0x7f56689e0f3c]
 17: (StoreTest_SyntheticMatrixCompressionAlgorithm_Test::TestBody()+0x118) [0x7f56689e1078]
 18: (void testing::internal::HandleExceptionsInMethodIfSupported<testing::Test, void>(testing::Test*, void (testing::Test::*)(), char const*)+0x43) [0x7f5668d673e3]
 19: (testing::Test::Run()+0xb7) [0x7f5668d5a127]
 20: (testing::TestInfo::Run()+0x9e) [0x7f5668d5a1ce]
 21: (testing::TestCase::Run()+0xa5) [0x7f5668d5a2d5]
 22: (testing::internal::UnitTestImpl::RunAllTests()+0x278) [0x7f5668d5a5b8]
 23: (testing::UnitTest::Run()+0x68) [0x7f5668d5a888]
 24: (main()+0x2f4) [0x7f566895be84]
 25: (__libc_start_main()+0xf5) [0x7f5663e5ab15]
 26: (()+0x265ba5) [0x7f56689aeba5]
 NOTE: a copy of the executable, or `objdump -rdS <executable>` is needed to interpret this.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-08-31 21:46:00 +08:00
Kefu Chai
19ea38d5ca test/perf_local: fix -Wmaybe-uninitialized warnings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-08-31 18:46:53 +08:00
Kefu Chai
1f0c6e29c7 test,pybind: silence -Wsign-compare warnings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-08-31 18:44:36 +08:00
Willem Jan Withagen
148fb82a79 os/CMakeLists.txt: undubble kv.cc usage.
- kv.cc is both in bluestore and in kstore.
   But atm. both are the same
 - Bluestore is not build on FreeBSD (no AIO)

So use the kstore one to be the one to build against.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-08-31 11:23:06 +02:00
xie xingguo
47c8a21435 os/bluestore/bluefs: drop redundant eof check for read_random()
Because we have done the sanity check and fixed the length
at the entrance, so we don't have to check it again,
especially in the while loop, which is less efficient.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-08-31 11:30:35 +08:00
xie xingguo
3ea32042dd os/bluestore/bluefs: update mtime of inode in unified path
To reduce code redundancy.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-08-31 10:36:41 +08:00
xie xingguo
1e5a5d0ba4 os/bluestore/bluefs: use map to track dirty files
So dirty files are arranged by dirty_seq and then
those of same dirty_seq are grouped into list and
as a result we can clean up dirty files much faster
during _flush_and_sync_log().

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-08-31 09:24:54 +08:00
Dan Mick
6209c42324 Merge pull request #10158 from Ved-vampir/zlib_isal_extension
Isa-l extention for zlib compression plugin
2016-08-30 15:22:08 -07:00
Matt Benjamin
de4ddd9e66 Merge pull request #10858 from atheism/rgw_getattr-return
rgw: remove duplicated calls to getattr 

verified: f23
2016-08-30 15:38:19 -04:00
Alfredo Deza
5dbabd2146 Merge pull request #10927 from liewegas/wip-0.94.9
doc/release-notes: v0.94.9

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2016-08-30 15:11:05 -04:00
Sage Weil
8df6bf89b2 doc/release-notes: v0.94.9
Signed-off-by: Sage Weil <sage@redhat.com>
2016-08-30 15:08:49 -04:00
Casey Bodley
97ca0fae43 Merge pull request #10745 from linuxbox2/rgw-nfs-31
rgw nfs v3 completions

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-08-30 14:59:45 -04:00