Commit Graph

54630 Commits

Author SHA1 Message Date
Yan Jun
c97ec99579 tools/osdmaptool: exit if we are unable to resolve pg_num
Signed-off-by: Yan Jun <yan.jun8@zte.com.cn>
2016-06-04 19:00:23 +08:00
Piotr Dałek
a81e2bb48c lockdep: Convert free_ids from list to bitmap
Convert "free_ids" list to bitmap, reducing its memory usage from
16 + MAX_LOCKS * 20 (~20KB) to MAX_LOCKS/8 (512b) and save some time
(re)populating the free id array.

Signed-off-by: Piotr Dałek <git@predictor.org.pl>
2016-06-04 12:15:47 +02:00
Michal Jarzabek
70b02f6944 common/WorkQueue.h: add override to virtual func
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-06-04 08:34:25 +01:00
Kefu Chai
cf9a42c7cc cmake: use ENABLE_SHARED instead of BUILD_SHARED_LIBS
we decided to drop the static libraries from the *-dev debian packages.
so no more tricky changes for supporting creating both libraries.

* partially revert 1dbfb26: s/BUILD_SHARED_LIBS/ENABLE_SHARED/
 - add_library() command use BUILD_SHARED_LIBS as the default library
   type, and all intermediate libraries should static ones. it would
   cause unnecessary confusion if some developer uses add_library() without
   specifying the library type, and ends up with a .so. so we use our
   own setting variables for specifying the type of user facing libraries.
* revert ac47440
 - the BUILD_SHARED_LIBS setting is also populated to the gmock libraries,
   which should be compiled as static ones. otherwise the unit tests will
   crash on exit.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-06-04 12:57:19 +08:00
xie xingguo
cfb16c4abd bluestore/BitAllocator: fix assert
0 is valid index, so this assert could fire.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-06-04 11:49:39 +08:00
xie xingguo
26e9560062 bluestore/BitAllocator: kill unused member m_on
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-06-04 11:49:39 +08:00
xie xingguo
1994e03fdc bluestore/BitAllocator: fix assert
0 is a valid BitMapEntity list index.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-06-04 11:49:39 +08:00
xie xingguo
1d7e30e427 bluestore/BitAllocator: remove duplicated of initialization
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-06-04 11:49:39 +08:00
xie xingguo
05db4b5873 bluestore/BitAllocator: simplify calculation of num_child
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-06-04 11:49:39 +08:00
xie xingguo
a2d4aba02d bluestore/BitAllocator: use debug_assert instead of assert
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-06-04 11:49:39 +08:00
xie xingguo
b473574bb9 bluestore/BitAllocator: remove redundant assert
We have assert this ahead.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-06-04 11:49:39 +08:00
xie xingguo
8940433f67 bluestore/BitAllocator: fix race condition
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-06-04 11:49:39 +08:00
xie xingguo
50de60d6a3 bluestore/BitAllocator: make assert make more sense
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-06-04 11:49:38 +08:00
xie xingguo
47cddb6a34 bluestore/BitAllocator: fix stats of concurrent scans
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-06-04 11:42:33 +08:00
Kefu Chai
703e9c800c cmake: install binaries used by ceph-qa-suite
they are:
- ceph_test_rados: used by
  tasks/rados.py
- ceph_test_rados_delete_pools_parallel: used by
  suites/rados/monthrash/workloads/pool-create-delete.yaml
- ceph_test_filejournal
  suites/rados/objectstore/filejournal.yaml
- ceph_test_objectstore: used by
  suites/rados/objectstore/objectstore.yaml
- ceph_test_{async_driver,msgr}: used by
  suites/rados/singleton-nomsgr/all/msgr.yaml

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-06-04 09:40:28 +08:00
Kefu Chai
a011b4e71a cmake: compile more radosstriper tests
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-06-04 09:40:28 +08:00
Kefu Chai
c24098cc54 cmake: do not link ceph_test_rgw_*, ceph-dencoder against cls_kvs
it is not used, and causes link errors.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-06-04 09:40:28 +08:00
Kefu Chai
01efc89aa7 cmake: link ceph-dencoder against os lib
os is a top level target which is linked into executables or user facing
libraries. so it is not included by any libraries linked by
ceph-dencoder so far.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-06-04 09:40:28 +08:00
Kefu Chai
93b1200306 cmake: link rbd cli against krbd_objs directly
rbd cli => Kernel.cc => krbd_create_from_context() <= krbd.cc

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-06-04 09:40:21 +08:00
Kefu Chai
3245df5508 cmake: fix linkage of ceph_test_cls_${name}
they should link against cls_${name}_client, instead of against
cls_${name} directly.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-06-04 09:38:08 +08:00
Kefu Chai
52021ff9f0 makefile: install mount.fuse.ceph,mount.ceph into /usr/sbin
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-06-04 09:37:33 +08:00
Kefu Chai
c4a8784330 cmake: install ceph-disk to /usr/sbin
* add keyword "INSTALL_SCRIPT" to distutils_install_module(), so we can
  override the install path of ceph-disk script.
* refactor the Distutils.cmake module a little bit, the ${option}
  variable out lives the CODE snipplet. so we need to reset it
  at the beginning.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-06-04 09:37:33 +08:00
Michal Jarzabek
663cf89573 osd/ReplicatedPG.h: add const to operator<< param
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-06-03 22:28:57 +01:00
Sage Weil
bc2fdd5c8e os/bluestore: paranoid checks on onode_map vs lru
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 16:42:35 -04:00
Sage Weil
fd28656aa6 os/bluestore: replace broken get_next with map_any
The get_next implementation assumed the lru was local to the OnodeSpace,
but it includes the whole cache now.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 16:41:37 -04:00
Sage Weil
2ea7750f59 os/bluestore: better audit_lru debugging
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 15:00:06 -04:00
Sage Weil
bf87e3a221 os/bluestore: shard the cache
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 15:00:06 -04:00
Sage Weil
07094ca008 osd: communicate shard count to ObjectStore
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 15:00:06 -04:00
Sage Weil
09c3dc95f8 osd: use spg_t method to hash pg to (wq) shard
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 15:00:05 -04:00
Sage Weil
51c2088119 os/bluestore: unify lrus into single Cache class
This will be sharded soon, but for now there's just one instance.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 15:00:05 -04:00
Sage Weil
ac8c40f3e3 Merge pull request #9483 from ceph/wip-rocksdb
rocksdb: fix build
2016-06-03 13:54:08 -04:00
Casey Bodley
91e7bf2c17 Merge pull request #9477 from tchaikov/wip-fix-cmake-unittests
cmake: do not create gtest/gmock shared libraries

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-06-03 13:46:11 -04:00
Kefu Chai
ac47440174 cmake: do not create gtest/gmock shared libraries
otherwise unit tests crash at exit.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-06-04 01:42:09 +08:00
Jianpeng Ma
4e1294030e os/bluestore/BlueStore: optimize WALWQ::flush()
In fact ThreadPool::drain will do
a)wait WorkQueue::empty() is true
b)wait processing thread to complete.
So it can remove the same work which wait WorkQueue::empty().

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2016-06-04 00:33:34 +08:00
Jianpeng Ma
0ee99d609e os/bluestore/BlueStore: Don't support dynamic set wal_apply mode.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2016-06-04 00:32:22 +08:00
Jianpeng Ma
f75221c9a9 common/WorkQueue: Make decrease thread num to zero.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2016-06-03 23:56:06 +08:00
Jianpeng Ma
95d9eeb3c2 common/config: make md_config_t::apply_changes recursive.
This make in md_config_obs_t::handle_conf_change to call apply_changes.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2016-06-03 23:56:02 +08:00
Jianpeng Ma
604f03e28b os/bluestore: If using sync_wal_apply, no need start wal_tp thread.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2016-06-03 23:55:59 +08:00
Javier M. Mellid
5de5876a53 rgw: aws4: add STREAMING-AWS4-HMAC-SHA256-PAYLOAD support
When authenticating requests using the Authorization header in AWS4, you have
the option of uploading the payload in chunks. You can send data in fixed size
or variable size chunks.

This patch enables streaming mode and signed headers support with chunked
uploads.

Fixes: http://tracker.ceph.com/issues/16146

Signed-off-by: Javier M. Mellid <jmunhoz@igalia.com>
2016-06-03 17:34:10 +02:00
Casey Bodley
7abda15aa5 Merge pull request #9381 from weiqiaomiao/wqm-wip-rgw-align
rgw:fix some indentation errors of "radosgw-admin --help"

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-06-03 11:34:07 -04:00
Sage Weil
4c6f1ba424 Makefile-rocksdb: remove .d files
Not really sure why autotools is removing these... but
whatever.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 11:22:45 -04:00
Kefu Chai
c6c6968e86 Merge pull request #9480 from ErwanAliasr1/evelu-cephtool
cephtool/test.sh: Adding iterations numbers in output log

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-06-03 23:09:49 +08:00
Sage Weil
b65e01f6b4 os/bluestore: unique type names or onode and buffer lrus
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 11:00:30 -04:00
Sage Weil
35de7bb50f os/bluestore: take collection lock when trimming collection cache
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 11:00:30 -04:00
Sage Weil
a2dafa172b os/bluestore: audit LRU at various points
This is purely for debugging.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 11:00:30 -04:00
Sage Weil
2d540bbbc4 os/bluestore: don't print bnode key
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 11:00:30 -04:00
Sage Weil
5005edf80f os/bluestore: fix buffercache discard bug
Signed-off-by: Sage Weil <sage@redhat.com>
2016-06-03 11:00:30 -04:00
Sage Weil
98c6c05f94 Merge pull request #9465 from liewegas/wip-bluestore-zero
os/bluestore: remove aio_zero from bdev interface
2016-06-03 10:46:26 -04:00
Sage Weil
fbb13ab187 Merge pull request #9417 from chhabaramesh/master
os/bluestore: Tree based bitmapalloc
2016-06-03 10:45:44 -04:00
Sage Weil
f485596dd0 Merge pull request #9466 from liewegas/wip-rocksdb
rocksdb: pull up to latest master
2016-06-03 10:41:35 -04:00