Commit Graph

67890 Commits

Author SHA1 Message Date
Daniel Gryniewicz
963dd121cc Merge pull request #12750 from zhangsw/feature-rgw-lc-validatei
rgw: add lifecycle validation according to S3.
2017-01-18 09:36:50 -05:00
Sage Weil
15ff48518a os/bluestore/BlueFS: dump allocator freelist on failure in reclaim_blocks
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 08:22:29 -06:00
Sage Weil
6dc1bcd9e7 os/bluestore/BlueFS: handle failure to reclaim blocks without crashing
We shouldn't fail to reclaim space in general, but if we do, do not treat
it as a fatal error.  Log loudly.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 08:22:29 -06:00
Daniel Gryniewicz
cf9e759269 Merge pull request #12827 from Liuchang0812/wip-18459
doc: correct S3 lifecycle support explain
2017-01-18 09:08:39 -05:00
Sage Weil
ebf7106b11 unitest_bit_alloc, unittest_alloc: fixes
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 07:38:44 -06:00
Sage Weil
b3fca67cc3 os/bluestore: prealloc/reserve extent vector for common alloc path
No need to worry about the gift/reclaim path--those are very rare.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 07:38:44 -06:00
Sage Weil
efabd177f8 os/bluestore/Allocator: drop unused and goofy release_extents
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 07:38:44 -06:00
Sage Weil
f012481787 os/bluestore: drop useless count arg to allocate
The vector<> has a size.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 07:38:44 -06:00
Sage Weil
5ab034345d os/bluestore: return blocks allocated from allocate()
Instead of having a separate output argument with the number of
blocks allocated, just return it via the return value.  Simplifies
the calling convention.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 07:38:44 -06:00
Sage Weil
5297858938 os/bluestore: manage vector from ExtentList
ExtentList was previous relying the caller to preallocate/size the
vector to be large enough for the worst case allocation of extents,
and keeping it's own manual count of the extent list size.  Instead,
manage that from ExtentList, and remove the preallocation from the
callers.

Fixes: http://tracker.ceph.com/issues/18573
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 07:38:44 -06:00
Sage Weil
01da8562a1 Merge pull request #12681 from xiexingguo/xxg-wip-bluestore-1227
os/bluestore: generate same onode extent-shard keys in a more efficient way

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-18 07:37:15 -06:00
Sage Weil
212522178c Merge pull request #12696 from xiexingguo/xxg-wip-improve-loops
os/bluestore: miscellaneous fixes to BitAllocator

Reviewed-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2017-01-18 07:36:45 -06:00
Sage Weil
a9bdb11d74 Merge pull request #12719 from xiexingguo/xxg-wip-bluestore-1229
os/bluestore/BitmapFreelistManager: readability improvements

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-18 07:36:00 -06:00
Sage Weil
323a8eb856 Merge pull request #12942 from Liuchang0812/cleanup-bluestore
os/bluestore: avoid unnecessary memory copy, use variable reference in BlockDevice::Open

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-18 07:35:41 -06:00
Sage Weil
15b25bf110 Merge pull request #12946 from ifed01/wip-bluestore-pextent-vector-mempooled
os/bluestore: Add bluestore pextent vector to mempool

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-18 07:35:18 -06:00
Ricardo Dias
235448879e
cmake: fix rpath on shared libraries and executables
The problem was due to the attempt of CMake to rewrite the RPATH of
the executables, or shared libraries, that didn't have any RPATH linked
during the building phase.

Currently INSTALL_RPATH is already set for all binaries. This patch
sets an empty INSTALL_RPATH for all binaries that don't depend on
any internal (also being built) target.

Signed-off-by: Ricardo Dias <rdias@suse.com>
2017-01-18 12:40:41 +00:00
Mingxin Liu
0ec21a5a8a OSDMonitor: calculate failure time only when osd reported failed
Signed-off-by: Mingxin Liu <mingxin@xsky.com>
2017-01-18 19:16:19 +08:00
Mingxin Liu
29e0b526a2 OSDMonitor: drop report message from all another reporters is not reasonable
if osd failed finally, this may make these reporters cannot receive lastest
update right away, besides, it's not effective to make a traverse of all reporters

Signed-off-by: Mingxin Liu <mingxin@xsky.com>
2017-01-18 19:16:10 +08:00
Mingxin Liu
a37765c7c7 osd/OSDMap: make get prev/next up osd more efficient
what's more, in get_previous_up_osd_before(), if arg n = 0, run into endless loop

Signed-off-by: Mingxin Liu <mingxin@xsky.com>
2017-01-18 18:38:57 +08:00
liuchang0812
fbe7c32ae5 doc: correct S3 lifecycle support explain
Fixes: http://tracker.ceph.com/issues/18459

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-01-18 17:56:11 +08:00
Varada Kari
eb3561106d os/bluestore: Add unittest to test kvdb dump stats
Signed-off-by: Varada Kari <varada.kari@sandisk.com>
2017-01-18 14:40:51 +05:30
Zhiqiang Wang
a8ba315767 mon: don't set last_osd_report when the pg stats msg is ignored
In some cases, this may lead to mon wrongly marking an osd down
because of no pg stats after a specified time period.

Signed-off-by: Zhiqiang Wang <zhiqiang@xsky.com>
2017-01-18 17:10:17 +08:00
Varada Kari
5a0d6396ab os/bluestore: Add unittest to test kvdb histogram
Signed-off-by: Varada Kari <varada.kari@sandisk.com>
2017-01-18 14:28:38 +05:30
Sage Weil
cda4b8b5bf doc/release-notes: fix typo
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-17 16:54:02 -05:00
Ricardo Dias
5769c6b449
librbd: Support for shared locking in ManagedLock
Signed-off-by: Ricardo Dias <rdias@suse.com>
2017-01-17 21:41:00 +00:00
Sage Weil
4864f302eb doc/release-notes: final kraken notes
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-17 16:09:44 -05:00
Samuel Just
7246209a13 ReplicatedPG: remove src_obcs, restructure LIST_SNAPS
We don't need src_obcs to make LIST_SNAPS work.  Instead, do what we do
in _rollback_to and simply grab the object context inline.  It's
particularly simple since we don't need to worry about rw locks here.

Signed-off-by: Samuel Just <sjust@redhat.com>
2017-01-17 09:42:10 -08:00
Samuel Just
0d7b0b7b52 src/: remove CLONE_RANGE, ASSERT_SRC_VERSION, SRC_CMPXATTR
These greatly complicate the osd implementation and appear unused.

Signed-off-by: Samuel Just <sjust@redhat.com>
2017-01-17 09:41:23 -08:00
Gregory Farnum
5f651d8e28 Merge pull request #12964 from jcsp/wip-18574
qa: update remaining ceph.com to download.ceph.com
2017-01-17 09:37:21 -08:00
Kefu Chai
e556bea651 Merge pull request #12962 from dillaman/wip-rbd-boost-crash
rbd: remove direct linking to static boost libraries

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-18 00:48:51 +08:00
John Spray
549d993d3f qa: update remaining ceph.com to download.ceph.com
Fixes: http://tracker.ceph.com/issues/18574
Signed-off-by: John Spray <john.spray@redhat.com>
2017-01-17 17:14:50 +01:00
Jason Dillaman
eeceb111d8 rbd: remove direct linking to static boost libraries
The boost libraries are included in libceph-common. If linked
directly, boost::regex will abort during shutdown since it uses
a global static variable and it will be destructed twice.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-17 10:39:03 -05:00
Jason Dillaman
449d7831d8 Merge pull request #12885 from rjfd/wip-18325
librbd: allow to open an image without opening the parent image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-01-17 08:45:52 -05:00
Jason Dillaman
06a4e14228 Merge pull request #12922 from trociny/wip-managed_lock_refactoring
librbd: managed lock refactoring

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-01-17 08:45:22 -05:00
donglinpeng
4493d117a4 common/buffer:Pipe fd is not closed when set nonblocking fails.
Signed-off-by: donglinpeng <donglinpeng@cmss.chinamobile.com>
2017-01-17 20:53:40 +08:00
songbaisen
e885500756 ceph: when osd_location_hook does not exist, we should exit error.
If the user define "osd crush location hook" in ceph.conf, but the
    osd_location_hook tool does not exist,we should exit error.

Signed-off-by:song baisen <song.baisen@zte.com.cn>
2017-01-17 19:47:48 +08:00
Mykola Golub
9107d31728 Merge pull request #12953 from dillaman/wip-18542
qa/tasks/qemu: update default image url after ceph.com redesign

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-17 10:03:11 +02:00
Mykola Golub
c4131810ef Merge pull request #12954 from dillaman/wip-rbd-coverity
rbd: correct coverity warnings

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-17 10:02:46 +02:00
Kefu Chai
88ed82f245 Merge pull request #12467 from bassam/pr-external-rocksdb
cmake: support for external rocksdb

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-17 13:53:01 +08:00
liuchang0812
a7efe6277a common/xmlformatter: turn on underscored by default, add unittest
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-01-17 12:02:06 +08:00
Jason Dillaman
275e89c55d rbd: correct coverity warnings
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-16 22:44:04 -05:00
Kefu Chai
c3aed5cdf9 Merge pull request #9028 from tchaikov/wip-bt-dump
common/BackTrace: add operator<<

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-01-17 11:20:54 +08:00
Jason Dillaman
6d17befb3b qa/tasks/qemu: update default image url after ceph.com redesign
Fixes: http://tracker.ceph.com/issues/18542
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-16 22:12:51 -05:00
Kefu Chai
d45f1ae7ad Merge pull request #12807 from runsisi/wip-fix-pg-ls
mon/PGMonitor: fix description for ceph pg ls

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-17 10:56:21 +08:00
Zhang Shaowen
0781e00389 rgw: modify error code in lifecycle to be compatible with S3.
Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-01-17 10:44:31 +08:00
runsisi
1852dd27b8 mon/PGMonitor: ceph pg ls-by-pool only supports string type of pool arg
Signed-off-by: runsisi <runsisi@zte.com.cn>
2017-01-17 09:56:40 +08:00
Yuri Weinstein
6886859cc2 Merge pull request #12928 from tmuthamizhan/wip-ansible-fs-suite
qa/suites/ceph-ansible: removing fs workunit

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2017-01-16 16:55:34 -08:00
Mykola Golub
f8108395f9 librbd: helper methods to query and break lock
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-01-16 23:12:29 +01:00
Mykola Golub
91b72f0a2d librbd: managed_lock: make AcquireRequest use GetLockRequest and BreakRequest
Initially this was implemented for exclusive_lock (03533b9,
23f60fe) but was lost when merging managed_lock refactoring.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-01-16 23:12:29 +01:00
Anjaneya Chagam
b7b14ad138 osd, messenger, librados: lttng enhancements
Few critical functions have been instrumented with function tracing
and oid tracing calls to help routing performance analysis.
Oid tracing events are heavily dependent on functional changes and may need
to be revised as and when core data flow logic changes.

Signed-off-by: Anjaneya Chagam <anjaneya.chagam@intel.com>
2017-01-16 13:58:58 -08:00