Commit Graph

67776 Commits

Author SHA1 Message Date
Radoslaw Zarzynski
8dac93392b rgw: fix handling RGWUserInfo::system in RGWHandler_REST_SWIFT.
Before this patch the flag was wrongly handled in the Swift API
implementation. In rare conditions this might result in setting
req_state::system_request.

This may happen only if both of those conditions are fulfilled:
 * RadosGW is running in a multi-site configuration (at least
   one user with the system flag turned on is present),
 * the "rgw_swift_account_in_url" configurable has been switched
   to true. The value is false by default and our documentation
   doesn't actually mention about the option.

The issue doesn't affect Jewel nor any previous release.

Fixes: http://tracker.ceph.com/issues/18476
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-01-18 17:57:38 +01:00
Matt Benjamin
4299bfcc73 librgw: remove call to crypto::shutdown
The call is cognate to removed code in radosgw, and triggers an
assert that the crypto module has already been shutdown.  With this
and preceding changes, I see clean shutdown on abnormal termination
of nfs-ganesha during startup.

Fixes: http://tracker.ceph.com/issues/18585

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-01-18 10:53:26 -05:00
Matt Benjamin
d633ecb1fd rgw: s/static std::map/static pointer/ for ext_mime_map
In some librgw shutdown cases, it appears that the shared
object runtime has partially destructed the static map when
our shutdown code is running.

Fixes: http://tracker.ceph.com/issues/18585

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-01-18 10:53:03 -05:00
Matt Benjamin
4efc4cab53 rgw_file: signal RGWLibFrontend shutdown correctly
The shutdown member of RGWLibProcess should be set.

Fixes: http://tracker.ceph.com/issues/18585

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-01-18 10:33:34 -05:00
Kefu Chai
80b749fe66 Merge pull request #12927 from rjfd/wip-fix-rpath-suse
cmake: fix rpath on shared libraries and binaries targets

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-18 23:08:09 +08:00
Daniel Gryniewicz
963dd121cc Merge pull request #12750 from zhangsw/feature-rgw-lc-validatei
rgw: add lifecycle validation according to S3.
2017-01-18 09:36:50 -05:00
Sage Weil
15ff48518a os/bluestore/BlueFS: dump allocator freelist on failure in reclaim_blocks
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 08:22:29 -06:00
Sage Weil
6dc1bcd9e7 os/bluestore/BlueFS: handle failure to reclaim blocks without crashing
We shouldn't fail to reclaim space in general, but if we do, do not treat
it as a fatal error.  Log loudly.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 08:22:29 -06:00
Daniel Gryniewicz
cf9e759269 Merge pull request #12827 from Liuchang0812/wip-18459
doc: correct S3 lifecycle support explain
2017-01-18 09:08:39 -05:00
Sage Weil
ebf7106b11 unitest_bit_alloc, unittest_alloc: fixes
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 07:38:44 -06:00
Sage Weil
b3fca67cc3 os/bluestore: prealloc/reserve extent vector for common alloc path
No need to worry about the gift/reclaim path--those are very rare.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 07:38:44 -06:00
Sage Weil
efabd177f8 os/bluestore/Allocator: drop unused and goofy release_extents
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 07:38:44 -06:00
Sage Weil
f012481787 os/bluestore: drop useless count arg to allocate
The vector<> has a size.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 07:38:44 -06:00
Sage Weil
5ab034345d os/bluestore: return blocks allocated from allocate()
Instead of having a separate output argument with the number of
blocks allocated, just return it via the return value.  Simplifies
the calling convention.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 07:38:44 -06:00
Sage Weil
5297858938 os/bluestore: manage vector from ExtentList
ExtentList was previous relying the caller to preallocate/size the
vector to be large enough for the worst case allocation of extents,
and keeping it's own manual count of the extent list size.  Instead,
manage that from ExtentList, and remove the preallocation from the
callers.

Fixes: http://tracker.ceph.com/issues/18573
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-18 07:38:44 -06:00
Sage Weil
01da8562a1 Merge pull request #12681 from xiexingguo/xxg-wip-bluestore-1227
os/bluestore: generate same onode extent-shard keys in a more efficient way

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-18 07:37:15 -06:00
Sage Weil
212522178c Merge pull request #12696 from xiexingguo/xxg-wip-improve-loops
os/bluestore: miscellaneous fixes to BitAllocator

Reviewed-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2017-01-18 07:36:45 -06:00
Sage Weil
a9bdb11d74 Merge pull request #12719 from xiexingguo/xxg-wip-bluestore-1229
os/bluestore/BitmapFreelistManager: readability improvements

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-18 07:36:00 -06:00
Sage Weil
323a8eb856 Merge pull request #12942 from Liuchang0812/cleanup-bluestore
os/bluestore: avoid unnecessary memory copy, use variable reference in BlockDevice::Open

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-18 07:35:41 -06:00
Sage Weil
15b25bf110 Merge pull request #12946 from ifed01/wip-bluestore-pextent-vector-mempooled
os/bluestore: Add bluestore pextent vector to mempool

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-18 07:35:18 -06:00
Ricardo Dias
235448879e
cmake: fix rpath on shared libraries and executables
The problem was due to the attempt of CMake to rewrite the RPATH of
the executables, or shared libraries, that didn't have any RPATH linked
during the building phase.

Currently INSTALL_RPATH is already set for all binaries. This patch
sets an empty INSTALL_RPATH for all binaries that don't depend on
any internal (also being built) target.

Signed-off-by: Ricardo Dias <rdias@suse.com>
2017-01-18 12:40:41 +00:00
Mingxin Liu
a37765c7c7 osd/OSDMap: make get prev/next up osd more efficient
what's more, in get_previous_up_osd_before(), if arg n = 0, run into endless loop

Signed-off-by: Mingxin Liu <mingxin@xsky.com>
2017-01-18 18:38:57 +08:00
liuchang0812
fbe7c32ae5 doc: correct S3 lifecycle support explain
Fixes: http://tracker.ceph.com/issues/18459

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-01-18 17:56:11 +08:00
Zhiqiang Wang
a8ba315767 mon: don't set last_osd_report when the pg stats msg is ignored
In some cases, this may lead to mon wrongly marking an osd down
because of no pg stats after a specified time period.

Signed-off-by: Zhiqiang Wang <zhiqiang@xsky.com>
2017-01-18 17:10:17 +08:00
Sage Weil
cda4b8b5bf doc/release-notes: fix typo
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-17 16:54:02 -05:00
Ricardo Dias
5769c6b449
librbd: Support for shared locking in ManagedLock
Signed-off-by: Ricardo Dias <rdias@suse.com>
2017-01-17 21:41:00 +00:00
Sage Weil
4864f302eb doc/release-notes: final kraken notes
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-17 16:09:44 -05:00
Samuel Just
7246209a13 ReplicatedPG: remove src_obcs, restructure LIST_SNAPS
We don't need src_obcs to make LIST_SNAPS work.  Instead, do what we do
in _rollback_to and simply grab the object context inline.  It's
particularly simple since we don't need to worry about rw locks here.

Signed-off-by: Samuel Just <sjust@redhat.com>
2017-01-17 09:42:10 -08:00
Samuel Just
0d7b0b7b52 src/: remove CLONE_RANGE, ASSERT_SRC_VERSION, SRC_CMPXATTR
These greatly complicate the osd implementation and appear unused.

Signed-off-by: Samuel Just <sjust@redhat.com>
2017-01-17 09:41:23 -08:00
Gregory Farnum
5f651d8e28 Merge pull request #12964 from jcsp/wip-18574
qa: update remaining ceph.com to download.ceph.com
2017-01-17 09:37:21 -08:00
Kefu Chai
e556bea651 Merge pull request #12962 from dillaman/wip-rbd-boost-crash
rbd: remove direct linking to static boost libraries

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-18 00:48:51 +08:00
John Spray
549d993d3f qa: update remaining ceph.com to download.ceph.com
Fixes: http://tracker.ceph.com/issues/18574
Signed-off-by: John Spray <john.spray@redhat.com>
2017-01-17 17:14:50 +01:00
Jason Dillaman
eeceb111d8 rbd: remove direct linking to static boost libraries
The boost libraries are included in libceph-common. If linked
directly, boost::regex will abort during shutdown since it uses
a global static variable and it will be destructed twice.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-17 10:39:03 -05:00
Jason Dillaman
449d7831d8 Merge pull request #12885 from rjfd/wip-18325
librbd: allow to open an image without opening the parent image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-01-17 08:45:52 -05:00
Jason Dillaman
06a4e14228 Merge pull request #12922 from trociny/wip-managed_lock_refactoring
librbd: managed lock refactoring

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-01-17 08:45:22 -05:00
donglinpeng
4493d117a4 common/buffer:Pipe fd is not closed when set nonblocking fails.
Signed-off-by: donglinpeng <donglinpeng@cmss.chinamobile.com>
2017-01-17 20:53:40 +08:00
songbaisen
e885500756 ceph: when osd_location_hook does not exist, we should exit error.
If the user define "osd crush location hook" in ceph.conf, but the
    osd_location_hook tool does not exist,we should exit error.

Signed-off-by:song baisen <song.baisen@zte.com.cn>
2017-01-17 19:47:48 +08:00
Mykola Golub
9107d31728 Merge pull request #12953 from dillaman/wip-18542
qa/tasks/qemu: update default image url after ceph.com redesign

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-17 10:03:11 +02:00
Mykola Golub
c4131810ef Merge pull request #12954 from dillaman/wip-rbd-coverity
rbd: correct coverity warnings

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-17 10:02:46 +02:00
Kefu Chai
88ed82f245 Merge pull request #12467 from bassam/pr-external-rocksdb
cmake: support for external rocksdb

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-17 13:53:01 +08:00
Jason Dillaman
275e89c55d rbd: correct coverity warnings
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-16 22:44:04 -05:00
Kefu Chai
c3aed5cdf9 Merge pull request #9028 from tchaikov/wip-bt-dump
common/BackTrace: add operator<<

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-01-17 11:20:54 +08:00
Jason Dillaman
6d17befb3b qa/tasks/qemu: update default image url after ceph.com redesign
Fixes: http://tracker.ceph.com/issues/18542
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-16 22:12:51 -05:00
Kefu Chai
d45f1ae7ad Merge pull request #12807 from runsisi/wip-fix-pg-ls
mon/PGMonitor: fix description for ceph pg ls

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-17 10:56:21 +08:00
Zhang Shaowen
0781e00389 rgw: modify error code in lifecycle to be compatible with S3.
Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-01-17 10:44:31 +08:00
runsisi
1852dd27b8 mon/PGMonitor: ceph pg ls-by-pool only supports string type of pool arg
Signed-off-by: runsisi <runsisi@zte.com.cn>
2017-01-17 09:56:40 +08:00
Yuri Weinstein
6886859cc2 Merge pull request #12928 from tmuthamizhan/wip-ansible-fs-suite
qa/suites/ceph-ansible: removing fs workunit

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2017-01-16 16:55:34 -08:00
Mykola Golub
f8108395f9 librbd: helper methods to query and break lock
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-01-16 23:12:29 +01:00
Mykola Golub
91b72f0a2d librbd: managed_lock: make AcquireRequest use GetLockRequest and BreakRequest
Initially this was implemented for exclusive_lock (03533b9,
23f60fe) but was lost when merging managed_lock refactoring.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-01-16 23:12:29 +01:00
Anjaneya Chagam
b7b14ad138 osd, messenger, librados: lttng enhancements
Few critical functions have been instrumented with function tracing
and oid tracing calls to help routing performance analysis.
Oid tracing events are heavily dependent on functional changes and may need
to be revised as and when core data flow logic changes.

Signed-off-by: Anjaneya Chagam <anjaneya.chagam@intel.com>
2017-01-16 13:58:58 -08:00