Commit Graph

58054 Commits

Author SHA1 Message Date
Samuel Just
27bdc8ce6d src/osd: relax the requirement that we scrub a whole hash value
Previously, we needed to scrub all objects in clones in a single
hash value mainly to ensure that _scrub had access to all clones
of a single object at the same time.  Instead, just avoid letting
head or snapdir be a boundary (see the comment in the commit
for details).

Signed-off-by: Samuel Just <sjust@redhat.com>
2016-09-30 16:43:08 -07:00
Samuel Just
a2c27c9423 hobject: clarify is_snap and has_snapset for max
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-09-28 13:25:54 -07:00
Gregory Farnum
b9f15e543e Merge pull request #11180 from liewegas/wip-mon-forward
messages/MForward: fix encoding features

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-09-28 10:28:56 -07:00
Sage Weil
d4f5e88f36 messages/MForward: fix encoding features
We were encoding the message with the sending client's
features, which makes no sense: we need to encode with
the recipient's features so that it can decode the
message.

The simplest way to fix this is to rip out the bizarre
msg_bl handling code and simply keep a decoded Message
reference, and encode it when we send.

We encode the encapsulated message with the intersection
of the target mon's features and the sending client's
features.  This probably doesn't matter, but it's
conceivable that there is some feature-dependent
behavior in the message encode/decode that is important.

Fixes: http://tracker.ceph.com/issues/17365
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-28 11:44:28 -04:00
Sage Weil
56ccf8ea08 Merge pull request #11243 from liewegas/wip-bluestore-deferred-csum
os/bluestore: remove deferred_csum machinery
2016-09-28 10:40:43 -05:00
Sage Weil
51a1f8600d Merge pull request #11113 from yuyuyu101/wip-fix-filestore-clone
os/filestore: disable use of splice by default

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-28 10:39:43 -05:00
Sage Weil
641d2ca04d Merge pull request #9652 from stiopaa1/osdc_ObjectCacher_constMember
osdc/ObjectCacher.h: add const to member functions

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-28 10:06:46 -05:00
Sage Weil
ad50703c15 Merge pull request #11248 from mikulely/cleanup-vstart-doc
doc: cleanup outdated radosgw description
2016-09-28 09:29:39 -05:00
Sage Weil
c48ee9d3ec Merge pull request #11217 from ceph/wip-17395-rbdmap-permissions
rpm: fix permissions for /etc/ceph/rbdmap

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2016-09-28 09:20:06 -05:00
Sage Weil
4182ee6654 Merge pull request #11240 from liewegas/wip-bluestore-assert
os/bluestore: add assert to compress_extent_map
2016-09-28 09:13:20 -05:00
Sage Weil
8a9e41a286 Merge pull request #11245 from xiexingguo/xxg-wip-bluestore-bsearch-shard
os/bluestore: binary search specified shard

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-28 09:12:50 -05:00
Sage Weil
539a86220e Merge pull request #11235 from xiexingguo/xxg-wip-bluestore-0926
os/bluestore: more cleanups

Reviewed-by: Sage Weil <sage@redhat.com>
2016-09-28 08:56:47 -05:00
Haomai Wang
cac8b17a37 Merge pull request #11247 from majianpeng/msg-async-cleanup
msg/async: remove unused code.

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-09-28 21:36:21 +08:00
Jianpeng Ma
91bc79eed6 msg/async: remove unused code.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2016-09-28 22:32:48 +08:00
Jason Dillaman
cc40473fb1 Merge pull request #10980 from trociny/wip-16213
rbd-mirror: replicate dynamic feature updates

Reviewed-by: Jason Dillaman <dillamana@redhat.com>
2016-09-28 09:06:29 -04:00
Mykola Golub
f99dbbd153 librbd: potential null pointer dereference when requesting exclusive lock
m_require_lock_on_read should be cleared when holding owner_lock.

For safety, also check that exclusive_lock is not null.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:19 +03:00
Mykola Golub
ac71dbca3e librbd: interlock image state machine and update features operations
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:19 +03:00
Mykola Golub
5a68e334d8 librbd: use counter to track exclusive lock block/unblock requests
It's possible the watch/notify message is duplicated resulting in two
concurrent block_requests() call.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:19 +03:00
Mykola Golub
93cf63f993 rbd-mirror: replicate dynamic feature updates
Fixes: http://tracker.ceph.com/issues/16213
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:19 +03:00
Mykola Golub
3c270b57bf librbd: async state machine to enable/disable image features
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:19 +03:00
Mykola Golub
606344dd29 librbd: templetize journal StandardPolicy
It will be needed for unit tests with a mocked ImageCtx.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:19 +03:00
Mykola Golub
4269a5fc0c librbd: allow to call append_disabled for DisabledPolicy
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:19 +03:00
Mykola Golub
dcfb8aa141 librbd: async methods to enable/disable mirroring
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:19 +03:00
Mykola Golub
953561f841 librbd: async method to check journal tag owner
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:19 +03:00
Mykola Golub
9026b515e6 librbd: async image set flags method
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:18 +03:00
Mykola Golub
a0cf640d58 librbd: async methods to create/remove object map
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:18 +03:00
Mykola Golub
28e576e278 cls/rbd: alow to call set_features asynchronously
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:18 +03:00
Mykola Golub
ac25cb1946 cls/journal: async client_list method
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-09-28 15:17:18 +03:00
John Spray
bfbb16cae1 Merge pull request #11120 from renhwztetecs/renhw-wip-mds-server
mds/server: clean up handle_client_open()

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-09-28 12:14:08 +01:00
John Spray
5524311246 Merge pull request #11078 from ukernel/wip-17271
mds: remove fail-safe queueing replay request

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2016-09-28 12:12:41 +01:00
John Spray
f9f8a36b1e Merge pull request #11225 from ukernel/wip-17392
client: protect InodeRef with client_lock

Reviewed-by: John Spray <john.spray@redhat.com>
2016-09-28 12:10:13 +01:00
Jiaying Ren
ed65930270 doc: cleanup outdated radosgw description
radosgw support is on by default, as built-in Civetweb, set up Apache
is no necessary any more.

Signed-off-by: Jiaying Ren <jiaying.ren@umcloud.com>
2016-09-28 16:52:08 +08:00
xie xingguo
895a76a4fe os/bluestore: add a counter to trace rejected compress ops
This is useful for choosing a more proper bluestore_compression_required_ratio.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-28 15:50:23 +08:00
xie xingguo
9caae754bf os/bluestore: make allocated space calc a little faster
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-28 15:24:19 +08:00
xie xingguo
6b9988acd3 os/bluestore: binary search specified shard
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-28 13:44:32 +08:00
xie xingguo
9f6344e337 os/bluestore: use std namespace for hex/dec output formatting
Because we use std::hex/dec everywhere in bluestore except these two places.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-28 08:32:37 +08:00
xie xingguo
9d909394f1 os/bluestore: remove fadvise_flags from WriteContext
Currently fadvise_flags is only used to check whether
buffered write is necessary, so there is no need
to keep it in the WriteContext as we have already
pre-calculated and kept the buffered field instead.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-28 08:32:37 +08:00
xie xingguo
c6adc6e0be os/bluestore: remove dead local variables from BlueStore::_wctx_finish()
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-28 08:32:37 +08:00
xie xingguo
a5dd191d03 os/bluestore: move nid assignment into BlueStore::_zero()
So other callers, such as BlueStore::_clone_range(),
won't do it twice.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-09-28 08:32:37 +08:00
Sage Weil
ad7487d641 os/bluestore: remove deferred_csum machinery
When we added this way back in d4f4fa0312,
we did not have our own buffer cache, and were relying
on the cache at the BlockDevice layer.  In that case,
we would have the problem of a partial wal overwrite
followed by another partial write that needed to read
the rest of the chunk.

However, now we have our own cache, and any data we write
in the _do_write_small() wal path will go into the cache,
which means we will never read the old data off of
disk and need the old csum values.

Remove this now-unnecessary kludge!

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-27 17:07:16 -04:00
Sage Weil
e4ed13fed0 unittest_bluestore_types: init g_ceph_context
The methods we're testing use it for dout.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-27 16:23:21 -04:00
Sage Weil
e8dd0883c1 os/bluestore: add assert to compress_extent_map
Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-27 14:02:36 -04:00
Sage Weil
67f2602700 Merge pull request #11238 from theanalyst/changelog-v10.2.3
doc/changelog: add v10.2.3
2016-09-27 11:02:54 -05:00
Sage Weil
f4ce7f0093 Merge pull request #10814 from liewegas/wip-bluestore-precondition
os/bluestore: precondition rocksdb/bluefs during mkfs

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-09-27 11:00:38 -05:00
Abhishek Lekshmanan
9c691776aa
doc/changelog: add v10.2.3
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-09-27 17:59:55 +02:00
Sage Weil
0e2198fa15 os/bluestore: precondition rocksdb on mkfs
Write N bytes of garbage to the kv store on startup.  With rocksdb,
this ensures that our log files are preallocated.

This option needs to match up with the rocksdb tunables so that it
is enough data to start recycling log files.  For now, start with
128MB.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-09-27 11:38:42 -04:00
Sage Weil
828c100647 Merge pull request #11234 from theanalyst/jewel-release-notes
doc/release-notes: v10.2.3 jewel
2016-09-27 10:18:25 -05:00
Sage Weil
5f5880d080 Merge pull request #11216 from liewegas/wip-bluestore-compress-map
os/bluestore: prevent extent merging across shard boundaries

Reviewed-by: Somnath Roy <somnath.roy@sandisk.com>
2016-09-27 09:45:38 -05:00
Abhishek Lekshmanan
9f97af26b8 doc/release-notes: more fixes to 10.2.3
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-09-27 16:38:26 +02:00
Jason Dillaman
d4f144ec3b Merge pull request #10445 from rjfd/wip-15259
journal: increase concurrency/parallelism of journal recorder

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-09-27 10:35:01 -04:00