Commit Graph

67617 Commits

Author SHA1 Message Date
Samuel Just
1753abc116 Merge pull request #12869 from athanatos/wip-18358
osdc/Objecter: resend pg commands on interval change

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-12 12:46:00 -08:00
Samuel Just
d89fdd2833 Objecter: resend pg commands on interval change
mark_lost_unfound* are now async since the rework, so we need
the Objecter to be able to resend on interval change.  This
is preferable to somehow requeueing the Command because they
don't use the normal op queue.

Fixes: http://tracker.ceph.com/issues/18358
Signed-off-by: Samuel Just <sjust@redhat.com>
2017-01-12 12:45:03 -08:00
Samuel Just
bc57b7cb70 Objecter: fold last_force_resend into op_target_t
It's always passed along with op_target_t, this seems simpler.

Signed-off-by: Samuel Just <sjust@redhat.com>
2017-01-12 12:44:59 -08:00
Samuel Just
68defc2b05 ReplicatedBackend: take read locks for clone sources during recovery
Otherwise, we run the risk of a clone source which hasn't actually
come into existence yet being used if we grab a clone which *just*
got added the the ssc, but has not yet actually had time to be
created (can't rely on message ordering here since recovery messages
don't necessarily order with client IO!).

Fixes: http://tracker.ceph.com/issues/17831
Signed-off-by: Samuel Just <sjust@redhat.com>
2017-01-12 12:43:18 -08:00
Sage Weil
240d885c7f Merge pull request #12888 from athanatos/wip-18165
osd/PrimaryLogPG::failed_push: update missing as well

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-12 14:17:58 -06:00
Gregory Farnum
6aa6f1d4b6 Merge pull request #12894 from dmick/wip-doc
doc/cephfs/troubleshooting: fix broken bullet list

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-01-12 10:39:54 -08:00
Jason Dillaman
3d7501ef05 Merge pull request #12905 from rjfd/wip-15824
librbd: added rbd_flatten_with_progress to API

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-01-12 12:20:09 -05:00
Mykola Golub
4b92adcb30 rbd-mirror: delayed replication support
Fixes: http://tracker.ceph.com/issues/15371
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-01-12 18:14:48 +01:00
Mykola Golub
b71a2d57cc test/rbd_mirror: ImageReplayer mock tests
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-01-12 18:14:48 +01:00
Mykola Golub
ce867ce44a rbd-mirror: tweaks to support creating mock test cases
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-01-12 18:14:48 +01:00
Mykola Golub
5c426683a5 test: add "resync requested" unit test for rbd-mirror bootstrap request
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-01-12 18:14:48 +01:00
Mykola Golub
72158bd9a3 qa/workunits/rbd: allow to tweak rbd-mirror test setup
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-01-12 18:09:02 +01:00
Jason Dillaman
abbcbbded2 Merge pull request #12843 from trociny/wip-18465
librbd: metadata_set API operation should not change global config setting

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-01-12 09:54:20 -05:00
Jason Dillaman
438f99016b Merge pull request #12880 from wjwithagen/wip-wjw-static_cast-NULL
tests: fix NULL references to be acceptable by Clang

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-01-12 09:53:06 -05:00
Ricardo Dias
52fae71fb7
rbd: added rbd_flatten_with_progress to librbd header
Fixes: http://tracker.ceph.com/issues/15824

Signed-off-by: Ricardo Dias <rdias@suse.com>
2017-01-12 14:30:29 +00:00
Nathan Cutler
8c724a5297 Merge pull request #12683 from SUSE/wip-run-make-check-deps
build/ops: add sanity checks to run-make-check.sh

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-01-12 15:22:19 +01:00
Xinze Chi
18f02de07c os/bluestore: nullptr in OmapIteratorImpl::valid
call stack:
SnapMapper::get_next_object_to_trim -> MapCacher::get_next ->
OSDriver::get_next-> BlueStore::OmapIteratorImpl::valid()

In OSDriver::get_next, it call iter->upper_bound(key); // this may reset it to nullptr

Signed-off-by: Xinze Chi <xinze@xsky.com>
2017-01-12 22:20:40 +08:00
Jason Dillaman
59d0207e6c Merge pull request #12864 from gaurav36/bug-18422-rbd-bench-write-crash-4G-io-size
rbd: bench-write should return error if io-size >= 4G

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-01-12 09:14:30 -05:00
Yan, Zheng
6526ecc084 qa/tasks: add test_open_ino_errors
Validate that errors encountered during opening inos are properly
propagated

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2017-01-12 20:15:53 +08:00
Mykola Golub
5b97cce360 Merge pull request #12863 from dillaman/wip-rbd-coverity
librbd: resolve static analyser warnings

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-12 12:48:18 +02:00
Dan Mick
c278971bb6 doc/cephfs/troubleshooting: fix broken bullet list
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2017-01-11 18:45:15 -08:00
Jason Dillaman
60c36674bd Merge pull request #12820 from trociny/wip-18447
rbd-mirror: check remote image mirroring state when bootstrapping

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-01-11 21:36:09 -05:00
xie xingguo
78cc0adfc8 os/bluestore: use Best-Effort policy when evicting onode from cache
We want a precise control of cache usage, and BE can achieve this goal
in a better way.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-01-12 09:28:59 +08:00
John Spray
6048704d2f Merge pull request #12465 from jcsp/wip-18159
mount: do not print "unknown" option to kclient

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2017-01-12 00:48:29 +00:00
John Spray
3db51ae52d Merge pull request #12794 from ukernel/wip-multimds-misc2
mds: misc multimds fixes part2

Reviewed-by: John Spray <john.spray@redhat.com>
2017-01-12 00:32:55 +00:00
Jason Dillaman
2e86a67b1b Merge pull request #12842 from trociny/wip-break_lock_test
test/librbd: add break_lock test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-01-11 19:30:36 -05:00
Bassam Tabbara
853d5221e9 rgw: make fcgi optional during build
fcgi can now be compiled out of the binary. this reduces the system
dependencies when fcgi is not needed or used.

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
2017-01-11 14:06:08 -08:00
Bassam Tabbara
cf8c782f6c embedded: add RGW to libcephd
added RGW and rgw-admin to libcephd.

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
2017-01-11 14:02:59 -08:00
Bassam Tabbara
3721790fcf embedded: add MDS to libcephd
Added MDS to libcephd

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
2017-01-11 13:59:17 -08:00
Willem Jan Withagen
cbb2d65b87 tests: fix NULL references to be acceptable by Clang
- On some platforms NULL evaluates to nullptr, which will require a
   cast to the right type to be able to compile.
      error: reinterpret_cast from 'nullptr_t' to 'ContextWQ *'

 - It is a delicate change since otherwise GCC will start complaining
   about the reverse:
      error: invalid static_cast from type 'const long int' to type 'ContextWQ*'

 By casting right at the instance of NULL both compilers are happy.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-01-11 17:14:59 +01:00
Mykola Golub
3aca476a97 Merge pull request #12839 from dillaman/wip-17993
librbd: delay mirror registration when creating clones

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-11 18:13:57 +02:00
Mykola Golub
31f76d1778 Merge pull request #12838 from dillaman/wip-18419
librbd: possible deadlock with flush if refresh in-progress

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-11 18:13:24 +02:00
Mykola Golub
e0da839dd9 Merge pull request #12837 from dillaman/wip-18441
rbd-mirror: avoid processing new events after stop requested

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-11 18:12:16 +02:00
Jason Dillaman
5341e1fc18 Merge pull request #12846 from dillaman/wip-rbd-mirror-ha-merge
librbd: refactor exclusive lock support into generic managed lock

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2017-01-11 10:53:33 -05:00
Casey Bodley
a0974fdcf6 rgw: fix off-by-one in RGWDataChangesLog::get_info
Fixes: http://tracker.ceph.com/issues/18488

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-01-11 09:33:02 -05:00
Igor Fedotov
96581a7542 os/bluestore: pass Collection* to access BlueStore instance and other needed stuff rather than have additional referencing members in BlueStore child classes.
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-11 11:48:46 +00:00
Igor Fedotov
061fb4b15f os/bluestore: refactor to avoid both SharedBlobSet and Cache pointers tracking in SharedBlob & BufferSpace respectively. Use Collection* in SharedBlob instead.
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-11 11:48:46 +00:00
Igor Fedotov
bc97ce0635 os/bluestore: make BufferSpace offsets 32-bit wide.
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-11 11:48:46 +00:00
Kefu Chai
025446ac78 Merge pull request #12832 from wjin/clean_async
msg/async: cleanups

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-11 18:25:19 +08:00
Yan, Zheng
2f50921492 mds: fix MDCache::trim() with max == 0
MDCache::shutdown_pass call MDCache::trim with max == 0. If the last
dentry is non-null, MDCache::trim does nothing

Signed-off-by: Yan, Zheng <zyan@redhat.com>
2017-01-11 17:16:45 +08:00
xie xingguo
f9799e3153 os/bluestore: conditionally load crr option
And moving COMP_NONE checking ahead, since this is the preferred option.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-01-11 17:00:15 +08:00
Yan, Zheng
2213cc2dcc mds: propagate error encountered during opening inode by number
Fixes: http://tracker.ceph.com/issues/18179
Signed-off-by: Yan, Zheng <zyan@redhat.com>
2017-01-11 15:21:41 +08:00
liuchang0812
3d023cf1b4 test: clean up unused variable
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-01-11 14:00:55 +08:00
Kefu Chai
03db36f354 Merge pull request #12840 from tchaikov/wip-libceph-common
cmake: turn libcommon into a shared library

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2017-01-11 13:07:20 +08:00
Kefu Chai
87256a1fbc Merge pull request #12809 from wjin/optimize_atomic
msg/async: avoid atomic variable overhead

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-11 13:02:17 +08:00
Kefu Chai
55c5fdd747 Merge pull request #12826 from LiumxNL/fix-op-tracker-initiate
mon: optracker's initiated_at timestamp should not be NULL

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-11 13:00:27 +08:00
Sage Weil
ab9d375df2 Merge pull request #12871 from xiexingguo/xxg-wip-bluestore-20170111
os/bluestore: kill BufferSpace.empty()

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-10 21:15:35 -06:00
Xiaoxi Chen
52fe52baf9 mds/server: skip unwanted dn in handle_client_readdir
We can skip unwanted dn which  < (offset_key, snap) via map.lower_bound, rather than
iterate across them.

Previously we iterate and skip dn which < (offset_key, dn->last), as dn->last >= snap
 means (offset_key, dn->last) >= (offset_key, snap), and such iterate_and_skip logic
still keep, so this commit doesnt change code logic but an optimization.

Signed-off-by: Xiaoxi Chen <xiaoxchen@ebay.com>
2017-01-10 20:04:56 -07:00
xie xingguo
985514b278 os/bluestore: kill BufferSpace.empty()
Because:
1. All other public methods are called under the protection of cache->lock,
which makes the usage of this method is weird.

2. The only caller is _dump_extent_map(), and we can do it without this
in a simpler way.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-01-11 10:43:58 +08:00
Haomai Wang
2945bf1b50 Merge pull request #12860 from liupan1111/wip-fix-dpdk-prefix
async: fixed the error "Cause: Cannot create lock on '/var/run/.rte_c…

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-11 10:17:07 +08:00