Commit Graph

69057 Commits

Author SHA1 Message Date
Zack Cerza
820833e7a0 Merge pull request #13634 from zmc/wip-kcephfs-openstack
qa/suites/kcephfs: Openstack volume configuration
2017-02-24 14:43:26 -07:00
Zack Cerza
e0296d7064 qa/suites/samba: Openstack volume configuration
Signed-off-by: Zack Cerza <zack@redhat.com>
2017-02-24 13:46:54 -07:00
Zack Cerza
3fef0a49da qa/suites/hadoop: Openstack volume configuration
Signed-off-by: Zack Cerza <zack@redhat.com>
2017-02-24 13:45:18 -07:00
Zack Cerza
62c6fd3371 qa/suites/knfs: Add openstack volume configuration
Signed-off-by: Zack Cerza <zack@redhat.com>
2017-02-24 13:44:33 -07:00
Zack Cerza
ec6fb28eaf qa/suites/kcephfs: Openstack volume configuration
Signed-off-by: Zack Cerza <zack@redhat.com>
2017-02-24 13:37:23 -07:00
Samuel Just
0c0feca36d osd,osdc: eliminate FLAG_ONDISK and helpers
The objecter actually always needs to get a response in order to
be able to not continually resend ops (even if the caller didn't
provide a callback).  Thus, it makes no sense for an MOSDOp to
ever not have FLAG_ONDISK set.  Therefore, we'll just remove the
helper and assume it's always there (it's safe to send a response
the client didn't ask for, the error paths already do that).  On
the Objecter side, we'll just unconditionally fill in ONDISK for
the benefit of pre-luminous OSDs.

Fixes: http://tracker.ceph.com/issues/18961
Signed-off-by: Samuel Just <sjust@redhat.com>
2017-02-24 11:27:02 -08:00
Samuel Just
48cc5d2643 PrimaryLogPG::start_flush: don't use ORDERSNAP, eliminate the second delete
I think that whole thing was a misguided attempt to avoid deleting head
if it exists in the base tier (in reality it doesn't matter since head
would have to be logically dirty and anything we actually care about
would be preserved by sending a new enough seq to cause a clone).

Introduced in 4843fd510b, but the real
logical error happened in f3df50188b.

I suggest never backporting this patch.  If you want to try, keep in
mind that the last version didn't turn up as busted for 2 years.

Fixes: f3df50188b
Signed-off-by: Samuel Just <sjust@redhat.com>
2017-02-24 11:26:25 -08:00
Zack Cerza
7ac25217ea Merge pull request #13631 from ceph/wip-krbd-openstack
qa/suites/krbd: Add openstack volume configuration
2017-02-24 12:23:23 -07:00
Sage Weil
674ae80a28 Merge pull request #13534 from liewegas/wip-objecter-fixes
osdc/Objecter: fix bugs in explicit naming of op spg_t

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-02-24 12:55:16 -06:00
Zack Cerza
201b4d0d1e qa/suites/krbd: Add openstack volume configuration
Signed-off-by: Zack Cerza <zack@redhat.com>
2017-02-24 11:17:45 -07:00
Sage Weil
b0a3a2cb69 Merge pull request #13545 from liewegas/wip-18933
osd: constify OpRequest::get_req(); fix a few cases of operator<< vs mutated message races

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-02-24 12:01:54 -06:00
Kefu Chai
8e36dadb71 Merge pull request #13625 from tchaikov/wip-suite-repo-for-workunit
qa/tasks/workunit: use the suite repo for cloning workunit

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-02-24 23:44:27 +08:00
Matt Benjamin
de98df6814 Merge pull request #13614 from linuxbox2/wip-valid-dirname
rgw_file: ensure valid_s3_object_name for directories, too
2017-02-24 09:09:25 -05:00
Jason Dillaman
3cd180b28b Merge pull request #12102 from yangdongsheng/async_remove
librbd: asynchronous image removal state machine

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-02-24 08:50:41 -05:00
Willem Jan Withagen
d92de30724 do_freebsd.sh: the EMBEDDED target is not (yet) working for FreeBSD
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-02-24 11:51:25 +01:00
Willem Jan Withagen
ec07744846 do_freebsd.sh: Remove ENODATA requirement
- This was there because cython did not know about ENOATTR
   But since cython 0.25.2 tus is fixed.
   And we don't need to edit /usr/include/errno.h

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-02-24 11:20:16 +01:00
Kefu Chai
3af2ed28c3 Merge pull request #13620 from tchaikov/wip-sepia-bt
script/sepia_bt.sh: get sha1,release from t.log if it's not in core

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-02-24 17:14:23 +08:00
Kefu Chai
4cf28de4c9 qa/tasks/workunit: use the suite repo for cloning workunit
as "workunits" reside in ceph/qa/workunits, it's more intuitive to
respect suite-repo option when cloning workunits.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-02-24 16:47:47 +08:00
Kefu Chai
cd0e53830e script/sepia_bt.sh: get sha1,release from t.log if it's not in core
* sometimes, the coredump comes from python, so we should get the sha1 and
  release in a different and more fragile way.
* also, the distro of Centos7 comes from python is "Centos Linux", so we
  should normalize its distro name and distro version.
* add "-v" option to be more chatty.
* normalize the $prog if $prog is */python*
* fix the pkg_path if the distro is centos7

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-02-24 11:15:30 +08:00
Jie Wang
11c0d64e99 BitAllocator: delete useless codes
Signed-off-by: Jie Wang <jie.wang@kylin-cloud.com>
2017-02-24 01:31:46 +00:00
Gui Hecheng
f42f6cf66a test/librbd: skip expect object request send when skip_partial_discard on
With skip_partial_discard on, there may be no object request send calls,
because they are skipped.

Signed-off-by: Gui Hecheng <guihecheng@cmss.chinamobile.com>
2017-02-24 09:31:14 +08:00
Jason Dillaman
38405b81dc Merge pull request #13312 from trociny/wip-18783
rbd-mirror: InstanceWatcher watch/notify stub for leader/follower RPC

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-02-23 20:20:03 -05:00
Gregory Farnum
8827efa284 Merge pull request #13616 from liewegas/wip-primary-temp
mon/OSDMonitor: remove trivial PGMap dependency for 'osd primary-temp' command

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-02-23 15:08:19 -08:00
Yuri Weinstein
bba8c3ca15 Merge pull request #13611 from zmc/wip-rgw-openstack
qa/suites/rgw: Add openstack volume configuration

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2017-02-23 14:56:50 -08:00
Sage Weil
ff12ba2402 mon/OSDMonitor: remove trivial PGMap dependency for 'osd primary-temp' command
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-23 16:50:27 -05:00
Matt Benjamin
eb1cd3b30c rgw_file: ensure valid_s3_object_name for directories, too
The logic in RGWLibFS::mkdir() validated bucket names, but not
object names (though RGWLibFS::create() did so).

The negative side effect of this was not creating illegal objects
(we won't), but in a) failing with -EIO and b) more importantly,
not removing up the proposed object from FHCache, which produced a
boost assert when recycled.

Fixes: http://tracker.ceph.com/issues/19066

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-02-23 16:02:07 -05:00
Matt Benjamin
73368cc14c Merge pull request #13607 from linuxbox2/wip-parentref
rgw: wip parentref
2017-02-23 13:00:42 -05:00
Zack Cerza
8af4c35f95 qa/suites/rgw: Add openstack volume configuration
Without this, OSDs will fail to create on instances whose root fs isn't
xfs.

Signed-off-by: Zack Cerza <zack@redhat.com>
2017-02-23 10:14:05 -07:00
Kefu Chai
69afc52492 Merge pull request #13480 from wido/srpm
make-srpm: Pass first parameter to make-dist for building SRPM

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-02-24 00:56:04 +08:00
Gui Hecheng
dc9892b118 librbd: adopt override for writesame related header files
Signed-off-by: Gui Hecheng <guihecheng@cmss.chinamobile.com>
2017-02-24 00:18:35 +08:00
Gui Hecheng
6d024c5dae librbd: make writesame get all zeros with rbd_skip_partial_discard on
Now writesame tends to do a discard on all zero buffer, but
if rbd_skip_partial_discard is turned on, discard will not do any
zeroing work on partial discard, so we read random data while expecting
all zeros.
To fix it, we introduce the ImageCtx::skip_partial_discard and
pass an extra parameter to discard. Writesame will always pass false
and other discards will pass the ImageCtx::skip_partial_discard
which is set by the rbd_skip_partial_discard option.

Signed-off-by: Gui Hecheng <guihecheng@cmss.chinamobile.com>
2017-02-24 00:16:46 +08:00
Sage Weil
9076e695fb osd: remove copy-get-classic
This hasn't been used since well before hammer.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-23 11:15:43 -05:00
Matt Benjamin
70ef7d45e0 rgw_file: return of RGWFileHandle::FLAG_EXACT_MATCH
Allow callers of rgw_lookup() on objects attested in an
rgw_readdir() callback the ability to bypass exact match in
RGWLibFS::stat_leaf() case 2, but restore exact match enforcement
for general lookups.

This preserves required common_prefix namespace behavior, but
prevents clients from eerily permitting things like "cd sara0" via
partial name match on "sara01."

Fixes: http://tracker.ceph.com/issues/19059

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-02-23 10:55:51 -05:00
Sage Weil
8ff8f0fa0b Merge pull request #13595 from tchaikov/wip-enable-bluestore-ceph-dencoder
ceph-dencoder: enable bluestore types

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-23 09:31:58 -06:00
Sage Weil
bbd9f0f0b2 osdc/Objecter: _calc_target on all ops so that we notice splits
We need to make sure we update the mapping and get an accurate actual_pgid
value by recalcuating the mapping on every map change.  Otherwise, we may
not notice a split (and subsequent actual_pgid change) and resend the same
op with a stale spg_t.  To fix this,

- _calc_target on need_resend
- update target regardless of current con

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-23 10:29:42 -05:00
Sage Weil
71f5309fe7 osdc/Objecter: refactor pool dne check to make op->session optional
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-23 10:29:42 -05:00
Sage Weil
57dfcb62c1 osdc/Objecter: track latest epoch in op_target_t
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-23 10:29:42 -05:00
Sage Weil
fce285a5ff osd: warn on ops directed to the wrong pg_t
Check whether the request hobj maps to the current pg_t.  If we have the
osd_debug_misdirected_ops setting enabled (as teuthology does), assert out
as well so that the error is easy to spot.  This catches bugs in the
Objecter (especially the new code that explicitly names the spg_t for the
request).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-23 10:29:42 -05:00
Sage Weil
930dc603e7 vstart.sh: osd debug misdirected ops = true
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-23 10:29:42 -05:00
Matt Benjamin
dea8d1ee37 rgw_file: rgw_lookup: don't ref for "/" or ".."
These refs won't be returned by nfs-ganesha, and are sufficiently
magical that other consumers should be persuaded to understand
their specialness.

Fixes: http://tracker.ceph.com/issues/19060

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-02-23 10:27:35 -05:00
Sage Weil
292306cdfb Merge pull request #13569 from athanatos/wip-17831-18583-18809-18927
ReplicatedBackend: don't queue Context outside of ObjectStore with obc

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-23 09:22:02 -06:00
Sage Weil
5b12163ed6 Merge pull request #13470 from wangzhengyong/master
os/bluestore/BitAllocator: fix bug of checking required blocks

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-23 09:04:01 -06:00
Sage Weil
7c44095e04 Merge pull request #13516 from wjwithagen/wip-wjw-test-onjectstore
test/ceph-test-objectstore: Don't always include BlueStore code

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-02-23 09:02:54 -06:00
Sage Weil
b1ea854d11 Merge pull request #13521 from dachary/wip-crush-uniform
crush: allow uniform buckets with no items

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-23 09:01:30 -06:00
Sage Weil
638594d579 Merge pull request #13540 from liewegas/wip-debug-osd
osd: debug con in ms_handle_connect

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-02-23 09:01:01 -06:00
Sage Weil
780ca8e38a Merge pull request #13565 from liewegas/wip-fix-pool-race-test
ceph_test_rados_api_misc: avoid livelock from PoolCreationRace

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-02-23 09:00:35 -06:00
Mykola Golub
215f2984bd rbd-mirror A/A: InstanceWatcher watch/notify stub for leader/follower RPC
Fixes: http://tracker.ceph.com/issues/18783
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-02-23 13:12:00 +01:00
Mykola Golub
385c2e4d11 librbd: add ManagedLock destroy method (useful for mock tests)
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-02-23 12:57:19 +01:00
Mykola Golub
c9afb1d459 cls/rbd: methods to track rbd-mirror instances
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-02-23 12:57:19 +01:00
Sarit Zubakov
1e5c2fc459 msg/async/rdma: Fix broken compilation
Resposible commit is: eb0f624

issue:985021

Change-Id: I5b4afc537a9351dd18f5ea08bf4d72a1b03a8635
Signed-off-by: Sarit Zubakov <saritz@mellanox.com>
2017-02-23 11:31:53 +02:00