Commit Graph

68395 Commits

Author SHA1 Message Date
Kefu Chai
40713870e4 Merge pull request #13268 from tchaikov/wip-better-error-ping-mon
ceph: do not throw TypeError on connection failure

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-02-08 11:32:25 +08:00
Kefu Chai
75434ff70b Merge pull request #13286 from Liuchang0812/remove-useless-close
msg/async: remove useless close function

Reviewed-by: Kefu Chai <kefu@redhat.com>
2017-02-08 11:31:50 +08:00
Kefu Chai
1f9ca87080 Merge pull request #13288 from dmick/master
ceph.in: add help for locally-handled commands

Reviewed-by: Kefu Chai <kefu@redhat.com>
2017-02-08 11:31:02 +08:00
Sage Weil
eafbe4486e Merge pull request #9976 from songbaisen/a13
mon: PGMonitor add check only concern our self cluster command

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-07 17:14:14 -06:00
Sage Weil
402b3580ed Merge pull request #10150 from songbaisen/b
mon: avoid start election twice when quorum enter

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-07 17:13:47 -06:00
Sage Weil
af3d311a82 Merge pull request #10309 from songbaisen/b8
mon: OSDMonitor add check only concern our self cluster command

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-07 17:13:13 -06:00
Yuri Weinstein
9f937aaf9b Merge pull request #12273 from songbaisen/s4
mon: add warn info for osds were removed from osdmap but still kept in crushmap

Reviewed-by: Piotr Dałek <piotr.dalek@ts.fujitsu.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-07 13:05:27 -08:00
Yuri Weinstein
1a8e3534b3 Merge pull request #13121 from LiumxNL/wip-170125
osd: we know the definite epoch of marking down

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-02-07 13:00:21 -08:00
Loic Dachary
3134606163 Merge pull request #13297 from dachary/wip-buildpackages
buildpackages: remove because it does not belong

Reviewed-by: Nathan Cutler <ncutler@suse.cz>
2017-02-07 21:40:58 +01:00
Sage Weil
d62a4948a9 Merge pull request #13162 from liewegas/wip-bluestore-reshard
os/bluestore: partial reshard support

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-02-07 13:01:48 -06:00
Sage Weil
8226159e7c mon: prevent sortbitwise flag from being unset
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 14:00:32 -05:00
Loic Dachary
5a43f8d579 buildpackages: remove because it does not belong
It should live in teuthology, not in Ceph. And it is currently broken:
there is no need to keep it around.

Fixes: http://tracker.ceph.com/issues/18846

Signed-off-by: Loic Dachary <loic@dachary.org>
2017-02-07 18:37:26 +01:00
Sage Weil
8015544617 osd/PG: drop sortbitwise feature check assert
This feature bit will get deprecated shortly anyway.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 12:17:07 -05:00
Sage Weil
5ca13ff7c0 osd/PG: drop osd_debug_randomize_hobj_sort_order
This is required post-jewel; no need to thrash it.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 12:15:41 -05:00
Sage Weil
c5a3bc07b9 qa/suites/rados: stop thrashing sortbitwise
This is required to upgrade past jewel; no need to keep testing it
on master.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 12:14:13 -05:00
Sage Weil
2620cb33c3 osd/OSDMap: fix kraken feature requirement
Use the FEATUREMASK since this is a reused bit.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 10:37:43 -05:00
Sage Weil
d4e37cc3e5 mon/OSDMonitor: use HAVE_FEATURE for kraken, jewel feature tests
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 10:36:32 -05:00
Sage Weil
3592121156 mon: apply monmap features to quorum requirements
Previously this was indirect..

 monmap requirements -> compatset -> quorum requirements

However, how that we are consistently using the monmap features, we no
longer need to use the compatset features when the monmap already
communicates the same thing.  Rename the helper to reflect that
quorum requirements come from both the compatset and the monmap.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 10:36:32 -05:00
Sage Weil
d1115ffbf9 mon: fix kraken requirement to use FEATUREMASK, HAVE_FEATURE macro
The KRAKEN_SERVER bit was reused.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 10:36:32 -05:00
Sage Weil
e8c50f78e0 osd: require luminous mons before starting
Require that mons are upgraded to luminous first.  This will ensure that
the last_force_op_resend flag is set for pre-luminous clients so that
luminous OSDs can safely discard them.  (This will come in a future patch.)

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 10:36:31 -05:00
Sage Weil
b5e3e56e04 osd: drop redundant check for hammer OSDs
The OSDMAP_REQUIRE_JEWEL flag requirement implies that there are no
pre-0.94.4 (early hammer) OSDs running.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 10:36:31 -05:00
Sage Weil
b053bca71f mon/mon_types: add sticky FEATURE_LUMINOUS feature bit
Once mons upgrade to luminous, you can't go back.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 10:36:31 -05:00
Sage Weil
c7a9c041cb mon/OSDMonitor: all upgrades pass through luminous
Prevent post-luminous OSDs from starting before require_luminous_osds is
set.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 10:36:31 -05:00
Sage Weil
cf8b5e3394 osd/OSDMap: add REQUIRE_LUMINOUS flag
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-07 10:35:33 -05:00
Matt Benjamin
084ebfcd1b Merge pull request #13035 from yehudasa/wip-18621
rgw: change default chunk size to 4MB
2017-02-07 08:50:49 -05:00
John Spray
9c151d0e5f Merge pull request #13259 from jcsp/wip-jcsp-relnotes
PendingReleaseNotes: note the fuse fstab format change

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-07 12:06:51 +00:00
Dan Mick
ff51087c83 ceph.in: add help for locally-handled commands
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2017-02-06 20:55:30 -08:00
Gui Hecheng
9a43a1205f librbd: fix segfault on EOPNOTSUPP returned while fetching snapshot timestamp
Fixes: http://tracker.ceph.com/issues/18839

Signed-off-by: Gui Hecheng <guihecheng@cmss.chinamobile.com>
2017-02-07 11:34:54 +08:00
liuchang0812
e554422ba4 msg/async: remove useless close function
fix coverity cid 1395314: it's invalid to pass a negative value to close function, and we have closed socket in net.connect/nonblock_connect in error cases indeed

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-02-07 11:10:32 +08:00
Zack Cerza
00417f0ecb Merge pull request #13279 from smithfarm/wip-fix-regression
tests: fix regression in qa/tasks/ceph_master.py
2017-02-06 17:08:18 -07:00
Willem Jan Withagen
669bbb9f16 FreeBSD: changes to ceph-disk to get it working and passing tests
- It currently only supports running with filestore
 - Testing is executed while running on a ZFS partition
 - All disktypes and naming is different on FreeBSD
 - Partitioning and tools are not workable on FreeBSD
 - add diagnostic timeout

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-02-07 00:09:42 +01:00
Yehuda Sadeh
7f4818f961 rgw: don't update bucket index multiple times in overwrite
Instead of this for overwrites:
 prepare (index),
   write (head) [-EEXIST]
 cancel (index)
 read (head)
 prepare (index)
   write (head)
 complete (index)

We now do:
 prepare (index),
   write (head) [-EEXIST]
   read (head)
   write (head)
 complete (index)

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-02-06 13:14:21 -08:00
Yehuda Sadeh
6f27f60892 rgw: assume obj write is a first write
if fails and object already exists then retry. This improves first obj
write performance on the expense of overwrites.

Fixes: http://tracker.ceph.com/issues/18622

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-02-06 13:12:06 -08:00
Yehuda Sadeh
66a82b4266 rgw: configurable write obj window size
Fixes: http://tracker.ceph.com/issues/18623

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-02-06 13:08:00 -08:00
Sage Weil
baee1c4432 include/ceph_features: retire OSD_MIN_SIZE_RECOVERY, OSD_PROXY_FEATURES
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
f27a46400e include/ceph_features: retire OSD_REPOP, OSD_OBJECT_DIGEST, OSD_TRANSACTION_MAY_LAYOUT
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
43e1b64fc9 include/ceph_features: retire OSD_SET_ALLOC_HINT
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
92a6ba3e8f include/ceph_features: retire OSD_PACKED_RECOVERY
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
3bf654216c include/ceph_features: retire MON_SCRUB
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
ff19592828 include/ceph_features: remove ceph_sanitize_features workaround
Way back in 9ea02b8410 we defined the
SNAPMAPPER feature such that it set bits 32-63 by sign-extending a negative
int32_t to int64_t.  In 4255b5c2fb it was
fixed.  This affected v0.58-657-g9ea02b8 to v0.65-263-g4255b5c.

The workaround santized features whenever the top bit 63 was set to be the
intended set of features (bits 0-32).  Only buggy peers in that range
ever set bit 63.

Since these versions are truly ancient (pre-dumpling) and no clients
should be that old, we are dropping the workaround.  Note that the Linux
kernel client never had this bug: 2b3e0c905af43cfe402a2ef3f800be5dc1684005
went from 30 bits used to 38 bits defiend with the workaround in place.

We deprecate the bit now (i.e., stop paying attention to this bit).  After
another extended period of time we'll eventually be able to retire
and reuse it.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
d504a3b78d include/ceph_features: retire OSD_SNAPMAPPER
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
67cb2f5143 include/ceph_features: retire {BACKFILL,RECOVERY}_RESERVATION
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
c84d9c83ed include/ceph_feaetures: retire MON_NULLROUTE
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
12dfac4302 include/ceph_features: retire CHUNKY_SCRUB
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
6d91f707be mon/MonClient: use FEATUREMASK for testing for SERVER_KRAKEN on the server
The mon we are talking to may be an old ceph-mon with the prior meanging of
the SERVER_KRAKEN bit; use the mask to disambiguate instead of testing for
two featurse explicitly.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
a5feb24979 include/ceph_features: return INDEP_PG_MAP
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
d1e14c4dd3 include/ceph_features: retire QUERY_T
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
fcf94d5716 include/ceph_features: retire MONCLOCKCHECK
Deprecated in Jewel.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
d1d63f8957 msg/Connection: has_features()
Test for multiple features all being set together.  Note that this can be
used with the CEPH_FEATUREMASK_ defines to safely test for reused feature
bits.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
311476187e include/ceph_features: define HAVE_FEATURE helper
This lets you test a feature succintly by name, *AND* makes use of the
FEATUREMASK so that it can be used on bitmasks that may come from old
versions with prior usages of the bit.  This makes it usable for data
type encoding or with client-provided bits.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00