Commit Graph

68422 Commits

Author SHA1 Message Date
Matt Benjamin
084ebfcd1b Merge pull request #13035 from yehudasa/wip-18621
rgw: change default chunk size to 4MB
2017-02-07 08:50:49 -05:00
John Spray
9c151d0e5f Merge pull request #13259 from jcsp/wip-jcsp-relnotes
PendingReleaseNotes: note the fuse fstab format change

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-07 12:06:51 +00:00
Dan Mick
ff51087c83 ceph.in: add help for locally-handled commands
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2017-02-06 20:55:30 -08:00
Gui Hecheng
9a43a1205f librbd: fix segfault on EOPNOTSUPP returned while fetching snapshot timestamp
Fixes: http://tracker.ceph.com/issues/18839

Signed-off-by: Gui Hecheng <guihecheng@cmss.chinamobile.com>
2017-02-07 11:34:54 +08:00
liuchang0812
e554422ba4 msg/async: remove useless close function
fix coverity cid 1395314: it's invalid to pass a negative value to close function, and we have closed socket in net.connect/nonblock_connect in error cases indeed

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-02-07 11:10:32 +08:00
Zack Cerza
00417f0ecb Merge pull request #13279 from smithfarm/wip-fix-regression
tests: fix regression in qa/tasks/ceph_master.py
2017-02-06 17:08:18 -07:00
Willem Jan Withagen
669bbb9f16 FreeBSD: changes to ceph-disk to get it working and passing tests
- It currently only supports running with filestore
 - Testing is executed while running on a ZFS partition
 - All disktypes and naming is different on FreeBSD
 - Partitioning and tools are not workable on FreeBSD
 - add diagnostic timeout

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-02-07 00:09:42 +01:00
Yehuda Sadeh
7f4818f961 rgw: don't update bucket index multiple times in overwrite
Instead of this for overwrites:
 prepare (index),
   write (head) [-EEXIST]
 cancel (index)
 read (head)
 prepare (index)
   write (head)
 complete (index)

We now do:
 prepare (index),
   write (head) [-EEXIST]
   read (head)
   write (head)
 complete (index)

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-02-06 13:14:21 -08:00
Yehuda Sadeh
6f27f60892 rgw: assume obj write is a first write
if fails and object already exists then retry. This improves first obj
write performance on the expense of overwrites.

Fixes: http://tracker.ceph.com/issues/18622

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-02-06 13:12:06 -08:00
Yehuda Sadeh
66a82b4266 rgw: configurable write obj window size
Fixes: http://tracker.ceph.com/issues/18623

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-02-06 13:08:00 -08:00
Sage Weil
baee1c4432 include/ceph_features: retire OSD_MIN_SIZE_RECOVERY, OSD_PROXY_FEATURES
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
f27a46400e include/ceph_features: retire OSD_REPOP, OSD_OBJECT_DIGEST, OSD_TRANSACTION_MAY_LAYOUT
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
43e1b64fc9 include/ceph_features: retire OSD_SET_ALLOC_HINT
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
92a6ba3e8f include/ceph_features: retire OSD_PACKED_RECOVERY
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
3bf654216c include/ceph_features: retire MON_SCRUB
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
ff19592828 include/ceph_features: remove ceph_sanitize_features workaround
Way back in 9ea02b8410 we defined the
SNAPMAPPER feature such that it set bits 32-63 by sign-extending a negative
int32_t to int64_t.  In 4255b5c2fb it was
fixed.  This affected v0.58-657-g9ea02b8 to v0.65-263-g4255b5c.

The workaround santized features whenever the top bit 63 was set to be the
intended set of features (bits 0-32).  Only buggy peers in that range
ever set bit 63.

Since these versions are truly ancient (pre-dumpling) and no clients
should be that old, we are dropping the workaround.  Note that the Linux
kernel client never had this bug: 2b3e0c905af43cfe402a2ef3f800be5dc1684005
went from 30 bits used to 38 bits defiend with the workaround in place.

We deprecate the bit now (i.e., stop paying attention to this bit).  After
another extended period of time we'll eventually be able to retire
and reuse it.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
d504a3b78d include/ceph_features: retire OSD_SNAPMAPPER
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
67cb2f5143 include/ceph_features: retire {BACKFILL,RECOVERY}_RESERVATION
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
c84d9c83ed include/ceph_feaetures: retire MON_NULLROUTE
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
12dfac4302 include/ceph_features: retire CHUNKY_SCRUB
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
6d91f707be mon/MonClient: use FEATUREMASK for testing for SERVER_KRAKEN on the server
The mon we are talking to may be an old ceph-mon with the prior meanging of
the SERVER_KRAKEN bit; use the mask to disambiguate instead of testing for
two featurse explicitly.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
a5feb24979 include/ceph_features: return INDEP_PG_MAP
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
d1e14c4dd3 include/ceph_features: retire QUERY_T
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
fcf94d5716 include/ceph_features: retire MONCLOCKCHECK
Deprecated in Jewel.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
d1d63f8957 msg/Connection: has_features()
Test for multiple features all being set together.  Note that this can be
used with the CEPH_FEATUREMASK_ defines to safely test for reused feature
bits.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
311476187e include/ceph_features: define HAVE_FEATURE helper
This lets you test a feature succintly by name, *AND* makes use of the
FEATUREMASK so that it can be used on bitmasks that may come from old
versions with prior usages of the bit.  This makes it usable for data
type encoding or with client-provided bits.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
40c944e0fd include/ceph_features: new macros, and document deprecation process
This was super confusing before.  Hopefully it is better now!

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
526e44a552 include/ceph_features: add SERVER_M feature placeholder
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Sage Weil
ce744f50ab include/ceph_features: CEPH_FEATURE_RESEND_ON_SPLIT
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 15:43:50 -05:00
Nathan Cutler
db2582e25e tests: fix regression in qa/tasks/ceph_master.py
https://github.com/ceph/ceph/pull/13194 introduced a regression:

2017-02-06T16:14:23.162 INFO:tasks.thrashosds.thrasher:Traceback (most recent call last):
  File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/ceph_manager.py", line 722, in wrapper
    return func(self)
  File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/ceph_manager.py", line 839, in do_thrash
    self.choose_action()()
  File "/home/teuthworker/src/github.com_ceph_ceph_master/qa/tasks/ceph_manager.py", line 305, in kill_osd
    output = proc.stderr.getvalue()
AttributeError: 'NoneType' object has no attribute 'getvalue'

This is because the original patch failed to pass "stderr=StringIO()" to run().

Fixes: http://tracker.ceph.com/issues/16263
Signed-off-by: Nathan Cutler <ncutler@suse.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-02-06 19:37:38 +01:00
Loic Dachary
fc2df15c01 Merge pull request #12979 from theanalyst/scripts/release-notes-tracker
script: ceph-release-notes check orig. issue only for backports

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-02-06 18:03:55 +01:00
Nathan Cutler
0fba639472 Merge pull request #13277 from jan--f/janf-teuth-cloud-doc
doc: minor change to a cloud testing paragraph

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2017-02-06 18:00:26 +01:00
Sage Weil
088f013961 Merge pull request #13275 from idryomov/wip-require-osd-features-fix
osd/OSDMap: require OSD features only of OSDs

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-06 10:44:39 -06:00
Jan Fajerski
cc97e9d090 doc: minor change to a cloud testing paragraph
Use terminate for the instances to match the terminology used by the
horizon interface.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2017-02-06 16:48:54 +01:00
Sage Weil
d67116bbc6 Merge pull request #13256 from dongbula/correct-cached_crc-comment
osd: correct comment of perfcounter cached_crc in code

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-06 09:15:43 -06:00
Casey Bodley
0f1e08cc4f Merge pull request #13220 from rzarzynski/wip-rgw-18364-2
rgw: be aware abount tenants on cls_user_bucket -> rgw_bucket conversion

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-02-06 09:56:03 -05:00
Sage Weil
9a41a0b728 mon/PGMonitor: fix force_create_pg
We weren't carefully registering the creating PG.  In
particular, the current osd mappings (acting, up, etc.)
weren't getting filled in, which meant the PG wasn't
(necessarily) mapped to an OSD until the OSDMap updated
and we recalculated mappings.

Fix by sending us through the common code path so that
all fields get updated properly.

Fixes: http://tracker.ceph.com/issues/18298
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 09:32:52 -05:00
Sage Weil
15f17bcca0 mon/MonCommands: remove send_pg_creates from cmd table
Forgot this in 6cbdd6750c

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 09:32:52 -05:00
Sage Weil
b79a85e80a mon/PGMonitor: clean up some send_pg_creates cruft
ff1fd4b4b6 already removed most of
this; remove the now useless stub and clean up the unneede con
check.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-06 09:32:52 -05:00
John Spray
f1c3eeda38 Merge pull request #12993 from jcsp/wip-cephfs-doc-authcaps
doc: clarify the path restriction mds cap example

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-02-06 12:59:22 +00:00
Radoslaw Zarzynski
7511564b88 Merge pull request #13242 from Jing-Scott/dev/fix-swift-anon-getobj-error-code
rgw: swift: fix anonymous user's error code of getting object

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-02-06 13:42:00 +01:00
Ilya Dryomov
ab558bbf29 osd/OSDMap: require OSD features only of OSDs
Fix up commit 1a5cc32f0a ("osd/OSDMap: reflect REQUIRE_*_OSDS flag in
required features") -- require_*_osds shouldn't affect older clients.

Fixes: http://tracker.ceph.com/issues/18831
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-02-06 13:35:51 +01:00
Haomai Wang
17bec5ff02 Merge pull request #13271 from Liuchang0812/fix-file-description-leak
msg/async: fix file description leak in NetHandler

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-02-06 20:16:19 +08:00
liuchang0812
ee1e7c255f msg/async: fix file description leak in NetHandler
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-02-06 19:09:23 +08:00
Jing Wenjun
318de28e10 rgw: swift: fix anonymous user's error code of getting object
The openstack swift will return 401 rather than 403 when
the anon user has no permission to get objects.

Fixes: http://tracker.ceph.com/issues/18806
Signed-off-by: Jing Wenjun <jingwenjun@cmss.chinamobile.com>
2017-02-06 18:50:34 +08:00
Kefu Chai
d832c0ed56 ceph: do not throw TypeError on connection failure
otherwise we could concat None with a string on connection problem.
which will result in TypeError. and the caller will print misleading
error like

Error connecting to cluster: TypeError

see also #12934

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-02-06 16:30:36 +08:00
Sage Weil
5fc3dd36e2 Merge pull request #13237 from smithfarm/wip-18799
tests: Thrasher: eliminate a race between kill_osd and __init__

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-05 12:49:30 -06:00
Kefu Chai
506df1f783 librados: do not expose non-public symbols
librados could be referencing the wrong symbol when calling the
destructor. for example, a variable of type AioGetxattrsData in
IoCtxImpl.cc) could be destructed using the destructor defined in
librados.cc. this is reproduciable using

ceph_test_rados_api_aio --gtest_filter=LibRadosAio.XattrIter

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-02-05 23:33:53 +08:00
Haomai Wang
621e445bbf Merge pull request #13263 from Adirl/fix_log_spaces
msg/async/rdma: fix log line spacing

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-02-05 20:40:58 +08:00
John Spray
1d9668cd0e PendingReleaseNotes: note the fuse fstab format change
Signed-off-by: John Spray <john.spray@redhat.com>
2017-02-04 20:19:44 +00:00