Commit Graph

52392 Commits

Author SHA1 Message Date
Josh Durgin
95ee97a7b9 Merge pull request #8606 from dillaman/wip-15457
rbd: loosen image spec validation requirements

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-14 16:46:27 -07:00
Josh Durgin
cbc3218a4a Merge pull request #8603 from rmechler/wip-15362
pybind/rados: fix omap method return values

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-04-14 15:41:14 -07:00
Jason Dillaman
9634214ce1 release-notes: document rbd cli name validation override
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-14 17:59:27 -04:00
Jason Dillaman
08c8cee2db rbd: fail if cannot extract spec from legacy "--image" optional
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-14 17:59:26 -04:00
Jason Dillaman
08fcc72f00 rbd: optionally disable spec validation when creating images/snapshots
Setting the "rbd-validate-names" config propery to false will disable
spec validation.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-14 17:59:26 -04:00
Jason Dillaman
e57d7c110e rbd: add support for relaxed image spec validation
Operations which create images or snapshots still fully enforce
the spec validation.  All other operations use a relaxed validation
format.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-14 17:59:26 -04:00
Jason Dillaman
6579c7da48 common: new rbd image spec validation option
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-14 17:59:26 -04:00
Vu Pham
aa30423d13 xio: alloc all portals and use for all connections
Allocate all xio_portal_threads and assign/spread both passive and
active connections to different portals of heavy messengers.

Signed-off-by: Vu Pham <vu@mellanox.com>
2016-04-14 14:27:15 -07:00
Vu Pham
f729177d6d xio: identify heavy messengers and properly allocate resources
Identify heavy messengers (osd client and cluster) and properly
allocate resources ie. number of portals/contexts, max number of
connection per portal/context; otherwise, configure with moderate
defaults for those messengers

Signed-off-by: Vu Pham <vu@mellanox.com>
2016-04-14 14:27:11 -07:00
Roland Mechler
18ea756b91 Removed parentheses for if statement.
Signed-off-by: Roland Mechler <rmechler@cisco.com>
2016-04-14 20:38:53 +00:00
Orit Wasserman
b1adcf8539 Merge pull request #8588 from yehudasa/wip-rgw-period-id
rgw: try to use current period id in a few more cases
2016-04-14 21:06:13 +02:00
Orit Wasserman
6e2667aec1 Merge pull request #8566 from cbodley/wip-rgw-period-reflect
rgw: RGWPeriod::reflect() sets master zonegroup as default
Reviewed-by: Orit Wasserman<owasserm@redhat.com>
2016-04-14 21:05:36 +02:00
Greg Farnum
d1ed6ebb3c update release-notes manually
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-04-14 11:29:13 -07:00
Yehuda Sadeh
d43704f6d2 Merge pull request #8585 from cbodley/wip-rgw-reload-usage
rgw: call rgw_log_usage_finalize() on reconfiguration

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-04-14 11:17:11 -07:00
Sage Weil
df4e134334 msg/simple/DispatchQueue: inject internal delays in special event dispatch
E.g., connection reset.  This will help uncover subtle races.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-14 13:01:36 -04:00
Samuel Just
e657ecf8e4 Merge pull request #8600 from liewegas/wip-rados-lfn
ceph_test_rados: make long name ~300 chars, (not ~800)

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-04-14 09:16:33 -07:00
Sage Weil
d0df02dbd6 Merge pull request #8604 from gregsfortytwo/wip-fsmap-decode-fix
mds: FSmap decode fix

Reviewed-by: Sage Weil <sage@redhat.com>
Tested-by: Sage Weil <sage@redhat.com>
2016-04-14 12:03:36 -04:00
Josh Durgin
f079f0b3d3 Merge pull request #8565 from dillaman/wip-15471
librbd: fix handling of proxied maintenance operations during shut down

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-14 08:59:41 -07:00
Josh Durgin
9ecf3bc114 librbd: do not return a failure if a peer cannot be notified of updateReviewed-by: Josh Durgin <jdurgin@redhat.com>
librbd: do not return a failure if a peer cannot be notified of update

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-14 08:59:16 -07:00
Josh Durgin
6956da8c0c Merge pull request #8511 from dillaman/wip-15436
librbd: IO deadlock when dynamically enabling/disabling features

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-14 08:58:57 -07:00
Josh Durgin
f655b7e210 Merge pull request #8494 from dillaman/wip-15352
journal: possible race condition during live replay

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-14 08:58:15 -07:00
Roland Mechler
0b0d584626 Fixes for python omap method return values.
Signed-off-by: Roland Mechler <rmechler@cisco.com>
2016-04-14 15:27:49 +00:00
Greg Farnum
b358c61a8b FSMap: guard the ever_enabled_multiple decode
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-04-14 08:15:35 -07:00
Sage Weil
d26322d2c3 ceph_test_rados: make long name ~300 chars, (not ~800)
Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-14 09:42:39 -04:00
Javier M. Mellid
ecf4572aa2 rgw: aws4: handle UNSIGNED-PAYLOAD under header auth
Fixes: http://tracker.ceph.com/issues/15499

Signed-off-by: Javier M. Mellid <jmunhoz@igalia.com>
2016-04-14 15:32:27 +02:00
Sage Weil
ef0678a3bc Merge pull request #8594 from dachary/wip-releases
release-notes: v10.1.2 release notes
2016-04-14 08:38:56 -04:00
Sage Weil
ae2ffc14f0 cmake: pass RULE_LAUNCHER_* to cythonReviewed-by: Josh Durgin <jdurgin@redhat.com>
cmake: pass RULE_LAUNCHER_* to cython

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-14 08:37:33 -04:00
Jason Dillaman
769f99490e librbd: dynamically disabling exclusive lock might leave lingering request
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-14 08:14:46 -04:00
Orit Wasserman
ae604ded82 rgw: handle no current_preiod in is_syncing_bucket_meta
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-14 12:13:45 +02:00
Orit Wasserman
9e079b1838 Merge pull request #8534 from kmroz/wip-rgw-rados-cleanup-1
rgw-rados: return RGWSystemMetaObj init directly
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-04-14 09:46:54 +02:00
Loic Dachary
489d062dd4 release-notes: v10.1.2 release notes
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-14 08:19:47 +02:00
Loic Dachary
a4819a6725 release-notes: v10.1.2 release notes (draft)
cd src/script
virtualenv v
source v/bin/activate
pip install githubpy GitPython requests
GITHUB_ACCESS_TOKEN=xxxxxxx ./ceph-release-notes \
    -r tags/v10.1.1..tags/v10.1.2 $(git rev-parse --show-toplevel)

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-14 08:15:54 +02:00
Josh Durgin
9abd1815e5 Merge pull request #8381 from ceph/wip-cython-tarball-build
cmake/pybind: fix include paths for cephfs

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-04-13 18:59:21 -07:00
Josh Durgin
ba1b0867ff Merge pull request #8569 from jdurgin/wip-dev-package-doc
doc: reinstate accidentally removed section header

Reviewed-by: Abhishek Lekshmanan <alekshmanan@suse.com>
2016-04-13 17:08:15 -07:00
Josh Durgin
1f62ec1393 Merge pull request #8587 from emenguy/fix_dependencies_documentation
doc: fix dependencies

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-13 17:06:08 -07:00
Matt Benjamin
a353eaca61 rgw_file: fixup attrs across renames
Once Unix attributes were materialized as RGW object/bucket
attributes, it became possible to verify the serialized bucket and
object hashes with the expected values (based on the file-type
invariant path to the object).

Prior to this change, we saved the serialized hash values with the
rest of the Unix attrs, in RGW_ATTR_UNIX1.  Unfortunately, these
values were invalidated by rename operations.  To address this problem,
and to faciliate future operations on objects by their hashed ids,
the id hashes have been moved into their own RGW attr
RGW_ATTR_UNIX_KEY1.  This should allow more efficient search by, but
more importantly to the invalidation problem, allows us to use the
ATTRSMOD_MERGE behavior in RGWCopyObj to get copy offload while still
fixing up the object id.

The code at this commit doesn't use the serialized unix_mode value as
the outgoing st.st_mode result for rgw_getattr operations, pending a
bugfix for Ganesha's expected value range.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-04-13 19:46:25 -04:00
Josh Durgin
c05d7c9f92 Merge pull request #8584 from dillaman/wip-15479
test: image replayer needs dummy remote mirror peer uuid

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-13 16:20:20 -07:00
Yehuda Sadeh
bf299dce47 rgw: try to use current period id in a few more cases
If missing period id, try to use the current period id. This is needed
for sync agent compatibility.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-04-13 16:05:09 -07:00
Sage Weil
9bb4766f15 Merge pull request #8188 from ceph/wip-systemd-restart-defaults
systemd: Use the same restart limits as upstart

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-04-13 16:50:46 -04:00
Sage Weil
c04fd4210f osd: fix watch reconnect race
It's possible to process a watch reconnect op, setting Watch::conn, before
the ms_handle_reset path tries to disconnect the old one.  Since reset()
was blindly disconnecting the "current" connection, we could race and
disconnect the new con instead of the old one.

Fix this by specifying which con to disconnect.

Fixes: http://tracker.ceph.com/issues/15441
Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-13 15:32:40 -04:00
Sage Weil
8166042a28 osd/Watch: slightly more informative debug output
Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-13 15:32:39 -04:00
Etienne Menguy
0f8585c36c doc: fix dependencies
Signed-off-by: Etienne Menguy <etienne.menguy@corp.ovh.com>
2016-04-13 19:31:16 +00:00
Boris Ranto
62084375fa systemd: Use the same restart limits as upstart
Currently, the systemd daemons are not restarted on failure. This patch
adds this functionality and sets the defaults to those defined in
upstart. This resolves to 3 fails per 30 minutes for osd, mon and mds
and 5 fails per 30 seconds for radosgw.

Signed-off-by: Boris Ranto <branto@redhat.com>
2016-04-13 21:26:31 +02:00
Casey Bodley
a201365aaa rgw: call rgw_log_usage_finalize() on reconfiguration
RGWRealmReloader was calling rgw_log_usage_init() with the new RGWRados
instance, but never cleaned up the previous one with
rgw_log_usage_finalize()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-04-13 13:30:18 -04:00
Jason Dillaman
4b1d1698ba test: image replayer needs dummy remote mirror peer uuid
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-13 12:35:32 -04:00
Sage Weil
4943a55528 Merge pull request #8498 from liewegas/wip-bluestore
os/bluestore: fix shortened bluefs paths in env mirror case
2016-04-13 11:26:44 -04:00
Casey Bodley
5230967dad rgw: RGWPeriod::reflect() sets master zonegroup as default
if RGWPeriod::reflect() is called right after a 'realm pull', it will
create the zonegroup objects but not set any as default.  so the next
time RGWRados is initialized, create_defaults() will add a new 'default'
zonegroup and set it as the master.  this causes a 'period update' to
find multiple master zonegroups and fail with EINVAL

reflect() now calls set_as_default(exclusive=true) on the master
zonegroup to guarantee that a default is set

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-04-13 10:44:17 -04:00
Jason Dillaman
877d44bcd0 journal: race possible when re-watching a journal object
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-13 10:34:24 -04:00
Matt Benjamin
b6297a704b rgw_file: fix silly abuse of flags in fh_lookup
Initially lookup_fh used its cflags argument just to proxy create
flags to new objects.  It's used for call path state now too, so
disambiguate it, and of course, fh->flags can't be consulted for
a call path state.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-04-13 10:14:41 -04:00
Sage Weil
6651e51408 os/bluestore: fix shortened bluefs paths in env mirror case
If we are mirroring the rocksdb env, don't shorten the
paths.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-13 09:29:16 -04:00