Commit Graph

52377 Commits

Author SHA1 Message Date
Sage Weil
df4e134334 msg/simple/DispatchQueue: inject internal delays in special event dispatch
E.g., connection reset.  This will help uncover subtle races.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-14 13:01:36 -04:00
Samuel Just
e657ecf8e4 Merge pull request #8600 from liewegas/wip-rados-lfn
ceph_test_rados: make long name ~300 chars, (not ~800)

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-04-14 09:16:33 -07:00
Sage Weil
d0df02dbd6 Merge pull request #8604 from gregsfortytwo/wip-fsmap-decode-fix
mds: FSmap decode fix

Reviewed-by: Sage Weil <sage@redhat.com>
Tested-by: Sage Weil <sage@redhat.com>
2016-04-14 12:03:36 -04:00
Josh Durgin
f079f0b3d3 Merge pull request #8565 from dillaman/wip-15471
librbd: fix handling of proxied maintenance operations during shut down

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-14 08:59:41 -07:00
Josh Durgin
9ecf3bc114 librbd: do not return a failure if a peer cannot be notified of updateReviewed-by: Josh Durgin <jdurgin@redhat.com>
librbd: do not return a failure if a peer cannot be notified of update

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-14 08:59:16 -07:00
Josh Durgin
6956da8c0c Merge pull request #8511 from dillaman/wip-15436
librbd: IO deadlock when dynamically enabling/disabling features

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-14 08:58:57 -07:00
Josh Durgin
f655b7e210 Merge pull request #8494 from dillaman/wip-15352
journal: possible race condition during live replay

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-14 08:58:15 -07:00
Roland Mechler
0b0d584626 Fixes for python omap method return values.
Signed-off-by: Roland Mechler <rmechler@cisco.com>
2016-04-14 15:27:49 +00:00
Greg Farnum
b358c61a8b FSMap: guard the ever_enabled_multiple decode
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-04-14 08:15:35 -07:00
Sage Weil
d26322d2c3 ceph_test_rados: make long name ~300 chars, (not ~800)
Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-14 09:42:39 -04:00
Javier M. Mellid
ecf4572aa2 rgw: aws4: handle UNSIGNED-PAYLOAD under header auth
Fixes: http://tracker.ceph.com/issues/15499

Signed-off-by: Javier M. Mellid <jmunhoz@igalia.com>
2016-04-14 15:32:27 +02:00
Sage Weil
ef0678a3bc Merge pull request #8594 from dachary/wip-releases
release-notes: v10.1.2 release notes
2016-04-14 08:38:56 -04:00
Sage Weil
ae2ffc14f0 cmake: pass RULE_LAUNCHER_* to cythonReviewed-by: Josh Durgin <jdurgin@redhat.com>
cmake: pass RULE_LAUNCHER_* to cython

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-14 08:37:33 -04:00
Jason Dillaman
769f99490e librbd: dynamically disabling exclusive lock might leave lingering request
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-14 08:14:46 -04:00
Orit Wasserman
ae604ded82 rgw: handle no current_preiod in is_syncing_bucket_meta
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-04-14 12:13:45 +02:00
Orit Wasserman
9e079b1838 Merge pull request #8534 from kmroz/wip-rgw-rados-cleanup-1
rgw-rados: return RGWSystemMetaObj init directly
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-04-14 09:46:54 +02:00
Loic Dachary
489d062dd4 release-notes: v10.1.2 release notes
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-14 08:19:47 +02:00
Loic Dachary
a4819a6725 release-notes: v10.1.2 release notes (draft)
cd src/script
virtualenv v
source v/bin/activate
pip install githubpy GitPython requests
GITHUB_ACCESS_TOKEN=xxxxxxx ./ceph-release-notes \
    -r tags/v10.1.1..tags/v10.1.2 $(git rev-parse --show-toplevel)

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-04-14 08:15:54 +02:00
Josh Durgin
9abd1815e5 Merge pull request #8381 from ceph/wip-cython-tarball-build
cmake/pybind: fix include paths for cephfs

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-04-13 18:59:21 -07:00
Josh Durgin
ba1b0867ff Merge pull request #8569 from jdurgin/wip-dev-package-doc
doc: reinstate accidentally removed section header

Reviewed-by: Abhishek Lekshmanan <alekshmanan@suse.com>
2016-04-13 17:08:15 -07:00
Josh Durgin
1f62ec1393 Merge pull request #8587 from emenguy/fix_dependencies_documentation
doc: fix dependencies

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-13 17:06:08 -07:00
Matt Benjamin
a353eaca61 rgw_file: fixup attrs across renames
Once Unix attributes were materialized as RGW object/bucket
attributes, it became possible to verify the serialized bucket and
object hashes with the expected values (based on the file-type
invariant path to the object).

Prior to this change, we saved the serialized hash values with the
rest of the Unix attrs, in RGW_ATTR_UNIX1.  Unfortunately, these
values were invalidated by rename operations.  To address this problem,
and to faciliate future operations on objects by their hashed ids,
the id hashes have been moved into their own RGW attr
RGW_ATTR_UNIX_KEY1.  This should allow more efficient search by, but
more importantly to the invalidation problem, allows us to use the
ATTRSMOD_MERGE behavior in RGWCopyObj to get copy offload while still
fixing up the object id.

The code at this commit doesn't use the serialized unix_mode value as
the outgoing st.st_mode result for rgw_getattr operations, pending a
bugfix for Ganesha's expected value range.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-04-13 19:46:25 -04:00
Josh Durgin
c05d7c9f92 Merge pull request #8584 from dillaman/wip-15479
test: image replayer needs dummy remote mirror peer uuid

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-13 16:20:20 -07:00
Yehuda Sadeh
bf299dce47 rgw: try to use current period id in a few more cases
If missing period id, try to use the current period id. This is needed
for sync agent compatibility.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-04-13 16:05:09 -07:00
Sage Weil
9bb4766f15 Merge pull request #8188 from ceph/wip-systemd-restart-defaults
systemd: Use the same restart limits as upstart

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-04-13 16:50:46 -04:00
Sage Weil
c04fd4210f osd: fix watch reconnect race
It's possible to process a watch reconnect op, setting Watch::conn, before
the ms_handle_reset path tries to disconnect the old one.  Since reset()
was blindly disconnecting the "current" connection, we could race and
disconnect the new con instead of the old one.

Fix this by specifying which con to disconnect.

Fixes: http://tracker.ceph.com/issues/15441
Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-13 15:32:40 -04:00
Sage Weil
8166042a28 osd/Watch: slightly more informative debug output
Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-13 15:32:39 -04:00
Etienne Menguy
0f8585c36c doc: fix dependencies
Signed-off-by: Etienne Menguy <etienne.menguy@corp.ovh.com>
2016-04-13 19:31:16 +00:00
Boris Ranto
62084375fa systemd: Use the same restart limits as upstart
Currently, the systemd daemons are not restarted on failure. This patch
adds this functionality and sets the defaults to those defined in
upstart. This resolves to 3 fails per 30 minutes for osd, mon and mds
and 5 fails per 30 seconds for radosgw.

Signed-off-by: Boris Ranto <branto@redhat.com>
2016-04-13 21:26:31 +02:00
Casey Bodley
a201365aaa rgw: call rgw_log_usage_finalize() on reconfiguration
RGWRealmReloader was calling rgw_log_usage_init() with the new RGWRados
instance, but never cleaned up the previous one with
rgw_log_usage_finalize()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-04-13 13:30:18 -04:00
Jason Dillaman
4b1d1698ba test: image replayer needs dummy remote mirror peer uuid
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-13 12:35:32 -04:00
Sage Weil
4943a55528 Merge pull request #8498 from liewegas/wip-bluestore
os/bluestore: fix shortened bluefs paths in env mirror case
2016-04-13 11:26:44 -04:00
Casey Bodley
5230967dad rgw: RGWPeriod::reflect() sets master zonegroup as default
if RGWPeriod::reflect() is called right after a 'realm pull', it will
create the zonegroup objects but not set any as default.  so the next
time RGWRados is initialized, create_defaults() will add a new 'default'
zonegroup and set it as the master.  this causes a 'period update' to
find multiple master zonegroups and fail with EINVAL

reflect() now calls set_as_default(exclusive=true) on the master
zonegroup to guarantee that a default is set

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-04-13 10:44:17 -04:00
Jason Dillaman
877d44bcd0 journal: race possible when re-watching a journal object
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-13 10:34:24 -04:00
Matt Benjamin
b6297a704b rgw_file: fix silly abuse of flags in fh_lookup
Initially lookup_fh used its cflags argument just to proxy create
flags to new objects.  It's used for call path state now too, so
disambiguate it, and of course, fh->flags can't be consulted for
a call path state.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-04-13 10:14:41 -04:00
Sage Weil
6651e51408 os/bluestore: fix shortened bluefs paths in env mirror case
If we are mirroring the rocksdb env, don't shorten the
paths.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-13 09:29:16 -04:00
Matt Benjamin
fb924f2382 rgw_file: don't need to memset Latch
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-04-13 09:21:47 -04:00
Matt Benjamin
842828a32e cohort_lru: define ctor for TreeX::Latch
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-04-13 09:19:40 -04:00
Sage Weil
6abc5d761a Merge pull request #8556 from liewegas/wip-ext4
doc: recommend against ext4

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.cz>
2016-04-13 09:19:19 -04:00
Kefu Chai
05968dbb61 Merge pull request #8574 from tchaikov/wip-readable-test-fix
test/encoding/readable: use [ for "test" not ((

Reviewed-by: Erwan Velu <erwan@redhat.com>
2016-04-13 20:32:50 +08:00
Orit Wasserman
1caef9807d Merge pull request #8567 from cbodley/wip-rgw-period-pull-url
radosgw-admin: allow 'period pull --url' without full multisite config
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-04-13 13:30:05 +02:00
Kefu Chai
8d346acb4f test/encoding/readable: use [ for "test" not ((
and use '&&' instead, easier to understand.

this also fixes following error in the ubuntu gitbuilder

error: Added files:
+ cat .git/added-files
src/0

where sh points to dash.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-04-13 16:21:09 +08:00
xie xingguo
f30db90465 osd: clear requeue_scrub_on_unblock flag after requeue scrub
We'd better clear requeue_scrub_on_unblock flag after successfully
requeuing scrub, this is for:
  1. if a newly initiated scrub is blocked by objectcontext again,
     reset requeue_scrub_on_unblock to true will be satisfied enough
     to meet such an appeal.
  2. so we don't push pg to the scrub queue when we don't want to
     by accident.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-04-13 11:12:57 +08:00
Jason Dillaman
760863f47e journal: potential for double-free of context on shut down
The context associated with a scheduled watch might be freed
by two ObjectPlayers.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-12 22:29:50 -04:00
Matt Benjamin
5b608ed661 rgw_file: fix 2 attr decoding issues
* fix general timestamp decoding (changing to a pointer notation)
* capture (std::swap) req_state->bucket_attrs in RGWLibStatBucketRequest

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-04-12 21:31:46 -04:00
Jason Dillaman
11a9722b45 journal: possible race condition during live replay
When two objects are being actively watched, it was possible for
the watch context to complete before the second watch was
associated.

Fixes: http://tracker.ceph.com/issues/15352
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-12 21:29:12 -04:00
Josh Durgin
aece82440b doc: reinstate accidentally removed section header
Accidentally removed in 63be401a41

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2016-04-12 18:07:41 -07:00
Casey Bodley
942504d22d radosgw-admin: 'realm pull' only accepts --url
'realm pull' is defined as a 'raw storage op', so cannot use the
--remote argument to refer to endpoints from the period or local
zonegroup

refactored send_to_url() slightly to make it easier to call directly

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-04-12 17:14:50 -04:00
Casey Bodley
70ff086a50 radosgw-admin: allow 'period pull --url' without full multisite config
to support 'period pull --remote', radosgw-admin needs a complete
multisite configuration to look up remote endpoints by name

however, 'period pull' will also accept a --url argument, which doesn't
require a working configuration. this patch splits the handling of these
two cases, so that 'period pull --url' can succeed when run on a cluster
that hasn't yet been fully configured

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-04-12 17:14:50 -04:00
Sage Weil
18a5fddb90 Merge pull request #8520 from yuyuyu101/wip-15440
msg/async: AsyncConnection: avoid is_connected require connection's lock
2016-04-12 16:23:57 -04:00