Commit Graph

51994 Commits

Author SHA1 Message Date
Josh Durgin
f00ea3f898 Merge pull request #8490 from dillaman/wip-15097
rbd: journal reset should disable/re-enable journaling feature

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-07 14:11:10 -07:00
Josh Durgin
43ac60a14c Merge pull request #8477 from dillaman/wip-15364
journal: fix race condition between Future and journal shutdown

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-07 14:07:51 -07:00
Jason Dillaman
88e244c839 rbd: journal reset should disable/re-enable journaling feature
Fixes: http://tracker.ceph.com/issues/15097
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-07 15:39:06 -04:00
Samuel Just
b69830fd24 mon: warn if 'sortbitwise' flag is not set and no legacy OSDs are presentReviewed-by: Samuel Just <sjust@redhat.com>
mon: warn if 'sortbitwise' flag is not set and no legacy OSDs are present

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-04-07 11:05:47 -07:00
Josh Durgin
9835166b41 Merge pull request #8476 from dillaman/wip-rbd-mirror-lockdep
rbd-mirror: workaround for intermingled lockdep singletons

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-07 10:14:13 -07:00
Sage Weil
4d36da6dcd Merge pull request #8456 from dreamhost/wip-authtool-help
authtool: update --help and manpage to match code.

Reviewed-by: Sage Weil <sage@redhat.com>
2016-04-07 11:44:30 -04:00
Sage Weil
66b7ae6610 Merge pull request #8446 from liewegas/wip-15366
osd: fix/clean up full map request handling

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-04-07 11:36:34 -04:00
Orit Wasserman
999e917e5e Merge pull request #8472 from jmunhoz/fix-aws4-subdomain-calling
rgw: aws4 subdomain calling bugfix
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-04-07 16:59:09 +02:00
Jason Dillaman
017d830848 rbd-mirror: workaround for intermingled lockdep singletons
If librados constructs the CephContext, lockdep will be initialized
in both the librados shared address space and also within the app
address space.  This breaks lockdep's functionality and results in
a crash upon shutdown.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-07 10:36:30 -04:00
Matt Benjamin
340fe95b56 Merge pull request #8460 from linuxbox2/jewel-nfs-fixes-3
Jewel nfs fixes 3
2016-04-07 10:26:11 -04:00
Jason Dillaman
60679fc53a librbd: restore out-of-band future callbacks to avoid lock cycles
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-07 10:25:24 -04:00
Javier M. Mellid
2f4bc8401d rgw: aws4 subdomain calling bugfix
Fixes: http://tracker.ceph.com/issues/15369

Signed-off-by: Javier M. Mellid <jmunhoz@igalia.com>
2016-04-07 12:39:34 +02:00
Loic Dachary
c2fd18c00d Merge pull request #8457 from dreamhost/wip-virtualenv-tmpdir
build: Respect TMPDIR for virtualenv.

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-04-07 07:24:45 +02:00
Robin H. Johnson
f01261f371 authtool: fix test output validation & minor whitespace.
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-06 21:31:44 +00:00
Jason Dillaman
408964eb09 journal: fix context memory leak when shutting down live replay
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-06 17:20:30 -04:00
Jason Dillaman
f931066cf5 journal: Future does not require metadata shared pointer
Avoid keeping the metadata object alive through the lifespan of the
future.  Callers can expect to receive a re-entrant callback if the
future is already safe and flush/wait is invoked.

Fixes: http://tracker.ceph.com/issues/15364
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-04-06 17:18:33 -04:00
Sage Weil
d3dbd8581b mon: warn if 'sortbitwise' flag is not set and no legacy OSDs are present
If the user has upgraded, they should set sortbitwise.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-06 17:03:53 -04:00
Sage Weil
297f5f2ce7 Merge pull request #8418 from liewegas/wip-blk-probe
os/ObjectStore: make device uuid probe output something friendly
2016-04-06 16:57:11 -04:00
Sage Weil
82e9f94523 Merge pull request #8428 from liewegas/wip-rest-mds
ceph-rest-api: fix fs/flag/set
2016-04-06 16:10:53 -04:00
Sage Weil
ed31ad64a4 Merge pull request #7981 from liewegas/wip-14364
osdc/Objecter: fix narrow race with tid assignment

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-04-06 15:52:10 -04:00
Sage Weil
b3d27f8ca7 Merge pull request #8403 from dx9/wip-ceph-dencoder-esessions-fix
mds: Add cmapv to ESessions default constructor initializer list

Reviewed-by: Sage Weil <sage@redhat.com>
2016-04-06 15:51:40 -04:00
Sage Weil
683a46cd5a Merge pull request #8419 from adamemerson/wip-32bit-time
common: fix time_t cast in decode

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2016-04-06 15:49:22 -04:00
Sage Weil
78d4fada4b Merge pull request #8431 from liewegas/wip-bluestore
os/bluestore: revamp BlueFS bdev management and add perfcounters
2016-04-06 15:48:45 -04:00
Orit Wasserman
f64a9e3b42 Merge pull request #8445 from jmunhoz/fix-aws4-uri-encoding
rgw: aws4 uri encoding bugfix
Review-by: Orit Wasserman <owasserm@redhat.com>
2016-04-06 20:37:58 +02:00
Sage Weil
7b1ed5dd14 Merge pull request #8450 from javacruft/tasksmax-infinity
systemd: drop any systemd imposed process/thread limits

Reviewed-by: Sage Weil <sage@redhat.com>
2016-04-06 09:36:15 -04:00
Sage Weil
9414befb89 debian/rules: include ceph-mds-*.conf upstart files in ceph-mds
These were lost by a typo in 0cbe3dea69

Fixes: http://tracker.ceph.com/issues/15395
Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-06 08:55:49 -04:00
Jason Dillaman
7c70281e00 Merge pull request #8459 from jdurgin/wip-rbd-op-threads
librbd: disallow unsafe rbd_op_threads values

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-04-06 07:46:53 -04:00
John Spray
1238bd8a27 Merge pull request #8455 from liewegas/wip-legacy-layout-zero
mds: fix file_layout_t legacy encoding snafu

Reviewed-by: John Spray <john.spray@redhat.com>
2016-04-06 11:41:24 +01:00
Sage Weil
25d80078e2 os/bluestore: use short, relative paths with bluefs
If we're using bluefs, only pass in the short relative
path (db, db.wal, db.slow).  The leading components
are ignored and only lead to errors if the configuration
provides relative paths that do not match (e.g., if one
if using ceph-objectstore-tool).

Fixes: http://tracker.ceph.com/issues/15376
Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-05 21:26:06 -04:00
Josh Durgin
6c0ab75bce librbd: disallow unsafe rbd_op_threads values
Don't use this config option in librbd until
http://tracker.ceph.com/issues/15034 is avoided.

The option itself is still useful for mirroring threads, where
ordering is unimportant.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2016-04-05 15:32:42 -07:00
Matt Benjamin
bb4c2cacb2 librgw/rgw_file: correctly handle object permissions
Implement the full object permission model for librgw (aka, NFS
and similar) operations.

Fixes DIRS1 unit tests.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-04-05 18:30:32 -04:00
Matt Benjamin
6851822afe rgw_file: print DIRS1 read parameters at verbose
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-04-05 18:30:26 -04:00
Matt Benjamin
d84f55f3fe rgw_file: fix attributes for "special" test cases
If a caller does an atomic create using rgw_lookup() and
RGW_LOOKUP_FLAG_CREATE, it needs to fix up the attributes using
create_stat().

For use outside of test cases, it probably needs an interlock also,
but for now, do just enough to satisfy existing attribute checks.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-04-05 18:30:20 -04:00
Matt Benjamin
1bd1ffda8d rgw_file unit tests: validate Unix owners in DIRS1
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-04-05 18:30:14 -04:00
Robin H. Johnson
8e2c804a3a authtool: update --help and manpage to match code.
Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-05 22:10:13 +00:00
Robin H. Johnson
dffd867285 build: Respect TMPDIR for virtualenv.
Gentoo's normal build process uses a sandbox to catch writes outside the
build environment; this includes providing a value other than /tmp for
TMPDIR. Use TMPDIR by default for CEPH_BUILD_VIRTUALENV.

Signed-off-by: Robin H. Johnson <robin.johnson@dreamhost.com>
2016-04-05 21:28:41 +00:00
Sage Weil
048251b66c common/fs_types: dump pool_id signed
Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-05 16:37:27 -04:00
Sage Weil
cd41ca2968 mds: fix legacy layout decode with pool 0
If you data pool was pool 0, this was transforming
that to -1 unconditionally, which broke upgrades.  We
only want do that for a fully zeroed ceph_file_layout,
so that it still maps to a file_layout_t.  If any fields
are set, though, we trust the fl_pgpool to be a valid
pool.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-05 16:37:25 -04:00
Orit Wasserman
0b09e477a5 Merge pull request #8447 from cbodley/wip-cmake-mrun
mrun: update path to cmake binaries
2016-04-05 21:42:48 +02:00
Kefu Chai
03bf796075 Merge pull request #8430 from wjin/fix
crush: fix error log

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-04-06 00:37:41 +08:00
James Page
05cafcf19f Drop any systemd imposed process/thread limits
If systemd has task accounting enabled, a default of 512 tasks
will be applied to all systemd units.

For ceph, this is way to low even for a modest cluster, so stop
this restriction being applied and allow administrators to apply
limits using sysctl.

Signed-off-by: James Page <james.page@ubuntu.com>
2016-04-05 17:33:57 +01:00
Casey Bodley
02ab8a2203 mrun: update path to cmake binaries
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-04-05 11:20:15 -04:00
Sage Weil
67f8f1fdc0 os/bluestore/BlueFS: add some perfcounters
Most utilization-related.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-05 11:19:04 -04:00
Sage Weil
75ddd73c31 os/bluestore/BlueFS: revamp bdev ids
You cannot tell from the old bdev vector which device
was which.

- use a fixed id for each type/slot
- go from fast(small) to slow(big)
- normalize the allocation fallback to try any slower
  device.
- clean up the BlueStore instantiation/setup accordingly

Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-05 11:19:04 -04:00
Sage Weil
a5564a664c os/ObjectStore: make device uuid probe output something friendly
Otherwise, all you see is errors about the probes that failed (e.g., a
failure to decode a non-bluestore superblock as bluestore).

Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-05 11:10:54 -04:00
Javier M. Mellid
4f6523dc72 rgw: aws4 uri encoding bugfix
Fixes: http://tracker.ceph.com/issues/15358

Signed-off-by: Javier M. Mellid <jmunhoz@igalia.com>
2016-04-05 16:00:10 +02:00
Sage Weil
bc9607b800 mon/OSDMonitor: fix off-by-one for osd_map_message_max
For most messages we were sending osd_map_message_max + 1 maps.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-05 09:58:02 -04:00
Loic Dachary
24b924b30b Merge pull request #8131 from ErwanAliasr1/evelu-fast-check
tests: Improving 'make check' execution time

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-04-05 15:52:52 +02:00
Sage Weil
81cc288931 osd: improve full map requests
If we don't get all the full maps we want, request more
immediately.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-05 09:45:33 -04:00
Sage Weil
2e22f54c5f osd: create rerequest_full_maps() helper
Signed-off-by: Sage Weil <sage@redhat.com>
2016-04-05 09:45:04 -04:00