Commit Graph

68422 Commits

Author SHA1 Message Date
Mykola Golub
596e5ea8a5 rbd-nbd: check /sys/block/nbdX/size to ensure kernel mapped correctly
Fixes: http://tracker.ceph.com/issues/18335
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-02-04 15:40:51 +01:00
Mykola Golub
8677dea4cd common: possible lockdep false alarm for ThreadPool lock
Fixes: http://tracker.ceph.com/issues/18819
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-02-04 15:27:11 +01:00
Kefu Chai
6cd8098a61 Merge pull request #13257 from tchaikov/wip-less-verbose-ceph-helper
tests: ceph-helpers.sh reduce get_timeout_delays() verbosity

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-02-04 20:15:34 +08:00
Kefu Chai
389bd00da3 tests: ceph-helpers.sh reduce get_timeout_delays() verbosity
`set +o` prints out the full command line which is echoed if "xtrace" is
enabled. this increases the verbosity of get_timeout_delays().
in this change, we follow the way of kill_daemons() to kill the extra
output. see aefcf6d.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-02-04 17:10:49 +08:00
lvshuhua
64f6ef3913 osd: correct comment of perfcounter cached_crc in code
Signed-off-by: lvshuhua <lvshuhua@cmss.chinamobile.com>
2017-02-04 17:09:20 +08:00
Haomai Wang
3d740bdaa1 Merge pull request #13080 from yuyuyu101/wip-async-fd
msg/async/AsyncConnection: socket's fd can be zero, avoid false assert

Reviewed-by: Kefu Chai <kefu@redhat.com>
2017-02-04 11:37:27 +08:00
Sage Weil
f2f2be0f39 Merge pull request #13251 from scuttlemonkey/master
script: adding contributor credits script

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-03 16:42:36 -06:00
Sage Weil
93bbc1e4bd Merge pull request #9396 from songbaisen/doc2
doc: fix the librados c api can not compile problem

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-03 16:24:59 -06:00
Adam C. Emerson
bd3bb7060b [librados,libcephfs] Avoid redefinition of rados_t
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-02-03 17:23:23 -05:00
Adam C. Emerson
b24e438b40 rgw: Classes with virtual functions get virtual destructors
Including template specializations.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-02-03 17:23:23 -05:00
Adam C. Emerson
48be05e420 crush: Do not defeat RVO with unnecessary std::move
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-02-03 17:23:23 -05:00
Adam C. Emerson
983ad3d4ef bluestore: Fix redeclaration of struct
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-02-03 17:23:23 -05:00
Adam C. Emerson
bcf7d9b830 rgw: Use non-deprecated get_omap function
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-02-03 17:23:23 -05:00
Adam C. Emerson
2e15bcd025 rgw: Fix rgw_format construction order
Since we have only one constructor, just use default initialization for
every member that doesn't depend on an argument.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-02-03 17:23:23 -05:00
Adam C. Emerson
f1c4adc50e rbd: Fix sign comparison warning
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-02-03 17:23:23 -05:00
Adam C. Emerson
03ed1e1faa key_value_store: Stop using deprecated omap_get_* functions
This gets rid of deprecation warnings.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-02-03 17:23:16 -05:00
Samuel Just
91b7423502 osd/: don't leak context for Blessed*Context or RecoveryQueueAsync
This has always been a bug, but until
68defc2b05, nothing deleted those contexts
without calling complete().

Fixes: http://tracker.ceph.com/issues/18809
Bug shadowed until: 68defc2b05
Signed-off-by: Samuel Just <sjust@redhat.com>
2017-02-03 13:12:47 -08:00
Matt Benjamin
3b807e763a Merge pull request #13252 from linuxbox2/wip-rgw-setattr
rgw_file:  fix RGWLibFS::setattr for directory objects
2017-02-03 14:47:20 -05:00
Matt Benjamin
4ad5a92268 rgw_file: fix RGWLibFS::setattr for directory objects
Fixes:  http://tracker.ceph.com/issues/18808

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-02-03 13:51:38 -05:00
Matt Benjamin
5bf39156d8 Merge pull request #13147 from yehudasa/wip-18331
rgw: fix use of marker in List::list_objects()
2017-02-03 11:57:23 -05:00
Yuri Weinstein
7582a03650 Merge pull request #12023 from yuyuyu101/wip-msgr-type
msg: allow different ms type for cluster network and public network

Reviewed-by: Adir Lev <adirl@mellanox.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-03 08:50:14 -08:00
Yuri Weinstein
94319878af Merge pull request #13114 from liewegas/wip-osdmap-required-features
osd: condition object_info_t encoding on required (not up) features

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-02-03 08:44:46 -08:00
Yuri Weinstein
c18061c731 Merge pull request #13206 from liewegas/wip-osd-enxio
osd: do not send ENXIO on misdirected op by default


Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-02-03 08:43:08 -08:00
Yuri Weinstein
f5b676acd9 Merge pull request #13213 from ovh/bp-osd-updateable-throttles
osd: allow client throttler to be adjusted on-fly, without restart

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-03 08:41:00 -08:00
Loic Dachary
dd859f425d Merge pull request #13063 from ovh/wip-mailmap-ovh-contributors
mailmap: Update OVH contributors

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-02-03 17:21:19 +01:00
scuttlemonkey
391a5b5f48 adding contributor credits script
Signed-off-by: Patrick McGarry <pmcgarry@redhat.com>
2017-02-03 17:16:59 +01:00
Sage Weil
f223ac9291 mon/PGMap: factor mon_osd_full_ratio into MAX AVAIL calc
If we only fill OSDs to 95%, we should factor that into
the MAX AVAIL calculation for the pool.

Fixes: http://tracker.ceph.com/issues/18522
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-03 10:08:33 -05:00
Sage Weil
f285fa2ef2 mon: smooth io/recovery stats over longer period
On a busy cluster, the PGMap will turn over every 1-2 seconds and
OSDs will report PG stats every 5-10 seconds.  Averaging over only
two PGMap versions (2-4 seconds) will lead to erratic and spikey
delta values.  Move to 6 versions (6-12 seconds) to better match
the reporting interval while still keeping the values somewhat
responsive.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-03 09:53:46 -05:00
Kefu Chai
2d0dd51a9e Merge pull request #13223 from wjwithagen/wip-wjw-freebsd-sphynx
build/install-deps.sh: Add sphinx package for building docs on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-02-03 22:01:41 +08:00
John Spray
c6eabe04d9 Merge pull request #11448 from ledgr/change/mount_fuse_ceph_options_in_fs_mntops_and_python
Rewrite mount.fuse.ceph (to python) and move ceph-fuse options to fs_mntops

Reviewed-by: John Spray <john.spray@redhat.com>
2017-02-03 12:30:46 +01:00
Josh Durgin
21cdcfcc66 Merge pull request #13194 from smithfarm/wip-16263
tests: ignore bogus ceph-objectstore-tool error in ceph_manager

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2017-02-02 15:31:29 -08:00
Sage Weil
39bbac00e7 os/bluestore: drop ExtentMap::Shard offset field
This is mirrored in shard_info, which we have a pointer to.

Note that shard_info is also a bit redundant as we can also look it up in
the onode vector in the same position, but it makes it more awkward to use
iterators.  Something to consider later to save memory.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-02 17:25:55 -05:00
Sage Weil
96e69ee9fd os/bluestore: simplify dirty shard handling in ExtentMap::update
We can do this with a single allocation with a simple vector<>.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-02 17:25:55 -05:00
Sage Weil
40db5b6614 os/bluestore: ExtentMap: reshard only requested range
Only reshard extents in the requested range.

Note that the strategy for unspanning blobs changed; we now span or
unspan specific blobs at the end based on our reshard result instead
of unspanning all at the start.  This keeps the spanning id stable,
which is important because it may be referenced from another that
we aren't even looking at.

Also note that this requires a bit of restructuring: an encode_some may
hit a spanning shard, *requiring* us to reshard, which means we should
always conduct the initial pass through update to discover other reshard
requirements, even if we already know some resharding will be needed.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-02 17:25:55 -05:00
Sage Weil
0819a0f90e os/bluestore: dump num spanning blobs from dump_onode
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-02 17:25:54 -05:00
Sage Weil
454d66bf32 os/bluestore: trivial cleanups in csum error code
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-02 17:25:54 -05:00
Sage Weil
2045431c61 os/bluestore: fsck: dump_onode after shards are loaded
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-02 17:25:54 -05:00
Sage Weil
44c3ec81e9 ceph_test_objectstore: error out on fsck failure
It's much more helpful this way.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-02 17:25:54 -05:00
Sage Weil
9ab4873288 os/memstore: return 0 from fsck
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-02 17:25:53 -05:00
Nathan Cutler
b519d38fb1 tests: Thrasher: eliminate a race between kill_osd and __init__
If Thrasher.__init__() spawns the do_thrash thread before initializing the
ceph_objectstore_tool property, do_thrash races with the rest
of Thrasher.__init__() and in some cases do_thrash can call kill_osd() before
Trasher.__init__() progresses much further. This can lead to an exception
("AttributeError: Thrasher instance has no attribute 'ceph_objectstore_tool'")
being thrown in kill_osd().

This commit eliminates the race by making sure the ceph_objectstore_tool
attribute is initialized before the do_thrash thread is spawned.

Fixes: http://tracker.ceph.com/issues/18799
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-02-02 23:23:54 +01:00
Sage Weil
2a75ab7722 Merge pull request #13234 from ifed01/wip-bluestore-performance-sandbox2017
os/bluestore: fix potential assert in cache _trim method.

Reviewed-by: Sage Weil <sage@redhat.com>
2017-02-02 16:09:57 -06:00
Matt Benjamin
8b57de98ec Merge pull request #12965 from linuxbox2/wip-librgw-expand-argv
rgw_file:  split last argv on ws, if provided
2017-02-02 15:25:08 -05:00
Matt Benjamin
fbc19e4eff rgw_file: split last argv on ws, if provided
This is intended to allow an "extra" unparsed argument string
containing various cmdline options to be passed as the last argument
in the argv array of librgw_create(), which nfs-ganesha is
expecting to happen.

While at it, hook env_args() too.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-02-02 14:16:53 -05:00
Radoslaw Zarzynski
871e1f51af rgw: be aware abount tenants on cls_user_bucket -> rgw_bucket conversion.
Fixes: http://tracker.ceph.com/issues/18364
Fixes: http://tracker.ceph.com/issues/16355
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-02-02 19:02:25 +01:00
Bartłomiej Święcki
f74d7f3673 mailmap: Update OVH contributors
Signed-off-by: Bartłomiej Święcki <bartlomiej.swiecki@corp.ovh.com>
2017-02-02 16:54:56 +01:00
Loic Dachary
6349f987df Merge pull request #12335 from theanalyst/mailmap/v11.1.0
mailmap updates for v11.1.0

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-02-02 16:46:05 +01:00
Sage Weil
317ebde7ec os/bluestore: fsck: check for shards past EOF
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-02 10:12:08 -05:00
Sage Weil
c7949d4010 os/bluestore: reshard on truncate if shards past EOF
This ensure we mop up shards past EOF instead of encoding them
empty and confusing future code (that, say, assumes no shards past
EOF).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-02 10:12:08 -05:00
Sage Weil
92a555ec42 os/bluestore/bluestore_types: beautify use_tracker_t operator<<
Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-02 10:12:08 -05:00
Sage Weil
4302e96d8d os/bluestore: ExtentMap: request reshard range from update() intelligently
Split ourselves, or merge with our immediate predecessor or
successor.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-02-02 10:12:08 -05:00