Commit Graph

72953 Commits

Author SHA1 Message Date
Jos Collin
dba3d3e42d common: Remove redundant includes
Fixes: http://tracker.ceph.com/issues/19883 (Partially)

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-05-26 21:12:39 +05:30
Igor Fedotov
6f8e5d2f1d os/bluestore: fix BitMapAllocator assert on out-of-bound hint value
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2017-05-26 08:41:34 -07:00
Casey Bodley
4603e97183 Merge pull request #15256 from fangyuxiangGL/bucket-stats
rgw: display more info when using  radosgw-admin bucket stats

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-05-26 10:48:41 -04:00
Casey Bodley
e3bf1df989 Merge pull request #15221 from fangyuxiangGL/set-placement-rule
rgw: set placement rule properly

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-05-26 10:35:26 -04:00
John Spray
ba545c1216 Merge pull request #15287 from ktdreyer/doc-ceph-fs-settings
doc: describe CephFS max_file_size

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-05-26 15:35:10 +01:00
Casey Bodley
30bc0f66d7 Merge pull request #15219 from fangyuxiangGL/extra_pool
rgw: use get_data_extra_pool() when get extra pool

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-05-26 10:34:19 -04:00
Casey Bodley
456ac50aa7 Merge pull request #14341 from theanalyst/cleanup/rgw/str-find
rgw_common: use string::npos for the results of str.find

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-05-26 10:33:35 -04:00
Sage Weil
d6c4925793 Merge pull request #14746 from wjwithagen/wip-wjw-reduce-noise-2
src/ceph.in: Use env(CEPH_DEV) to suppress noise from ceph

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-26 09:30:17 -05:00
Sage Weil
622c09ccd3 Merge pull request #15247 from liewegas/wip-upmap-save
osdmaptool: require --upmap-save before modifying input osdmap

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-05-26 09:20:05 -05:00
Jason Dillaman
47ad4429fb Merge pull request #15234 from trociny/wip-19832
librbd: potential read IO hang when image is flattened

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-05-26 10:12:44 -04:00
Jason Dillaman
a38f0a5c98 Merge pull request #15239 from trociny/wip-19962
librbd: discard related IO should skip op if object non-existent

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-05-26 10:12:06 -04:00
Matt Benjamin
189ce0e5a6 Merge pull request #15293 from linuxbox2/wip-rgwfile-buckattr
rgw_file: store bucket uxattrs on the bucket
2017-05-26 09:48:09 -04:00
linbing
730781afec mon: it's no need to get pg action_primary osd twice in pg scrub
Signed-off-by: linbing <linbing@t2cloud.net>
2017-05-26 21:36:14 +08:00
Jason Dillaman
32bd33eb1b Merge pull request #15290 from idryomov/wip-krbd-unmap-straw
qa/suites/krbd: unmap subsuite needs straw buckets

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-05-26 09:27:50 -04:00
Ken Dreyer
4274c91c28 doc: describe differences with "mds set" vs "fs set"
Thanks to John Spray <jspray@redhat.com> on ceph-users for this
information.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-05-26 06:38:14 -06:00
Ken Dreyer
02753cdb91 doc: describe CephFS max_file_size
Add a description of max_file_size to the CephFS admin docs.

Thanks to John Spray <jspray@redhat.com> on ceph-users for this
information.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-05-26 06:38:11 -06:00
Jianpeng Ma
910e58011d os/bluestore/BlueStore: Only call once notify_all.
All txcs of deferred_running have the same osr, so only call once
notify_call.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-05-26 18:15:06 +08:00
Jianpeng Ma
45113968b8 os/bluestore/BlueStore: avoid iterating to get ios/cost in _kv_sync_thread.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-05-26 18:15:06 +08:00
Jianpeng Ma
6435c4a252 os/bluestore/BlueStore: batch handle Throttle.put.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-05-26 18:15:06 +08:00
Willem Jan Withagen
f28f4cbc20 ./qa/workunits/ceph-helpers.sh: Do not trace kill_daemon
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-05-26 12:07:28 +02:00
Willem Jan Withagen
0f8972dd70 vstart:Suppress trivial logging info during devlopment
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-05-26 12:07:14 +02:00
Willem Jan Withagen
f7e60bac5d src/ceph.in: Use env(CEPH_DEV) to suppress noise from ceph
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-05-26 12:07:13 +02:00
linbing
5b468b641a Modify note error
Signed-off-by: linbing linbing@t2cloud.net
2017-05-26 17:45:43 +08:00
liuchang0812
5284778e0e tool/ceph: support target mon in tell help subcommand
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-05-26 17:39:22 +08:00
xie xingguo
9939d5a819 common/ceph_context: fix leak of registered commands on exit
By unregister them properly.
Also rearrange commands order to keep pace with register process.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-05-26 17:28:55 +08:00
Greg Farnum
b0e9deeea8 osd: Reset() the snaptrimmer on shutdown
We were failing to exit various wait states which held PGRefs. Error!

Fixes: http://tracker.ceph.com/issues/19931

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2017-05-25 21:52:49 -07:00
Sage Weil
6b6c14f8c7 Merge pull request #14658 from chardan/jfw-wip-halflife_atomic_t-baragon
librados,libradosstriper,test: migrate atomic_t to std::atomic (baragon)

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-25 22:29:19 -05:00
Sage Weil
0f01014ba5 Merge pull request #15227 from tchaikov/wip-20051
mon/MonClient: cancel pending commands on shutdown

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-05-25 22:28:47 -05:00
Sage Weil
6650a18e59 Merge pull request #15249 from Alessandro-Barbieri/patch-2
yasm-wrapper: filter -pthread

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-25 22:27:57 -05:00
Sage Weil
dcebdf4ff0 Merge pull request #15268 from ifed01/wip-bluestore-false-assert
os/bluestore: fix false assert in IOContext::aio_wake

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-25 22:27:23 -05:00
Sage Weil
94c834ab9b Merge pull request #15272 from tchaikov/wip-mon-cleanups
mon: cleanups

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-25 22:27:11 -05:00
Sage Weil
855955e58e osd: reduce size of osdmap cache, messages
On large clusters, these large caches can be problematic (as maps get big).
We've seen good results with extremely small caches (10s of maps).  Make
a more modest reduction.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-25 23:13:37 -04:00
Sage Weil
c1b92cdcbb test/osd/osd-config.sh: fix test to isolate cases
The third test (increasing osd_map_max_advance)
was triggering a warning from the 4th case (which
it didn't before).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-25 23:13:37 -04:00
Sage Weil
c489d45113 osd: fadvise hint WILL_NEED when reading encoded osdmaps
This way will ensure we cache data for recent osdmaps if we need to for
the benefit of laggy clients... even if (in bluestore's case)
bluestore_default_buffered_reads = false (it's true by default).  This
should mitigate any tail latency/work even if the osdmap cache size is too
small.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-25 22:52:33 -04:00
Sage Weil
73985a5b10 osd: instrument osdmap bl cache hits and misses
Add perfcounters so we can see whether we are missing osdmaps in the
cache.  This will let us tell whether, given a workload or environment,
our osdmap cache might be too small.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-25 22:52:33 -04:00
Sage Weil
0ff3d4291c osd: do not bother with misdirected op diagnosis by default
We enable osd_debug_misdirected_ops in QA, but this is wasted effort on
a production cluster.  In particular, it means that a idle client that
sends an op to the wrong OSD based on an old map will require that OSD to
load that old map into memory to decide whether to print a warning... all
on the off-chance that the client is buggy.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-25 22:29:22 -04:00
Sage Weil
c150cba817 osd: remove osd_enxio_on_misdirected_op option
There is no good reason anyone would want this turned on.

Introduced 923e7f5ce5 (post-kraken), but
backported to kraken and jewel (10.2.6).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-25 22:29:22 -04:00
liuchang0812
b2fcb62b7a tool/ceph: remove old mon support and verbose support
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-05-26 10:27:26 +08:00
liuchang0812
9753a0065d tool/ceph: validate target in tell subcommand
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-05-26 10:27:26 +08:00
liuchang0812
b0af39713b test/cephtool: convert FS_NAME to local variable
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-05-26 10:27:26 +08:00
liuchang0812
a1cf9ae766 doc/tool: introduce "ceph tell x help" command in man
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-05-26 10:27:26 +08:00
liuchang0812
5680936878 tool/ceph: create "tell x help" command
Fixes: http://tracker.ceph.com/issues/19885

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-05-26 10:27:26 +08:00
Brad Hubbard
096249707d Merge pull request #15192 from badone/wip-tracker-19900-wait_auth_rotating-crash
mgr: Mark session connections down on shutdown

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-26 08:35:29 +10:00
Sage Weil
890f482568 mgr/MgrStandby: prevent use-after-free on just-shut-down Mgr
Fixes: http://tracker.ceph.com/issues/19595
Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-25 18:25:27 -04:00
Sage Weil
d292b5419f qa/tasks/repair_test: unset flags we set
In particular, noscrub and nodeepscrub leave a health
warning, which prevents shutdown with at-end.yaml.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-25 18:05:42 -04:00
myoungwon oh
6dbcbb5515 osd: prevent upgrading unsupported cluster
Signed-off-by: Myoungwon Oh omwmw@sk.com
Signed-off-by: Sage Weil sage@redhat.com
2017-05-26 05:52:56 +09:00
Yuri Weinstein
25b8e0f63f Merge pull request #15146 from tchaikov/wip-split-test-tiering
qa: split test_tiering into smaller pieces

Reviewed-by: Sage Weil <sage@redhat.com>
2017-05-25 13:43:53 -07:00
Yuri Weinstein
0f7e269880 Merge pull request #15156 from tchaikov/wip-ceph.in-assert-connected
ceph.in: assert(state==connected) before help_for_target()

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2017-05-25 13:43:17 -07:00
Yuri Weinstein
516c3ec452 Merge pull request #15224 from tchaikov/wip-denc-no-deep-copy-for-segmented-buffer
denc: add need_contiguous to denc_traits

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-05-25 13:40:23 -07:00
Sage Weil
9b81fa43db crush/CrushTreeDumper: allow children to filter results
Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-25 16:31:52 -04:00