Commit Graph

77457 Commits

Author SHA1 Message Date
xie xingguo
22740cc9b3 os/bluestore: formatting nits
So we don't output anything if csum is currently off:

_do_alloc_write blob Blob(0x7fad7cc25950 blob([0x42a80000~10000] none/0x1)

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-01 12:33:40 +08:00
xie xingguo
8ec4b4960f os/bluestore: don't re-initialize csum-setting for existing blobs
The global checksum setting may change, e.g., from NONE to CRC32,
which can cause improper re-initialization of the csum-settings of
existing blobs(e.g., partial write/overwrite may turn out to shrink
'csum_data').

We could develop some complicated solutions but for now let's not
bother since the above scenario is rare.

Fixes: http://tracker.ceph.com/issues/21175
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-01 12:33:40 +08:00
Kefu Chai
958c8480ea Merge pull request #17180 from tchaikov/wip-literals-for-options
common/options: use user-defined literals for default values

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2017-08-29 09:25:33 +08:00
Kefu Chai
4324ad9955 Merge pull request #16066 from tanghaodong25/bluefs-sync-write
os/bluestore/BlueFS: don't need wait for aio when using _sync_write

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 09:12:47 +08:00
Kefu Chai
a8124b1c6f Merge pull request #15479 from yonghengdexin735/wip-zzz-const
messages/MDentryLink: add const to member function

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-29 09:11:58 +08:00
Kefu Chai
9c1c2dde22 Merge pull request #17256 from scienceluo/wip-luo-add-log-branch
auth: add err reason for log info in load function

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-29 09:11:22 +08:00
Sage Weil
df3fe608b8 Merge pull request #17307 from liewegas/wip-powercycle-slow-trim
qa/suites/powercycle/osd/whitelist_health: whitelist slow trimming
2017-08-28 13:14:16 -05:00
Sage Weil
5235f35ac8 qa/suites/powercycle/osd/whitelist_health: whitelist more
"2017-08-26 16:09:27.704418 mon.a mon.0 172.21.15.169:6789/0 876 : cluster [WRN] MDS health message (mds.0): Behind on trimming (66/30)" in cluster log

Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-28 13:58:02 -04:00
John Spray
bc2daa6ee9 Merge pull request #16857 from yanyixing/chartfix
pybind: fix chart size become bigger when refresh

Reviewed-by: John Spray <john.spray@redhat.com>
2017-08-28 18:28:34 +01:00
Matt Benjamin
315e419181 Merge pull request #17267 from linuxbox2/wip-lock-qlane
rgw_file:  fix LRU lane lock in evict_block()
2017-08-28 11:01:03 -04:00
Sage Weil
0f5da4afc1 Merge pull request #17293 from tchaikov/wip-jewel-x-singleton
qa/suites/rados/upgrade/jewel-x-singleton: tolerate sloppy past_intervals

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-28 08:55:18 -05:00
Kefu Chai
4fba9c0ee2 Merge pull request #17019 from dachary/wip-doc-ceph-disk
doc: document ceph-disk prepare class hierarchy

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-28 19:17:33 +08:00
Kefu Chai
b2d7f4f4c7 qa/suites/rados/upgrade/jewel-x-singleton: tolerate sloppy past_intervals
See-also: d5d5d7d1
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-28 15:19:41 +08:00
Pan Liu
0bef6c7753 Merge pull request #17284 from liupan1111/wip-nvme-cleanup
bluestore/NVMEDevice: code cleanup
2017-08-28 10:01:58 +08:00
Xie Xingguo
3e0506a9a5 Merge pull request #17253 from hjwsm1989/fix-qa-bug
qa: fix the potential delay of pg state change

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-28 08:35:01 +08:00
Pan Liu
54383e8bd9 bluestore/NVMEDevice: remove useless IOSegment, and set
dpdk_thread_adaptor as static.

Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
Signed-off-by: Ziye Yang <optimistyzy@intel.com>
2017-08-27 23:23:00 +08:00
Pan Liu
8b80a9ba7d bluestore/NVMEDevice: remove useless aio_stop in class NVMEDevice
Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
2017-08-27 23:06:55 +08:00
Pan Liu
455e7435f7 os/bluestore/NVMEDevice: remove not used BufferedExtents.
Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
2017-08-27 23:03:15 +08:00
Jason Dillaman
fc0646fa6d Merge pull request #17055 from dillaman/wip-21017
mgr/dashboard: fix duplicate images listed on iSCSI status page

Reviewed-by: John Spray <john.spray@redhat.com>
2017-08-27 08:39:18 -04:00
Jason Dillaman
f2092a9d32 Merge pull request #17216 from Yan-waller/wip-walle-0824imagectx
test/librbd: fix mock method macro of set_journal_policy

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-27 08:33:35 -04:00
Sage Weil
64dcb9c3d0 Merge pull request #17275 from ceph/revert-17268-wip-21089
Revert "os/bluestore: compensate for bad freelistmanager size/blocks metadata"

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-26 21:22:04 -05:00
Kefu Chai
30b5b4627c Merge pull request #16494 from asomers/bin_bash
misc: Fix bash path in shebangs

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-27 10:14:14 +08:00
Xie Xingguo
303d5b34a5 Revert "os/bluestore: compensate for bad freelistmanager size/blocks metadata" 2017-08-27 10:12:46 +08:00
Xie Xingguo
dbe1e6ed6c Merge pull request #17268 from liewegas/wip-21089
os/bluestore: compensate for bad freelistmanager size/blocks metadata

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-27 09:38:14 +08:00
Xie Xingguo
d0402b1175 Merge pull request #17271 from xiexingguo/wip-ls-by-class
mon/MonCommands: fix copy-and-paste error

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-27 09:36:09 +08:00
Xie Xingguo
df81aa4643 Merge pull request #17272 from scienceluo/wip-luo-silence-buiding-warning-branch
common: silence jenkins's buiding warning in obj_bencher.cc

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-27 09:34:58 +08:00
Pan Liu
82e7dee3ff Merge pull request #17200 from optimistyzy/823_queue_depth
os/bluestore/NVMEDevice: fix the nvme queue depth issue
2017-08-26 22:29:54 +08:00
Luo Kexue
6ed6883b49 common: silence jenkins's buiding warning in obj_bencher.cc
Signed-off-by: Luo Kexue <luo.kexue@zte.com.cn>
2017-08-26 10:58:39 +08:00
xie xingguo
49e293d552 mon/MonCommands: fix copy-and-paste error
Class is definitely required by default for the "crush rule ls-by-class"
command.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-26 10:09:11 +08:00
Xie Xingguo
3619904fb1 Merge pull request #17270 from liewegas/wip-luminous-note
doc/release-notes: clarify purpose of require-osd-release

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-26 09:11:13 +08:00
Ziye Yang
09e4513c29 NVMEDevice: fix the nvme queue depth issue
We need to track the queue depth usage for each qpair to
prevent submit too many I/Os. If there are too many requests,
we need to poll the qpair, to make sure there is enough slots
for next I/O submit.

Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
2017-08-26 08:07:32 +08:00
Sage Weil
ba38d3c337 doc/release-notes: clarify purpose of require-osd-release
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-25 18:48:09 -04:00
Sage Weil
c029a9645b os/bluestore: compensate for bad freelistmanager size/blocks metadata
This repairs bluestores created before http://tracker.ceph.com/issues/21089
was fixed in f6f1ae3724.

In both cases, the freelistmanager's size is off by one block (4k).  In
one case, it is just a matter of fixing the size and twiddling the trailing
bit.  In the second case, the size delta causes freelistmanager to need
a new row, which means the blocks count also changes, and we have lots
of bits to zero (all but one in the new row).

Both are silently corrected by fsck in this patch.

Fixes: http://tracker.ceph.com/issues/21089
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-25 18:08:49 -04:00
Matt Benjamin
3301596734 rgw_file: fix LRU lane lock in evict_block()
Found by "Supriti Singh" <Supriti.Singh@suse.com>.

Fixes http://tracker.ceph.com/issues/21141

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-08-25 17:55:11 -04:00
Josh Durgin
3dfc8659c5 Merge pull request #17245 from jdurgin/wip-dup-perf
osd/PGLog: write only changed dup entries

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-25 14:52:43 -07:00
Kefu Chai
2fe72ad907 Merge pull request #17225 from liewegas/wip-bluestore-fsck-leaks
os/bluestore: print leaked extents to debug output

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-26 00:53:39 +08:00
Kefu Chai
5127b858b4 Merge pull request #17242 from neha-ojha/wip-21023
mon: warn about using osd new instead of osd create

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-26 00:52:39 +08:00
Kefu Chai
d440f98b5f Merge pull request #17248 from tchaikov/wip-20987
mon/OSDMonitor: check last_scan_epoch instead when sending creates

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-26 00:44:05 +08:00
Kefu Chai
745343629e Merge pull request #17246 from tchaikov/wip-20913
osd/PGBackend: release a msg using msg->put() not delete

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-08-26 00:37:16 +08:00
Sage Weil
d930a4e062 Merge pull request #17029 from xiexingguo/wip-crush-rule-rename
mon: "ceph osd crush rule rename" support

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-25 10:21:38 -05:00
Sage Weil
ae32d1a3ee Merge pull request #17103 from C2python/clear_attr
common: Destroy attr of RWLock after initialized

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-25 10:12:29 -05:00
Sage Weil
5db94f4786 Merge pull request #17126 from xiexingguo/wip-nicenum
common/types: make numbers a bit nicer when displaying space usage

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-25 10:11:06 -05:00
Sage Weil
fca01a264f Merge pull request #17182 from tchaikov/wip-obj-bencher
common/obj_bencher: set {min,max}_iops if runtime < 1 sec

Reviewed-by: PCzhangPC <pengcheng.zhang@easystack.cn>
2017-08-25 10:10:31 -05:00
Sage Weil
51e327c57d Merge pull request #17221 from xiexingguo/wip-pg-sparse-read
osd/PrimaryLogPG: fix sparse read won't trigger repair correctly

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-25 10:09:42 -05:00
Sage Weil
e353d93971 Merge pull request #17222 from xiexingguo/wip-propagate-eagain
osd/PrimaryLogPG: do_osd_ops - propagate EAGAIN/EINPROGRESS on failok

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-25 10:09:11 -05:00
Sage Weil
86f227388a Merge pull request #17258 from liewegas/wip-21127
qa/standalone/scrub/osd-scrub-repair: fix grep pattern

Reviewed-by: David Zafman <dzafman@redhat.com>
2017-08-25 10:04:18 -05:00
Sage Weil
84465bf5a5 qa/standalone/scrub/osd-scrub-repair: fix grep pattern
PGMap shows

    ss << pg_sum.stats.sum.num_objects_unfound
       << "/" << pg_sum.stats.sum.num_objects << " objects unfound (" << b << "%)";

but we were grepping for "1/1 unfound" instead of "1/1 objects
unfound".

Introduced by fe81b7e3a5.

Fixes: http://tracker.ceph.com/issues/21127
Signed-off-by: Sage Weil <sage@redhat.com>
2017-08-25 11:03:44 -04:00
Loic Dachary
ed89f8cb0e doc: document ceph-disk prepare class hierarchy
Signed-off-by: Loic Dachary <loic@dachary.org>
2017-08-25 15:48:59 +03:00
Luo Kexue
63515bec9d auth: add err log info for load function
Signed-off-by: Luo Kexue <luo.kexue@zte.com.cn>
2017-08-25 19:12:34 +08:00
huangjun
3bff102d4b qa: fix the potential delay of pg state change
If start osd process first and then mark it in, the
pg state may remain all active+clean when doing
wait_for_clean() check, which may fail the next
osd_scrub_pgs() process.
So faster pg state change by marking osd in first.

Signed-off-by: huangjun <huangjun@xsky.com>
2017-08-25 17:07:37 +08:00