Commit Graph

60860 Commits

Author SHA1 Message Date
Yunchuan Wen
f9fc3548ae osd: mark queued flag for op
queue_op will check the op epoch with current osdmap epoch,
and then, the op will be push into waiting_for_map or mark
queued flag.
but when the op pop from waiting_for_map, take_op_map_waiters
forget to mark queued flag before handle it.

Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2016-12-07 08:56:14 +08:00
chanyoung
8b2c896d9d osd: fix typos in "struct OSDOp" comments
"nembers" -> "members"

Signed-off-by: Chanyoung Park <park910113@gmail.com>
2016-12-07 09:25:56 +09:00
Jason Dillaman
d3f224b3de Merge pull request #12344 from trociny/wip-resync-fixup
rbd-mirror: fix gmock warnings in bootstrap request unit tests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-12-06 19:18:16 -05:00
Sage Weil
86dcfd8de4 Merge pull request #11369 from theanalyst/kraken-release-notes
doc: release notes for 11.0.2

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-12-06 18:39:46 -05:00
Abhishek Lekshmanan
61d0078409 doc: add salient features of kraken 11.1.0 rc
Reordering to add Sage's release note comments on top

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-12-07 00:23:11 +01:00
Abhishek Lekshmanan
230406e32f doc: add release notes for 11.1.0
Release notes as of 7b1293e70d

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-12-07 00:20:54 +01:00
Abhishek Lekshmanan
f8467c0df9 doc: bump release notes to 11.0.2
bumping release notes to 11.0.2 kraken and adding the single commit that
differs between the changes

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-12-07 00:20:53 +01:00
Abhishek Lekshmanan
a07040589d doc: release notes for 11.0.1
Signed-off-by: Abhishek Lekshmanan <alekshmanan@suse.com>
2016-12-07 00:20:53 +01:00
Sage Weil
48d5f133b8 Merge pull request #12346 from theanalyst/doc/changelog/v10.2.4
doc: adding changelog for v10.2.4

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-06 18:11:19 -05:00
Greg Farnum
cbf18b1d80 ceph-fuse: start up log on parent process before shutdown
Otherwise, we hit an assert in the Ceph context and logging teardown.

Fixes: http://tracker.ceph.com/issues/18157

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2016-12-06 15:07:22 -08:00
Abhishek Lekshmanan
0828922878 doc: adding changelog for v10.2.4
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-12-07 00:06:52 +01:00
Sage Weil
2340a7b9a6 Merge pull request #12328 from liewegas/wip-bluestore-flush
os/bluestore: flush before enumerating omap values
2016-12-06 17:27:24 -05:00
Sage Weil
8981c1c7c2 Merge pull request #12265 from liewegas/wip-bluestore-precondition
os/bluestore: drop old bluestore preconditioning; replace with wal preextension of file size
2016-12-06 17:27:10 -05:00
Sage Weil
4eca628fb5 Merge pull request #12281 from dachary/wip-17743-memstore
tests: do not use memstore.test_temp_dir in two tests

Reviewed-by: David Zafman <dzafman@redhat.com>
2016-12-06 17:21:57 -05:00
Sage Weil
38964b9816 Merge pull request #12298 from chhabaramesh/bit_alloc_mempool
os/bluestore: bitmap allocator dump functionality

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-06 17:21:29 -05:00
Mykola Golub
376026d7b2 rbd-mirror: fix gmock warnings in bootstrap request unit tests
Fixes: http://tracker.ceph.com/issues/18156
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-12-06 23:40:50 +02:00
Sage Weil
b5458f7756 Merge pull request #12338 from liewegas/wip-kraken-notes
doc/release-notes: kraken release notes (draft)

Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2016-12-06 14:35:29 -05:00
Sage Weil
4607cb5f9f doc/release-notes: kraken release notes (draft)
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-06 14:34:30 -05:00
Samuel Just
a77cfe6bdd Merge pull request #12340 from athanatos/wip-18127
osd/PGLog::proc_replica_log,merge_log: fix bound for last_update

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-06 09:45:32 -08:00
Sage Weil
ebb9f0942c Merge pull request #12339 from kylinstorage/wip-optimize-assert
msg/async: assert(0) -> ceph_abort()

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-06 10:58:39 -05:00
Casey Bodley
2f3e75e8b8 Merge pull request #12329 from ktdreyer/wip-doc-spelling
doc: fix grammar/spelling in RGW sections

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-12-06 10:52:01 -05:00
Li Wang
b357eddd42 msg/async/rdma/RDMAStack.cc: assert(0) -> ceph_abort()
Signed-off-by: Li Wang <li.wang@kylin-cloud.com>
2016-12-06 14:54:40 +00:00
Li Wang
0e387afb26 msg/async/rdma/Infiniband.h: assert(0) -> ceph_abort()
Signed-off-by: Li Wang <li.wang@kylin-cloud.com>
2016-12-06 14:52:22 +00:00
Li Wang
3591b3fe53 msg/async/rdma/Infiniband.cc: assert(0) -> ceph_abort()
Signed-off-by: Li Wang <li.wang@kylin-cloud.com>
2016-12-06 14:50:07 +00:00
Pan Liu
42645a3018 rbd-nbd: support partition for rbd-nbd mapped raw block device.
Fixes: http://tracker.ceph.com/issues/18115
Signed-off-by: Pan Liu pan.liu@istuary.com
2016-12-06 21:04:03 +08:00
John Spray
6c5958c1f5 Merge pull request #12125 from ukernel/wip-17990
mds: properly commit new dirfrag before splitting it

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-12-06 12:18:38 +00:00
Haomai Wang
6e69b5801d Merge pull request #12334 from Adirl/fix_log_level
msg/async/rdma: change log level: 0 -> 1

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-12-06 19:06:52 +08:00
Avner BenHanoch
03bb8964a7 msg/async/rdma: change log level: 0 -> 1
this will avoid irrelevant messages to console in case of "ceph -s"

issue: 914828

Change-Id: Ia220c62ff7a9f80fbe6068e1dd9d4a9a05ed01db
Signed-off-by: Avner BenHanoch <avnerb@mellanox.com>
2016-12-06 13:54:30 +03:00
Li Wang
6dc85ca9e3 msg/async/dpdk/TCP.h: assert(0) -> ceph_abort()
Signed-off-by: Li Wang <li.wang@kylin-cloud.com>
2016-12-06 08:35:33 +00:00
Li Wang
fbfc5483e3 msg/async/dpdk/DPDKStack.cc: assert(0) -> ceph_abort()
Signed-off-by: Li Wang <li.wang@kylin-cloud.com>
2016-12-06 08:32:22 +00:00
Li Wang
7d13dd5c87 msg/async/dpdk/DPDK.cc: assert(0) -> ceph_abort()
Signed-off-by: Li Wang <li.wang@kylin-cloud.com>
2016-12-06 08:30:09 +00:00
Li Wang
ac2cc22728 common/map_cacher.hpp: assert(0) -> ceph_abort()
Signed-off-by: Li Wang <li.wang@kylin-cloud.com>
2016-12-06 08:29:04 +00:00
Loic Dachary
2711dac3e6 tests: do not use memstore.test_temp_dir in two tests
unittest_memstore_clone and test_objectstore_memstore.sh both
use memstore.test_temp_dir and when running in parallel they
interfere with each other.

src/test/objectstore/store_test_fixture.h will create

   memstore.test_temp_dir

when running via src/test/test_objectstore_memstore.sh

src/test/objectstore/test_memstore_clone.cc will also create

   memstore.test_temp_dir

when running via unittest_memstore_clone.

Fixes: http://tracker.ceph.com/issues/17743

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-12-06 09:12:50 +01:00
Kefu Chai
71ef0cbd8e Merge pull request #9837 from zhjwpku/typos
doc: network-protocol typos

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-06 09:04:59 +08:00
Samuel Just
b03c950135 PGLog::proc_replica_log,merge_log: fix bound for last_update
If olog.tail > log.tail, olog.tail is also a bound on last_update.
See the changed comment in the commit for details.

Also adds unit tests.

Fixes: http://tracker.ceph.com/issues/18127
Signed-off-by: Samuel Just <sjust@redhat.com>
2016-12-05 12:08:14 -08:00
Sage Weil
dded3de946 Merge pull request #12053 from theanalyst/v10.2.4/release-notes
doc: release notes for 10.2.4

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-12-05 13:59:57 -05:00
Ken Dreyer
7b0ba9d323 doc: fix capitalization in RGW admin ops
lower-case second word in this sentence.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2016-12-05 11:59:14 -07:00
Ken Dreyer
7db4def824 doc: fix spelling in RGW s3 compliance
mentionned -> mentioned

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2016-12-05 11:59:13 -07:00
Sage Weil
1e042a9bbb os/bluestore: flush before enumerating omap values
For a few update ops we enumerate omap keys (to remove them).
Make sure we flush the pipeline before doing so or else we may
lose keys inserted by a previous transaction that hasn't yet
committed.

Fixes: http://tracker.ceph.com/issues/18140
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-05 13:52:14 -05:00
Sage Weil
9ae9e64158 os/bluestore/BlueFS: pre-extend file size for WAL (.log) files
When rocksdb has log recycling on (this is required!), it will
do robust checksums on log records and change playback behavior
to tolerate trailing garbage in the log file.  This normally
allows it to overwrite previous log files, but it can also let
us overwrite arbitrary garbage on the device.

If we allocate some new space for a .log file (already indicated
by the WRITER_WAL hint), extend the size immediately so that each
subsequent append doesn't have to (unless/until we do another
allocation).

This is safe as long as rocksdb recycling is enabled (which it is
by default).

This is faster because we don't have to flush the bluefs log on
every log append during the period after startup before rocksdb
starts recycling log files.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-05 13:46:52 -05:00
Sage Weil
73ffab4fe6 os/bluestore: remove kludgey rocksdb preconditioning
This doesn't work, it's slow, and it's hacky.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-05 13:46:34 -05:00
Iain Buclaw
5f0bc2acbb pybind/rados: Add @requires for all aio methods
Signed-off-by: Iain Buclaw <iain.buclaw@sociomantic.com>
2016-12-05 19:06:48 +01:00
Sage Weil
7b1293e70d Merge pull request #12275 from xiexingguo/xxg-wip-bluestore-1202
os/bluestore: dedup omap_head, reuse nid instead

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-05 11:47:02 -05:00
Sage Weil
2041a187bf Merge pull request #12305 from athanatos/wip-ec-rbd-fixes
osd: fixes to make rbd on ec work

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-05 11:45:07 -05:00
Sage Weil
645119e7c9 Merge pull request #12306 from athanatos/wip-ec-scrub
osd: fix ec scrub errors

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-05 11:32:11 -05:00
Jason Dillaman
566d01bfd2 Merge pull request #12212 from trociny/wip-16991
rbd-mirror: recovering after split-brain

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-12-05 11:20:03 -05:00
Sage Weil
d75ffa4389 Merge pull request #12307 from athanatos/wip-18042
msg/simple/Pipe::stop_and_wait: unlock pipe_lock for stop_fast_dispatching()

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-05 11:18:47 -05:00
Ramesh Chander
d89df9dfe8 bitmap allocator dump functionality
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-12-05 06:30:11 -08:00
Abhishek Lekshmanan
232271bbf0 doc: release notes: add the last 5 prs making it in 10.2.4
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-12-05 15:14:12 +01:00
Loic Dachary
55df834e85 Merge pull request #12310 from wjin/change_info
mailmap: change personal info

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-12-05 15:03:03 +01:00