Commit Graph

66841 Commits

Author SHA1 Message Date
Sage Weil
4e23550bb2 Merge pull request #12333 from xiexingguo/xxg-wip-bluestore-1206
os/bluestore: fix potential csum_order overflow

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-14 01:07:37 -06:00
Sage Weil
6b6af6cfd4 Merge pull request #12382 from dachary/wip-18092-gf-complete
erasure-code: synchronize with upstream gf-complete
2016-12-14 01:06:47 -06:00
Sage Weil
3faf8b8466 CMakeLists: add vstart-base target
No mds or radosgw.  Add rados CLI.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-14 00:51:25 -06:00
Sage Weil
80ac7b124b Merge pull request #12459 from runsisi/wip-ec-minor-cleanup
osd/ECBackend: minor cleanup to remove duplicate code

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-13 20:08:55 -06:00
Sage Weil
581a8c6310 Merge remote-tracking branch 'gh/kraken' 2016-12-13 17:48:47 -06:00
Matt Benjamin
4092c97ee5 rgw: custom headers: use boost::container::flat_map
Use this occasion of serialized map to implement encoders
for boost::container::flat_map, which is optimized for
in-order insertion.

After some discussion, I'm proposing to just add the new template
forms, rather than (e.g.) adding either a large amount of
specialization machinery, or alternatively using C-style
macros.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-12-13 18:14:13 -05:00
Matt Benjamin
b82919a152 rgw: add rgw_log_http_headers option
Tracks headers that should be handled conditionally (currently,
can only log, so using minimal structure to represent the
mapping).

Adds map of custom headers to rgw_log_entry, and populate it with
headers pre-selected for custom logging in RGWREST.  Added to encoder
and Formatter output.

Some additional optimization possible.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-12-13 18:13:42 -05:00
Jason Dillaman
7d743bfce6 librbd: block concurrent in-flight object map updates for the same object
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-12-13 16:57:59 -05:00
Jason Dillaman
b1d624b43e librbd: new block guard helper to prevent concurrent IO to blocks
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-12-13 16:57:59 -05:00
Jason Dillaman
ea7b30a4fb librbd: convert ObjectMap to template for unit testing
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-12-13 16:57:59 -05:00
Jason Dillaman
477ae54a56 librbd: clean up object map update interface
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-12-13 16:57:59 -05:00
Jason Dillaman
378b810cba librbd: update in-memory object map after on-disk update committed
Concurrent IO to the same object would previously result in the first
IO pausing to update the object map while the other IO would proceed
to directly update the object before the object map state was properly
updated.

Fixes: http://tracker.ceph.com/issues/16176
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-12-13 16:57:59 -05:00
Jason Dillaman
b82a1c1d1f journal: avoid logging an error when a watch is blacklisted
Fixes: http://tracker.ceph.com/issues/18243
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-12-13 14:40:23 -05:00
Sage Weil
c6198c3e7e Merge pull request #12447 from ifed01/wip-bluestore-fix-reshard2
os/bluestore: avoid resharding if the last shard size fall below shar…

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Somnath Roy <somnath.roy@sandisk.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-13 11:47:42 -06:00
Kefu Chai
0be3f5f72e Merge pull request #12289 from liewegas/wip-pg-down
osd/PG: add "down" pg state (distinct from down+peering)

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-12-13 22:46:16 +08:00
Kefu Chai
c0e6171c95 Merge pull request #12389 from ovh/wip-rework-recovery-priorities
osd: Increase priority for inactive PGs backfill

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-13 22:44:52 +08:00
Kefu Chai
11733614b8 Merge pull request #12352 from kylinstorage/wip-cleanup-mark-queued
osd: mark queued flag for op

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-13 22:44:22 +08:00
Igor Fedotov
353060638c os/bluestore: avoid resharding if the last shard size fall below shard min size
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2016-12-13 13:41:41 +00:00
runsisi
fe7d068180 ECBackend: minor cleanup to remove duplicate code
Signed-off-by: runsisi <runsisi@zte.com.cn>
2016-12-13 16:27:16 +08:00
Pan Liu
ff718c8b09 osd: remove the lock heartbeat_update_lock, and change heatbeat_need_update to atomic_bool
Signed-off-by: Pan Liu <pan.liu@istuary.com>
2016-12-13 16:27:14 +08:00
Kefu Chai
a3bf341876 Merge pull request #12294 from dx9/test-ecp-uname
test: use uname -m vs. uname -p in test-erasure-code-plugins.sh

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-13 10:56:14 +08:00
John Spray
8fdae47fd3 tasks/cephfs: set norequire_active_mds on kclient
The kernel client's cluster availability test is
more primitive than the fuse client, so we need
to switch it off to avoid client mounts failing
while MDSs are still coming up.

Fixes: http://tracker.ceph.com/issues/18161
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-13 01:05:25 +00:00
David Zafman
85e0774a7d test: Update for new error message when doing scrub with deep-scrub errors
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-12-12 15:53:25 -08:00
Casey Bodley
73cd8df887 rgw: use explicit flag to cancel RGWCoroutinesManager::run()
RGWCoroutinesManager::run() was setting ret = -ECANCELED to break out of
the loop when it sees going_down. coroutines that failed with -ECANCELED
were confusing this logic and leading to coroutine deadlock assertions
below. when we hit the going_down case, set a 'canceled' flag, and check
that flag when deciding whether to break out of the loop

Fixes: http://tracker.ceph.com/issues/17465

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-12-12 16:42:17 -05:00
Jason Dillaman
857dfee932 Merge pull request #1304 from vshankar/wip-15028
cram: support fetching from sha1 branch, tag, commit hash

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-12-12 16:29:54 -05:00
Sage Weil
df052e791c Merge pull request #12450 from athanatos/wip-18180
osd/ReplicatedPG::record_write_error: don't leak orig_reply on cancel

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-12 14:20:27 -06:00
Samuel Just
3b07638c6e Merge pull request #12402 from liewegas/wip-scrub-recovery
osd: default osd_scrub_during_recovery=false

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-12-12 11:30:18 -08:00
Sage Weil
ec3d62b6c3 Merge pull request #12448 from theanalyst/doc/11.1.0-rc
doc: final additions to 11.1.0-rc release notes

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-12 13:25:08 -06:00
Abhishek Lekshmanan
1e31aee432 doc: final additions to 11.1.0-rc release notes
Signed-off-by: Abhishek Lekshmanan <alekshmanan@suse.com>
2016-12-12 19:33:13 +01:00
Jenkins Build Slave User
91421d8d04 11.1.0 2016-12-12 18:27:56 +00:00
Sage Weil
63249312c2 Merge pull request #1305 from ceph/wip-h-j-x
upgrade/hammer-jewel-x: whitelist quota
2016-12-12 11:37:30 -06:00
Sage Weil
9c31801188 upgrade/hammer-jewel-x: whitelist quota
This is from teh librados api test.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-12 12:29:09 -05:00
Kefu Chai
51342e87ff Merge pull request #10209 from runsisi/sisi-wip-remove-redundant-check
osd/ReplicatedPG: remove redundant check for balance/localize read

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Samuel Just <sjust@redhat.com>
2016-12-13 00:21:46 +08:00
Kefu Chai
2bdf59303b Merge pull request #12190 from liupan1111/wip-speed-up-acting-ods
osd/OSDMap: improve the performance of pg_to_acting_osds

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-13 00:18:55 +08:00
Kefu Chai
6af0c8fc04 Merge pull request #12279 from wjwithagen/wip-wjw-freebsd-ENODATA-2
os/filestore/chain_xattr.h:uses ENODATA, so include compat.h

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-13 00:08:02 +08:00
Kefu Chai
d89e2fca63 Merge pull request #12365 from liewegas/wip-mon-flag-warning
mon/OSDMonitor: only show interesting flags in health warning

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-13 00:06:56 +08:00
Kefu Chai
1b533f8e26 Merge pull request #12439 from tchaikov/wip-pybind-requires
pybind/rados: add missing "length" requires for aio_execute()

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-12-13 00:05:07 +08:00
Kefu Chai
9418e07069 Merge pull request #12390 from tchaikov/wip-start-after-setting-nonce
msg/async: set nonce before starting the workers

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-12-13 00:03:01 +08:00
Kefu Chai
106115dac3 Merge pull request #12309 from wjwithagen/wip-wjw-freebsd-CLOCK_MONOTONE
rgw/rgw_file.cc: Add compat.h to allow CLOCK_MONOTONE

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2016-12-13 00:02:10 +08:00
Kefu Chai
55e18d2e5f Merge pull request #12257 from kylinstorage/wip-remove-unneeded-forward-declaration
remove unneeded forward declaration

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-13 00:01:19 +08:00
Kefu Chai
405e94ab8e Merge pull request #12301 from wjwithagen/wip-wjw-freebsd-blkid
src/test/CMakeLists.txt: Exclude test on HAVE_BLKID

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-13 00:00:33 +08:00
David Zafman
836d896868 Merge pull request #12378 from dzafman/wip-18139
test: Don't write to a poolid that this test might not have created

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-12 07:56:24 -08:00
Mykola Golub
b1181c7088 Merge pull request #12371 from ceph/wip-18149
qa/workunits/rbd: use more recent qemu-iotests that support Xenial

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-12-12 16:17:13 +02:00
John Spray
57ac1af88f mds: make cache size health warning factor configurable
...now that it's used more than once place, copying around
the fraction was bad.

Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-12 12:02:43 +00:00
John Spray
6b578e7f25 mds: release pool allocator memory after exceeding size limit
Usually we like keeping the memory in our pools, but in circumstances
where we have violated our self-imposed inode count cap, we should
shrink our usage of system memory afterwards.

Fixes: http://tracker.ceph.com/issues/18225
Signed-off-by: John Spray <john.spray@redhat.com>
2016-12-12 12:02:40 +00:00
Brad Hubbard
ba421b5725 Merge pull request #12436 from badone/wip-cov1395747
crush: Silence coverity warnings for test/crush/crush.cc

Reviewed-by: xiexingguo <xie.xingguo@zte.com.cn>
2016-12-12 14:41:41 +10:00
Kefu Chai
2bb42d9c7f Merge pull request #12409 from tchaikov/wip-doc-releases
doc/releases: add links to kraken and v10.2.4

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2016-12-12 12:39:13 +08:00
Kefu Chai
2126436294 pybind/rados: add missing "length" requires for aio_execute()
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-12-12 11:24:44 +08:00
songbaisen
a3fda1d721 mon: make it more clearly to debug for paxos state
Signed-off-by:song baisen <song.baisen@zte.com.cn>
2016-12-12 09:10:55 +08:00
Brad Hubbard
efbe45fe47 crush: Silence coverity warnings for test/crush/crush.cc
Coverity 1395747 reports that "c" leaks. Switching to smart pointers should
resolve that.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2016-12-12 09:16:33 +10:00