Commit Graph

70545 Commits

Author SHA1 Message Date
Jason Dillaman
a5d0d0ca08 qa/workunits: partial revert of commit 5b486d9
Testing for disk usage and diff extents for a sparsely written
imported RBD image cannot generically be handled across different
OSD object stores and RBD image features.

The only alternatives would include grepping the rbd CLI
debug log for specific invocations of aio_write or mocking
the rbd CLI for unit testing.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-04-07 21:06:37 -04:00
Jason Dillaman
2188a7b23b rbd: import-diff was attempting to write empty chunks
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-04-07 21:06:29 -04:00
Jason Dillaman
24ba996513 rbd: corrected typo in rbd export v2 section header
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-04-07 21:06:16 -04:00
Sage Weil
c8a6ed8c23 Merge pull request #14306 from liewegas/wip-bluestore-throttle-model
os/bluestore: unify throttling model

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2017-04-07 10:49:32 -05:00
Sage Weil
c38e83f69a os/bluestore: make deferred_aggressive a counter
Multiple threads may run _osr_drain_preceding; use a count to
prevent the first finisher from prematurely disabling
aggressive mode.

Fixes: http://tracker.ceph.com/issues/19542
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-07 11:31:21 -04:00
Kefu Chai
ee6132c607 Merge pull request #14387 from wjwithagen/wip-wjw-test-osd-dup
test/osd/CMakeLists.txt: osd-dup.sh require BlueStore/AIO

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-07 23:16:13 +08:00
Sage Weil
c43faf1dd2 Merge pull request #14348 from rzarzynski/wip-bs-bitmap-no-virts-in-hotspot
os/bluestore: avoid the VTABLE-related burden in BitMapAllocator's hotspot

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-07 09:39:18 -05:00
Kefu Chai
5624b19099 Merge pull request #14366 from wjin/clean_mgr
mgr: remove unused function declarations

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-07 16:16:37 +08:00
Willem Jan Withagen
aa4413198b test/osd/CMakeLists.txt: osd-dup.sh require BlueStore/AIO
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-04-07 10:05:25 +02:00
Kefu Chai
2950ad91d2 Merge pull request #14029 from dachary/wip-osd-crushmap
mon: osd crush set crushmap need sanity check

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-07 12:42:20 +08:00
Dan Mick
57b45024f6 Merge pull request #14334 from tchaikov/wip-cmake-ctags
cmake: Add simple recursive ctags target for Ceph source only

Reviewed-by: Dan Mick <dmick@redhat.com>
2017-04-06 19:34:05 -07:00
Haomai Wang
572281a10c Merge pull request #14320 from Adirl/poll_blocking
msg/async/rdma: Make poll_blocking() poll for async events in additio…

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-04-07 08:23:27 +08:00
Casey Bodley
bf461574b1 Merge pull request #14340 from oritwas/wip-rgw-fix-zone-create
radosgw-admin: use zone id when creating a zone

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-06 14:21:16 -04:00
Matt Benjamin
56e8b0ecb1 Merge pull request #14262 from guihecheng/rgw_file-fix-rmdir
rgw_file: fix missing unlock in unlink
2017-04-06 14:00:51 -04:00
Casey Bodley
d108f2db3f Merge pull request #14216 from dongbula/add-multi-zonegroup-for-test
rgw: add --num-zonegroups option for multi test

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-06 13:22:36 -04:00
Casey Bodley
80892760ec Merge pull request #14354 from mogeb/cmake-lttng
cmake: build tracepoint libraries for vstart target

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-06 13:09:40 -04:00
Sage Weil
bb6bef042f Merge pull request #14115 from liewegas/wip-bluestore-metadata
os/bluestore: implement collect_metadata
2017-04-06 10:16:17 -05:00
Sage Weil
7024b04bdf Merge pull request #14304 from rchagam/18576_bug_fix
tracing: fix segv

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-06 10:15:17 -05:00
Sage Weil
1d465facb4 Merge pull request #14328 from liewegas/wip-mgrmap-features
mgr: fix several init/re-init bugs

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-06 10:14:09 -05:00
Sage Weil
1ea9783781 Merge pull request #14333 from liewegas/wip-bluestore-misc
os/bluestore: misc fixes

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-04-06 10:13:43 -05:00
Amir Vadai
2386cea1eb msg/async/rdma: Make poll_blocking() poll for async events in addition to tx/rx
Issue: 995322
Change-Id: I62e75f4c4e574ba97e24b20a4d7b94c56c605bb5
Signed-off-by: Amir Vadai <amir@vadai.me>
2017-04-06 15:09:25 +00:00
Sage Weil
092aa00654 Merge pull request #14210 from liewegas/wip-osd-dup
os: allow offline conversion of filestore -> bluestore (or anything else)

Reviewed-by: David Zafman <dzafman@redhat.com>
2017-04-06 09:51:18 -05:00
Casey Bodley
d346b1b835 Merge pull request #12175 from dongbula/fix-slavezonegroup-cannot-enable-bucket-versioning
rgw: fix slave zonegroup cannot enable the bucket versioning

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-06 10:41:18 -04:00
Daniel Gryniewicz
6a43cddce2 Merge pull request #14342 from theanalyst/cleanup/rgw/rgw-lc-inc
rgw_lc: drop a bunch of unused headers
2017-04-06 10:22:00 -04:00
Casey Bodley
4e793bfd2b Merge pull request #13622 from zhangsw/feature-lifecycle-multipart
rgw: add support for multipart upload expiration.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-04-06 10:02:29 -04:00
Nathan Cutler
3c89ca8fb6 Merge pull request #14337 from smithfarm/wip-19492
common: support s390 and unknown architectures in spin-wait loop

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-04-06 15:25:53 +02:00
Matt Benjamin
69fe2f2718 Merge pull request #14339 from haklein/master
add RGW ldap auth documentation
2017-04-06 09:14:22 -04:00
Mohamad Gebai
22875e50cb cmake: build tracepoint libraries for vstart target
Avoid a segfault in TracepointProvider::verify_config() when building
for the 'vstart' target. TracepointProvider tries to load the tracepoint
providers libraries at runtime, but these aren't built as part of the
'vstart' target.

Signed-off-by: Mohamad Gebai <mgebai@suse.com>
2017-04-06 08:34:28 -04:00
Wei Jin
3f514bda1c mgr: clean nonused function declaration
Signed-off-by: Wei Jin <wjin.cn@gmail.com>
2017-04-06 19:11:17 +08:00
Nathan Cutler
2807d28c1a common: support s390 and unknown architectures in spin-wait loop
This fixes the s390 build which was broken by 34481768cb

It also reinstates the previous architecture-independent for-loop
implementation as a catch-all for "unknown" (not-explicitly-supported)
architectures.

Fixes: http://tracker.ceph.com/issues/19492
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-04-06 10:41:37 +02:00
Mykola Golub
af80ee62d6 Merge pull request #14240 from dillaman/wip-rbd-mirror-peer-uuids
rbd-mirror: pool watcher should track mirror uuid

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-04-06 11:02:26 +03:00
Loic Dachary
81527f237f Merge pull request #14293 from badone/wip-ceph-disk-list-selinux
ceph-disk: Populate mount options when running "list"

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-06 08:28:20 +02:00
Dan Mick
3681683df7 cmake: Add simple recursive ctags target for Ceph source only
Excludes submodules and random JavaScript.

Signed-off-by: Dan Mick <dan.mick@redhat.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-06 13:27:12 +08:00
Jason Dillaman
d3663113f8 Merge pull request #14032 from joscollin/wip-18511-returntype
librbd: changed the return type of ImageRequestWQ::discard()

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-05 20:12:42 -04:00
Jason Dillaman
184df4abcf Merge pull request #13957 from wangzhengyong/import
rbd: error out if import image format failed

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-05 20:11:33 -04:00
Jason Dillaman
d271e8c279 Merge pull request #13836 from gaurav36/bug-14535-rbd-snap-pool-name-validatation
rbd: validate pool and snap name optionals

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-05 20:10:20 -04:00
Yuri Weinstein
d302deb504 Merge pull request #14282 from wjwithagen/wip-wjw-freebsd-ceph-fuse
build: let FreeBSD build ceph-fuse

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-05 15:02:41 -07:00
Yuri Weinstein
618767b12a Merge pull request #14308 from badone/SyntheticClient_random_walk_warning
client/SyntheticClient.cc: Fix warning in random_walk

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-05 15:00:13 -07:00
Yuri Weinstein
04c5374d5e Merge pull request #10146 from yonghengdexin735/wip-zzz-filestore-write
os/filestore: handle error returned from write_fd()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-05 14:58:28 -07:00
Casey Bodley
39349a4fe9 Merge pull request #13815 from theanalyst/cleanup/rgw/rest-read-input
rgw: don't read all user input for a few param requests

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-05 14:30:14 -04:00
Sage Weil
2faa01bf86 mon/MgrMonitor: make debug prefix useful
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 11:58:57 -04:00
Radoslaw Zarzynski
796c34de91 os/bluestore: don't use virtual for accessing BitMapZone::is_exhausted.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-04-05 17:38:30 +02:00
Sage Weil
4652f34c5f os/bluestore: do not wake kv thread if only deferred events pending
No need to wake up if there is only deferred work; we can do
it lazily.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:26:56 -04:00
Sage Weil
36dd549893 os/bluestore: bluestore_deferred_batch_ops = 32 (not 8)
A bit more batching.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:26:56 -04:00
Sage Weil
b4b800f3e2 os/bluestore: unify throttling model
Implement a super simple model for the cost of a transaction
for the purposes of throttling.  This replaces two independent
throttles (one for transaction ops, one for bytes) and puts
them both under the 'bytes' throttle.  The txc model cost is
expressed in terms of bytes as this is probably the simplest
thing for users to reason about.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:26:56 -04:00
Sage Weil
5075b27f00 os/bluestore: release throttle before commit
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:26:56 -04:00
Sage Weil
0bd142b42c ceph_test_objectstore: error via derr too
This helps establish timing relative to the log.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
0541ee1e6c os/bluestore: increase aio queue depth
We've seen some reports of the aio EAGAIN backoff in logs; use a larger
aio ring buffer to reduce the risk of this.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
7499a87632 os/bluestore: reduce some debug level
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
554972ded2 os/bluestore: put fsck structures in mempools
This lets us track them individually in debug mode.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00