Commit Graph

70721 Commits

Author SHA1 Message Date
Jason Dillaman
d271e8c279 Merge pull request #13836 from gaurav36/bug-14535-rbd-snap-pool-name-validatation
rbd: validate pool and snap name optionals

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-05 20:10:20 -04:00
Yuri Weinstein
d302deb504 Merge pull request #14282 from wjwithagen/wip-wjw-freebsd-ceph-fuse
build: let FreeBSD build ceph-fuse

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-05 15:02:41 -07:00
Yuri Weinstein
618767b12a Merge pull request #14308 from badone/SyntheticClient_random_walk_warning
client/SyntheticClient.cc: Fix warning in random_walk

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-05 15:00:13 -07:00
Yuri Weinstein
04c5374d5e Merge pull request #10146 from yonghengdexin735/wip-zzz-filestore-write
os/filestore: handle error returned from write_fd()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-05 14:58:28 -07:00
Willem Jan Withagen
e8f03e205d core: Prefix /proc/ with FreeBSD emulation
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-04-05 21:36:22 +02:00
Casey Bodley
7f2871fe59 rgw: allow larger payload for period commit
testing with 3 zonegroups and 3 zones each, the period json grew larger
than 4k and caused decode failures on period commit

updated to use the new config variable rgw_max_put_param_size

Fixes: http://tracker.ceph.com/issues/19505

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-04-05 14:32:43 -04:00
Casey Bodley
39349a4fe9 Merge pull request #13815 from theanalyst/cleanup/rgw/rest-read-input
rgw: don't read all user input for a few param requests

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-05 14:30:14 -04:00
Sage Weil
2faa01bf86 mon/MgrMonitor: make debug prefix useful
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 11:58:57 -04:00
Radoslaw Zarzynski
796c34de91 os/bluestore: don't use virtual for accessing BitMapZone::is_exhausted.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-04-05 17:38:30 +02:00
Sage Weil
4652f34c5f os/bluestore: do not wake kv thread if only deferred events pending
No need to wake up if there is only deferred work; we can do
it lazily.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:26:56 -04:00
Sage Weil
36dd549893 os/bluestore: bluestore_deferred_batch_ops = 32 (not 8)
A bit more batching.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:26:56 -04:00
Sage Weil
b4b800f3e2 os/bluestore: unify throttling model
Implement a super simple model for the cost of a transaction
for the purposes of throttling.  This replaces two independent
throttles (one for transaction ops, one for bytes) and puts
them both under the 'bytes' throttle.  The txc model cost is
expressed in terms of bytes as this is probably the simplest
thing for users to reason about.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:26:56 -04:00
Sage Weil
5075b27f00 os/bluestore: release throttle before commit
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:26:56 -04:00
Sage Weil
0bd142b42c ceph_test_objectstore: error via derr too
This helps establish timing relative to the log.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
0541ee1e6c os/bluestore: increase aio queue depth
We've seen some reports of the aio EAGAIN backoff in logs; use a larger
aio ring buffer to reduce the risk of this.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
7499a87632 os/bluestore: reduce some debug level
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
554972ded2 os/bluestore: put fsck structures in mempools
This lets us track them individually in debug mode.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
6af489121b mempool: do not skip first 2 mempools
This broke when we sorted the pool definitions in the header.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
066514c37c os/bluestore: flush osr even on failure in _deferred_replay
This is one less thing for fsck to worry about.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
c67e9e2530 os/bluestore: trim cache during fsck
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
f7a51d35a9 os/bluestore: be noisy about bitmap init (it's slow!)
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
5f2db7f83b Merge pull request #14316 from liewegas/wip-bluestore-fsck-unused
os/bluestore: fsck: verify blob.unused field

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-04-05 09:22:51 -05:00
Sage Weil
703213b1f0 os/bluestore: use typedef for blob unused (uint16_t)
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:18:17 -04:00
Sage Weil
f49b1d24c6 os/bluestore: fsck: verify blob.unused field
Two checks:

- verify that no logical extents reference the portion of the
  blob marked unused, and
- verify that the csum (if present) is zero for any unused
  region.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:18:17 -04:00
Sage Weil
4759c705e9 Merge pull request #14157 from liewegas/wip-19379
os/bluestore: fix deferred writes vs collection split race

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-04-05 08:56:16 -05:00
Sage Weil
c618d22d25 Merge pull request #14258 from liewegas/wip-bluestore-tool
ceph-bluestore-tool: rename from bluefs-tool; improve usage
2017-04-05 08:55:36 -05:00
Sage Weil
d4525121c9 Merge pull request #14294 from tchaikov/wip-check-last-osd-report-if-luminous
mon/OSDMonitor: check last_osd_report only when the whole cluster is lu…

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-05 08:55:23 -05:00
Sage Weil
6f8cd66b94 Merge pull request #14303 from liewegas/wip-more-mgr-commands
mgr: move 'osd perf' and 'osd blocked-by' to mgr

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-05 08:55:03 -05:00
Casey Bodley
aad7e6e2da Merge pull request #14010 from zhangsw/fix-rgw-fetchremote-bug
rgw: version id doesn't work in fetch_remote_obj

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-05 09:38:41 -04:00
liuchang0812
7a3fbbfac6 rgw: use is_truncated to judge whether get all bucket already
That use is_truncated is simple and avoid nessesary list. We have to iterate 11
times initially if there is 100 buckets and iter_max_bucket is 10. We only need
10 times now.

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-04-05 20:06:11 +08:00
liuchang0812
00cdfce27c rgw/rgw_bucket: update is_truncated option in rgw_read_user_buckets function
The function called `rgw_read_user_buckets` has one option `bool *is_truncated`
which should be updated, and we could use `is_truncated` to avoid unnessesary
iteration.

Fixes: http://tracker.ceph.com/issues/19365

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-04-05 19:44:47 +08:00
Loic Dachary
8a2cf69ec4 Merge pull request #13310 from ceph/wip-ceph-disk-fix
ceph-disk: Add fix subcommand

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-05 13:43:02 +02:00
Abhishek Lekshmanan
036d7af16f rgw_lc: drop a bunch of unused headers
Dropping headers that are already included as a part of rgw_common

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-04-05 13:20:41 +02:00
Zhang Shaowen
433297d500 rgw: add support for multipart upload expiration.
Fixes: http://tracker.ceph.com/issues/19088

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-04-05 19:01:35 +08:00
Orit Wasserman
3fea36d635 radosgw-admin: use zone id when creating a zone
Fixes: http://tracker.ceph.com/issues/19498
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-04-05 13:42:36 +03:00
Harald Klein
864db8e5ee add RGW ldap auth documentation
Signed-off-by: Harald Klein <hari@vt100.at>
2017-04-05 12:01:48 +02:00
Orit Wasserman
2e9609ddd2 Merge pull request #14314 from rzarzynski/wip-rgw-bulkupload-freebsd
rgw: switch to std::array in RGWBulkUploadOp due to C++11 and FreeBSD.
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-05 12:06:05 +03:00
Orit Wasserman
8d701f6417 Merge pull request #14252 from cbodley/wip-19409
radosgw-admin: new 'global quota' commands update period config
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-05 12:02:58 +03:00
Orit Wasserman
df253384e6 Merge pull request #14109 from cbodley/wip-rgw-stat-manifest
rgw: stat requests skip compression, manifest handling, etc
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-05 12:02:10 +03:00
Loic Dachary
3f8efee390 mon: implement osd crush class create/rm/ls
Signed-off-by: Loic Dachary <loic@dachary.org>
2017-04-05 09:22:24 +02:00
Loic Dachary
e7d91eb4e8 crush: implement class_is_in_use/remove_class_name
Signed-off-by: Loic Dachary <loic@dachary.org>
2017-04-05 09:22:24 +02:00
Loic Dachary
f94d6b449a mon: osd crush set-device-class
Signed-off-by: Loic Dachary <loic@dachary.org>
2017-04-05 09:22:24 +02:00
Loic Dachary
8131c788b7 crush: implement update_device_class
Change the device class of a given device. The class must already exist.

Signed-off-by: Loic Dachary <loic@dachary.org>
2017-04-05 09:21:50 +02:00
Sarit Zubakov
89dfc561f1 src/msg/async: Update fix broken compilation for Posix
This commit relates to PR#13940

issue: 1010987

Change-Id: I402812adcf816c145356f0b98cfd1869c4cd5400
Signed-off-by: Sarit Zubakov <saritz@mellanox.com>
2017-04-05 06:48:27 +00:00
Sage Weil
fe41eee4f9 os/bluestore/KernelDevice: assume rotational if we can't get devname
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-04 23:39:42 -04:00
Kefu Chai
24e69d79e7 Merge pull request #14281 from tchaikov/wip-19429
qa/tasks/workunit.py: use "overrides" as the default settings of workunit

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-04-05 10:01:27 +08:00
Haomai Wang
71c78b859a Merge pull request #14297 from Adirl/ibport
msg/async/rdma: Make port number an attribute of the Connection not o…

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-04-05 07:02:26 +08:00
Sage Weil
fe28add997 Merge pull request #13766 from dachary/wip-18962-ceph-disk-zap
ceph-disk: Write 10M to all partitions before zapping

Reviewed-by: Sébastien Han <seb@redhat.com>
2017-04-04 15:40:53 -05:00
Casey Bodley
5b377188ca Merge pull request #13998 from wangzhengyong/aio_complete
rgw: fix memory leak in delete_obj_aio

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 16:31:26 -04:00
Jason Dillaman
6be45f804b Merge pull request #12883 from mslovy/wip-rbd-import
rbd: import real thin-provision image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-04 16:12:05 -04:00