Commit Graph

70462 Commits

Author SHA1 Message Date
Mykola Golub
af80ee62d6 Merge pull request #14240 from dillaman/wip-rbd-mirror-peer-uuids
rbd-mirror: pool watcher should track mirror uuid

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-04-06 11:02:26 +03:00
Loic Dachary
81527f237f Merge pull request #14293 from badone/wip-ceph-disk-list-selinux
ceph-disk: Populate mount options when running "list"

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-06 08:28:20 +02:00
Jason Dillaman
d3663113f8 Merge pull request #14032 from joscollin/wip-18511-returntype
librbd: changed the return type of ImageRequestWQ::discard()

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-05 20:12:42 -04:00
Jason Dillaman
184df4abcf Merge pull request #13957 from wangzhengyong/import
rbd: error out if import image format failed

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-05 20:11:33 -04:00
Jason Dillaman
d271e8c279 Merge pull request #13836 from gaurav36/bug-14535-rbd-snap-pool-name-validatation
rbd: validate pool and snap name optionals

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-05 20:10:20 -04:00
Yuri Weinstein
d302deb504 Merge pull request #14282 from wjwithagen/wip-wjw-freebsd-ceph-fuse
build: let FreeBSD build ceph-fuse

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-05 15:02:41 -07:00
Yuri Weinstein
618767b12a Merge pull request #14308 from badone/SyntheticClient_random_walk_warning
client/SyntheticClient.cc: Fix warning in random_walk

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-05 15:00:13 -07:00
Yuri Weinstein
04c5374d5e Merge pull request #10146 from yonghengdexin735/wip-zzz-filestore-write
os/filestore: handle error returned from write_fd()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-05 14:58:28 -07:00
Casey Bodley
39349a4fe9 Merge pull request #13815 from theanalyst/cleanup/rgw/rest-read-input
rgw: don't read all user input for a few param requests

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-05 14:30:14 -04:00
Sage Weil
5f2db7f83b Merge pull request #14316 from liewegas/wip-bluestore-fsck-unused
os/bluestore: fsck: verify blob.unused field

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-04-05 09:22:51 -05:00
Sage Weil
703213b1f0 os/bluestore: use typedef for blob unused (uint16_t)
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:18:17 -04:00
Sage Weil
f49b1d24c6 os/bluestore: fsck: verify blob.unused field
Two checks:

- verify that no logical extents reference the portion of the
  blob marked unused, and
- verify that the csum (if present) is zero for any unused
  region.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:18:17 -04:00
Sage Weil
4759c705e9 Merge pull request #14157 from liewegas/wip-19379
os/bluestore: fix deferred writes vs collection split race

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-04-05 08:56:16 -05:00
Sage Weil
c618d22d25 Merge pull request #14258 from liewegas/wip-bluestore-tool
ceph-bluestore-tool: rename from bluefs-tool; improve usage
2017-04-05 08:55:36 -05:00
Sage Weil
d4525121c9 Merge pull request #14294 from tchaikov/wip-check-last-osd-report-if-luminous
mon/OSDMonitor: check last_osd_report only when the whole cluster is lu…

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-05 08:55:23 -05:00
Sage Weil
6f8cd66b94 Merge pull request #14303 from liewegas/wip-more-mgr-commands
mgr: move 'osd perf' and 'osd blocked-by' to mgr

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-05 08:55:03 -05:00
Casey Bodley
aad7e6e2da Merge pull request #14010 from zhangsw/fix-rgw-fetchremote-bug
rgw: version id doesn't work in fetch_remote_obj

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-05 09:38:41 -04:00
Loic Dachary
8a2cf69ec4 Merge pull request #13310 from ceph/wip-ceph-disk-fix
ceph-disk: Add fix subcommand

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-05 13:43:02 +02:00
Orit Wasserman
2e9609ddd2 Merge pull request #14314 from rzarzynski/wip-rgw-bulkupload-freebsd
rgw: switch to std::array in RGWBulkUploadOp due to C++11 and FreeBSD.
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-05 12:06:05 +03:00
Orit Wasserman
8d701f6417 Merge pull request #14252 from cbodley/wip-19409
radosgw-admin: new 'global quota' commands update period config
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-05 12:02:58 +03:00
Orit Wasserman
df253384e6 Merge pull request #14109 from cbodley/wip-rgw-stat-manifest
rgw: stat requests skip compression, manifest handling, etc
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-05 12:02:10 +03:00
Kefu Chai
24e69d79e7 Merge pull request #14281 from tchaikov/wip-19429
qa/tasks/workunit.py: use "overrides" as the default settings of workunit

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-04-05 10:01:27 +08:00
Haomai Wang
71c78b859a Merge pull request #14297 from Adirl/ibport
msg/async/rdma: Make port number an attribute of the Connection not o…

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-04-05 07:02:26 +08:00
Sage Weil
fe28add997 Merge pull request #13766 from dachary/wip-18962-ceph-disk-zap
ceph-disk: Write 10M to all partitions before zapping

Reviewed-by: Sébastien Han <seb@redhat.com>
2017-04-04 15:40:53 -05:00
Casey Bodley
5b377188ca Merge pull request #13998 from wangzhengyong/aio_complete
rgw: fix memory leak in delete_obj_aio

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 16:31:26 -04:00
Jason Dillaman
6be45f804b Merge pull request #12883 from mslovy/wip-rbd-import
rbd: import real thin-provision image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-04 16:12:05 -04:00
Casey Bodley
6cb94d550b Merge pull request #14327 from cbodley/wip-12863
rgw: switch from "timegm()" to "internal_timegm()" for better portability

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 16:11:12 -04:00
Sage Weil
f907d83140 Merge pull request #14190 from idryomov/wip-respect-epoch-barrier
osdc/Objecter: respect epoch barrier in _op_submit()

Reviewed-by: John Spray <john.spray@redhat.com>
2017-04-04 15:07:29 -05:00
Sage Weil
ad89fd8b3e Merge pull request #14220 from jcsp/wip-19407
mon: update mgrmap when active goes offline

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-04 15:06:59 -05:00
Casey Bodley
3c9df5582b Merge pull request #12437 from idealguo/remove-duplicate-flush
rgw: remove duplicate flush formatter

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 14:40:06 -04:00
Casey Bodley
606467bc1b Merge pull request #13934 from chuang-he/fix_copy_obj_data
rgw: fix configurable write obj window size

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 14:39:28 -04:00
Casey Bodley
1e8b763443 Merge pull request #11963 from zhangsw/fix-rgw-lifecycle-bug
rgw: LCWorker's worktime is not the same as config rgw_lifecycle_work_time.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-04-04 14:31:11 -04:00
Rishabh Kumar
a60c3dd995 Switch from "timegm()" to "internal_timegm()"
Changed timegm() to internal_timegm() for better portability

Fixes: http://tracker.ceph.com/issues/12863
Signed-off-by: Rishabh Kumar <kris.kr296@gmail.com>
2017-04-04 14:24:05 -04:00
Casey Bodley
b4c0fc73aa Merge pull request #14042 from pritha-srivastava/wip-rgw-fix-accounting
rgw: Added code to correctly account for bytes sent/ received during a 'PUT' operation.

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 14:19:27 -04:00
Casey Bodley
484e1a38f7 Merge pull request #14125 from zhangsw/fix-rgw-cache-normalname-bug
rgw: add pool namespace to cache's key so that system obj can have unique key

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 14:17:51 -04:00
Jason Dillaman
b1f1df4f37 Merge pull request #14072 from trociny/wip-notify
librbd: Notifier::notify API improvement

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-04 14:06:05 -04:00
Casey Bodley
f3d6c28a55 Merge pull request #14160 from Liuchang0812/wip-19363-fix-lc-two-response
rgw/lifecycle: do not send lifecycle rules when GetLifeCycle failed

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 13:22:15 -04:00
Radoslaw Zarzynski
6f1871bc85 rgw: switch to std::array in RGWBulkUploadOp due to C++11 and FreeBSD.
Before this patch RGWBulkUploadOp::terminal_errors was declared as
std::initializer_list<int>. Unfortunately, a constexpr constructor
for it is available since C++14, not C++11. This was causing build
failures on FreeBSD.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-04-04 18:24:20 +02:00
Sage Weil
f8f9094964 os/bluestore: do not extend blobs with unused bitmap
If we resize the blob we need to adjust the resolution of the
unused bitmap, and that is only possible for some bit patterns.
For now just ignore blobs with unused blocks.

Add an assert in add_tail() so that we don't forget that
add_tail is (probably) where we'd would do that adjustment.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-04 12:12:26 -04:00
Sage Weil
83e7b81737 os/bluestore: some whitespace
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-04 12:12:25 -04:00
Sage Weil
045acc3fb0 os/bluestore: mark_used for wctx->writes
The refactored blob reuse code needs to mark blobs used when
processing wctx->writes.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-04 12:12:25 -04:00
Sage Weil
31c550f7bd os/bluestore: prefix fsck errors with 'fsck error:'
Greppable!

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-04 11:28:29 -04:00
Amir Vadai
af2f1ecd27 msg/async/rdma: Make port number an attribute of the Connection not of the Device
Since multiple connections on different ports could exist, shouldn't use
device->active_port, instead use conn->ibport.
Or in other words, now Device object doesn't have an active_port,
instead every port specific action (create_qp, get_lid, get_gid etc.)
need to specify the port number. The information about the port number
is known to the connection (RDMAConnectedSocket*) who is the caller of
those actions.

Issue: 995322
Change-Id: I482cb87c04ba99845dc44f6dd0547835fe814ebf
Signed-off-by: Amir Vadai <amir@vadai.me>
2017-04-04 17:52:10 +03:00
Kefu Chai
c0e044c1bd Merge pull request #14310 from tchaikov/wip-yield-for-ppc
common/simple_spin: use __ppc_yield() on all powerpc archs

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Tested-by: Andrew Solomon <asolomon@us.ibm.com>
2017-04-04 21:58:30 +08:00
Kefu Chai
ffea11550e Merge pull request #14289 from tchaikov/wip-conditionalize-crc32c
cmake,crc32c: conditionalize crc32c on different archs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Tested-by: Andrew Solomon <asolomon@us.ibm.com>
2017-04-04 21:57:22 +08:00
Loic Dachary
9f64925658 Merge pull request #14275 from ceph/evelu-cephdisk-race
ceph-disk: Adding retry loop in get_partition_dev()

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-04 14:17:18 +02:00
Kefu Chai
06cf99cbcd Merge pull request #14185 from DHB-liuhong/objects
mon/PGMap: make si units more readable in PGMap summary

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-04 19:10:16 +08:00
Kefu Chai
d7d32be097 Merge pull request #14313 from wjin/clean_mgr
mgr: rm nonused main function

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-04 19:01:50 +08:00
Erwan Velu
93e7b95ed8 ceph-disk: Adding retry loop in get_partition_dev()
There is very rare cases where get_partition_dev() is called before the actual partition is available in /sys/block/<device>.

It appear that waiting a very short is usually enough to get the partition beein populated.

Analysis:
update_partition() is supposed to be enough to avoid any racing between events sent by parted/sgdisk/partprobe and
the actual creation on the /sys/block/<device>/* entrypoint.
On our CI that race occurs pretty often but trying to reproduce it locally never been possible.

This patch is almost a workaround rather than a fix to the real problem.
It offer retrying after a very short to be make a chance the device to appear.
This approach have been succesful on the CI.

Note his patch is not changing the timing when the device is perfectly created on time and just differ by a 1/5th up to 2 seconds when the bug occurs.

A typical output from the build running on a CI with that code.
	command_check_call: Running command: /usr/bin/udevadm settle --timeout=600
	get_dm_uuid: get_dm_uuid /dev/sda uuid path is /sys/dev/block/8:0/dm/uuid
	get_partition_dev: Try 1/10 : partition 2 for /dev/sda does not in /sys/block/sda
	get_partition_dev: Found partition 2 for /dev/sda after 1 tries
        get_dm_uuid: get_dm_uuid /dev/sda uuid path is /sys/dev/block/8:0/dm/uuid
	get_dm_uuid: get_dm_uuid /dev/sda2 uuid path is /sys/dev/block/8:2/dm/uuid

fixes: #19428

Signed-off-by: Erwan Velu <erwan@redhat.com>
2017-04-04 12:46:46 +02:00
Wei Jin
3f857b9ae4 mgr: rm nonused main function
Signed-off-by: Wei Jin <wjin.cn@gmail.com>
2017-04-04 17:47:56 +08:00