Commit Graph

70384 Commits

Author SHA1 Message Date
Douglas Fuller
cb86740a5f cephfs: Permit recovering metadata into a new RADOS pool
Add a procedure that permits reconstructing metadata in a potentially
damaged cephfs metadata pool and writing the results into a
freshly-initialized pool that refers to the same data pool. Add option
flags to override checks that would ordinarily prevent this and add
options to the recovery tools to write output to a separate pool instead of
the one selected for recovery. See docs/cephfs/disaster-recovery.rst for
details.

Fixes: http://tracker.ceph.com/issues/15068
Fixes: http://tracker.ceph.com/issues/15069
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-04-04 12:29:01 -07:00
Douglas Fuller
8757f603bf mon/cephfs: Warn about overlaying CephFS metadata pools
Don't allow creation of filesystems with overlaying metadata pools unless
the user passes --allow-dangerous-pool-overlay.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-04-04 12:29:01 -07:00
Casey Bodley
3c9df5582b Merge pull request #12437 from idealguo/remove-duplicate-flush
rgw: remove duplicate flush formatter

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 14:40:06 -04:00
Casey Bodley
606467bc1b Merge pull request #13934 from chuang-he/fix_copy_obj_data
rgw: fix configurable write obj window size

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 14:39:28 -04:00
Casey Bodley
1e8b763443 Merge pull request #11963 from zhangsw/fix-rgw-lifecycle-bug
rgw: LCWorker's worktime is not the same as config rgw_lifecycle_work_time.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-04-04 14:31:11 -04:00
Casey Bodley
b4c0fc73aa Merge pull request #14042 from pritha-srivastava/wip-rgw-fix-accounting
rgw: Added code to correctly account for bytes sent/ received during a 'PUT' operation.

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 14:19:27 -04:00
Casey Bodley
484e1a38f7 Merge pull request #14125 from zhangsw/fix-rgw-cache-normalname-bug
rgw: add pool namespace to cache's key so that system obj can have unique key

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 14:17:51 -04:00
Jason Dillaman
b1f1df4f37 Merge pull request #14072 from trociny/wip-notify
librbd: Notifier::notify API improvement

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-04 14:06:05 -04:00
Casey Bodley
f3d6c28a55 Merge pull request #14160 from Liuchang0812/wip-19363-fix-lc-two-response
rgw/lifecycle: do not send lifecycle rules when GetLifeCycle failed

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 13:22:15 -04:00
Kefu Chai
c0e044c1bd Merge pull request #14310 from tchaikov/wip-yield-for-ppc
common/simple_spin: use __ppc_yield() on all powerpc archs

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Tested-by: Andrew Solomon <asolomon@us.ibm.com>
2017-04-04 21:58:30 +08:00
Kefu Chai
ffea11550e Merge pull request #14289 from tchaikov/wip-conditionalize-crc32c
cmake,crc32c: conditionalize crc32c on different archs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Tested-by: Andrew Solomon <asolomon@us.ibm.com>
2017-04-04 21:57:22 +08:00
Loic Dachary
9f64925658 Merge pull request #14275 from ceph/evelu-cephdisk-race
ceph-disk: Adding retry loop in get_partition_dev()

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-04 14:17:18 +02:00
Kefu Chai
06cf99cbcd Merge pull request #14185 from DHB-liuhong/objects
mon/PGMap: make si units more readable in PGMap summary

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-04 19:10:16 +08:00
Kefu Chai
d7d32be097 Merge pull request #14313 from wjin/clean_mgr
mgr: rm nonused main function

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-04 19:01:50 +08:00
Erwan Velu
93e7b95ed8 ceph-disk: Adding retry loop in get_partition_dev()
There is very rare cases where get_partition_dev() is called before the actual partition is available in /sys/block/<device>.

It appear that waiting a very short is usually enough to get the partition beein populated.

Analysis:
update_partition() is supposed to be enough to avoid any racing between events sent by parted/sgdisk/partprobe and
the actual creation on the /sys/block/<device>/* entrypoint.
On our CI that race occurs pretty often but trying to reproduce it locally never been possible.

This patch is almost a workaround rather than a fix to the real problem.
It offer retrying after a very short to be make a chance the device to appear.
This approach have been succesful on the CI.

Note his patch is not changing the timing when the device is perfectly created on time and just differ by a 1/5th up to 2 seconds when the bug occurs.

A typical output from the build running on a CI with that code.
	command_check_call: Running command: /usr/bin/udevadm settle --timeout=600
	get_dm_uuid: get_dm_uuid /dev/sda uuid path is /sys/dev/block/8:0/dm/uuid
	get_partition_dev: Try 1/10 : partition 2 for /dev/sda does not in /sys/block/sda
	get_partition_dev: Found partition 2 for /dev/sda after 1 tries
        get_dm_uuid: get_dm_uuid /dev/sda uuid path is /sys/dev/block/8:0/dm/uuid
	get_dm_uuid: get_dm_uuid /dev/sda2 uuid path is /sys/dev/block/8:2/dm/uuid

fixes: #19428

Signed-off-by: Erwan Velu <erwan@redhat.com>
2017-04-04 12:46:46 +02:00
Wei Jin
3f857b9ae4 mgr: rm nonused main function
Signed-off-by: Wei Jin <wjin.cn@gmail.com>
2017-04-04 17:47:56 +08:00
Nathan Cutler
26c1b4c2d7 Merge pull request #14174 from shinobu-x/wp-sk-typo-osdmonitor-20170328
mon/OSDMonitor: Clean up: delete extra S signature for plural

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-04 08:37:09 +02:00
Kefu Chai
7f2ac2334a crc32c,compressor: only compile functions on supported arch
so we can still compile if certain header file (<sys/auxv.h>) used
for detecting cpu capabilities on ppc is missing on x86 host machine.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-04 11:38:29 +08:00
Kefu Chai
58e173c54d common/simple_spin: use __ppc_yield() on all powerpc archs
__ppc_yield() is declared in sys/platform/ppc.h by glibc, for better
portability we just use the inlined assembly here. the shared resource
hints are supported by PowerPC ISA 2.06 but on older PowerPC cores, they
are no-ops. so it's fine to do this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-04 11:23:48 +08:00
Orit Wasserman
14867ad398 Merge pull request #12243 from rzarzynski/wip-rgw-bulkupload
rgw: add support for the BulkUpload of Swift API
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-03 21:54:32 +03:00
Yehuda Sadeh
e18b2f26e9 Merge pull request #14120 from wangzhengyong/uninitialized
rgw: fix uninitialized fields

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-04-03 11:33:23 -07:00
Sage Weil
7b7402f695 Merge pull request #14217 from Liuchang0812/wip-18584-pg-info-dump
osd: print pg_info_t::purged_snaps as array, not string

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-03 10:46:36 -05:00
John Spray
2bf485d366 Merge pull request #14036 from batrick/mds-debug-reply
mds: bump client_reply debug to match client_req

Reviewed-by: Yan, Zheng <zyan@redhat.com>
2017-04-03 16:20:19 +01:00
Loic Dachary
21f5737d4a Merge pull request #14296 from theanalyst/fix/script/credits
script: drop the -x arg for credits script

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-03 17:03:12 +02:00
Sage Weil
c3d1333794 Merge pull request #13401 from liewegas/wip-kill-subop
osd: kill all remaining MOSDSubOp users

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-04-03 10:00:53 -05:00
John Spray
531118fbe8 Merge pull request #14221 from jcsp/wip-19253-b
qa: whitelist another fullness log message

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-04-03 15:31:29 +01:00
Sage Weil
aec22a7d57 Merge pull request #14279 from jimmyway/wip-fix-pg-comment
osd: fix comments about pg refs and lock

Reviewed-by: Pan Liu <liupan1111@gmail.com>
2017-04-03 09:27:13 -05:00
Sage Weil
f5803eb7b3 Merge pull request #14277 from atheism/fix-test-objectstore-chain_xattr
test: objectstore: chain_xattr: fix wrong memset usage to fill buf

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-03 09:26:30 -05:00
Sage Weil
4d888d491e Merge pull request #13800 from xiexingguo/wip-clean-pgcreate-throttle
common/config_opts.h: kill mon_pg_create_interval

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-03 08:38:07 -05:00
Radoslaw Zarzynski
51dd349d65 Merge pull request #13621 from Jing-Scott/add-remov-x-delete-feature
rgw: add the remove-x-delete feature to cancel swift object expiration

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-04-03 15:19:12 +02:00
John Spray
13e8315d1a Merge pull request #13862 from jcsp/wip-16523
qa, mds: add checks for fragmentation, and enable it by default
2017-04-03 11:56:37 +01:00
Shinobu Kinjo
daae49f959 mon/OSDMonitor: Clean up: delete extra S signature for plural
Signed-off-by: Shinobu Kinjo <shinobu@redhat.com>
2017-04-03 19:28:21 +09:00
Nathan Cutler
c35a72173f Merge pull request #14156 from smithfarm/release-notes-add-rbd-mirror
tools: ceph-release-notes: prefixes and pep8 compliance

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-04-03 12:16:17 +02:00
Abhishek Lekshmanan
f40b8afaca script: drop the -x arg for credits script
while useful for debugging creates a whole lot of output which we don't
need normally

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-04-03 11:57:34 +02:00
Orit Wasserman
0c4c0c892d Merge pull request #12084 from hansbogert/patch-4
rgw: Add --zonegroup-new-name  in usage
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-03 10:21:25 +03:00
Kefu Chai
65c85823a3 Merge pull request #14269 from liewegas/wip-no-spinlock
mon/OSDMonitor: spinlock -> std::mutex

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-03 15:16:58 +08:00
Kefu Chai
d79d85bca5 Merge pull request #14274 from liewegas/wip-osd-beacon-fix
osd: fix some osd beacon bugs

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-03 15:16:05 +08:00
Haomai Wang
2900ba5568 Merge pull request #14288 from Adirl/small_leaks
msg/async/rdma: Fix small memory leaks detected by valgrind

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-04-03 04:28:56 +08:00
Kefu Chai
3ebe721a91 cmake: point to asm_compiler to yasm only if HAVE_INTEL
as currently only isa uses it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-03 01:44:18 +08:00
Kefu Chai
195425c9ca cmake: extract ppc64le detection into SIMDExt.cmake
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-03 01:44:17 +08:00
Radoslaw Zarzynski
2189c63e35 rgw: add the check for Content-Length in BulkUpload.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-04-02 18:35:22 +02:00
Radoslaw Zarzynski
06b9a84851 rgw: implement the full response generation in BulkUpload of Swift API.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-04-02 18:35:22 +02:00
Radoslaw Zarzynski
3770e2473b rgw: optimize metadata caching in BulkUpload of Swift API.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-04-02 18:35:22 +02:00
Radoslaw Zarzynski
0c4d1dfabf rgw: implement the object creation in BulkUpload of Swift API.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-04-02 18:35:22 +02:00
Radoslaw Zarzynski
e9afe38665 rgw: implement the container creation in BulkUpload of Swift API.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-04-02 18:35:21 +02:00
Amir Vadai
23fd3efaaf msg/async/rdma: Fix small memory leaks detected by valgrind
Issue: 995322
Change-Id: Iccffbd0defd09aa51c4b51b78733921444ea1c5f
Signed-off-by: Amir Vadai <amir@vadai.me>
2017-04-02 16:47:46 +03:00
Radoslaw Zarzynski
6c1bb7a10e rgw: implement the AlignedStreamGetter.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-04-02 15:46:13 +02:00
Radoslaw Zarzynski
9ed7edaaf7 rgw: implement the basic security check for BulkUpload of Swift API.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-04-02 15:46:13 +02:00
Kefu Chai
ef006681b7 Merge pull request #14170 from liewegas/wip-fewer-warnings
common/ceph_context: fewer warnings about experimental features

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-02 12:53:29 +08:00
Brad Hubbard
fa3ddead5e Merge pull request #14271 from joscollin/wip-krbd-warning
rbd: warning, ‘devno’ may be used uninitialized in this function

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-02 08:59:38 +10:00