Commit Graph

70620 Commits

Author SHA1 Message Date
Sage Weil
6af489121b mempool: do not skip first 2 mempools
This broke when we sorted the pool definitions in the header.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
066514c37c os/bluestore: flush osr even on failure in _deferred_replay
This is one less thing for fsck to worry about.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
c67e9e2530 os/bluestore: trim cache during fsck
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
f7a51d35a9 os/bluestore: be noisy about bitmap init (it's slow!)
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:23:38 -04:00
Sage Weil
5f2db7f83b Merge pull request #14316 from liewegas/wip-bluestore-fsck-unused
os/bluestore: fsck: verify blob.unused field

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-04-05 09:22:51 -05:00
Sage Weil
703213b1f0 os/bluestore: use typedef for blob unused (uint16_t)
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:18:17 -04:00
Sage Weil
f49b1d24c6 os/bluestore: fsck: verify blob.unused field
Two checks:

- verify that no logical extents reference the portion of the
  blob marked unused, and
- verify that the csum (if present) is zero for any unused
  region.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-05 10:18:17 -04:00
Sage Weil
4759c705e9 Merge pull request #14157 from liewegas/wip-19379
os/bluestore: fix deferred writes vs collection split race

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-04-05 08:56:16 -05:00
Sage Weil
c618d22d25 Merge pull request #14258 from liewegas/wip-bluestore-tool
ceph-bluestore-tool: rename from bluefs-tool; improve usage
2017-04-05 08:55:36 -05:00
Sage Weil
d4525121c9 Merge pull request #14294 from tchaikov/wip-check-last-osd-report-if-luminous
mon/OSDMonitor: check last_osd_report only when the whole cluster is lu…

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-05 08:55:23 -05:00
Sage Weil
6f8cd66b94 Merge pull request #14303 from liewegas/wip-more-mgr-commands
mgr: move 'osd perf' and 'osd blocked-by' to mgr

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-05 08:55:03 -05:00
Casey Bodley
aad7e6e2da Merge pull request #14010 from zhangsw/fix-rgw-fetchremote-bug
rgw: version id doesn't work in fetch_remote_obj

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-05 09:38:41 -04:00
Loic Dachary
8a2cf69ec4 Merge pull request #13310 from ceph/wip-ceph-disk-fix
ceph-disk: Add fix subcommand

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-05 13:43:02 +02:00
Abhishek Lekshmanan
036d7af16f rgw_lc: drop a bunch of unused headers
Dropping headers that are already included as a part of rgw_common

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-04-05 13:20:41 +02:00
Zhang Shaowen
433297d500 rgw: add support for multipart upload expiration.
Fixes: http://tracker.ceph.com/issues/19088

Signed-off-by: Zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
2017-04-05 19:01:35 +08:00
Orit Wasserman
3fea36d635 radosgw-admin: use zone id when creating a zone
Fixes: http://tracker.ceph.com/issues/19498
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-04-05 13:42:36 +03:00
Harald Klein
864db8e5ee add RGW ldap auth documentation
Signed-off-by: Harald Klein <hari@vt100.at>
2017-04-05 12:01:48 +02:00
Orit Wasserman
2e9609ddd2 Merge pull request #14314 from rzarzynski/wip-rgw-bulkupload-freebsd
rgw: switch to std::array in RGWBulkUploadOp due to C++11 and FreeBSD.
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-05 12:06:05 +03:00
Orit Wasserman
8d701f6417 Merge pull request #14252 from cbodley/wip-19409
radosgw-admin: new 'global quota' commands update period config
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-05 12:02:58 +03:00
Orit Wasserman
df253384e6 Merge pull request #14109 from cbodley/wip-rgw-stat-manifest
rgw: stat requests skip compression, manifest handling, etc
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-04-05 12:02:10 +03:00
Loic Dachary
3f8efee390 mon: implement osd crush class create/rm/ls
Signed-off-by: Loic Dachary <loic@dachary.org>
2017-04-05 09:22:24 +02:00
Loic Dachary
e7d91eb4e8 crush: implement class_is_in_use/remove_class_name
Signed-off-by: Loic Dachary <loic@dachary.org>
2017-04-05 09:22:24 +02:00
Loic Dachary
f94d6b449a mon: osd crush set-device-class
Signed-off-by: Loic Dachary <loic@dachary.org>
2017-04-05 09:22:24 +02:00
Loic Dachary
8131c788b7 crush: implement update_device_class
Change the device class of a given device. The class must already exist.

Signed-off-by: Loic Dachary <loic@dachary.org>
2017-04-05 09:21:50 +02:00
Sarit Zubakov
89dfc561f1 src/msg/async: Update fix broken compilation for Posix
This commit relates to PR#13940

issue: 1010987

Change-Id: I402812adcf816c145356f0b98cfd1869c4cd5400
Signed-off-by: Sarit Zubakov <saritz@mellanox.com>
2017-04-05 06:48:27 +00:00
Sage Weil
fe41eee4f9 os/bluestore/KernelDevice: assume rotational if we can't get devname
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-04 23:39:42 -04:00
Kefu Chai
24e69d79e7 Merge pull request #14281 from tchaikov/wip-19429
qa/tasks/workunit.py: use "overrides" as the default settings of workunit

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-04-05 10:01:27 +08:00
Haomai Wang
71c78b859a Merge pull request #14297 from Adirl/ibport
msg/async/rdma: Make port number an attribute of the Connection not o…

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-04-05 07:02:26 +08:00
Sage Weil
fe28add997 Merge pull request #13766 from dachary/wip-18962-ceph-disk-zap
ceph-disk: Write 10M to all partitions before zapping

Reviewed-by: Sébastien Han <seb@redhat.com>
2017-04-04 15:40:53 -05:00
Casey Bodley
5b377188ca Merge pull request #13998 from wangzhengyong/aio_complete
rgw: fix memory leak in delete_obj_aio

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 16:31:26 -04:00
Jason Dillaman
6be45f804b Merge pull request #12883 from mslovy/wip-rbd-import
rbd: import real thin-provision image

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-04 16:12:05 -04:00
Casey Bodley
6cb94d550b Merge pull request #14327 from cbodley/wip-12863
rgw: switch from "timegm()" to "internal_timegm()" for better portability

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 16:11:12 -04:00
Sage Weil
f907d83140 Merge pull request #14190 from idryomov/wip-respect-epoch-barrier
osdc/Objecter: respect epoch barrier in _op_submit()

Reviewed-by: John Spray <john.spray@redhat.com>
2017-04-04 15:07:29 -05:00
Sage Weil
ad89fd8b3e Merge pull request #14220 from jcsp/wip-19407
mon: update mgrmap when active goes offline

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-04 15:06:59 -05:00
Sage Weil
f2a44f4160 mgr/Mgr: log something at end of handle_mgr_digest
Saw a run that showed the notify_all pg_summary as the last
message for this thread; hopefully we can see if it is
blocked in notify_all() or not.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-04 16:05:23 -04:00
Sage Weil
025934423f mgr/Mgr: drop lock while fetching config-keys
This avoids a deadlock if some other message arrives before
the command reply and needs to take the mgr lock in dispatch.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-04 15:59:05 -04:00
Douglas Fuller
37bafff9f4 qa/cephfs: Add test for rebuilding into an alternate metadata pool
Add a test to validate the ability of cephfs_data_scan and friends to
recover metadata from a damaged CephFS installation into a fresh metadata
pool.

cf: http://tracker.ceph.com/issues/15068
cf: http://tracker.ceph.com/issues/15069
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-04-04 12:29:01 -07:00
Douglas Fuller
cb86740a5f cephfs: Permit recovering metadata into a new RADOS pool
Add a procedure that permits reconstructing metadata in a potentially
damaged cephfs metadata pool and writing the results into a
freshly-initialized pool that refers to the same data pool. Add option
flags to override checks that would ordinarily prevent this and add
options to the recovery tools to write output to a separate pool instead of
the one selected for recovery. See docs/cephfs/disaster-recovery.rst for
details.

Fixes: http://tracker.ceph.com/issues/15068
Fixes: http://tracker.ceph.com/issues/15069
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-04-04 12:29:01 -07:00
Douglas Fuller
8757f603bf mon/cephfs: Warn about overlaying CephFS metadata pools
Don't allow creation of filesystems with overlaying metadata pools unless
the user passes --allow-dangerous-pool-overlay.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-04-04 12:29:01 -07:00
Casey Bodley
3c9df5582b Merge pull request #12437 from idealguo/remove-duplicate-flush
rgw: remove duplicate flush formatter

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 14:40:06 -04:00
Casey Bodley
606467bc1b Merge pull request #13934 from chuang-he/fix_copy_obj_data
rgw: fix configurable write obj window size

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 14:39:28 -04:00
Casey Bodley
1e8b763443 Merge pull request #11963 from zhangsw/fix-rgw-lifecycle-bug
rgw: LCWorker's worktime is not the same as config rgw_lifecycle_work_time.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-04-04 14:31:11 -04:00
Sage Weil
6d5e0132d9 mgr/Mgr: fix map waits in init
If we go active multiple times we may already have an fsmap
subscription registered via MonClient, which means that we
won't receive a net new FSMap during the init phase.  This is
trivial to reproduce; just 'ceph mgr fail x' and when it
activates the second time init() will get stuck waiting.

The core issue is that monc subs are stateful, but we forget
the various maps with the previous Mgr incarnation.  Sipmle
workaround is to reset the mon connection as we init.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-04 14:27:54 -04:00
Sage Weil
1113eb123b mgr/Mgr: use cond (not context) for FSMap wait
This is simpler.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-04 14:27:41 -04:00
Rishabh Kumar
a60c3dd995 Switch from "timegm()" to "internal_timegm()"
Changed timegm() to internal_timegm() for better portability

Fixes: http://tracker.ceph.com/issues/12863
Signed-off-by: Rishabh Kumar <kris.kr296@gmail.com>
2017-04-04 14:24:05 -04:00
Casey Bodley
b4c0fc73aa Merge pull request #14042 from pritha-srivastava/wip-rgw-fix-accounting
rgw: Added code to correctly account for bytes sent/ received during a 'PUT' operation.

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 14:19:27 -04:00
Casey Bodley
484e1a38f7 Merge pull request #14125 from zhangsw/fix-rgw-cache-normalname-bug
rgw: add pool namespace to cache's key so that system obj can have unique key

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 14:17:51 -04:00
Jason Dillaman
b1f1df4f37 Merge pull request #14072 from trociny/wip-notify
librbd: Notifier::notify API improvement

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-04-04 14:06:05 -04:00
Sage Weil
d88f0fdb39 mon/MgrMonitor: encode MgrMap with mon quroum features
Fixes: http://tracker.ceph.com/issues/19491
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-04 13:58:33 -04:00
Casey Bodley
f3d6c28a55 Merge pull request #14160 from Liuchang0812/wip-19363-fix-lc-two-response
rgw/lifecycle: do not send lifecycle rules when GetLifeCycle failed

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-04 13:22:15 -04:00