Commit Graph

67790 Commits

Author SHA1 Message Date
Sage Weil
88df169500 qa/suites/rados/basic: set low omap limit for rgw workload
This gets *some* coverage for the omap limits in the rados suite.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-23 12:07:57 -05:00
Jason Dillaman
20da91e881 Merge pull request #12326 from vshankar/wip-15028
librbd: create fewer empty objects during copyup

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-01-23 10:39:16 -05:00
Ramesh Chander
506a06a71e unittest_bit_alloc race fix
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-23 10:19:48 -05:00
Haomai Wang
2b2ab914b2 Merge pull request #13056 from optimistyzy/123_logic
NVMEDevice.cc: cleanup the logic in data_buf_next_sge

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-23 22:44:07 +08:00
Kefu Chai
1e8ca9bb90 Merge pull request #12938 from LiumxNL/fix-process-osd-failure
mon/OSDMonitor: fix process osd failure

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-23 20:07:35 +08:00
Kefu Chai
4f13f3e9b5 Merge pull request #9419 from songbaisen/a4
osdmaptool: show all the pg map to osds info

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-23 19:43:35 +08:00
Kefu Chai
d54f75d244 Merge pull request #12828 from donglinpeng/dlppull
common/buffer: close pipe fd if set nonblocking fails.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-23 19:42:14 +08:00
optimistyzy
edb0e7d4c6 NVMEDevice.cc: cleanup the logic in data_buf_next_sge
Signed-off-by: optimistyzy <optimistyzy@gmail.com>
2017-01-23 11:00:02 +08:00
Sage Weil
65f5187e42 Merge pull request #12980 from liewegas/wip-osdop-printer
osd/osd_types: clean up OSDOp printers

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-22 10:45:37 -06:00
Sage Weil
1bda01736f osd/osd_types: clean up OSDOp printers
Specify which ones get offset~length instead of blacklisting those that
don't.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-22 11:44:46 -05:00
Sage Weil
55b96a3b65 Merge pull request #12950 from liewegas/wip-omap-getkeys
osd: extend OMAP_GETKEYS and GETVALS to include a 'more' output field

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-01-22 10:44:04 -06:00
Sage Weil
9a6a276aa2 Merge pull request #12961 from songbaisen/s10
crush:  when osd_location_hook does not exist, we should exit error.


Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-22 10:43:27 -06:00
Sage Weil
5dccac8697 Merge pull request #12975 from wonzhq/fix-pgstats-down
mon: don't set last_osd_report when the pg stats msg is ignored

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-22 10:43:00 -06:00
Sage Weil
c0b4ced7b1 Merge pull request #12976 from LiumxNL/wip-170118
osd/OSDMap: get_previous_up_osd_before() may run into endless loop

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-22 10:42:33 -06:00
Sage Weil
4bad4bd86a Merge pull request #12981 from liewegas/wip-crush-move-osd
mon/OSDMonitor: make 'osd crush move ...' work on osds

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-22 10:42:08 -06:00
Sage Weil
7495487e56 Merge pull request #13008 from athanatos/wip-clone-range
osd,librados: remove clone_range and associated multi-object cruft

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-22 10:41:55 -06:00
Mykola Golub
fce69f6348 Merge pull request #13033 from dillaman/wip-18618
journal: don't hold future lock during assignment

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-22 14:52:32 +02:00
Xie Xingguo
24413051d6 Merge pull request #13051 from chuanhong-wang/dev_conf_clean
common: delete unused conf "filestore_debug_disable_sharded_check"

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-01-22 13:35:50 +08:00
chuanhong.wang
57c1542ed4 common: delete unused conf "filestore_debug_disable_sharded_check"
Signed-off-by: Chuanhong Wang <chuanhong.wang@163.com>
2017-01-22 12:23:40 +08:00
Mykola Golub
11dce465f0 Merge pull request #13042 from dillaman/wip-librbd-compile-warning
librbd: fixed initializer list ordering

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-21 17:52:42 +02:00
Jason Dillaman
0f21ceef83 journal: don't hold future lock during assignment
It's possible that the future raced with its owner and reaches
an empty reference count. This was resulting in the future being
destructed while its lock was still held.

Fixes: http://tracker.ceph.com/issues/18618
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-21 09:48:14 -05:00
Jason Dillaman
4da2326252 librbd: fixed initializer list ordering
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-21 09:17:36 -05:00
Venky Shankar
ac4e6cc2b6 test / librbd: create few empty objects during flatten
Fixes: http://tracker.ceph.com/issues/15028
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-01-21 16:29:27 +05:30
Venky Shankar
8419036659 test / librbd: Write ones instead of zeroes to test images
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-01-21 16:29:27 +05:30
Venky Shankar
c455711c2f librbd: Create few empty objects during copyup
This is based out of Doug's (@fullerdj) work (PR #9329)
as an attempt to avoid creating empty objects when
flattening an image and otherwise whenever unnecessary.

This gives good optimization benefit when a parent image
is sparsely populated. Moreover, this change is required
for correct behavior when checking disk usage of a clone
(which used to report fully allocated image due to all,
including empty objects being created during flatten).

Signed-off-by: Douglas Fuller dfuller@redhat.com
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-01-21 16:29:27 +05:30
Venky Shankar
ad0dcff47f librbd: make has_parent() prone to callers from copyup
This is required when CopyupRequest would need to invoke
pre_object_map_update() as part of upcoming changes to
create fewer child image objects whenever possible.

CopyupRequest constructor accepts image extents as an
rvalue forcing the caller to transfer ownership to it
and leaving the original variable in an unspecified
stated making has_parent() return incorrect state when
invoked from CopyupRequest. Therefore, introduce a
private tracking state that can be used in place of
checking emptiness of parent image extents.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-01-21 16:29:27 +05:30
Sage Weil
1f150f8a52 PendingReleaseNotes: mention old clients vs new OSDs
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-20 17:52:18 -05:00
Sage Weil
2d9cfadf71 rados: use bare omap_get_keys op
This handles the client-side looping on 'more' if the OSD limits
the response size.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-20 17:52:18 -05:00
Sage Weil
faec324f64 ceph_test_rados: pass nullptr for pmore for omap fetch
Assume OSD limits are hugh enough.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-20 17:52:18 -05:00
Sage Weil
35671cedb2 rados: omap bench: pass null for pmore for omap fetch
Assume OSD limits are high enough for us.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-20 17:52:18 -05:00
Sage Weil
b9f4194306 ceph_test_rados_*: use new omap methods
Make these tests pass nullptr for pmore.  This codifies our
assumption that the OSD limits are high enough.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-20 17:52:18 -05:00
Sage Weil
fbebd83537 librados: add omap_get_{keys,vals}2 with pmore output arg
Expose public methods that include a new output argument to indicate
whether there are more keys to fetch or not.

Mark the old interfaces deprecated.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-20 17:52:17 -05:00
Sage Weil
cfa6f7932e osdc/Objecter: infer ptruncated on old OSDs via max_entries
If we do not get an explicit 'more' value from the OSD, infer it by
checking whether we got the max requested entries.  On old OSDs, which
don't enforce a limit, this will work.  On new OSDs, we will get the
explicit result.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-20 17:52:17 -05:00
Mykola Golub
af9152f34a Merge pull request #12991 from dillaman/wip-17447
librbd: avoid possible recursive lock when racing acquire lock

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-20 19:50:02 +02:00
Mykola Golub
709198ae02 Merge pull request #12982 from dillaman/wip-18524
librbd: remove unnecessary dependencies of ManagedLock

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-20 19:49:36 +02:00
Sage Weil
4b7258a8ad Merge pull request #13010 from liewegas/wip-bluestore-allocator
os/bluestore: fix Allocator::allocate() int truncation

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-01-20 11:13:47 -06:00
Kefu Chai
d8e4a2c204 Merge pull request #12908 from tchaikov/wip-rocksdb
rocksdb: build with ppc64

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2017-01-20 22:41:04 +08:00
John Spray
2d253c30d8 Merge pull request #12830 from renhwztetecs/renhw-wip-libcephfs-misc
libcephfs: cleanups

Reviewed-by: John Spray <john.spray@redhat.com>
2017-01-20 15:29:30 +01:00
John Spray
abb2608b6b Merge pull request #12994 from ukernel/wip-18487
mds: add authority check for delay dirfrag split

Reviewed-by: John Spray <john.spray@redhat.com>
2017-01-20 15:28:12 +01:00
Sage Weil
e19aa84846 os/bluestore: fix Allocator::allocate() int truncation
An allocation of size 0x80000000 gets truncated to 0.  Larger values can
break things in similar ways.

Introduced in 5ab034345d.

Fixes: http://tracker.ceph.com/issues/18595
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-19 19:51:45 -06:00
Alfredo Deza
3e75c6bea6 Merge pull request #12947 from smatzek/fix_18538
ceph-disk: use correct user in check_journal_req

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-01-19 18:39:59 -05:00
Sage Weil
b6aef08cc9 osdc/Objecter: add pmore argument to omap_get_{keys,vals}
Note that the MDS callers have new #warnings indicating that they
are not providing the pmore argument and are thus broken.  (They
were already broken.)

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-19 15:59:30 -06:00
Sage Weil
d6dcf417c2 osd/PrimaryLogPG: tell client if we truncate results
If we truncate the results of the omap read commands,
provide a flag so that the caller knows there is more
to be read.  We don't need to provide the name of the
next key because the interface is defined as
"start_after" (not "start_with"), allowing them to use
the last key they received.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-19 15:59:30 -06:00
Casey Bodley
5db320ce93 Merge pull request #12865 from ceph/wip-rgw-18476
rgw: fix handling RGWUserInfo::system in RGWHandler_REST_SWIFT.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-01-19 11:00:12 -05:00
Sage Weil
00222af585 Merge pull request #12968 from liewegas/wip-kraken-notes
doc/release-notes: final kraken notes
2017-01-19 06:57:54 -06:00
Sage Weil
47956475de mon/OSDMonitor: make 'osd crush move ...' work on osds
Currently it only allows you to move buckets, which is annoying and much
less useful.  To move an OSD you need to use create-or-move, which is
harder to use.

Fixes: http://tracker.ceph.com/issues/18587
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-19 06:54:54 -06:00
Sage Weil
04980b7d83 Merge pull request #12963 from liewegas/wip-bluestore-extents
os/bluestore: fix reclaim_blocks and clean up Allocator interface

Reviewed-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-19 06:29:25 -06:00
John Spray
36874c8d0c Merge pull request #12550 from stiopaa1/B9935_segfaultInRmDir
client/Client.cc: prevent segfaulting

Reviewed-by: John Spray <john.spray@redhat.com>
2017-01-19 09:15:27 +01:00
Yan, Zheng
5de08f099b mds: add authority check for delay dirfrag split
the dirfrag can be migareted to other mds while waiting in the
timer.

Fixes: http://tracker.ceph.com/issues/18487
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-01-19 15:30:19 +08:00
Kefu Chai
e1d13284e0 Merge pull request #12988 from SUSE/wip-submitting-patches
doc: clarify SubmittingPatches.rst

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-19 13:30:03 +08:00