Commit Graph

67288 Commits

Author SHA1 Message Date
fangyuxiang
c0ddd399ef ReplicatedBackend: do not set omap header if it is empty
In replicatedpg backfill, objects have no omap header or keys previously, but an empty omap header will be inserted when they are pushed to replica, which leads leveldb performance degrade seriously when cluster has huge number of objects.
so my opinion is that we does't insert omap header if is size is zero when handle PushOp in recovery.

Signed-off-by: fang yuxiang <fang.yuxiang@eisoo.com>
2016-12-27 16:53:44 +08:00
liuchang0812
fe3d3821cb tools/rados: add parameter offset for put cmd and test case for it
add a parameter "--offset" for put command
add a test case for rados put command

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2016-12-27 16:06:41 +08:00
liuchang0812
52db747f32 doc: fix document about rados mon
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2016-12-27 14:59:04 +08:00
Kefu Chai
b5acc288d7 Merge pull request #12663 from badone/wip-ceph_test_rados_api_c_write_operations-valgrind-fixes
c_write_operations.cc: Fix trivial memory leak

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-27 14:44:35 +08:00
liuchang0812
14de3a1ee1 test: replace hard-code binary names with varibles
This test case couldn't run under customize env CEPH_BIN.

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2016-12-27 14:18:29 +08:00
Haomai Wang
610a97abf8 Merge pull request #12672 from liupan1111/wip-fix-nvme-driver-compile-issue
bluestore: fixed compilation error when enable spdk

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-12-27 14:07:07 +08:00
Pan Liu
1ed6a37611 bluestore: fixed compilation error when enable spdk
Signed-off-by: Pan Liu <pan.liu@istuary.com>
2016-12-27 12:42:44 +08:00
Adir Lev
131062f70e msg/async/rdma: clean line endings
Change-Id: I59359ae585b66018fe54d5e841a6506c077c606f
Signed-off-by: Adir Lev <adirl@mellanox.com>
2016-12-27 01:53:49 +02:00
Brad Hubbard
da5e60cd70 test/librados/cmd.cc: Fix trivial memory leaks
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2016-12-27 09:16:30 +10:00
Sage Weil
11c30a86fc Merge pull request #12659 from kylinstorage/wip-remove-obsolete-configuration-option
common/config_opts.h: remove obsolete configuration option

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-26 12:31:47 -06:00
huangjun
7d9fd21e79 osd/PG: add new have_unfound() function in MissingLoc
No need to lookup all objects in needs_recovery_map if only want to
          know whether if there are unfound objects.

  Signed-off-by: huangjun <hjwsm1989@gmail.com>
2016-12-26 19:43:38 +08:00
Mykola Golub
2a48c028bd librados_test_stub: tmap_update: return -ENOENT when removing nonexistent key
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-12-26 12:49:42 +02:00
Haomai Wang
32378addb2 Merge pull request #12648 from Adirl/fix_RoCEv2_deafult_value
msg/async/rdma: fix RoCE v2 deafult value

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-12-26 16:25:30 +08:00
Brad Hubbard
efb1100796 c_write_operations.cc: Fix trivial memory leak
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2016-12-26 18:16:30 +10:00
Brad Hubbard
2488e29f2b Merge pull request #12657 from badone/wip-c_read_operations-valgrind-fixes
test/librados/c_read_operations.cc: Fix valgrind errors

Reviewed-by: liuchang0812 <liuchang0812@gmail.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-26 16:28:44 +10:00
Haomai Wang
b19bddf031 Merge pull request #12660 from liupan1111/wip-fix-dpdk-compile
async: Fixed compilation error when enable -DWITH_DPDK

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-12-26 14:02:34 +08:00
Pan Liu
0d4ded580d async: Fixed compilation error when enable -DWITH_DPDK
Signed-off-by: Pan Liu <pan.liu@istuary.com>
2016-12-26 10:29:21 +08:00
Brad Hubbard
8c90a2d207 test/librados/c_read_operations.cc: Fix valgrind errors
Fixes: http://tracker.ceph.com/issues/18354

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2016-12-26 09:27:25 +10:00
Li Wang
b6325d5dd7 common/config_opts.h: remove obsolete configuration option
Signed-off-by: Li Wang <li.wang@kylin-cloud.com>
2016-12-25 14:00:20 +00:00
Orit Wasserman
aedd4a571c Merge pull request #12474 from cbodley/wip-rgw-test-versioned
test/rgw: add test for versioned object sync
Reviewed-by: Orit wasserman <owasserm@redhat.com>
2016-12-25 12:47:27 +02:00
Orit Wasserman
d8f42fe6be rgw: clear master_zonegroup when reseting RGWPeriodMap
Fixes: http://tracker.ceph.com/issues/17239
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2016-12-25 12:36:34 +02:00
Brad Hubbard
1433917647 test/librados/c_read_operations.cc: Fix trivial memory leak
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2016-12-25 09:37:57 +10:00
Brad Hubbard
4afdefefb1 Merge pull request #12597 from badone/wip-osdmap-nocopy
osd/OSDMap: Uncomment code to enable private default constructors

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-25 08:21:39 +10:00
Igor Fedotov
54b309135b test/fio_ceph_objectstore: fix fio plugin build failure caused by recent g_ceph_context removal
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2016-12-24 22:20:04 +00:00
Haomai Wang
4e5d36f292 os/bluestore: prevent lock for almost "flush" calls
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-12-25 00:05:53 +08:00
Sage Weil
b41fe6b44d Merge pull request #12642 from theanalyst/doc/release-notes/11.1.1
doc: release notes for v11.1.1
2016-12-23 23:22:56 -06:00
Sage Weil
e096f07f81 Merge pull request #12582 from Liuchang0812/fix-store-version-bug
os/filestore: version will be uninitialized varible if store_version doesn't exist

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-23 23:19:37 -06:00
Sage Weil
03e3a225fd Merge pull request #12581 from Liuchang0812/fix-clang-warn-filestore
os/filestore: fix clang static check warn "use-after-free“

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-23 23:19:15 -06:00
Sage Weil
2377a1d3cb Merge pull request #12517 from hjwsm1989/wip-18266
messages/MOSDPGTrim: add the missed HEAD_VERSION AND COMPAT_VERSION

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-23 23:17:42 -06:00
Sage Weil
8343d21359 Merge pull request #12518 from kylinstorage/wip-safe-read-cmd
common/admin-socket: fix potential buffer overflow

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-23 23:17:15 -06:00
Sage Weil
78736d5410 Merge pull request #12653 from wjwithagen/wjw-wip-denc-raw
src/test/test_denc.cc: Fix errors in buffer overflow

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2016-12-23 23:16:21 -06:00
Sage Weil
7bbb79adcb Merge pull request #12469 from bassam/pr-jemalloc-mallinfo
cmake: disable mallinfo for jemalloc

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-23 23:10:44 -06:00
Sage Weil
408c24dcb3 Merge pull request #12468 from bassam/pr-simplify-jemalloc
cmake: simplify find_package jemalloc

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-23 23:10:30 -06:00
Sage Weil
91707c6bb6 Merge pull request #12519 from hjwsm1989/pgbackfill
osd/PG: simplify the logic of backfill_targets checking

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-23 23:10:14 -06:00
Sage Weil
e6f496ceca Merge pull request #12585 from liewegas/wip-notify-ack
osd/osd_types: print notify-ack op properly
2016-12-23 22:54:23 -06:00
Sage Weil
42c33edf30 Merge pull request #12563 from xiexingguo/xxg-wip-osd-1217
common: make attempts of auth rotating configurable 

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-23 22:54:14 -06:00
Sage Weil
20a1f3d698 Merge pull request #11065 from LiumxNL/wip-fix-osdmap-update
mon/OSDMonitor: should propose osdmap update when cluster addr changed

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-23 22:53:58 -06:00
Sage Weil
cf8161f78c Merge pull request #12634 from liewegas/wip-bluestore-shard-keys
os/bluestore: do not cache shard keys

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: Allen Samuels <allen.samuels@sandisk.com>
2016-12-23 22:53:08 -06:00
Sage Weil
29b7226a4b Merge pull request #12635 from liewegas/wip-bluestore-cache
os/bluestore: set cache meta ratio to .9

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-12-23 22:52:43 -06:00
Sage Weil
0ddbdf8628 Merge pull request #12644 from xiexingguo/xxg-wip-bluestore-keyreserve
os/bluestore: preallocate object[extent_shard] key to avoid reallocate

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-12-23 22:52:29 -06:00
Haomai Wang
22e0d6cf85 messages/MOSDSubOp: Make encode_payload can be reentrant
Otherwise, AsyncConnection will use uninitialized feature to encode
message. The caller side will set a old version header but encode with newest
feature since passing feature is ok. It will let receiver side got a old
header version but newest payload decode result.

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-12-24 11:33:34 +08:00
Willem Jan Withagen
cb4950b3ae src/test/test_denc.cc: Fix errors in buffer overflow
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-12-24 00:46:54 +01:00
Sage Weil
f5f16ce8f9 os/bluestore: do not precalculate/cache shard keys
Note that we are generating it on demand now.  We can
probably do better, especially when in a loop.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-23 15:48:50 -05:00
Sage Weil
a03c5be452 Merge pull request #12149 from adamemerson/wip-g_ceph_context-exterminate
global: start removing g_ceph_context

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-12-23 08:40:48 -06:00
Sage Weil
6251ff6a3e Merge remote-tracking branch 'gh/kraken' 2016-12-23 09:37:23 -05:00
Sage Weil
2861a2188a Merge pull request #12630 from liewegas/wip-workunit-retry
qa/tasks/workunit: clear clone dir before retrying checkout

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-12-23 08:12:35 -06:00
Sage Weil
8bbdcae9b1 Merge pull request #12614 from liewegas/wip-task-peer
qa/tasks/peer: update task based on current peering behavior

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-12-23 08:11:36 -06:00
Haomai Wang
9dc43d3b32 Merge pull request #12559 from Adirl/verify_transport_type
msg/async: assert if compiled code doesn't support the configured ms_…

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-12-23 21:38:15 +08:00
Avner BenHanoch
e3b744a19d msg/async: assert if compiled code doesn't support the configured ms_async_transport_type
for example, currently there is a crash when using the async stack (access of null pointer)
in case the user configured rdma for a code that was not compiled with RDMA

issue: 913397

Change-Id: I4e3d88006312a713b8d3aaefbdcd0596039270e1
Signed-off-by: Avner BenHanoch <avnerb@mellanox.com>
2016-12-23 13:59:00 +02:00
Igor Fedotov
66deb1f7da Merge pull request #12643 from xiexingguo/xxg-wip-bluestore-1123
os/bluestore: remove intermediate key var to avoid string copy

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: whu liuchang <liuchang0812@gmail.com>
2016-12-23 14:52:48 +03:00