Commit Graph

67304 Commits

Author SHA1 Message Date
Sage Weil
4ec3164f26 Merge pull request #12406 from songbaisen/s5
tool: add some ceph relate processes to ps-ceph.pl

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-29 11:22:28 -06:00
Sage Weil
f518679a8c Merge pull request #12621 from fiskn/master
doc: Update disk thread section to reflect that scrubbing is no longe…
2016-12-29 11:17:57 -06:00
Sage Weil
08c3618771 mon/OSDMonitor: set last_force_op_resend on overlay pool too
We currently set the last_force_op_resend field on the
base pool when we set or clear the overlay.  Set it on
the cache/overlay pool too.  The Objecter should resend
even with a change only to the base pool, but the OSD
needs to see the change on the overlay pool to correctly
discard the op.

Fixes: http://tracker.ceph.com/issues/18366
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 12:08:28 -05:00
liuchang0812
96f5c92dbf test: update test_rados_tool.sh, use POOL and OBJ var
* replace hard-code pool name with $POOL
* replace hard-code object name with $OBJ
* introduce a new variable called $POOL_EC
* clean up pool
* simplify test case

Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2016-12-29 16:05:37 +00:00
Haomai Wang
09a49861e6 msg/async/rdma: fix ceph_clock_now calls
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-12-29 23:50:31 +08:00
Sage Weil
f706819d6a Merge pull request #12403 from liewegas/wip-mon-mgr-cleanups
mon: clean up some osdmon/pgmon interactions

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-29 09:38:59 -06:00
Sage Weil
265c2ff446 qa/workunits: remove crash_replay_interval tests
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 10:30:39 -05:00
Sage Weil
63bb2b7d45 doc: remove crash_replay_interval mentions
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 10:30:08 -05:00
Sage Weil
b6fdff4904 mon/MDSMonitor: no need to set crash_replay_interval on data pools
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 10:30:08 -05:00
Sage Weil
0cb51ab40b osd/PG: remove waiting_for_ack
No longer used.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 10:30:08 -05:00
Sage Weil
abb29b35b0 osd: simplify dup/resent logic
No need to special ack path.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 10:30:08 -05:00
Sage Weil
3269c52128 osd: remove replay_queue
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 10:30:07 -05:00
Sage Weil
5aca4ebce6 osd/PG: do not go into replay state
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 10:30:07 -05:00
Sage Weil
845f432dc1 osd/PG: do not queue ops for replay
We no longer send ACKs, so this can't happen anyway.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 10:30:07 -05:00
Sage Weil
1addadc40a osd: we can discard "replay" ops
Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 10:30:07 -05:00
Sage Weil
b9a3698e4c osd/ReplicatedPG: do not send ACK separate from COMMIT
This never comes before COMMIT, making it useless to clients.  And it's
just unnecessary overhead.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 10:30:07 -05:00
Sage Weil
e94521638b osd: remove 'rlat' read latency metrics
These are measuring how long of a delay we see before ops are readable.
They are calculated in the on_applied path, which we'd like to remove,
and weren't reliably calculated anyway.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 10:30:07 -05:00
Sage Weil
46cdcf8229 osd/ReplicatedPG: kill hit_set_flushing
This was added before we started taking the ondisk lock in order to allow
reading a just-written hitset.  Since this is a rare path anyway, just
take the ondisk lock.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-29 10:30:07 -05:00
Sage Weil
2c05a968fe Merge pull request #12522 from hjwsm1989/ecwrite
osd/ECBackend: Send write message to peers first, then do local write

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-29 09:29:24 -06:00
Sage Weil
12a0f96f07 Merge pull request #12524 from yuyuyu101/wip-bluestore-flush
os/bluestore: prevent lock for almost "flush" calls

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-29 09:28:39 -06:00
Sage Weil
2bdb569267 Merge pull request #12528 from kylinstorage/wip-JournalingObjectStore-cleanup
os/filestore/JournalingObjectStore cleanup

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-29 09:27:51 -06:00
Sage Weil
13c01a0350 Merge pull request #12670 from liewegas/wip-nits
mon: fix a few nits

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-29 09:27:32 -06:00
Sage Weil
5c1c3c0845 Merge pull request #12684 from xiexingguo/xxg-wip-fix-onodesizetracking
os/bluestore: fix OnodeSizeTracking testing

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-29 09:26:21 -06:00
Michal Jarzabek
9d95c439e4 msg/Messenger.cc: add std::move
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-12-29 15:10:46 +00:00
Haomai Wang
020fd24d7e Merge pull request #12707 from tchaikov/wip-dpdk-v16.07
builds with dpdk v16.07

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-12-29 15:02:59 +08:00
Kefu Chai
3e559b2194 msg/async: bump dpdk to v16.07
as some distros include it already. so sync it up to avoid building
failures on them with dpdk-dev package(s) shipped by distro.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-12-29 14:09:20 +08:00
Kefu Chai
09b4978cfd msg/async: be compatible with dpdk v16.07
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-12-29 14:06:41 +08:00
Kefu Chai
27d9cf8fd9 Merge pull request #12698 from yuyuyu101/wip-dpdk-fix
msg/async/dpdk: fix compile errors

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-29 14:06:00 +08:00
Kefu Chai
c54f568a1f Merge pull request #12699 from wjwithagen/patch-15
qa/test_rados_tool.sh: POSIX dd only accepts 'k' as multiplier

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-29 12:04:23 +08:00
Brad Hubbard
06d6550328 test/librados/snapshots.cc: Fix memory leak
Fix for valgrind reported leak of librados::ObjectWriteOperation heap
object.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2016-12-29 13:14:56 +10:00
Brad Hubbard
9c48cad021 test/librados/tier.cc: Fix valgrind errors
Rectify memory leak and invalid reads.

Fixes: http://tracker.ceph.com/issues/18360
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2016-12-29 13:07:30 +10:00
runsisi
9ede01affd osd/OpRequest: dump both name and addr for the client op
Signed-off-by: runsisi <runsisi@zte.com.cn>
2016-12-29 10:23:31 +08:00
Sage Weil
c2535c1363 mon/OSDMonitor: remove workaround for dumpling-era bug
We will definitely have published (and stored) a new osdmap since then.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-12-28 14:10:08 -05:00
Sage Weil
1611090173 Merge pull request #12703 from kylinstorage/wip-remove-unused-variable
os/bluestore/BlueStore.cc: remove unused variable

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2016-12-28 11:56:55 -06:00
Sage Weil
eff4c1c5f3 Merge pull request #12594 from wjwithagen/wip-wjw-freebsd-rebind-timing
common/config_opts.h: FreeBSD timing changed due to no SO_REUSEADDR

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-28 11:54:53 -06:00
Li Wang
2590b97b4d os/bluestore/BlueStore.cc: remove unused variable
Signed-off-by: Li Wang <li.wang@kylin-cloud.com>
2016-12-28 15:23:51 +00:00
Willem Jan Withagen
4b9b562465 qa/test_rados_tool.sh: POSIX dd only accepts 'k' as multiplier
FreeBSD does not want KB as 1k multiplier.
see also: http://www.unix.com/man-page/posix/1posix/dd/

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-12-28 12:13:29 +01:00
Haomai Wang
8ca15b1a4e test_userspace_event: fix missing std
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-12-28 17:56:32 +08:00
Haomai Wang
410002de5a msg/dpdk/TCP: remove unneeded CephContext argument
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-12-28 17:55:45 +08:00
Yunchuan Wen
9d725523a8 rbd: limit --io-threads to avoid wait forever in do_bench
Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2016-12-28 17:33:31 +08:00
Yunchuan Wen
08fafce9b7 rbd: limit --io-size to avoid divide by zero in do_bench
Signed-off-by: Yunchuan Wen <yunchuan.wen@kylin-cloud.com>
2016-12-28 17:33:22 +08:00
Xinze Chi
59fdcc1990 os/bluestore: _txc_release_alloc when do wal cleaning
Signed-off-by: Xinze Chi <xinze@xsky.com>
2016-12-28 12:08:23 +08:00
Haomai Wang
b486adb692 Merge pull request #12688 from Adirl/clean_line_end
msg/async/rdma: clean line endings

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-12-28 10:50:15 +08:00
xie xingguo
1d97862f71 os/bluestore: fix OnodeSizeTracking testing
[  FAILED  ] 1 test, listed below:
[  FAILED  ] ObjectStore/StoreTest.OnodeSizeTracking/2, where GetParam() = "bluestore"

 1 FAILED TEST

The above test failure happens as the bluestore mount() process
will try to load all collections and put them into the coll_map,
which will be also tracked as mempool::bluestore_meta_other.
So total_bytes from mempool won't be equal to zero.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-12-28 09:56:04 +08:00
Dave Chen
091547d10c common/ceph_context: Show clear message if all features are enabled
It's saying the following dangerous and experimental featuresare enabled
while the value is "*", it's not quite clear what's "*" stands for.

The patch updates the message so that it's more clear when "*" is used
in place.

Signed-off-by: Dave Chen <wei.d.chen@intel.com>
2016-12-28 09:54:17 +08:00
Sage Weil
075325c3a4 Merge pull request #12336 from kylinstorage/wip-cleanup-use-string-ref
osd: cleanup: use string & to avoid unnecessary copy

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-27 16:38:17 -06:00
Sage Weil
c67a23592d Merge pull request #12569 from liewegas/wip-bluestore-raw-unused
os/bluestore/bluestore_types: drop std::bitset for blob unused

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: Varada Kari <varada.kari@sandisk.com>
2016-12-27 16:37:15 -06:00
Sage Weil
bb281925f7 Merge pull request #12612 from fangyuxiangGL/master
osd/ReplicatedBackend: do not set omap header if it is empty

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-12-27 16:36:44 -06:00
Sage Weil
56b04966f6 Merge pull request #12668 from hjwsm1989/pg-unfound
osd/PG: add new have_unfound() function in MissingLoc

Reviewed-by: Sage Weil <sage@redhat.com>
2016-12-27 16:36:18 -06:00
Sage Weil
2e1a096a82 Merge pull request #12674 from Liuchang0812/tools-rados-offset-support
tools/rados: add a parameter "--offset" to rados put command

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-12-27 16:35:50 -06:00