Commit Graph

74403 Commits

Author SHA1 Message Date
Jianpeng Ma
717809fafc os/bluestore/BlueFS: replace claim_append with claim_append_piecewise to reduce memory copy.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-06-21 07:08:18 +08:00
Jianpeng Ma
434656c610 common/buffer: add function bufferlist::claim_append_piecewise(list& bl).
This only useful for bl is bufferlist::page_aligned_appender. Using
this function can remove memcopy for continue ptrs.
Because page_aligned_appender::flush will split a ptr into two or
more ptrs. For this case, rebuild_aligned_size_and_memory can't handle,
it  will rebuild.

For example
a=bl.get_page_aligned_appender(1);
a.append(3K)
a.flush();
t.claim_append(bl);
a.append(1K);
a.flush();
t.claim_append(bl);

dst.claim_append(t);
//3K and 1K ptr are continue in memory. But they are two ptrs..
dst.is_aligned_size_and_memory(4096,4096) is false.

We add new function claim_append_piecewise() to specially
handle this case.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-06-21 07:04:51 +08:00
Sage Weil
abad4772e0 osd: replicated_ruleset -> replicated_rule
Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-20 17:45:59 -04:00
Sage Weil
fcc8069786 pybind/mgr/restful: remove default of 127.0.0.1
i.e., disabled until explicitly enabled by an admin

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-20 17:25:05 -04:00
Sage Weil
015bc3f5c5 pybind/mgr/dashboard: remove default of 127.0.0.1
i.e., disabled until explicitly enabled by an admin.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-20 17:25:05 -04:00
Sage Weil
de026f15f8 ceph.spec,debian: remove auto-generated self-signed mgr restful cert
Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-20 17:25:05 -04:00
Sage Weil
aa76cf7488 Revert "qa: do not restrict valgrind runs to centos"
This reverts commit 5923961465.

See http://tracker.ceph.com/issues/20360

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-20 17:14:52 -04:00
Casey Bodley
2edd33c1a7 Merge pull request #15260 from shashalu/fix-secondary-zonegroup-cors
rgw: update bucket cors in secondary zonegroup should forward to master

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-06-20 16:54:08 -04:00
Sage Weil
853a54a7e5 Merge pull request #15709 from jcsp/wip-dashboard-loglast
mgr/dashboard: load log lines on startup, split out audit log

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-06-20 15:25:30 -05:00
Sage Weil
650df8e287 Merge pull request #15750 from xiexingguo/wip-bluestore-20170619
os/bluestore: refactor BlueStore::_do_write;  kill dead ExtentMap::find_lextent() method

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-06-20 15:25:03 -05:00
Sage Weil
79c4820673 Merge pull request #15766 from liewegas/wip-20227-fix
os/bluestore: fix unsharing blob dirty_range args

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-06-20 15:24:30 -05:00
Casey Bodley
c3b5a4b16b Merge pull request #15014 from zhangsw/fix-rgw-versionIdMarker-bug
rgw: VersionIdMarker and NextVersionIdMarker should be returned when listing object versions

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-06-20 16:07:46 -04:00
Yehuda Sadeh
8c85f84636 Merge pull request #14500 from zhangsw/fix-rgw-multipart-index-bug
rgw: fix the bug that part's index can't be removed after completing multipart upload

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-20 12:44:37 -07:00
Sage Weil
87224fd3b5 os/bluestore: debug OmapIteratorImpl
Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-20 15:02:42 -04:00
Sage Weil
c5d129b526 osd/SnapMapper: debug keys inserted, removed, and iterated
Hunting bug http://tracker.ceph.com/issues/19943

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-20 15:02:42 -04:00
Sage Weil
867ada5bd5 ceph-objectstore-tool: do not populate snapmapper with missing clones
Cache pools may have clones represented in SnapSet that are not stored
locally.  This is fine as long as ceph-objectstore-tool doesn't go and
add them when it shouldn't.

Fixes: http://tracker.ceph.com/issues/19943
Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-20 14:25:28 -04:00
Casey Bodley
742eaea1d5 Merge pull request #15771 from fangyuxiangGL/cleanup_rgw_admin
rgw: cleanup unused codes in rgw_admin.cc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-06-20 14:16:10 -04:00
John Spray
78ba3b8e0e Merge pull request #15768 from ukernel/wip-objecter-inflight-ops
osdc/Objecter: fix inflight_ops update

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-06-20 14:13:40 -04:00
Casey Bodley
1b334403b1 Merge pull request #15737 from wjwithagen/wip-wjw-test_rgw_string
rgw/rgw_string.h: FreeBSD would like errno.h included

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-06-20 14:02:49 -04:00
Yehuda Sadeh
9fe46d04c2 Merge pull request #15782 from cbodley/wip-rgw-vstart-s3tests
vstart: add rgw configuration needed to pass all s3tests

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-06-20 11:02:28 -07:00
Casey Bodley
3c557f3027 vstart: add rgw configuration needed to pass all s3tests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-06-20 12:28:11 -04:00
Sage Weil
072bf61a94 qa/objectstore/bluestore*: fsck on mount
This will catch more bugs!

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-20 12:17:48 -04:00
Sage Weil
782b63ae9c Merge pull request #15751 from xiexingguo/wip-add-state-name
src/common/ceph_string: stringify new osd states

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-06-20 11:16:29 -05:00
Sage Weil
6a00ba0e26 qa/tasks/ceph_manager: get osds all in after thrashing
Otherwise we might end up with some PGs remapped, which means they won't
get scrubbed.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-20 12:07:25 -04:00
Sage Weil
3befb062c7 os/bluestore: move sharedblob to new collection in same shard
We have to move the SharedBlob to the new collection even if
the new collection is part of the same cache shard.  It's only the buffers
that need to be conditioned on the shard.

Fixes: http://tracker.ceph.com/issues/20358
Signed-off-by: Sage Weil <sage@redhat.com>
2017-06-20 11:56:08 -04:00
Casey Bodley
4908814ffc Merge pull request #14703 from zhangsw/feature-lifecycle-deletemarker
rgw: add support for delete marker expiration in s3 lifecycle.

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-06-20 11:30:38 -04:00
Sage Weil
2e2e8eb3bb Merge pull request #15540 from joscollin/wip-cleanup-test-commented-code-2
test/osd: Removed Commented Code - 2
2017-06-20 10:22:37 -05:00
Kefu Chai
9fddcd2d46 Merge pull request #15770 from tchaikov/wip-test-test_mon_crush
qa/workunits/cephtool/test.sh: only include last line for epoch

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-06-20 23:01:16 +08:00
Kefu Chai
9fc8b42c04 Merge pull request #15733 from wjwithagen/wip-wjw-freebsd-ceph-disk-service
ceph-disk: command invocation needs all fields separate

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-06-20 22:44:18 +08:00
Jos Collin
53a8f6d21d test/osd: Removed Commented Code - 2
Removed commented code found in test/osd/.

Fixes: http://tracker.ceph.com/issues/20207 (Partially)

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-06-20 19:40:06 +05:30
Willem Jan Withagen
45de36e37a ceph-disk: command invocation needs all fields separate
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-06-20 15:13:06 +02:00
Jason Dillaman
3086d2a085 librbd: removed synchronous watcher check from remove image state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-06-20 07:50:43 -04:00
Jason Dillaman
960c7cd809 librbd: clean up remove request state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-06-20 07:50:40 -04:00
Jason Dillaman
29d531802f librbd: remove state machine should ignore group not supported errors
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-06-20 07:48:40 -04:00
Yan, Zheng
146383a21b osdc/Journaler: fix memory leak in Journaler::_issue_read()
Contexts executed by _finish_flush() may call _issue_read(),
_issue_read() may add new context to tail of waitfor_safe list.
So _finish_flush() should first remove contexts from waitfor_safe,
then execute the contexts.

Fixes: http://tracker.ceph.com/issues/20338
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-06-20 19:00:38 +08:00
John Spray
412b397dc5 Merge pull request #15592 from david-z/wip-fix-dump-cache
mds: explicitly output error msg for dump cache asok command

Reviewed-by: John Spray <john.spray@redhat.com>
2017-06-20 06:47:13 -04:00
Yan, Zheng
57e82edc9c qa/cephfs: use ceph.dir.pin to trigger migration
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-06-20 17:39:46 +08:00
Yan, Zheng
8f9261fa98 mds: don't export dirfrag to stopping mds
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-06-20 17:38:18 +08:00
Daniel Bar-On
d8d9d7a732 msg/async/rdma: automatically set RDMAV_HUGEPAGES_SAFE according to conf
Signed-off-by: DanielBar-On <danielbo@mellanox.com>
2017-06-20 08:54:04 +00:00
Kefu Chai
a65b08fe6e qa/workunits/cephtool/test.sh: only include last line for epoch
/home/jenkins-build/build/workspace/ceph-pull-requests-arm64/qa/workunits/cephtool/test.sh:1606: test_mon_crush:  epoch='2017-06-20 04:44:52.862459 ffffad4d0200 -1 asok(0xffffa8000b10) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: The UNIX domain socket path /home/jenkins-build/build/workspace/ceph-pull-requests-arm64/build/src/test/td/t-7202/out/client.admin.48876.asok is too long! The maximum length on this system is 107
12'
/home/jenkins-build/build/workspace/ceph-pull-requests-arm64/qa/workunits/cephtool/test.sh:1607: test_mon_crush:  '[' '2017-06-20 04:44:52.862459 ffffad4d0200 -1 asok(0xffffa8000b10) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: The UNIX domain socket path /home/jenkins-build/build/workspace/ceph-pull-requests-arm64/build/src/test/td/t-7202/out/client.admin.48876.asok is too long! The maximum length on this system is 107
12' -gt 1 ']'
/home/jenkins-build/build/workspace/ceph-pull-requests-arm64/qa/workunits/cephtool/test.sh: line 1607: [: 2017-06-20 04:44:52.862459 ffffad4d0200 -1 asok(0xffffa8000b10) AdminSocketConfigObs::init: failed: AdminSocket::bind_and_listen: The UNIX domain socket path /home/jenkins-build/build/workspace/ceph-pull-requests-arm64/build/src/test/td/t-7202/out/client.admin.48876.asok is too long! The maximum length on this system is 107
12: integer expression expected

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-06-20 16:21:28 +08:00
fang.yuxiang
90409911f6 rgw: cleanup unused codes in rgw_admin.cc
Signed-off-by: fang yuxiang <fang.yuxiang@eisoo.com>
2017-06-20 16:12:19 +08:00
John Spray
8bc96561f3 mds: fix re-entrant calls into Journaler from PurgeQueue
Signed-off-by: John Spray <john.spray@redhat.com>
2017-06-20 08:40:59 +01:00
Kefu Chai
405d1367ee Merge pull request #15742 from wjwithagen/wip-wjw-freebsd-host-errno-3
common/freebsd_errno.cc: fixed again a stupid typo

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-06-20 15:36:54 +08:00
Pritha Srivastava
5e94a9852c rgw: Changes for s3test config file, to add user under a tenant.
Signed-off-by: Pritha Srivastava <prsrivas@redhat.com>
2017-06-20 12:57:24 +05:30
runsisi
c37b700c90 test/cli-integration/rbd: verify formatting for image create timestamp
Signed-off-by: runsisi <runsisi@zte.com.cn>
2017-06-20 13:52:06 +08:00
runsisi
b5bdd6d53e test/unittest_rbd: add unit tests for image create timestamp
Signed-off-by: runsisi <runsisi@zte.com.cn>
2017-06-20 13:52:06 +08:00
runsisi
1d838bf9da pybind/rbd: add support for image create timestamp
Signed-off-by: runsisi <runsisi@zte.com.cn>
2017-06-20 13:52:06 +08:00
runsisi
c79aab7b89 rbd: include create timestamp for info command
Signed-off-by: runsisi <runsisi@zte.com.cn>
2017-06-20 13:52:06 +08:00
runsisi
0358f29c9d librbd: add create timestamp metadata for image
Signed-off-by: runsisi <runsisi@zte.com.cn>
2017-06-20 13:52:06 +08:00
Yan, Zheng
3cf26a1ec5 osdc/Objecter: fix inflight_ops update
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-06-20 11:55:42 +08:00