Commit Graph

81682 Commits

Author SHA1 Message Date
Jason Dillaman
1afc6f5050 rbd-mirror: new 'rbd_mirroring_delete_delay' configuration option
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:13 -05:00
Jason Dillaman
8f485ec854 rbd-mirror: async mirroring trash move state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:13 -05:00
Jason Dillaman
62998f3de5 rbd-mirror: watch notifications for images added to trash
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:13 -05:00
Jason Dillaman
01f2d887db rbd-mirror: use one image deleter per pool
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
a3705f10ec rbd-mirror: avoid logging an error for expected bootstrap failures
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
f3affb6635 rbd-mirror: free memory after image deleter fails to open image
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
2a549a5946 librbd: async journal reset state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
1a40d7ca62 librbd: incorporate new trash notification messages
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
4466800cf0 librbd: watch/notify types for trash add/remove events
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
86a4b33d73 librbd: async trash move state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
ed147192fd test/librados_test_stub: add mock version of create
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
John Spray
dc236764ce
Merge pull request #19578 from cernceph/dvanders_brm
mgr/balancer: fix KeyError in balancer rm

Reviewed-by: John Spray <john.spray@redhat.com>
2017-12-19 11:40:33 +00:00
Bingyin Zhang
ba59ffa160 rgw: remove unused varialbe "marker" in function RGWLC::process
Signed-off-by: Bingyin Zhang <zhangbingyin@cloudin.cn>
2017-12-19 17:04:41 +08:00
Patrick Donnelly
2f7765a8dc
Merge PR #19534 into mimic-dev1
* refs/pull/19534/head:
	qa: don't configure ec data pool with memstore

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-12-18 21:31:35 -08:00
Patrick Donnelly
b2284f23b8
qa: don't configure ec data pool with memstore
Fixes: http://tracker.ceph.com/issues/22436

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-18 21:12:22 -08:00
Haomai Wang
6e905de9bf
Merge pull request #19586 from liewegas/wip-22231
Revert "msg/async/AsyncConnection: unregister connection when racing happened"
2017-12-19 11:55:32 +08:00
Sage Weil
01dd3dd79c Revert "msg/async/AsyncConnection: unregister connection when racing happened"
This reverts commit 5216309c25.  Seeing many
many instances of

     0> 2017-12-19 00:04:34.146 7fed2ebc1700 -1 /build/ceph-13.0.0-4128-gc27b472/src/msg/async/AsyncConnection.cc: In function 'void AsyncConnection::process()' thread 7fed2ebc1700 time 2017-12-19 00:04:34.147015
/build/ceph-13.0.0-4128-gc27b472/src/msg/async/AsyncConnection.cc: 726: FAILED assert(0 == "old msgs despite reconnect_seq feature")

 ceph version 13.0.0-4128-gc27b472 (c27b4726c18322825fbc2a58de2759766e332fa6) mimic (dev)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x55ce15c5bab2]
 2: (AsyncConnection::process()+0x25f6) [0x55ce15f347e6]
 3: (EventCenter::process_events(int, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> >*)+0x6e8) [0x55ce15cf5988]
 4: (()+0xb7b965) [0x55ce15cf8965]
 5: (()+0xb8c80) [0x7fed30e02c80]
 6: (()+0x76ba) [0x7fed314f16ba]
 7: (clone()+0x6d) [0x7fed305683dd]

See http://tracker.ceph.com/issues/22231
Signed-off-by: Sage Weil <sage@redhat.com>
2017-12-18 21:40:06 -06:00
lvshanchun
416cdfc76b rgw: create sync-module instance when execute radosgw-admin data sync run
Signed-off-by: lvshanchun <lvshanchun@gmail.com>
2017-12-19 10:53:06 +08:00
Bingyin Zhang
6ed481cc17 rgw: remove unused variable bl in file rgw_op.cc
Signed-off-by: Bingyin Zhang <zhangbingyin@cloudin.cn>
2017-12-19 09:37:05 +08:00
Patrick Donnelly
435babe4a4
mds: reduce debugging level for balancer messages
Fixes: http://tracker.ceph.com/issues/21853

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-18 11:50:38 -08:00
Casey Bodley
b5eaa02a8d
Merge pull request #19129 from qrGitHub/wip-rgw-unused-param
rgw: remove unused param in get_bucket_instance_policy_from_attr

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-12-18 14:11:43 -05:00
Yuri Weinstein
054c364f8d
Merge pull request #18662 from ZVampirEM77/wip-em-rewriteobj
rgw: fix rewrite a versioning object create a new object bug

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-12-18 08:48:05 -08:00
Yuri Weinstein
a00a008225
Merge pull request #19131 from theanalyst/usage-trim
cls/rgw: trim all usage entries in cls_rgw

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-12-18 08:47:23 -08:00
Yuri Weinstein
53f472854d
Merge pull request #19272 from cfanz/wip2-optimize-get_obj_vals
cls_rgw: use more effective container operations in get_obj_vals

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-12-18 08:46:32 -08:00
Yuri Weinstein
53b0a7b46d
Merge pull request #19438 from cbodley/wip-qa-rgw-multisite-trim
qa/rgw: disable log trim in multisite suite
2017-12-18 08:46:03 -08:00
Yuri Weinstein
db6349b6c1
Merge pull request #17482 from yaozongyou/rgw-admin-process-all-gc-objects
rgw-admin: support for processing all gc objects including unexpired.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-12-18 08:45:08 -08:00
Casey Bodley
ca4510bc76 rgw: dont log EBUSY errors in 'sync error list'
these temporary errors get retried automatically, so no admin
intervention is required. logging them only serves to waste space in
omap and obscure the more serious sync errors

Fixes: http://tracker.ceph.com/issues/22473

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-12-18 11:42:23 -05:00
Patrick Donnelly
a313e6fe59
Merge PR #19234 into master
* refs/pull/19234/head:
	mds: handle client session messages when mds is stopping

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-18 06:53:03 -08:00
John Spray
213af8b666
Merge pull request #19533 from batrick/vstart-runner-fixes
vstart_runner: fixes for recent cephfs changes

Reviewed-by: John Spray <john.spray@redhat.com>
2017-12-18 13:18:12 +00:00
Dan van der Ster
4f581e738e mgr/balancer: fix KeyError in balancer rm
Fix the typo in the plan name which leads to a KeyError in balancer
rm.

Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
Fixes: http://tracker.ceph.com/issues/22470
2017-12-18 13:53:20 +01:00
Bingyin Zhang
bafe561e71 rgw: adjust log format for lifecycle
Signed-off-by: Bingyin Zhang <zhangbingyin@cloudin.cn>
2017-12-18 18:10:20 +08:00
You Ji
065b7bb8c5 mds/MDSMap : use arrary_section for mds stat
http://tracker.ceph.com/issues/22338
Signed-off-by: You Ji <youji@ebay.com>
2017-12-17 18:59:03 -07:00
Yan, Zheng
559fdcaec2 mds: handle client session messages when mds is stopping
handle session messages except CEPH_SESSION_REQUEST_OPEN. The problem
I found is that mds ignores CEPH_SESSION_REQUEST_RENEWCAPS, which
causes client sessions to become stale. Locker::revoke_stale_caps()
increases client caps' sequence number. This causes clients to warn
about caps' sequence number mismatch when handle caps import/export
message.

mds should handle CEPH_SESSION_FLUSHMSG_ACK message too. Because
one step of exporting subtree is flushing session messages.

Fixes:  http://tracker.ceph.com/issues/22460
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-12-18 09:09:10 +08:00
Yan, Zheng
f383470a56 osdc/Journaler: introduce STATE_STOPPING state
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-12-18 09:06:31 +08:00
Patrick Donnelly
80c186f2d6
Merge PR #19421 into master
* refs/pull/19421/head:
	cephfs-journal-tool: tool would miss to report some invalid range

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-12-17 16:10:01 -08:00
Patrick Donnelly
62d2e2e3de
Merge PR #19277 into master
* refs/pull/19277/head:
	cephfs: potential adjust failure in lru_expire

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-12-17 16:08:22 -08:00
Sage Weil
886af910ce
Merge pull request #19548 from tchaikov/mimic-gcc-7
build mimic-dev1 with gcc 7
2017-12-16 10:52:14 -06:00
Mykola Golub
43b88419d4
Merge pull request #19550 from dillaman/wip-22461
rbd-mirror: cluster watcher should ensure it has latest OSD map

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-12-16 16:32:51 +02:00
Alfredo Deza
4ee0e9eb5b
Merge pull request #19458 from wido/ceph-volume-eol
ceph-volume: Add linesep/newline at end of JSON file when writing

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-12-16 08:38:28 -05:00
Kefu Chai
7459713cf5
Merge pull request #19518 from jcsp/wip-mgr-access-denied
mgr: fix "access denied" message

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-12-16 12:32:40 +08:00
Kefu Chai
258b10cc01
Merge pull request #19515 from tchaikov/wip-cmake-lttng-leak
cmake: link libcommon with libstdc++ statically if WITH_STATIC_LIBSTDCXX

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-12-16 12:31:57 +08:00
Kefu Chai
419a182241
Merge pull request #19490 from adamemerson/wip-hypomodern
Update C++ standard to 14 and clean up

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-12-16 12:31:13 +08:00
Kefu Chai
5ad7efd61f
Merge pull request #19486 from liewegas/wip-22419
osd: pass pool options to ObjectStore on pg create

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2017-12-16 12:29:15 +08:00
Kefu Chai
5d9dd9e12c
Merge pull request #19385 from liewegas/wip-stdout-logs
mon: allow cluter and debug logs to go to stderr, with appropriate prefix

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-12-16 12:27:57 +08:00
Kefu Chai
6c13ea9a6a
Merge pull request #19542 from tchaikov/mimic-22093
qa: decrease the msg_inject_socket_failures from 1/500 to 1/1000

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-12-16 12:27:00 +08:00
root
7708bff40c cephfs-journal-tool: tool would miss to report some invalid range
Fixes: http://tracker.ceph.com/issues/22459
Signed-off-by: dongdong tao <tdd21151186@gmail.com>
2017-12-16 11:56:13 +08:00
root
590c39eab0 cephfs: potential adjust failure in lru_expire
Fix: the first adjust is no needed,it will never take real effect.
     the second 'adjust' may never get the chance to be executed
     suppose we can reach the second 'adjust', it will crash because the bottom list is empty now.

Fixes: http://tracker.ceph.com/issues/22458

Signed-off-by: dongdong tao <tdd21151186@gmail.com>
2017-12-16 11:44:19 +08:00
myoungwon oh
9d2456fc43
Merge pull request #19464 from myoungwon/wip-bug-fix-22369
osd: fix unordered read bug (for chunked object)

Reviewed-by: Sage Weil <sage@redhat.com>
2017-12-16 10:50:44 +09:00
Patrick Donnelly
634a2ccb34
Merge PR #19535 into master
* refs/pull/19535/head:
	doc: clarify type of client in config ref

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-12-15 15:31:30 -08:00
Jason Dillaman
9eb247961a rbd-mirror: cluster watcher should ensure it has latest OSD map
Fixes: http://tracker.ceph.com/issues/22461
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-15 14:51:46 -05:00