Commit Graph

81638 Commits

Author SHA1 Message Date
Kefu Chai
18fe287989 qa/suites/hadoop: switch from trusty to ubuntu latest
use the ubuntu_face.yaml facet for the distro used for testing. since we
are dropping the support for trusty.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit dbe33502cb)
2017-12-19 11:12:33 -06:00
Kefu Chai
0d1f3d2603 qa/suites/fs: use ubuntu_latest for multiclient tasks
instead of using ubuntu 14.04, since we want to drop the support of this
release.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 88311be439)
2017-12-19 11:12:31 -06:00
Kefu Chai
4ec785b945 qa/suites/fs: use ubuntu_latest for libcephfs_java
* instead of using ubuntu 14.04, use ubuntu_latest.since we want
  to drop the support of this release.
* refactor this test to use the facet of ubuntu_latest.yaml.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit aa89bb2f93)
2017-12-19 11:12:28 -06:00
Kefu Chai
4d266e3347 qa/tasks: remove test_buildpackages
the buildpackages feature is not part of ceph. and its test was moved to
teuthology in 5a43f8d5. let's remove the leftovers from ceph/ceph. BTW,
we have not run this test suite since then. and its dependency cannot be
fulfilled.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 582f04508f)
2017-12-19 11:12:25 -06:00
Casey Bodley
1946e3d0bb
Merge pull request #19576 from qrGitHub/wip-rgw-log-adjustment
rgw: adjust log format for lifecycle

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2017-12-19 10:41:53 -05:00
Sage Weil
54cf9c11a0
Merge pull request #19043 from liewegas/wip-22161
os/bluestore: prevent mount if osd_max_object_size >= 4G

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-12-19 09:33:30 -06:00
Casey Bodley
b2e431d03a
Merge pull request #19273 from qrGitHub/wip-rgw-typo-UNKNOWN
rgw: correct typo UNKOWN to UNKNOWN

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-12-19 10:16:34 -05:00
Sage Weil
d35fed9e95
Merge pull request #18196 from liewegas/wip-bluestore-sync-onreadable
os/bluestore: synchronous on_applied completions

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-12-19 08:22:53 -06:00
Jason Dillaman
2a8ab2d2d1 rbd-mirror: propagate deletion only if remote image doesn't exist
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:22:30 -05:00
Jason Dillaman
f3978ba566 rbd-mirror: only the leader should initialize the image deleter
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:13 -05:00
Jason Dillaman
3ccdc3f934 rbd-mirror: image deleter now only removes images from the trash
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:13 -05:00
Jason Dillaman
2b5095232d rbd-mirror: move images to trash when propagating deletions
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:13 -05:00
Jason Dillaman
e6330a41ef rbd-mirror: integrate trash watcher within image deleter
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:13 -05:00
Jason Dillaman
1afc6f5050 rbd-mirror: new 'rbd_mirroring_delete_delay' configuration option
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:13 -05:00
Jason Dillaman
8f485ec854 rbd-mirror: async mirroring trash move state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:13 -05:00
Jason Dillaman
62998f3de5 rbd-mirror: watch notifications for images added to trash
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:13 -05:00
Jason Dillaman
01f2d887db rbd-mirror: use one image deleter per pool
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
a3705f10ec rbd-mirror: avoid logging an error for expected bootstrap failures
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
f3affb6635 rbd-mirror: free memory after image deleter fails to open image
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
2a549a5946 librbd: async journal reset state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
1a40d7ca62 librbd: incorporate new trash notification messages
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
4466800cf0 librbd: watch/notify types for trash add/remove events
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
86a4b33d73 librbd: async trash move state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
Jason Dillaman
ed147192fd test/librados_test_stub: add mock version of create
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 09:09:12 -05:00
John Spray
dc236764ce
Merge pull request #19578 from cernceph/dvanders_brm
mgr/balancer: fix KeyError in balancer rm

Reviewed-by: John Spray <john.spray@redhat.com>
2017-12-19 11:40:33 +00:00
Patrick Donnelly
2f7765a8dc
Merge PR #19534 into mimic-dev1
* refs/pull/19534/head:
	qa: don't configure ec data pool with memstore

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-12-18 21:31:35 -08:00
Patrick Donnelly
b2284f23b8
qa: don't configure ec data pool with memstore
Fixes: http://tracker.ceph.com/issues/22436

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-18 21:12:22 -08:00
Haomai Wang
6e905de9bf
Merge pull request #19586 from liewegas/wip-22231
Revert "msg/async/AsyncConnection: unregister connection when racing happened"
2017-12-19 11:55:32 +08:00
Sage Weil
01dd3dd79c Revert "msg/async/AsyncConnection: unregister connection when racing happened"
This reverts commit 5216309c25.  Seeing many
many instances of

     0> 2017-12-19 00:04:34.146 7fed2ebc1700 -1 /build/ceph-13.0.0-4128-gc27b472/src/msg/async/AsyncConnection.cc: In function 'void AsyncConnection::process()' thread 7fed2ebc1700 time 2017-12-19 00:04:34.147015
/build/ceph-13.0.0-4128-gc27b472/src/msg/async/AsyncConnection.cc: 726: FAILED assert(0 == "old msgs despite reconnect_seq feature")

 ceph version 13.0.0-4128-gc27b472 (c27b4726c18322825fbc2a58de2759766e332fa6) mimic (dev)
 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x102) [0x55ce15c5bab2]
 2: (AsyncConnection::process()+0x25f6) [0x55ce15f347e6]
 3: (EventCenter::process_events(int, std::chrono::duration<unsigned long, std::ratio<1l, 1000000000l> >*)+0x6e8) [0x55ce15cf5988]
 4: (()+0xb7b965) [0x55ce15cf8965]
 5: (()+0xb8c80) [0x7fed30e02c80]
 6: (()+0x76ba) [0x7fed314f16ba]
 7: (clone()+0x6d) [0x7fed305683dd]

See http://tracker.ceph.com/issues/22231
Signed-off-by: Sage Weil <sage@redhat.com>
2017-12-18 21:40:06 -06:00
lvshanchun
416cdfc76b rgw: create sync-module instance when execute radosgw-admin data sync run
Signed-off-by: lvshanchun <lvshanchun@gmail.com>
2017-12-19 10:53:06 +08:00
Bingyin Zhang
6ed481cc17 rgw: remove unused variable bl in file rgw_op.cc
Signed-off-by: Bingyin Zhang <zhangbingyin@cloudin.cn>
2017-12-19 09:37:05 +08:00
Patrick Donnelly
435babe4a4
mds: reduce debugging level for balancer messages
Fixes: http://tracker.ceph.com/issues/21853

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-18 11:50:38 -08:00
Casey Bodley
b5eaa02a8d
Merge pull request #19129 from qrGitHub/wip-rgw-unused-param
rgw: remove unused param in get_bucket_instance_policy_from_attr

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-12-18 14:11:43 -05:00
Yuri Weinstein
054c364f8d
Merge pull request #18662 from ZVampirEM77/wip-em-rewriteobj
rgw: fix rewrite a versioning object create a new object bug

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-12-18 08:48:05 -08:00
Yuri Weinstein
a00a008225
Merge pull request #19131 from theanalyst/usage-trim
cls/rgw: trim all usage entries in cls_rgw

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-12-18 08:47:23 -08:00
Yuri Weinstein
53f472854d
Merge pull request #19272 from cfanz/wip2-optimize-get_obj_vals
cls_rgw: use more effective container operations in get_obj_vals

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-12-18 08:46:32 -08:00
Yuri Weinstein
53b0a7b46d
Merge pull request #19438 from cbodley/wip-qa-rgw-multisite-trim
qa/rgw: disable log trim in multisite suite
2017-12-18 08:46:03 -08:00
Yuri Weinstein
db6349b6c1
Merge pull request #17482 from yaozongyou/rgw-admin-process-all-gc-objects
rgw-admin: support for processing all gc objects including unexpired.

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-12-18 08:45:08 -08:00
Casey Bodley
ca4510bc76 rgw: dont log EBUSY errors in 'sync error list'
these temporary errors get retried automatically, so no admin
intervention is required. logging them only serves to waste space in
omap and obscure the more serious sync errors

Fixes: http://tracker.ceph.com/issues/22473

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-12-18 11:42:23 -05:00
Patrick Donnelly
a313e6fe59
Merge PR #19234 into master
* refs/pull/19234/head:
	mds: handle client session messages when mds is stopping

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-18 06:53:03 -08:00
John Spray
213af8b666
Merge pull request #19533 from batrick/vstart-runner-fixes
vstart_runner: fixes for recent cephfs changes

Reviewed-by: John Spray <john.spray@redhat.com>
2017-12-18 13:18:12 +00:00
Dan van der Ster
4f581e738e mgr/balancer: fix KeyError in balancer rm
Fix the typo in the plan name which leads to a KeyError in balancer
rm.

Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
Fixes: http://tracker.ceph.com/issues/22470
2017-12-18 13:53:20 +01:00
Bingyin Zhang
bafe561e71 rgw: adjust log format for lifecycle
Signed-off-by: Bingyin Zhang <zhangbingyin@cloudin.cn>
2017-12-18 18:10:20 +08:00
You Ji
065b7bb8c5 mds/MDSMap : use arrary_section for mds stat
http://tracker.ceph.com/issues/22338
Signed-off-by: You Ji <youji@ebay.com>
2017-12-17 18:59:03 -07:00
Yan, Zheng
559fdcaec2 mds: handle client session messages when mds is stopping
handle session messages except CEPH_SESSION_REQUEST_OPEN. The problem
I found is that mds ignores CEPH_SESSION_REQUEST_RENEWCAPS, which
causes client sessions to become stale. Locker::revoke_stale_caps()
increases client caps' sequence number. This causes clients to warn
about caps' sequence number mismatch when handle caps import/export
message.

mds should handle CEPH_SESSION_FLUSHMSG_ACK message too. Because
one step of exporting subtree is flushing session messages.

Fixes:  http://tracker.ceph.com/issues/22460
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-12-18 09:09:10 +08:00
Yan, Zheng
f383470a56 osdc/Journaler: introduce STATE_STOPPING state
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-12-18 09:06:31 +08:00
Patrick Donnelly
80c186f2d6
Merge PR #19421 into master
* refs/pull/19421/head:
	cephfs-journal-tool: tool would miss to report some invalid range

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-12-17 16:10:01 -08:00
Patrick Donnelly
62d2e2e3de
Merge PR #19277 into master
* refs/pull/19277/head:
	cephfs: potential adjust failure in lru_expire

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-12-17 16:08:22 -08:00
Sage Weil
886af910ce
Merge pull request #19548 from tchaikov/mimic-gcc-7
build mimic-dev1 with gcc 7
2017-12-16 10:52:14 -06:00
Mykola Golub
43b88419d4
Merge pull request #19550 from dillaman/wip-22461
rbd-mirror: cluster watcher should ensure it has latest OSD map

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-12-16 16:32:51 +02:00