Commit Graph

3094 Commits

Author SHA1 Message Date
Casey Bodley
f473d57013 librados: add async interfaces for use with Networking TS
Defines asynchronous librados operations that satisfy all of the
"Requirements on asynchronous operations" imposed by the C++ Networking
TS [1] in section 13.2.7. These operations are implemented in terms of
boost::asio, but the interfaces themselves are free of boost types -
this makes the transition to std::net trivial when it's available.

These interfaces conform to the Extensible Asynchronous Model [2] that
originated in boost::asio. This model allows the last 'handler' argument
to either be a callback that gets the result, a coroutine yield_context
that will suspend until completion, or a 'use_future' tag to request the
result in a std::future (see the unit tests for examples of each). The
'Extensible' part also enables further integration with new frameworks.

For now, only async_read(), async_write(), and the read/write variants
of async_operate() are provided.

[1] Working Draft, C++ Extensions for Networking
http://www.open-std.org/jtc1/sc22/wg21/docs/papers/2017/n4711.pdf
[2] "Library Foundations for Asynchronous Operations"
http://www.open-std.org/jtc1/sc22/wg21/docs/papers/2014/n3896.pdf

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-01-09 09:58:18 -05:00
Sage Weil
0cdb6a74e7
Merge pull request #19616 from ifed01/wip-ifed-revert-extents
osd: get rid off extent map in object_info

Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-09 08:44:52 -06:00
Yuri Weinstein
c30eca51a4
Merge pull request #19765 from liewegas/wip-force-backfill-cleanups
qa: tolerate failure to force backfill

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-08 12:50:18 -08:00
Igor Fedotov
1653bcca3e qa/standalone/scrub/osd-scrub-repair.sh: remove extents flag from object_info_t
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-01-08 20:10:16 +03:00
Jason Dillaman
50ef9aff9d
Merge pull request #19704 from trociny/wip-nbd-format
rbd-nbd: output format support for list-mapped command

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-01-07 09:04:35 -05:00
Kefu Chai
e7097593a7 qa/standalone: remove osd-map-max-advance related tests
this setting was removed in 8967b73

Fixes: http://tracker.ceph.com/issues/22596
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-01-06 19:40:15 +08:00
Patrick Donnelly
f6e1a797d4
Revert "Merge PR #19369 into master"
This reverts commit 3189ba19a7, reversing
changes made to b7620de020.

Despite the change in json format being positive, the unfortunate side-effect
is that it broke upgrade testing (because the QA framework must handle the
transition of mdsmap["info"] to a list from object) and the ceph-mgr.

Fixes: http://tracker.ceph.com/issues/22527
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-04 09:42:37 -08:00
Sage Weil
819a3578fa Merge tag 'v13.0.1' 2018-01-03 10:04:20 -06:00
Sage Weil
8651e15c93 qa/tasks/ceph_manager: tolerate failure to force backfill/recoery
The pool may have been deleted out from underneath us.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-03 08:37:02 -06:00
Mykola Golub
e372e9492b rbd-nbd: output format support for list-mapped command
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-01-03 14:44:10 +02:00
Mykola Golub
a5fd0e71d1
Merge pull request #19724 from dillaman/wip-18480
rbd: support cloning an image from a non-primary snapshot

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-01-03 14:11:25 +02:00
Jason Dillaman
e4b8ae348b
Merge pull request #19666 from trociny/wip-nbd-unmap-by-image
rbd-nbd: allow to unmap by image or snap spec

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-01-02 20:35:30 -05:00
Yuri Weinstein
10fc85089c qa/tests - Added options to use both cases: mon.a and installer.0
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-01-02 10:12:54 -08:00
Kefu Chai
0cd700e64d
Merge pull request #19634 from jcsp/wip-22514
qa: configure zabbix properly before selftest

Reviewed-by: Sage Weil <sage@redhat.com>
2018-01-03 00:09:37 +08:00
Jason Dillaman
c7c15b681c librbd: permit creation of clones against non-primary images
Fixes: http://tracker.ceph.com/issues/18480
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-01-02 10:11:56 -05:00
Sage Weil
6dc41a2bb1
Merge pull request #19605 from ceph/wip-use-installer0-master
qa/tests: run ceph-ansible task on installer.0 role/node
2017-12-29 10:45:06 -06:00
Mykola Golub
be87e8b118 rbd-ggate: allow to unmap by image or snap spec
(to match the behaviour of krbd unmap)

Signed-off-by: Mykola Golub <to.my.trociny@gmail.com>
2017-12-27 20:29:58 +00:00
Mykola Golub
8e0f40aae1 rbd-ggate: extended info when listing devices
This matches nbd and krbd drivers output.

Signed-off-by: Mykola Golub <to.my.trociny@gmail.com>
2017-12-27 20:29:58 +00:00
Mykola Golub
02e211c282 rbd-nbd: allow to unmap by image or snap spec
(to match the behaviour of krbd unmap)

Signed-off-by: Mykola Golub <mgolub@suse.com>
2017-12-25 17:19:49 +02:00
Mykola Golub
47e38ca1b9 qa/workunits/rbd: bench-write is part of exclusive option test
Signed-off-by: Mykola Golub <mgolub@suse.com>
2017-12-25 17:19:49 +02:00
Patrick Donnelly
3189ba19a7
Merge PR #19369 into master
* refs/pull/19369/head:
	qa: update handling of fs status format
	PendingReleaseNotes: add note for format change
	mds/MDSMap : use arrary_section for mds stat

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Xiaoxi Chen <xiaoxchen@ebay.com>
2017-12-21 20:21:18 -08:00
Sage Weil
1a549a01ca
Merge pull request #19588 from batrick/i22475
qa: check pool full flags

Reviewed-by: Sage Weil <sage@redhat.com>
2017-12-21 15:16:54 -06:00
Patrick Donnelly
1f1a2a27ef
qa: update handling of fs status format
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-21 10:35:09 -08:00
John Spray
c64c9ff00d qa: configure zabbix properly before selftest
Even though the selftest routine doesn't care about
the settings, we should set them to avoid emitting
nasty log/health messages when enabling the module.

Fixes: http://tracker.ceph.com/issues/22514
Signed-off-by: John Spray <john.spray@redhat.com>
2017-12-21 08:28:55 -05:00
Yuri Weinstein
3b2a26d919 qa/tests: run ceph-ansible task on installer.0 role/node
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2017-12-20 13:12:41 -08:00
Sage Weil
f33ab7e03a Merge remote-tracking branch 'gh/mimic-dev1' 2017-12-20 15:08:30 -06:00
Sage Weil
cd31bf91d8
Merge pull request #19600 from liewegas/wip-mimic-trusty-backports
qa: mimic-dev1 backports to avoid trusty nodes
2017-12-20 14:58:32 -06:00
Sage Weil
6446303916
Merge pull request #19544 from tchaikov/mimic-qa-pass-options-the-right-way
qa/stanalone: pass options using --<option-name>=<value>

Revewed-by: Alfredo Deza <adeza@redhat.com>
2017-12-20 14:57:38 -06:00
Sage Weil
a3a911f9dd qa/suites/rbd: fewer socket failures
500 makes the mgr fail.  Fewer failures, and whitelist them if they
happen.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-12-20 14:17:46 -06:00
Mykola Golub
9a1f52e89b
Merge pull request #19604 from dillaman/wip-22485
qa/workunits/rbd: simplify split-brain test to avoid potential race

Reviewed-by: Mykola Golub <mgolub@suse.com>
2017-12-20 15:45:36 +02:00
Jason Dillaman
8c2ee6dd0f qa/workunits/rbd: simplify split-brain test to avoid potential race
Fixes: http://tracker.ceph.com/issues/22485
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-12-19 16:30:25 -05:00
Sage Weil
06b7707cee
Merge pull request #19456 from liewegas/wip-22373
qa/standalone/ceph-helpers: pass --verbose to ceph-disk
2017-12-19 11:55:07 -06:00
Kefu Chai
18fe287989 qa/suites/hadoop: switch from trusty to ubuntu latest
use the ubuntu_face.yaml facet for the distro used for testing. since we
are dropping the support for trusty.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit dbe33502cb)
2017-12-19 11:12:33 -06:00
Kefu Chai
0d1f3d2603 qa/suites/fs: use ubuntu_latest for multiclient tasks
instead of using ubuntu 14.04, since we want to drop the support of this
release.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 88311be439)
2017-12-19 11:12:31 -06:00
Kefu Chai
4ec785b945 qa/suites/fs: use ubuntu_latest for libcephfs_java
* instead of using ubuntu 14.04, use ubuntu_latest.since we want
  to drop the support of this release.
* refactor this test to use the facet of ubuntu_latest.yaml.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit aa89bb2f93)
2017-12-19 11:12:28 -06:00
Kefu Chai
4d266e3347 qa/tasks: remove test_buildpackages
the buildpackages feature is not part of ceph. and its test was moved to
teuthology in 5a43f8d5. let's remove the leftovers from ceph/ceph. BTW,
we have not run this test suite since then. and its dependency cannot be
fulfilled.

Signed-off-by: Kefu Chai <kchai@redhat.com>
(cherry picked from commit 582f04508f)
2017-12-19 11:12:25 -06:00
Patrick Donnelly
6e046dfc90
qa: check pool full flags
Cluster-wide flag removed in b4ca5ae462c6f12ca48b787529938862646282cd.

Fixes: http://tracker.ceph.com/issues/22475

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-18 21:59:57 -08:00
Patrick Donnelly
b2284f23b8
qa: don't configure ec data pool with memstore
Fixes: http://tracker.ceph.com/issues/22436

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-18 21:12:22 -08:00
Yuri Weinstein
53b0a7b46d
Merge pull request #19438 from cbodley/wip-qa-rgw-multisite-trim
qa/rgw: disable log trim in multisite suite
2017-12-18 08:46:03 -08:00
John Spray
213af8b666
Merge pull request #19533 from batrick/vstart-runner-fixes
vstart_runner: fixes for recent cephfs changes

Reviewed-by: John Spray <john.spray@redhat.com>
2017-12-18 13:18:12 +00:00
myoungwon oh
9d2456fc43
Merge pull request #19464 from myoungwon/wip-bug-fix-22369
osd: fix unordered read bug (for chunked object)

Reviewed-by: Sage Weil <sage@redhat.com>
2017-12-16 10:50:44 +09:00
Patrick Donnelly
ee9d5f9a45
Merge PR #19440 into master
* refs/pull/19440/head:
	mds: update mds option descriptions
	mds: obsolete MDSMap option configs
	mds: organize Filesystem class def

Reviewed-by: John Spray <john.spray@redhat.com>
2017-12-15 11:07:58 -08:00
Kefu Chai
2ceff9eb4e qa/stanalone: pass options using --<option-name>=<value>
not "--<option-name> <value>', otherwise `ceph-authtool` would error
out:

$ CEPH_ARGS='--osd-map-max-advance 1000' bin/ceph-authtool --gen-print-key
bin/ceph-authtool: unexpected '1000'
usage: ceph-authtool keyringfile [OPTIONS]...
....

but using the syntax of `--<option-name>=<value>', it works:

$ CEPH_ARGS='--osd-map-max-advance=1000' bin/ceph-authtool --gen-print-key
AQBAhTNamf5+ABAASkAp/6IGq7LkUTEOMp/fgw==

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-12-15 16:19:15 +08:00
Kefu Chai
6b3d0f61f9 qa: decrease the msg_inject_socket_failures from 1/500 to 1/1000
Fixes: http://tracker.ceph.com/issues/22093
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-12-15 14:21:43 +08:00
Patrick Donnelly
cd1e5f53f0
vstart_runner: ignore failed dentry invalidation
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-13 19:15:43 -08:00
Patrick Donnelly
0f507d8855
vstart_runner: set ec_profile attribute
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-13 19:15:39 -08:00
Patrick Donnelly
67ca6cd229
mds: obsolete MDSMap option configs
These configs were used for initialization but it is more appropriate to
require setting these file system attributes via `ceph fs set`. This is similar
to what was already done with max_mds. There are new variables added for `fs
set` where missing.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-13 18:30:52 -08:00
myoungwon oh
56462d5ee8 qa/suites/rados/thrash: remove write op
current chunked object and ChunkReadOp are
only for the read case.
write op and promote_object() still be tested without ChunkReadOp
by another ceph_test_rados in the same test suite (with --set_chunk)

Signed-off-by: Myoungwon Oh <omwmw@sk.com>
2017-12-14 01:27:02 +09:00
Kefu Chai
a2b310b1c6
Merge pull request #19478 from tchaikov/wip-silence-warnings
qa/standalone/ceph-helpers.sh: silence ceph-disk DEPRECATION_WARNING

Reviewed-by: Sage Weil <sage@redhat.com>
2017-12-13 22:08:50 +08:00
Kefu Chai
c7539de95c
Merge pull request #19365 from liewegas/wip-tell
qa/tasks/ceph_manager: tolerate tell osd.* error

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-12-13 19:58:41 +08:00