Commit Graph

50148 Commits

Author SHA1 Message Date
xie xingguo
3cfb83d1d5 librados: remove unused local variables
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-02-24 16:59:33 +08:00
xie xingguo
8caa2e455c librados: do not clear handle for aio_watch()
which is needed for aio_unwatch() to work.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-02-24 16:56:23 +08:00
Erwan Velu
48af4bec8b tests/ceph-disk: Let teardown clearing data
When running the ceph-disk check suite, 'test_mark_init' & 'test_activate_dir' had a
permission denied of the freshly created stuff like in :

tests/ceph-disk.sh:237: test_mark_init:  /bin/rm -fr /ceph/src/ceph-disk/test-ceph-disk/dir
/bin/rm: cannot remove « /ceph/src/ceph-disk/test-ceph-disk/dir/snap_1 »: Permission denied
/bin/rm: cannot remove « /ceph/src/ceph-disk/test-ceph-disk/dir/current »: Permission denied
/bin/rm: cannot remove « /ceph/src/ceph-disk/test-ceph-disk/dir/snap_2 »: Permission denied

Those two tests are starting a mon with run_mon.
Trying to delete the files while the daemon are still alive is impossible.
This patch removes the explicit 'rm' and let the teardown doing the cleaning
stuff by stopping daemons & cleaning content.

By using this patch, make check is now sucessful on ceph-disk.

Signed-off-by: Erwan Velu <erwan@redhat.com>
2016-02-24 09:56:01 +01:00
Erwan Velu
57f31e9536 tests/ceph-disk: Using dummy device mappers
When doing a make test, if your local setup was running a "dm-0" or "dm-1",
the make check was failing.

The detection of the local "dm-x" were leading to a wrong comparaison with
the expected simulated values.

The fix is using a dummy name for that "dm" to prevent any collision with the local setup.

Prior that patch, a typical output of that error looked like :

>               assert expect == main.list_devices()
E               assert [{'partitions...: '/dev/Xda'}] == [{'partitions'...: '/dev/Xda'}]
E                 At index 0 diff: {'partitions': [{'dmcrypt': {'holders': ['dm-0'], 'type': 'plain'}, 'ptype': '4fbd7e29-9d25-41b8-afd0-5ec00ceff05d', 'path': '/dev/Xda1', 'is_partition': True, 'mount': None, 'uuid': '56244cf5-83ef-4984-888a-2d8b8e0e04b2', 'type': 'data', 'state': 'unprepared', 'fs_type': None}], 'path': '/dev/Xda'} != {'partitions': [{'ptype': '4fbd7e29-9d25-41b8-afd0-5ec00ceff05d', 'whoami': None, 'path': '/dev/Xda1', 'is_partition': True, 'mount': '/var/cache/ccache', 'uuid': '56244cf5-83ef-4984-888a-2d8b8e0e04b2', 'ceph_fsid': None, 'fs_type': 'btrfs', 'dmcrypt': {'holders': ['dm-0'], 'type': 'plain'}, 'type': 'data', 'state': 'active'}], 'path': '/dev/Xda'}
E                 Full diff:
E                 - [{'partitions': [{'dmcrypt': {'holders': ['dm-0'], 'type': 'plain'},
E                 + [{'partitions': [{'ceph_fsid': None,
E                 +                   'dmcrypt': {'holders': ['dm-0'], 'type': 'plain'},
E                 -                   'fs_type': None,
E                 ?                              ^^^^
E                 +                   'fs_type': 'btrfs',
E                 ?                              ^^^^^^^
E                 'is_partition': True,
E                 -                   'mount': None,
E                 +                   'mount': '/var/cache/ccache',
E                 'path': '/dev/Xda1',
E                 'ptype': '4fbd7e29-9d25-41b8-afd0-5ec00ceff05d',
E                 -                   'state': 'unprepared',
E                 ?                             ^^^^ -----
E                 +                   'state': 'active',
E                 ?                             ^^^^^
E                 'type': 'data',
E                 -                   'uuid': '56244cf5-83ef-4984-888a-2d8b8e0e04b2'}],
E                 ?                                                                 --
E                 +                   'uuid': '56244cf5-83ef-4984-888a-2d8b8e0e04b2',
E                 +                   'whoami': None}],
E                 'path': '/dev/Xda'}]

tests/test_main.py:342: AssertionError

Signed-off-by: Erwan Velu <erwan@redhat.com>
2016-02-24 09:55:57 +01:00
Erwan Velu
ba05b7e700 tests/ceph-disk: Creating missing working dir
When running run-tox.sh in a very simple env,
the test will fail if '/var/lib/ceph/tmp' doesn't exist.

This patch adds a check to create this directory if required as mkdtemp doesn't do it for you.

Prior this patch, the following behavior was seen :

tests/test_main.py:342:
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _
ceph_disk/main.py:3753: in list_devices
    fstype=fs_type, options='')
ceph_disk/main.py:1217: in mount
    dir=STATEDIR + '/tmp',
_ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _

suffix = '', prefix = 'mnt.', dir = '/var/lib/ceph/tmp'

    def mkdtemp(suffix="", prefix=template, dir=None):
        """User-callable function to create and return a unique temporary
        directory.  The return value is the pathname of the directory.

        Arguments are as for mkstemp, except that the 'text' argument is
        not accepted.

        The directory is readable, writable, and searchable only by the
        creating user.

        Caller is responsible for deleting the directory when done with it.
        """

        if dir is None:
            dir = gettempdir()

        names = _get_candidate_names()

        for seq in xrange(TMP_MAX):
            name = names.next()
            file = _os.path.join(dir, prefix + name + suffix)
            try:
>               _os.mkdir(file, 0700)
E               OSError: [Errno 2] No such file or directory: '/var/lib/ceph/tmp/mnt.KoAV85'

/usr/lib64/python2.7/tempfile.py:333: OSError

Signed-off-by: Erwan Velu <erwan@redhat.com>
2016-02-24 09:55:46 +01:00
Jason Dillaman
dc5a9053ce Merge pull request #7649 from yuyuyu101/wip-async-watch
librados: implement async watch/unwatch

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-02-23 23:41:03 -05:00
You Ji
f59c872d4c test: enable test for bug #2339 which has been resolved.
Signed-off-by: You Ji <jiyou09@gmail.com>
2016-02-23 20:36:37 -07:00
Josh Durgin
0b56c5e550 Merge pull request #7761 from dillaman/wip-14847
librbd: fix state machine race conditions during shut down

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-02-23 18:07:12 -08:00
Haomai Wang
7109de7b80 RadosClient: call watch_flush before finisher stop
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-02-24 09:29:05 +08:00
Mykola Golub
e688a44e35 cls_rbd: async version of dir_get_name
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-02-23 22:23:21 +02:00
Yehuda Sadeh
635ae88a19 Merge pull request #7632 from zaitcev/cleanup-dead-code-3
rgw: Drop unused usage_exit from rgw_admin.cc

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-23 11:44:50 -08:00
Yehuda Sadeh
06681eddc9 Merge pull request #7285 from magicrobotmonkey/patch-1
Increase verbosity level on RGWObjManifest line

Reviewed-by: Yehuda Saeh <yehuda@redhat.com>
2016-02-23 11:25:38 -08:00
Yehuda Sadeh
a6538d40f9 Merge pull request #7618 from zaitcev/wip-5073-subuser-bis
rgw: Fix subuser harder with tenants

Reviewed-y: Yehuda Sadeh <yehuda@redhat.com>
2016-02-23 11:23:16 -08:00
Sage Weil
933ae4ca9e Merge pull request #7763 from dachary/wip-releases
doc: fix 0.94.4 and 0.94.5 ordering
2016-02-23 13:18:00 -05:00
Jason Dillaman
a1a0e96c3d Merge pull request #7364 from javenwu/master
common: default cluster name to config file prefix

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-02-23 13:17:52 -05:00
Jason Dillaman
89878e8f2d Merge pull request #7548 from yuyuyu101/librbd-avoid-memcpy
librbd: reduce mem copies to user-buffer during read

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-02-23 13:15:29 -05:00
Jason Dillaman
76dc44713d Merge pull request #7667 from jdurgin/wip-14780
Revert "librbd: use task finisher per CephContext"

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-02-23 13:14:23 -05:00
Haomai Wang
7b3334ac68 Merge pull request #7625 from branch-predictor/bp-async-more
msg/async: smarter MSG_MORE

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-02-24 01:30:34 +08:00
Loic Dachary
dafe0d9773 doc: fix 0.94.4 and 0.94.5 ordering
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-24 00:13:53 +07:00
Casey Bodley
479366a584 Merge pull request #7760 from theanalyst/fix/rgw-fcgi-build
rgw: fcgi should include acconfig
2016-02-23 11:02:03 -05:00
Jason Dillaman
e67099d036 librbd: deterministically unblock writes on snap set
Previously this was handled in the state machine's destructor,
but that can lead to nondeterministic behavior due to interactions
between threads.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-23 10:59:09 -05:00
Jason Dillaman
514519a69f librbd: avoid close race-condition within ImageState
The lock was previously unlocked/locked to avoid lock cycles. This
creates an issue when closing the image because the another thread
might have already deleted the ImageState before the lock could be
re-locked.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-23 10:53:13 -05:00
Abhishek Lekshmanan
f3fc6b15fd rgw: fcgi should include acconfig
As it references FASTCGI_INCLUDE_DIR which is referenced from it

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-02-23 16:39:06 +01:00
Sage Weil
c7c1d281db doc/release-notes: v0.94.6 final notes
Signed-off-by: Sage Weil <sage@redhat.com>
2016-02-23 10:35:34 -05:00
Sage Weil
de0be8af45 Merge pull request #7689 from dachary/wip-release-notes
release-notes: draft v0.94.6 release notes
2016-02-23 10:29:53 -05:00
Piotr Dałek
c5a6b6a5ae msg/async: cut the middle-man
Get rid of complete_bl and let messenger write directly to outcoming_bl of
a connection. Also, if message bufferlist is small enough, append its
contents to outcoming_bl directly, so we'll use less iovecs and in best
case, pack entire message (together with header and footer added in
write_message()) in single bufferptr.

Signed-off-by: Piotr Dałek <piotr.dalek@ts.fujitsu.com>
2016-02-23 15:52:42 +01:00
Haomai Wang
bd89343865 Merge pull request #7725 from ceph/wip-fix-async-valgrind
AsyncMessenger: fix valgrind leak
2016-02-23 22:19:34 +08:00
Kefu Chai
dd17b51367 Merge pull request #7758 from dachary/wip-ceph-disk-prepare-help
ceph-disk: fix prepare --help

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-02-23 21:11:18 +08:00
Loic Dachary
4a61793c5b ceph-disk: fix prepare --help
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-23 18:56:07 +07:00
Kefu Chai
0ae120dbd0 Merge pull request #7756 from dachary/wip-ceph-disk-args
ceph-disk: deactivate / destroy PATH arg are optional

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-02-23 19:12:08 +08:00
Loic Dachary
ac241ab441 ceph-disk: deactivate / destroy PATH arg are optional
And the mandatory positional arguments need not be == 1, it is enough to
leave the nargs parameter out.

Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-23 16:16:47 +07:00
Mykola Golub
103eee4d13 test: image_replay: use flush to speedup commit position update
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-02-23 09:25:53 +02:00
Mykola Golub
9572d27a52 rbd-mirror: add asok commands to get image replyer status and flush
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-02-23 09:25:45 +02:00
Mykola Golub
1a6dfa4621 rbd-mirror: store sync snapshot name in registered client
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-02-23 09:25:37 +02:00
Mykola Golub
79dcef2794 librbd: add field to MirrorPeerClientMeta to store snap name
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-02-23 09:25:31 +02:00
Mykola Golub
e92b45278c rbd-mirror: ImageReplayer: pass registered client ID as external param
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-02-23 09:25:20 +02:00
Loic Dachary
4bb184f1e3 Merge pull request #7687 from yangdongsheng/ceph-disk_nargs
ceph-disk: make some arguments as required if necessary

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-02-23 12:08:46 +07:00
Sage Weil
e9a4cd13ad Merge pull request #7640 from batrick/vstart-btrfs-missing
vstart.sh: silence a harmless msg where btrfs is not found

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-02-22 21:59:28 -05:00
Jason Dillaman
89764124b3 Merge pull request #7737 from trociny/wip-librados_test_stub-debug
test: more debug logging for TestWatchNotify

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-02-22 12:37:33 -05:00
Sage Weil
b9a4b977a3 Merge pull request #7714 from SUSE/wip-qa-typo
doc: standardize @param (not @parma, @parmam, @params)

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-02-22 12:36:42 -05:00
Jason Dillaman
289403df3c Merge pull request #7738 from trociny/test-librbd-poolname
test: create pools for rbd tests with different prefix

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-02-22 12:36:01 -05:00
Sage Weil
dd478ffeff Merge pull request #7727 from jmunhoz/ceph-fix-14829
vstart.sh: avoid race condition starting rgw via vstart.sh

Reviewed-by: Sage Weil <sage@redhat.com>
2016-02-22 12:29:47 -05:00
Jason Dillaman
93f255c988 Merge pull request #7614 from trociny/wip-rbd-mirroring-image-reply
rbd-mirror: implement ImageReplayer

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-02-22 11:47:49 -05:00
Loic Dachary
ebc7a92f18 Merge pull request #7744 from dachary/wip-14838-ceph-disk-dmcrypt
ceph-disk: s/dmcrpyt/dmcrypt/

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2016-02-22 23:07:35 +07:00
Loic Dachary
ef6aafa854 ceph-disk: s/dmcrpyt/dmcrypt/
http://tracker.ceph.com/issues/14838 Fixes: #14838

Signed-off-by: Frode Sandholtbraaten <fsa@basefarm.no>
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-02-22 23:02:46 +07:00
Radoslaw Zarzynski
a7a5cf2b91 rgw: return proper error codes in S3/Keystone auth.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-02-22 16:24:25 +01:00
Radoslaw Zarzynski
19843ce2b5 rgw: enable users of RGWHTTPClient to get HTTP status code.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-02-22 16:24:25 +01:00
Radoslaw Zarzynski
7186d1cbbb rgw: improve debugs around S3/Keystone auth mechanism.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-02-22 16:16:45 +01:00
Kefu Chai
838b367529 Merge pull request #7688 from tchaikov/wip-14788
buffer: hide iterator_impl symbols

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-02-22 22:42:41 +08:00
Mykola Golub
83da093637 test: create pools for rbd tests with different prefix
This makes easier to find out what test fails to cleanup.

Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-02-22 09:37:36 +02:00