Commit Graph

56825 Commits

Author SHA1 Message Date
Anirudha Bose
d0e29c74f8 ceph-disk: Compatibility fixes for Python 3
ceph-disk: Misc cleanups

Signed-off-by: Anirudha Bose <ani07nov@gmail.com>
2016-08-17 13:04:32 +05:30
Kefu Chai
e354918ec8 Merge pull request #10264 from yuyuyu101/wip-async-abstract-backend
msg/async: allow other async backend implementations

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-17 02:18:39 +08:00
Haomai Wang
f6c3fd9994 test_msgr: ensure wait for ms_dispatch executed
Otherwise in slow runner, ms_dispatch may not executed when assert

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:19:25 +08:00
Haomai Wang
9bfd11e7f9 msg/async/Event: remove global_centers assert
In tests we allow to reset EventCenter instance in the same CephContext,
so it may let global_centers->centers to set the same position multi times.

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:19:25 +08:00
Haomai Wang
6d3e495de2 test_async_networkstack: add networkstack tests
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:19:25 +08:00
Haomai Wang
3a43a0bb34 msg/async/AsyncConnection: fix _conn_prefix racing when stopped
When the connection is lossy and enter fault, it will dispatch reset event.
If cleanup handler is executed as well as ms_handle_reset call mark_down,
it may exists racing for "cs". cleanup handler will reset "cs" but
_conn_prefix in mark_down will access "cs".

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:19:25 +08:00
Haomai Wang
1d4ff2a30a msg/async: readd set_priority call
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:19:25 +08:00
Haomai Wang
154376b211 msg/async: allow EventCenter::set_owner reentry
If daemonlize we need to respawn event threads, it need to allow set_owner again

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:19:25 +08:00
Haomai Wang
8d63e2c709 msg/async/Stack: register fork watcher
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:19:25 +08:00
Haomai Wang
524553ff31 common/ceph_context: add prefork/postfork wathcher support
Because daemon() will termniate all existing threads, it will make something go
wrong.

So we want to add hook at CephContext, do something before/after fork.

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:19:25 +08:00
Haomai Wang
31833e8b48 msg/async/Stack: disable smart thread spawn now
New async msgr runtime need to spawn threads when binding, but ceph-osd will
call daemon() after binding port. So we need to respawn threads if forked.

Then thread spawn delay will increase complexity for this change and it's
really a simple strategy which help less, we disable auto spawn now.

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:19:23 +08:00
Haomai Wang
4e57181b54 msg/async/PosixStack: increase log level
AsyncMessenger will try to loop the bind port range, so it will produce
some addr inuse errors which is not abnormal.

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:17:55 +08:00
Haomai Wang
f62f28ceea msg/async/Event: remove event wakeup flag
Now only dispatch external event will wakeup event thread(previously
delete_time_event will call wakeup), we only need to use
"external_num_events" to indicate whether we have extra events.

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:17:55 +08:00
Haomai Wang
fca0de1f07 msg/async/Event: debug event address when dispatching and executing
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:17:55 +08:00
Haomai Wang
d0cd88b3ee msg/async/AsyncConnection: support NetworkStack api instead of posix
1. replace sd to ConnectedSocket
2. Replace WorkerPool with Stack
3. Use Stack worker

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:17:55 +08:00
Haomai Wang
57629c6700 msg/async/net_handler: let set_socket_options return value
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:17:55 +08:00
Haomai Wang
31bbe39ac2 msg/async: add PosixStack support
Add default posix backend support, it should be the full replacement for
the original AsyncMessenger IO logics.

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:17:55 +08:00
Haomai Wang
0ba42237e2 msg/async/Stack: add abstract Stack
Stack is a network IO framework which encapsulates all necessary basic network
interface, then it manages threads to work.

Different network backend like posix, dpdk even RDMA need to inherit Stack
class to implement necessary interfaces. So it will make ease for other
network backend to integrated into ceph. Otherwise, each backend need to
implement the whole Messenger logics like reconnect, policy handle, session
maintain...

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:16:07 +08:00
Yan, Zheng
bb5f0327bf Merge pull request #10691 from ceph/wip-jlayton-dotdot
Clean up handling of "/.." in ceph client
2016-08-16 08:08:17 -05:00
Mykola Golub
e012d555e4 Merge pull request #10733 from dillaman/wip-16608
rbdmap: specify bash shell interpreter

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-08-16 16:05:57 +03:00
Ilya Dryomov
c05ee0de78 Merge pull request #10735 from dillaman/wip-17030
librbd: always respond to "release lock" request if lock owner

Reviewed-off-by: Ilya Dryomov <idryomov@gmail.com>
2016-08-16 14:58:56 +02:00
Mykola Golub
0a9ccf2b96 Merge pull request #10712 from dillaman/wip-16740
librbd: permit disabling journaling if in corrupt state

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-08-16 15:54:40 +03:00
Mykola Golub
e8363da6ab Merge pull request #10711 from dillaman/wip-16984
librbd: fix possible inconsistent state when disabling mirroring fails

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-08-16 15:51:48 +03:00
Mykola Golub
9f2c559984 Merge pull request #10708 from dillaman/wip-16967
rbd: bench io-size should not be larger than image size

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-08-16 15:50:19 +03:00
Mykola Golub
062362befb Merge pull request #10714 from dillaman/wip-16529
qa/workunits: support filtering cls_rbd unit test cases

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-08-16 15:48:40 +03:00
Loic Dachary
10e9a2748d Merge pull request #9688 from shylesh/wip-16280
ceph-disk: change ownership of initfile to ceph:ceph

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-08-16 14:43:32 +02:00
Josh Durgin
0b84e0d45d Merge pull request #10376 from onyb/wip-rbd-pypi
pybind: Rework rbd/setup.py for PyPI

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-08-16 00:05:24 -07:00
Jason Dillaman
d8e7946fff librbd: always respond to "release lock" request if lock owner
Fixes: http://tracker.ceph.com/issues/17030
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-08-15 17:37:30 -04:00
Dan Mick
1506199721 Merge pull request #10709 from cgwalters/doc-use-https-for-repos
doc/install: Use https:// for download.ceph.com

Reviewed-by: Dan Mick <dmick@redhat.com>
2016-08-15 12:44:22 -07:00
Jason Dillaman
4e05cbf7e6 doc: added rbdmap man page to RBD restructured index
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-08-15 14:10:27 -04:00
Jason Dillaman
51237c33d1 rbdmap: specify bash shell interpreter
Fixes: http://tracker.ceph.com/issues/16608
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-08-15 14:07:43 -04:00
Casey Bodley
7fc89e1359 Merge pull request #10596 from cbodley/wip-rgw-period-puller
rgw multisite: fixes for period puller
2016-08-15 14:02:28 -04:00
Orit Wasserman
e71894660d Merge pull request #10330 from rzarzynski/wip-rgw-objdeler-fixes
rgw: multiple fixes for Swift's object expiration
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-08-15 17:01:48 +02:00
Kefu Chai
f468c73b6b Merge pull request #10619 from chengweiv5/fix-doc
doc: fix rados/configuration/osd-config-ref.rst

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-15 23:00:02 +08:00
Casey Bodley
612b075f83 Merge pull request #10138 from Yan-waller/yj-wip-rgwrados-0705
rgw: fix the error return variable in log message and cleanups

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-08-15 10:39:05 -04:00
Loic Dachary
13c773522a Merge pull request #10729 from SUSE/wip-rnotes-script-regex
script: improve ceph-release-notes regex

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-08-15 14:30:09 +02:00
Jason Dillaman
89bc567220 Merge pull request #10705 from chengweiv5/doc-image-format
doc: format 2 now is the default image format

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-08-15 08:26:22 -04:00
Nathan Cutler
c20922ee5b script: improve ceph-release-notes regex
Tolerate multiple spaces after ':', remove duplicate "fs", add "log" and
"msgr".

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2016-08-15 14:25:03 +02:00
Jason Dillaman
1ef143d440 librbd: fix possible memory leak when image open fails
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-08-15 07:48:01 -04:00
Orit Wasserman
16c1a7d03a Merge pull request #10118 from weiqiaomiao/wqm-wip-bucketcreate
rgw: for the create_bucket api, if the input creation_time is zero, we should set it to 'now"
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-08-15 10:03:43 +02:00
Sage Weil
ea63a4e184 Merge pull request #10431 from ifed01/wip-bluestore-fix-csum-disable2
os/bluestore: proper handling for csum enable/disable settings

Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-13 16:33:14 -04:00
Sage Weil
7ef03978a8 Merge pull request #10719 from stiopaa1/mon_pgmonitor_moveC_StatsStr
mon/PGMonitor: move C_Stats struct to cc file

Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-13 12:56:27 -04:00
Josh Durgin
aaac836380 Merge pull request #10208 from BlaXpirit/cmake-py3
Include Python 3 bindings into the cmake build and make packages for them

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-08-12 16:30:35 -07:00
Jeff Layton
c160f71883 client: add a testcase for "/.." handling
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2016-08-12 18:48:19 -04:00
Jeff Layton
30d4ca01db client: don't use special faked-up inode for /..
The CEPH_INO_DOTDOT thing is quite strange. Under most OS (Linux
included), the parent of the root is itself. IOW, at the root, '.' and
'..' refer to the same inode.

Change the ceph client to do the same, as this allows users to get
valid stat info for '..', as well as elimnating some special-casing.

Also in several places, we're checking dn_set.empty as an indicator
of being the root. While that is true for the root, it's also true
for unlinked directories.

This patch has treats them the same. An unlinked directory will
be reparented to itself, effectively acting as a root of its own.

Signed-off-by: Jeff Layton <jlayton@redhat.com>
2016-08-12 18:48:12 -04:00
Michal Jarzabek
3ca6cc2200 mon/PGMonitor: move C_Stats struct to cc file
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2016-08-12 22:30:38 +01:00
Sage Weil
2844f44bfd Merge pull request #10685 from liewegas/wip-bluefs-extent
os/bluestore/bluefs_types: fix extent operator<<
2016-08-12 15:38:22 -04:00
Casey Bodley
dce782ce92 Merge pull request #10676 from Yan-waller/yj-wip-rgwdocmultisite
rgw/doc: fix indent

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-08-12 14:57:23 -04:00
Jason Dillaman
0891ede57c qa/workunits: support filtering cls_rbd unit test cases
Fixes: http://tracker.ceph.com/issues/16529
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-08-12 14:44:09 -04:00
Jason Dillaman
6afb884d75 librbd: permit disabling journaling if in corrupt state
Fixes: http://tracker.ceph.com/issues/16740
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-08-12 14:39:43 -04:00