Commit Graph

56457 Commits

Author SHA1 Message Date
Haomai Wang
fca0de1f07 msg/async/Event: debug event address when dispatching and executing
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:17:55 +08:00
Haomai Wang
d0cd88b3ee msg/async/AsyncConnection: support NetworkStack api instead of posix
1. replace sd to ConnectedSocket
2. Replace WorkerPool with Stack
3. Use Stack worker

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:17:55 +08:00
Haomai Wang
57629c6700 msg/async/net_handler: let set_socket_options return value
Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:17:55 +08:00
Haomai Wang
31bbe39ac2 msg/async: add PosixStack support
Add default posix backend support, it should be the full replacement for
the original AsyncMessenger IO logics.

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:17:55 +08:00
Haomai Wang
0ba42237e2 msg/async/Stack: add abstract Stack
Stack is a network IO framework which encapsulates all necessary basic network
interface, then it manages threads to work.

Different network backend like posix, dpdk even RDMA need to inherit Stack
class to implement necessary interfaces. So it will make ease for other
network backend to integrated into ceph. Otherwise, each backend need to
implement the whole Messenger logics like reconnect, policy handle, session
maintain...

Signed-off-by: Haomai Wang <haomai@xsky.com>
2016-08-16 23:16:07 +08:00
Kefu Chai
9fa7af97b5 Merge pull request #10535 from dzafman/wip-cot-fix
test: Removeall merged after print_function commit needs a fix

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-02 15:37:57 +08:00
David Zafman
f58063578c test: Removeall merged after print_function commit needs a fix
Signed-off-by: David Zafman <dzafman@redhat.com>
2016-08-01 22:29:56 -07:00
Josh Durgin
98b9ed1d7c Merge pull request #10344 from xiexingguo:xxg-wip-pipe-2016-07-19-02
msg/simple: apply prefetch policy more precisely

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Conflicts:
	src/msg/simple/Pipe.cc (removed unneeded cast)
2016-08-01 15:40:39 -07:00
Ali Maredia
f9be456d34 Merge pull request #10532 from linuxbox2/rgw-ldap-recon
rgw: add reinit/rebind logic (ldap)

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2016-08-01 18:08:36 -04:00
Matt Benjamin
9b8fccf687 rgw: add reinit/rebind logic (ldap)
Gracefully handle stale LDAP connections by rebinding--verified
with MS AD.  Rebind is attempted once per request until rebound--
not worse than misconfiguring the environment.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-08-01 17:36:17 -04:00
Yuri Weinstein
c39e671ce5 Merge pull request #10365 from majianpeng/osd-perfcounter
osd/ReplicatedPG: for sync-read it don't cacl l_osd_op_r_prepare_lat.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-01 14:30:05 -07:00
Yuri Weinstein
9d811caf34 Merge pull request #10450 from xiexingguo/xxg-wip-cleanup-options
osd: cleanup options and other redundancies

Reviewed-by: Samuel Just <sjust@redhat.com>
2016-08-01 14:29:39 -07:00
Yuri Weinstein
4f5e4dff68 Merge pull request #10471 from xiexingguo/xxg-wip-fix-memdb-assert
kv/MemDB: fix assert triggerred by m_total_bytes underflow
2016-08-01 14:28:39 -07:00
Yuri Weinstein
a602346880 Merge pull request #9679 from xiexingguo/xxg-wip-fix-cephx
auth/cephx: misc fixes

Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-01 14:27:27 -07:00
Yuri Weinstein
ef97f9393b Merge pull request #9734 from xiexingguo/xxg-wip-cleanup-omap
os/filestore: add sanity checks and cleanups for mount() process

Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-01 14:26:43 -07:00
Yuri Weinstein
e08022f566 Merge pull request #10231 from yonghengdexin735/wip-zzz-paxosserver-type
mon/PaxosService: make the return value type inconsistent

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-01 14:25:27 -07:00
Yuri Weinstein
8548a1e9bc Merge pull request #10340 from yuyuyu101/wip-16715
msg/async/AsyncConnection: replace Mutex with std::mutex for peformance

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-01 14:22:55 -07:00
scuttlemonkey
63c88a71f3 Merge pull request #10531 from scuttlemonkey/master
Add UK mirror and update copyright
2016-08-01 16:14:30 -04:00
Patrick McGarry
4f2f79ca32 doc: added new UK Ceph mirror to doc and mirroring
Signed-off-by: Patrick McGarry <pmcgarry@redhat.com>
2016-08-01 16:03:25 -04:00
Patrick McGarry
87c579cebe Merge remote-tracking branch 'origin/master' 2016-08-01 15:59:08 -04:00
Casey Bodley
4a90e648ed Merge pull request #10207 from prallabh/wip-16388
rgw: Fix incorrect content length and range for zero sized objects during range requests

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-08-01 15:50:09 -04:00
Casey Bodley
94db6ef834 Merge pull request #10510 from yehudasa/wip-16861
test_rgw_bencode: null terminate strings before checking

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-08-01 15:26:01 -04:00
Josh Durgin
ef9e8dc37d Merge pull request #9944 from sileht/master
python-rados: extends ReadOp/WriteOp API

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-08-01 09:53:03 -07:00
Kefu Chai
6c04c94d03 Merge pull request #10098 from dzafman/wip-16568
tools: New "removeall" used to remove head with snapshots

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-02 00:26:54 +08:00
Kefu Chai
43de9824db Merge pull request #10085 from chengweiv5/fix-doc
doc: ceph-deploy mon add doesn't take multiple nodes

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-02 00:17:29 +08:00
root
a3b5a461d2 For range requests, let the range be dumped before the error is honored.
Signed-off-by: Pavan Rallabhandi <PRallabhandi@walmartlabs.com>
2016-08-01 20:52:45 +05:30
root
67bfbf4102 For zero sized objects, let the range adhere as per the RFC
Signed-off-by: Pavan Rallabhandi <PRallabhandi@walmartlabs.com>
2016-08-01 20:52:45 +05:30
root
a94ec15a3b For zero sized objects, return 416 during range requests
Signed-off-by: Pavan Rallabhandi <PRallabhandi@walmartlabs.com>
2016-08-01 20:52:45 +05:30
Casey Bodley
e3ba5e8543 Merge pull request #10480 from ceph/lifecycle-cleanup
Clean up lifecycle thread

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-08-01 10:59:31 -04:00
Patrick Donnelly
9bef6cf85a
Merge remote-tracking branch 'upstream/pull/10514/head'
* upstream/pull/10514/head:
  src/vstart.sh: stop script aborting when ceph.cfg is not there

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2016-07-30 16:33:29 -04:00
Willem Jan Withagen
df49518642 src/vstart.sh: stop script aborting when ceph.cfg is not there
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2016-07-30 22:05:06 +02:00
Mykola Golub
77ec14a95b Merge pull request #10432 from dillaman/wip-16708
rbd-mirror: potential IO stall when using asok flush request

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-07-30 19:59:49 +03:00
Mykola Golub
df2aa585c4 Merge pull request #10341 from dillaman/wip-16223
rbd-mirror: reduce memory footprint during journal replay

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-07-30 19:28:02 +03:00
Mehdi Abaakouk
5c630e37a9 python-rados: Implements new write_ops
* rados_write_op_create
* rados_write_op_append
* rados_write_op_write_full
* rados_write_op_write
* rados_write_op_remove
* rados_write_op_truncate
* rados_write_op_zero

Signed-off-by: Mehdi Abaakouk <sileht@redhat.com>
2016-07-30 10:15:20 +02:00
Mehdi Abaakouk
250e16538a python-rados: add some read_op/write_op methods
This change adds python API for the following C methods:
* rados_aio_write_op_operate
* rados_write_op_omap_set
* rados_read_op_set_flags
* rados_aio_read_op_operate

Signed-off-by: Mehdi Abaakouk <sileht@redhat.com>
2016-07-30 10:15:09 +02:00
Kefu Chai
00b6fe11d2 Merge pull request #10489 from ceph/wip-cmake
cmake changes

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Ali Maredia <amaredia@redhat.com>
2016-07-30 13:24:32 +08:00
Yehuda Sadeh
4410eedc83 test_rgw_bencode: null terminate strings before checking
Fixes: http://tracker.ceph.com/issues/16861

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-07-29 16:07:01 -07:00
Kefu Chai
a27bbaaebf cmake: link libcommon against pthread
as Thread.cc lives in libcommon, and global is not using libpthread
directly. so moving libpthread linkage from libglobal to libcommon.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-30 00:26:44 +08:00
Josh Durgin
e5b3ee0b79 Merge pull request #10177 from BlaXpirit/ceph-tests-py3
pybind: Port Python-based tests and remaining Python bindings to Python 3

Reviewed-by: Case Bodley <cbodley@redhat.com>
Reviewed-by: John Spray <jspray@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-07-29 09:04:27 -07:00
Daniel Gryniewicz
bc299e56e4 Clean up lifecycle thread
Make sure that the lifecycle thread is terminated and all memory is
cleaned up on shutdown.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2016-07-29 11:34:21 -04:00
Patrick Donnelly
a955647a2d
Merge remote-tracking branch 'upstream/pull/10312/head'
* upstream/pull/10312/head:
  vstart: refactor and fix forced config changes
  vstart: cleanup echoed commands and sh issues
2016-07-29 11:13:48 -04:00
Kefu Chai
8bf5cd1606 cmake: cleanup Findfuse.cmake
* remove unused stuff, we do not pass/use FUSE_VERSION in cmake.
  the FUSE_VERSION we are using is defined by "fuse_common.h".
* use FindPackageHandleStandardArgs for handling find_package()
  arguments.
* also detect osxfuse on MacOS.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-29 23:12:33 +08:00
Kefu Chai
8bac1c1eeb cmake: do not reference undefined variables
* AIO_LIBS is now named AIO_LIBARIES, and there is not point to print
  out its path
* USE_NSS is not defined if NSS is not checked, so if(USE_NSS) is better
  here.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-29 23:12:33 +08:00
Kefu Chai
aa524e689d cmake: remove duplicated linked lib for libcommon
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-29 23:12:33 +08:00
Kefu Chai
7296be4e84 cmake: use fullpaths of libraries
better off using the detected path, instead of using the default path
for finding the linked libaries.

see "cmake  --help-policy CMP0065" for more details.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-29 23:12:33 +08:00
Kefu Chai
221c47d349 cmake: set policies
this makes sure we are compatible with latest and future cmake

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-29 23:12:33 +08:00
Kefu Chai
ce1d2e47ed cmake: remove uuid
as it is replaced by the boost implementation, and not detected in
cmake anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-29 23:12:33 +08:00
Kefu Chai
998a50627f cmake: do not link ec_jerasure_generic against crush
crush is not used in erasure plugins at this moment.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-29 23:12:33 +08:00
Kefu Chai
417c54f1ef cmake: exclude private symbols in librbd
missed it in 0edfad0.
* librbd: pass '--exclude-libs,ALL' to linker
* rbd: link against used libraries explicitly, rbd is accessing some
  internal symbols not exposed by librbd.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-29 23:12:33 +08:00
Jason Dillaman
20dd3adeac Merge pull request #10483 from trociny/fixup-test-rbd-mirror
qa/workunits/rbd: small fixup and improvements for rbd-mirror tests

Reviewed-by: Jason Dillaman <dillaman@hotmail.com>
2016-07-29 10:17:06 -04:00