Commit Graph

55535 Commits

Author SHA1 Message Date
Mykola Golub
0c4063d6b7 test: ceph_test_librbd does not need rados_test_stub
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2016-07-04 22:32:11 +03:00
Sage Weil
fa8107a0c5 Merge pull request #10117 from xiexingguo/xxg-wip-bluestore-2016-07-04
os/bluestore: fix incorrect pool decoding of bnode

Reviewed-by: Sage Weil <sage@redhat.com>
2016-07-04 10:55:29 -04:00
Kefu Chai
c6286c231c Merge pull request #9755 from dx9/wip-ns-name-uncompress
common/dns_resolve: use ns_name_uncompress instead of ns_name_ntop

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-07-04 21:53:20 +08:00
Kefu Chai
873aba7dd9 Merge pull request #9766 from dx9/wip-autotools-arch
configure.ac: Use uname instead of arch.

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2016-07-04 21:49:41 +08:00
Kefu Chai
ed473638e5 Merge pull request #9772 from tchaikov/wip-close-on-exec
msgr: set close on exec flag

Reviewed-by: Haomai Wang <haomai@xsky.com>
2016-07-04 21:47:42 +08:00
Kefu Chai
0efb391a40 Merge pull request #9820 from dx9/wip-fix-res-query-detect
configure.ac: fix res_query detection

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-07-04 21:46:55 +08:00
Kefu Chai
81ca1cbdd7 Merge pull request #9845 from dx9/wip-config-basename
common: remove basename() dependency

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-07-04 21:46:14 +08:00
Kefu Chai
c5d50caa67 Merge pull request #9969 from liewegas/wip-assert
include/assert: clean up ceph assertion macros

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-07-04 21:44:17 +08:00
Kefu Chai
a758a028b6 Merge pull request #9983 from SUSE/wip-cmake-fix-fcgi-include-dir
cmake: Fix FCGI include directory

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-07-04 21:43:24 +08:00
Kefu Chai
e0f15d9946 Merge pull request #10093 from tchaikov/wip-16525
crush: reset bucket->h.items[i] when removing tree item

Reviewed-by: Sage Weil <sage@redhat.com>
2016-07-04 21:42:34 +08:00
Kefu Chai
042c0aa957 Merge pull request #9330 from dachary/wip-15176-partprobe
ceph-disk: partprobe should block udev induced BLKRRPART

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-07-04 20:29:16 +08:00
Kefu Chai
8b433e13c2 Merge pull request #9394 from xiexingguo/xxg-wip-batchpgstates
mon/PGMonitor: batch filter pg states; add sanity check

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-07-04 20:19:20 +08:00
xie xingguo
29d2931d81 os/bluestore: fix incorrect pool decoding of bnode
"pool" is a pointer, and we shall alter its value instead.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-07-04 17:08:59 +08:00
Loic Dachary
8519481b72 ceph-disk: partprobe should block udev induced BLKRRPART
Wrap partprobe with flock to stop udev from issuing BLKRRPART because
this is racy and frequently fails with a message like:

    Error: Error informing the kernel about modifications to partition
    /dev/vdc1 -- Device or resource busy.  This means Linux won't know about
    any changes you made to /dev/vdc1 until you reboot -- so you shouldn't
    mount it or use it in any way before rebooting.

Opening a device (/dev/vdc for instance) in write mode indirectly
triggers a BLKRRPART ioctl from udev (starting version 214 and up)
when the device is closed (see below for the udev release note).

However, if udev fails to acquire an exclusive lock (with
flock(fd, LOCK_EX|LOCK_NB); ) the BLKRRPART ioctl is not issued.

045e00cf16/src/udev/udevd.c (L1042)

Acquiring an exclusive lock before running the process that opens the
device in write mode is therefore an effective way to control this
behavior.

git clone git://anonscm.debian.org/pkg-systemd/systemd.git
systemd/NEWS:
CHANGES WITH 214:

  * As an experimental feature, udev now tries to lock the
       disk device node (flock(LOCK_SH|LOCK_NB)) while it
       executes events for the disk or any of its partitions.
       Applications like partitioning programs can lock the
       disk device node (flock(LOCK_EX)) and claim temporary
       device ownership that way; udev will entirely skip all event
       handling for this disk and its partitions. If the disk
       was opened for writing, the close will trigger a partition
       table rescan in udev's "watch" facility, and if needed
       synthesize "change" events for the disk and all its partitions.
       This is now unconditionally enabled, and if it turns out to
       cause major problems, we might turn it on only for specific
       devices, or might need to disable it entirely. Device Mapper
       devices are excluded from this logic.

Fixes: http://tracker.ceph.com/issues/15176

Signed-off-by: Marius Vollmer <marius.vollmer@redhat com>
Signed-off-by: Loic Dachary <loic@dachary.org>
2016-07-04 11:01:32 +02:00
Orit Wasserman
76705d87ad Merge pull request #10077 from yehudasa/wip-16494
rgw: fix for issue 16494
2016-07-04 09:37:34 +02:00
Kefu Chai
b6a1e50ae8 Merge pull request #10064 from BlaXpirit/brag-py3
Port ceph-brag to Python 3 (+ small fixes)

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-07-04 15:00:50 +08:00
Kefu Chai
4ca9152512 Merge pull request #10115 from runsisi/ss-wip-fix-rpm-spec
ceph.spec.in: fix rpm package building error

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-07-04 14:08:35 +08:00
runsisi
49dfad1f53 ceph.spec.in: fix rpm package building error as follows:
error: Installed (but unpackaged) file(s) found:
      /usr/lib/udev/rules.d/60-ceph-by-parttypeuuid.rules

Signed-off-by: runsisi <runsisi@zte.com.cn>
2016-07-04 13:52:03 +08:00
Loic Dachary
b8a4ca7e4c Merge pull request #9885 from dachary/wip-16351-by-parttypeuuid
udev: always populate /dev/disk/by-parttypeuuid

Reviewed-by: Alexandre Derumier <aderumier@odiso.com>
2016-07-03 13:31:46 +02:00
Sage Weil
fcf8d9ca78 Merge pull request #10095 from liewegas/wip-bluestore-trim
os/bluestore: trim cache on reads

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-07-02 18:53:40 -04:00
Sage Weil
7cff281e7d Merge pull request #10080 from xiexingguo/xxg-wip-add-compress-ratio
os/bluestore: improve required compression threshold

Reviewed-by: Sage Weil <sage@
2016-07-02 07:32:38 -04:00
Kefu Chai
f019ad563c msg/simple: set close on exec on server sockets
mds execv() when handling the "respawn" command, to avoid fd leakage,
and enormous CLOSE_WAIT connections after respawning, we need to set
FD_CLOEXEC flag for the socket fds.

Fixes: http://tracker.ceph.com/issues/16390
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-02 12:50:56 +08:00
Kefu Chai
eaf68c7241 msg/async: set close on exec on server sockets
mds execv() when handling the "respawn" command, to avoid fd leakage,
and enormous CLOSE_WAIT connections after respawning, we need to set
FD_CLOEXEC flag for the socket fds.

Fixes: http://tracker.ceph.com/issues/16390
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-02 12:50:56 +08:00
xie xingguo
0f706479f2 os/bluestore: add compression required ratio to enable/disable compression
Require the net gain of compression at least to be at a specified ratio,
otherwise we don't compress.

Ask for compressing at least 12.5% off, by default.

This is for the sake of performance because if the compression turns out
to be meaningless(saving little space), we can simply shut it down, as we
know the compression/decompression can be rather CPU-consuming.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-07-02 09:57:10 +08:00
Sage Weil
7eef57c271 Merge pull request #10096 from ceph/wip-dang-cmake
debian: set libexec dir to correct value as autotools did

Reviewed-by: Sage Weil <sage@redhat.com>
2016-07-01 14:46:26 -04:00
Matt Benjamin
097f3e4512 Merge pull request #9941 from weiqiaomiao/wqm-wip-fetchobj
rgw: fix memory leak in RGWRados::fetch_remote_obj()

lgtm
2016-07-01 14:33:40 -04:00
Daniel Gryniewicz
4cb038c497 debian - set libexec dir to correct value as autotools did
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2016-07-01 14:12:47 -04:00
Sage Weil
5166deead8 os/bluestore: trim cache on reads too
We were only trimming in the write path, which would make memory explode
on a read-only workload.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-07-01 14:04:52 -04:00
Sage Weil
06178de946 Merge pull request #10082 from chhabaramesh/bitalloc_warn
os/bluestore: Remove bit alloc Woverloaded-virtual warnings
2016-07-01 13:29:46 -04:00
Sage Weil
7d843e9d1d Merge pull request #10068 from jcsp/wip-cephfs-doc-update
doc: update CephFS "early adopters" info

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2016-07-01 13:28:17 -04:00
pritha-srivastava
c4da56d0cb Merge pull request #9584 from chiehtu/fix-16188
rgw: fix Swift API returns double space usage

Reviewed by: Pritha Srivastava <prsrivas@redhat.com>
2016-07-01 21:37:12 +05:30
Matt Benjamin
89561acfde Merge pull request #10000 from weiqiaomiao/wqm-wip-add-userlist-cli
rgw: add "radosgw-admin user list" cli

verified
2016-07-01 11:40:08 -04:00
John Spray
f76f5a93aa Merge pull request #9838 from xiexingguo/xxg-wip-fix-synthetic-client
client: misc fixes

Reviewed-by: John Spray <john.spray@redhat.com>
2016-07-01 15:31:22 +01:00
Sage Weil
6655f542ae Merge pull request #10092 from ceph/wip-dang-cmake
cmake: fixes

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-07-01 10:05:20 -04:00
Sage Weil
0dd1accf60 Merge pull request #10028 from ceph/wip-cmake-readme-fixes
cmake: Removed README.cmake.md, edited README.md
2016-07-01 09:59:53 -04:00
Kefu Chai
a7069c7aab crush: reset bucket->h.items[i] when removing tree item
* crush: so we don't see the reference after the removing, this keeps
  check_item_loc() happy, and move_bucket() use check_item_loc() to see if
  the removed bucket disappears after the removal.
* test: also add unittest_crush_wrapper::CrushWrapper.insert_item

Fixes: http://tracker.ceph.com/issues/16525
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-01 21:19:45 +08:00
Daniel Gryniewicz
f81c0354e6 init-ceph - use sbindir, rather than hard coding sbin
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2016-07-01 09:07:43 -04:00
Daniel Gryniewicz
37f53ec5ab CMake - add libexecdir to the replaced variables
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2016-07-01 09:04:17 -04:00
John Spray
22670bb126 Merge pull request #10081 from tchaikov/wip-16556
cmake: remove unnecessary linked libs from libcephfs

Reviewed-by: John Spray <john.spray@redhat.com>
2016-07-01 14:02:19 +01:00
Jason Dillaman
0c500f8e9c Merge pull request #10083 from trociny/wip-16539
rbd-mirror: remove ceph_test_rbd_mirror_image_replay test case

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2016-07-01 08:29:38 -04:00
Mykola Golub
dbe4a72fd6 Merge pull request #10065 from dillaman/wip-16558
rbd-mirror: gracefully fail if object map is unavailable

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-07-01 14:19:28 +03:00
Kefu Chai
27cb0a121e cmake: remove unnecessary linked libs from libcephfs
* some of the libs shares the same .cc which has static C++ variables. if
  we link against the different libs sharing the same static C++
  variables, and the dtor of the C++ variables has side-effects, among
  other things, deallocates a memory chunk. then, we are in the trouble of
  double free. so "osd" lib is removed.
* some of the libs are referenced by the linked lib, so no need to link
  against them again. for example, BLKID_LIBRARIES are linked by
  libcommon, so we can remove it from the linked libs list.
* and lib "os" and "cls_references_objs" are not used by libcephfs at all,
  so remove them.

Fixes: http://tracker.ceph.com/issues/16556
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-07-01 16:27:48 +08:00
Ramesh Chander
21d1dab1f1 Remove bit alloc Woverloaded-virtual warnings
Signed-off-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-06-30 22:06:12 -07:00
Albert Tu
5dd825aed2 rgw: fix double counting in RGWRados::update_containers_stats()
Fixes: http://tracker.ceph.com/issues/16188
Signed-off-by: Albert Tu <albert.t@inwinstack.com>
2016-07-01 10:22:01 +08:00
Yehuda Sadeh
1eec00bef1 rgw: forward input data when forwarding set_bucket_version to master
Fixes: http://tracker.ceph.com/issues/16494

Needed to keep input data around to be forwarded correctly. Also, master
does not send any data back, so don't try to parse anything.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-06-30 18:29:51 -07:00
Yehuda Sadeh
dd1068c54e rgw: set args when rebuilding req_info
Was missing args, so it didn't sign requests with subresources
correctly when forwarding.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-06-30 18:29:51 -07:00
John Spray
e222a99ab1 doc/cephfs: rename early-adopters to best-practices
...and give it a link in the TOC (in addition
to where it is referenced from the top of index.rst)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-06-30 23:56:39 +01:00
John Spray
f6ddfad6da doc/cephfs: remove some scary warnings
...and restructure the "early adopters" page
into a "best practices" guide.  Early adopters
are now just adopters :-)

Signed-off-by: John Spray <john.spray@redhat.com>
2016-06-30 23:56:39 +01:00
Ali Maredia
af6e986100 cmake: Removed README.cmake.md, edited README.md
Deleted README.cmake.md and put any helpful
information it had into README.md.

Also a added note about which tests get executed
by ctest.

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2016-06-30 18:07:58 -04:00
Matt Benjamin
85bb43e111 Merge pull request #9891 from diluga/rgw_socket_backlog_with_sign
RGW : setting socket backlog for via ceph.conf
2016-06-30 16:50:31 -04:00