Commit Graph

78851 Commits

Author SHA1 Message Date
Kefu Chai
dd9b340b70 test/unittest_dns_resolve: #include <arpanameser_compat.h>
so it compiles on osx

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-03 23:43:58 +08:00
Kefu Chai
33cd10d9cb cmake: do not link against global if not necessary
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-03 23:43:49 +08:00
Kefu Chai
dc465adc63 cmake: do not link against libblkid if not necessary
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-10-03 21:16:57 +08:00
Kefu Chai
314dff75a4 Merge pull request #18022 from neha-ojha/wip-21566
osd: hold lock while accessing recovery_needs_sleep

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-10-02 11:41:07 +08:00
Kefu Chai
7a663ae9da Merge pull request #18059 from Liuchang0812/remove-duplicated-func
osd: remove duplicated function ec_pool in pg_pool_t

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-10-02 11:40:31 +08:00
Kefu Chai
8233596870 Merge pull request #17913 from rzarzynski/wip-bs-bulky_disk_releases
os/bluestore: release disk extents in bulky manner

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed: Sage Weil <sage@redhat.com>
2017-10-02 11:37:44 +08:00
Kefu Chai
002467953d Merge pull request #17752 from XinzeChi/wip-force-recovery
osd: set min_version to newest version in maybe_force_recovery

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-02 11:35:32 +08:00
Kefu Chai
dd4e4ed3fe Merge pull request #17728 from ygtzf/cleanup-unused-parameter
mon: cleanup unused option mon_health_data_update_interval

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-10-02 11:34:39 +08:00
Kefu Chai
ebf39a2235 Merge pull request #16843 from amitkumar50/cov-radosstriper
rados: Intializing members class StriperTest

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-02 11:33:52 +08:00
Sage Weil
f7782427ab Merge pull request #17912 from ceph/docs-min-size
docs: Do not use "min size = 1" as an example

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-10-01 21:35:10 -05:00
Sage Weil
e10b527dae Merge pull request #17931 from jcsp/wip-21518
mgr/zabbix: fix div by zero

Reviewed-by: Wido den Hollander <wido@42on.com>
2017-10-01 21:34:09 -05:00
Sage Weil
6467fcaff2 Merge pull request #18040 from joscollin/wip-guide-submitting-patches-typo
doc: Fix typo and URL

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-01 21:29:07 -05:00
Sage Weil
0885e9a9d7 Merge pull request #18060 from dragonylffly/wip-revise-organization
doc: update Li Wang Affiliation

Reviewed-by: Sage Weil <sage@redhat.com>
2017-10-01 21:24:19 -05:00
Mykola Golub
af33467301 Merge pull request #18043 from dillaman/wip-21567
librbd: snapshots should be created/removed against data pool

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-10-01 12:32:58 +03:00
Mykola Golub
3e3a69a54b Merge pull request #18042 from dillaman/wip-21529
librbd: image-meta config overrides should be dynamically refreshed

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-10-01 12:28:05 +03:00
Mykola Golub
0c9c894acf Merge pull request #18026 from dillaman/wip-21535
rbd-mirror: sync image metadata when transfering remote image

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-10-01 12:27:26 +03:00
Mykola Golub
2665d4448e Merge pull request #17992 from dillaman/wip-21558
librbd: hold cache_lock while clearing cache nonexistence flags

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-10-01 12:26:28 +03:00
Orit Wasserman
8ef45de6af Merge pull request #17989 from mkogan1/wip-rgw-21151
rgw: update vstart.sh to support rgw ssl port notation : '--rgw_port 443s'
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2017-10-01 11:39:33 +03:00
Patrick Donnelly
534c30aca4
Merge PR #18041 into master
* refs/remotes/upstream/pull/18041/head:
	qa: relax cap expected value check
2017-09-30 17:43:56 -07:00
Patrick Donnelly
08384c0ad5
Merge PR #17990 into master
* refs/remotes/upstream/pull/17990/head:
	mds: open purge queue when transitioning out of standby replay
	mds: always re-probe mds log when standby replay done

Reviewed-by: John Spray <john.spray@redhat.com>
2017-09-30 17:43:54 -07:00
Patrick Donnelly
e48683e35d
Merge PR #17935 into master
* refs/remotes/upstream/pull/17935/head:
	ceph_volume_client: fix setting caps for IDs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-30 17:43:52 -07:00
Marcus Watts
61f292ec3c Merge pull request #17958 from gaosibei/branch1
RGW: fix a bug about inconsistent unit of comparison
2017-09-30 18:30:02 -04:00
Li Wang
c5c8fb5ea5 doc: revise organization
Signed-off-by: Li Wang <laurence.liwang@gmail.com>
2017-09-30 10:39:36 +00:00
Chang Liu
6597e048af osd: remove duplicated function ec_pool in pg_pool_t
Signed-off-by: Chang Liu <liuchang0812@gmail.com>
2017-09-30 16:03:25 +08:00
Xie Xingguo
cd6b9830d1 Merge pull request #15199 from xiexingguo/wip-object-logic-size
osd: fine-grained statistics of logical object space usage

Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-30 14:50:32 +08:00
Kefu Chai
259b3c1ead Merge pull request #16884 from liewegas/wip-20919
osd/PrimaryLogPG: send requests to primary on cache miss

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-09-30 12:14:14 +08:00
Kefu Chai
3dfe209499 Merge pull request #17955 from asomers/bin_bash2
test: fix bash path in shebangs (part 2)

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-30 12:13:35 +08:00
Kefu Chai
709c77b2b5 Merge pull request #17985 from dzafman/wip-21327
ceph-objectstore-tool: "$OBJ get-omaphdr" and "$OBJ list-omap" scan all pgs instead of using specific pg

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-30 12:12:25 +08:00
Kefu Chai
d877b0b07d Merge pull request #18005 from jcsp/wip-21577
tools: update monstore tool for fsmap, mgrmap

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-30 12:11:21 +08:00
Kefu Chai
583f62bd98 Merge pull request #18015 from tchaikov/wip-kill-warnings
osd,os/bluestore: kill clang analyzer warnings

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-30 12:10:49 +08:00
Kefu Chai
c76742b748 Merge pull request #18018 from tchaikov/wip-ceph-disk-cleanup
ceph-disk: more precise error message when a disk is specified

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-09-30 12:10:06 +08:00
Kefu Chai
48582cb00e Merge pull request #18034 from tchaikov/wip-options
common/options: pass by reference and use user-literals for size

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2017-09-30 12:07:15 +08:00
Jos Collin
ded96388da doc: Fix URL in Licensing
Fixed the unnecessary URL format in the text. Modify the URL formatting to highlight only the file name seems better.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-09-30 07:40:01 +05:30
Jason Dillaman
ae1530bbfb Merge pull request #17971 from idryomov/wip-krbd-exclude-shared-298
qa/suites/krbd: exclude shared/298

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-09-29 16:07:59 -04:00
Jason Dillaman
5a3baf1bd8 librbd: snapshots should be created/removed against data pool
Fixes: http://tracker.ceph.com/issues/21567
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-09-29 15:11:38 -04:00
Radoslaw Zarzynski
90bbcd7cbb os/bluestore: drop support for non-bulky extent release.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-09-29 20:30:53 +02:00
Radoslaw Zarzynski
5e1e6f9393 os/bluestore: release txc's extents in bulky manner.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-09-29 20:30:53 +02:00
Radoslaw Zarzynski
16906c0190 os/bluestore: BlueFS releases disk extents in bulky manner.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-09-29 20:30:53 +02:00
Jason Dillaman
ede691323d librbd: avoid dynamically refreshing non-atomic configuration settings
Fixes: http://tracker.ceph.com/issues/21529
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-09-29 12:22:57 -04:00
David Zafman
2f466f8b26 Merge pull request #17920 from dzafman/wip-21382
Erasure code recovery should send additional reads if necessary

Fixes: http://tracker.ceph.com/issues/21382

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-09-29 09:04:43 -07:00
Patrick Donnelly
b37c7f7db7
qa: relax cap expected value check
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-29 08:48:14 -07:00
Dongsheng Yang
b10d26dfa8 librbd: notify watcher when updating image metadata
Signed-off-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
2017-09-29 11:45:55 -04:00
Haomai Wang
fd704ab8b3 Merge pull request #18036 from ownedu/wip-fix-asyncrdma-coredump
msg/async/rdma: fix a potential coredump when handling tx_buffers under heavy RDMA

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-09-29 10:33:14 -05:00
Radoslaw Zarzynski
d11753ef4d os/bluestore: make the BitMapAllocator aware about bulk releases.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-09-29 17:09:29 +02:00
Radoslaw Zarzynski
cb0420ea0b os/bluestore: make the StupidAllocator aware about bulk releases.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-09-29 17:09:29 +02:00
Radoslaw Zarzynski
0b41d2372e os/bluestore: extend the Allocator interface with bulk releases.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2017-09-29 17:09:29 +02:00
Jos Collin
41c4b3dbbe doc: Fix typo and URL in Submitting patches
Dropped the repeated 'the' in the paragraph and Fixed the unnecessary URL format in the text.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-09-29 20:20:33 +05:30
xie xingguo
1e4263fa5d osd/PrimaryLogPG: allow trimmed read for OP_CHECKSUM
Normal reads support trimmed read length, and so shall checksums!

This fixes occasionally failure of rados/thrash test scripts, e.g.:
(1) create object using WriteOp with random generated length
(2) normal writes might accompany with TruncOp of randomized chosen truncate_size
(3) for ReadOp, pick a random 'length' to read, and do checksum simultaneously
    for the same range ([0, 'length']) to read too.

Since the 'length' for reading is randomized chosen, it might
exceed the current object size, and hence causing an EOVERFLOW error.

Related issues:
http://qa-proxy.ceph.com/teuthology/xxg-2017-09-22_01:52:47-rados-wip-object-logic-size-distro-basic-smithi/1657337
http://qa-proxy.ceph.com/teuthology/xxg-2017-09-22_14:14:19-rados-wip-object-logic-size-distro-basic-smithi/1658015

Fix the above problems by keeping pace with normal reads.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-29 21:16:19 +08:00
xie xingguo
421aee3aea osd: fine-grained statistics of logical object space usage
To test this change, we create an image of 5GB and do rbd bench write of 1GB:
./bin/rbd create bar -s 5120 && ./bin/rbd bench --io-type write --io-size 32K --io-total 100M --io-pattern rand  rbd/bar

Below is the test result.

Was:

GLOBAL:
    SIZE       AVAIL      RAW USED     %RAW USED
    30911M     27052M        3859M         12.49
POOLS:
    NAME                  ID     USED      %USED     MAX AVAIL     OBJECTS
    rbd                   0      3191M     26.36         8914M        1174
    cephfs_data_a         1          0         0         8914M           0
    cephfs_metadata_a     2       2246         0         8914M          21

Now:

GLOBAL:
    SIZE       AVAIL      RAW USED     %RAW USED
    30911M     27050M        3861M         12.49
POOLS:
    NAME                  ID     USED        %USED     MAX AVAIL     OBJECTS
    rbd                   0      101216k      1.10         8913M        1178
    cephfs_data_a         1            0         0         8913M           0
    cephfs_metadata_a     2          892         0         8913M          21

E.g., this change can make "osd pool set-quota max_bytes" work nicely.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-09-29 21:16:19 +08:00
Mykola Golub
7dc2f78215 Merge pull request #17979 from dillaman/wip-21559
rbd-mirror: forced promotion can result in incorrect status

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-09-29 15:20:12 +03:00