Commit Graph

77307 Commits

Author SHA1 Message Date
Xie Xingguo
89d28a176c Merge pull request #16955 from xiexingguo/wip-app-ls
mon/OSDMonitor: "osd pool application get" support

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-19 17:49:43 +08:00
Xie Xingguo
e0e255f48e Merge pull request #17064 from xiexingguo/wip-20970
mon/PGMap: reweight::by_utilization - skip DNE osds

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-19 17:46:50 +08:00
Xie Xingguo
bda001fd2d Merge pull request #17067 from renhwztetecs/renhw-wip-mon-cleanup
mon: some cleanup

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2017-08-19 17:43:49 +08:00
David Zafman
4ea1cd2a4e Merge pull request #17052 from dzafman/wip-pidfile
tests: Increase sleep in test_pidfile.sh

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-08-18 15:44:41 -07:00
Alfredo Deza
e33c1d9434 ceph-volume tests adapt tests for the new LVM api parser
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-18 17:21:33 -04:00
Alfredo Deza
23eaeb084c ceph-volume lvm.api uses the new parser for lvs
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-18 17:10:54 -04:00
Alfredo Deza
5b93f98123 ceph-volume lvm.api uses the new parses for vgs
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-18 17:08:30 -04:00
Alfredo Deza
b93afefc6a ceph-volume: lvm add a parser for the delimeted output in the CLI
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-18 17:05:45 -04:00
Jason Dillaman
9d7ff92b9a Merge pull request #15691 from vshankar/mirror-ha-policy
rbd-mirror: introduce basic image mapping policy

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-18 15:13:59 -04:00
David Zafman
599d7622dd tests: run-standalone.sh skip core_pattern if already set
If sudo requires a password it is nice to be able to avoid
sudo sysctl by setting core_pattern ahead of time.

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-18 10:27:12 -07:00
Alfredo Deza
3ca95b6094 Merge pull request #17076 from ceph/toc-sidebar-fix
doc/templates update toctree call to include hidden entries

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2017-08-18 12:29:05 -04:00
Alfredo Deza
1e8e689ca7 Merge pull request #17093 from dzafman/wip-runs-message
tests: run-standalone.sh improve error message

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2017-08-18 12:08:17 -04:00
Alfredo Deza
9bb3397a58 doc update template call for toctree
Up until version 1.1.3 of Sphinx, this call would show hidden toctree
entries. Most of Ceph's toctree's are hidden, so when the version of
Sphinx was bumped to >1.6, the sidebar stopped showing entries

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-18 12:05:03 -04:00
Kefu Chai
fbfd17b2fd Merge pull request #17026 from dzafman/wip-add-trap
tests: qa/standalone: Add trap for signals to restore the kernel core pattern

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-18 23:02:04 +08:00
lisali
1b90d57764 os/bluestore: Add lat record of deferred_queued and deferred_aio_wait
Originally bluestore defines the two lat deferred_queued_lat and
deferred_aio_wait_lat, but doesn't use it.
This patch is to add the records that each TXC stays on deferred queue
deferred ios.

Signed-off-by: Xiaoyan Li xiaoyan.li@intel.com
2017-08-18 09:51:35 -04:00
Venky Shankar
8647b37cbf rbd-mirror: load/update image map state machine
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-08-18 08:49:04 -04:00
Venky Shankar
64fa2c12c7 rbd-mirror: track on-disk image to instance map
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2017-08-18 08:49:04 -04:00
David Zafman
175b10795d tests: run-standalone.sh improve error message
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-18 03:49:42 -07:00
Ziye Yang
35e7955f80 NVMEDevice: fix the write bug
This patch can solve the write issue when we use spdk nvme driver
to handle I/Os from db bdev in the future.

Signed-off-by: Ziye Yang <optimistyzy@gmail.com>
Signed-off-by: Pan Liu <wanjun.lp@alibaba-inc.com>
2017-08-18 18:16:07 +08:00
Boris Ranto
32f28c96d0 Merge pull request #17070 from ktdreyer/rpm-macros-in-comments
rpm: rm macros in comments

Reviewed-By: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
2017-08-18 11:33:45 +02:00
xie xingguo
6ae96d33a8 mon/PGMap: reweight::by_utilization - skip DNE osds
EC could set one or more members of acting set to CRUSH_ITEM_NONE,
which as a result can cause pgs_by_osd.resize() attempt to apply
for a large amount of memory which we can not afford.

Fix the above problem by always excluding a current DNE osd from
acting set.

Fixes: http://tracker.ceph.com/issues/20970
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-18 13:27:06 +08:00
Kefu Chai
8afca6dfa8 Merge pull request #17043 from renhwztetecs/renhw-wip-pgmap-pool
mon/pgmap: update pool nearfull display

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-18 11:32:41 +08:00
Kefu Chai
fd07d7bb5e Merge pull request #17002 from mychoxin/yuanxin_adjust_blockdevice
os/bluestore: move aio_callback{,_priv} to base class BlockDevice

Reviewed-by: Pan Liu <liupan1111@gmail.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-18 11:22:14 +08:00
Kefu Chai
405c73e59d Merge pull request #16940 from jcsp/wip-20955
mgr: add missing call to pick_addresses

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-18 11:14:37 +08:00
David Zafman
021177b790 Merge pull request #16407 from dzafman/wip-20243
osd: Improve size scrub error handling and ignore system attrs in xattr checking

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-17 20:05:40 -07:00
Jos Collin
a96cb5b4da msg: drop unnecessary polling_stop()
Drop the unnecessary polling_stop() in the ~RDMAStack(). The RDMADispatcher object contained in
RDMAStack will get distroyed when RDMAStack gets distroyed. Thus ~RDMADispatcher() will be
called automatically and executes the polling_stop().

Fixes:
The below coverity scan reports.
1. CID 1416590:  Memory - corruptions
2. CID 1416593:  Memory - illegal accesses
3. CID 1416595:  Memory - corruptions
4. CID 1416597:  Memory - illegal accesses

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-08-18 07:02:40 +05:30
songweibin
19dd4203eb common: add new line break when get command descriptions
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2017-08-18 08:54:07 +08:00
songweibin
992829d38c rbd: adding newline operation when only '--format' used
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2017-08-18 08:54:07 +08:00
Jason Dillaman
5d3d5ea5ac test/librbd: TestMirroringWatcher unit tests should ignore duplicates
Fixes: http://tracker.ceph.com/issues/21029
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-08-17 18:39:05 -04:00
Jason Dillaman
1b21476f33 Merge pull request #17062 from trociny/wip-qa-rbd-mirror-data-pool
qa/workunits/rbd: test data pool is mirrored correctly

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-17 18:24:37 -04:00
Jason Dillaman
509ab39e82 Merge pull request #16517 from gohighsec/master
rbd: check if an image is already mapped before rbd map

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-17 18:10:47 -04:00
Jason Dillaman
9cdaa7ff0d Merge pull request #16591 from PCzhangPC/fix7
rbd: introduce commands of "image-meta ls/rm"

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-17 18:08:44 -04:00
Jason Dillaman
1fe275f920 Merge pull request #17073 from dillaman/wip-20567
rbd-mirror: Set the data pool correctly when creating images

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-17 16:50:49 -04:00
J. Eric Ivancich
1c4df03394 osd: adjust osd_min_pg_log_entries
Return osd_min_pg_log_entries to its original values, which matches
osd_pg_log_dups_tracked, so the extended dup log is not used in the
general case.

This helps address: http://tracker.ceph.com/issues/21026

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2017-08-17 16:12:35 -04:00
Adam Wolfe Gordon
1af67b7529 doc: Update mirroring docs to mention data-pool configuration
Signed-off-by: Adam Wolfe Gordon <awg@digitalocean.com>
(cherry picked from commit 1e001c19e9)
2017-08-17 15:45:25 -04:00
Adam Wolfe Gordon
07e4b72680 rbd-mirror: Set the data pool correctly when creating images
Previously the data-pool option was ignored by rbd-mirror, so when using
erasure coding data for the image on the secondary site would end up in
the metadata pool.

Configure the data-pool using the data-pool's name from the primary site
when creating images on the secondary site.

Fixes: http://tracker.ceph.com/issues/20567

Signed-off-by: Adam Wolfe Gordon <awg@digitalocean.com>
(cherry picked from commit dffaac83d1)
2017-08-17 15:45:17 -04:00
David Galloway
cd50aad45a Merge pull request #17069 from yuriw/wip_add_luminous
Decreased amount of jobs on master, kraken, luminous runs
2017-08-17 15:27:19 -04:00
Matt Benjamin
e7b14d03bc Merge pull request #17040 from mdw-at-linuxbox/rgw-master-fix-plus
Rgw master fix plus
2017-08-17 14:54:51 -04:00
Ken Dreyer
5c1e9f55d3 rpm: rm macros in comments
rpm expands all macros in a .spec file, even those in comments. Drop the
percent signs so rpm will not expand these.

This change silences rpmlint's warning about macros in comments.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-08-17 12:20:01 -06:00
Gregory Farnum
b5220e202e Merge pull request #17066 from amitkumar50/cov-os-1
os: Initializing uninitialized members aio_info

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-08-17 10:21:15 -07:00
amitkuma
a5626dd238 os: Initializing uninitialized members aio_info
Fixes the coverity issue:

** 717332 Uninitialized pointer field
2. uninit_member: Non-static class member field iocb.data is not
initialized in this constructor nor in any functions that it calls.
4. uninit_member: Non-static class member field iocb.key is not
initialized in this constructor nor in any functions that it calls.
6. uninit_member: Non-static class member field iocb.__pad2 is not
initialized in this constructor nor in any functions that it calls.
8. uninit_member: Non-static class member field iocb.aio_lio_opcode
is not initialized in this constructor nor in any functions that it calls.
10. uninit_member: Non-static class member field iocb.aio_reqprio
is not initialized in this constructor nor in any functions that it calls.

CID 717332 (#1 of 1): Uninitialized pointer field (UNINIT_CTOR)
12. uninit_member: Non-static class member field iocb.aio_fildes is not
initialized in this constructor nor in any functions that it calls.

Signed-off-by: Amit Kumar amitkuma@redhat.com
2017-08-17 22:30:22 +05:30
Yingxin
4186d9efa4 osd/OpRequest: fix reqid assignment for reply messages
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2017-08-17 12:40:35 -04:00
Yuri Weinstein
6b7331e038 Decreased amount of jobs on master, kraken, luminous runs
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2017-08-17 09:32:09 -07:00
Yuri Weinstein
8a63a83c6f Merge pull request #16896 from amitkumar50/cov-librado-2
rados: Initializing members of librados/TestCase.h

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-17 07:42:10 -07:00
Jason Dillaman
e949906715 Merge pull request #16939 from trociny/wip-nonlinux-fsx
test/librbd: make fsx build on non-linux platform

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-17 10:32:01 -04:00
Kefu Chai
164fd5fdc6 osd: exit(1) directly without lock if init fails
if init fails to connect to a monitor, we just exit(1), there is no need
to set the `r` or lock the grand osd_lock for this. this change also
silences the warning of clang analyzer:

Value stored to 'r' is never read

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-17 21:56:10 +08:00
Abhishek Lekshmanan
93a858392a rgw_lc: add support for optional filter argument and make ID optional
Support Filter tag in Lifecycle XML similar to AWS S3, while S3 docs
mention that this tag is mandatory, older clients still default to
Prefix, and S3 itself seems to relaxed in enforcing the rule, this
implementation also follows a similar pattern. Filter optionally
supports filtering via (multiple) Object Tags, this is still a TODO. The
current implementation of object tags is still as an object xattr, and
since the LC processing still iterates over the bucket index which
currently doesn't have any info. on tags, this requires some thought
into for implementing without a larger performance penalty

Fixes: http://tracker.ceph.com/issues/20872
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-08-17 13:59:47 +02:00
Xie Xingguo
ccc40482b6 Merge pull request #17027 from joscollin/wip-cleanup-Wsign-compare
test/osd: silence warnings from -Wsign-compare

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-17 19:53:02 +08:00
Mykola Golub
c4c7075029 qa/workunits/rbd: test data pool is mirrored correctly
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-08-17 10:07:12 +02:00
Kefu Chai
b567261208 cmake: require lz4 v1.7 for building lz4 compressor
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-17 16:01:55 +08:00