Commit Graph

77457 Commits

Author SHA1 Message Date
Kefu Chai
fd07d7bb5e Merge pull request #17002 from mychoxin/yuanxin_adjust_blockdevice
os/bluestore: move aio_callback{,_priv} to base class BlockDevice

Reviewed-by: Pan Liu <liupan1111@gmail.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-18 11:22:14 +08:00
Kefu Chai
405c73e59d Merge pull request #16940 from jcsp/wip-20955
mgr: add missing call to pick_addresses

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-18 11:14:37 +08:00
David Zafman
021177b790 Merge pull request #16407 from dzafman/wip-20243
osd: Improve size scrub error handling and ignore system attrs in xattr checking

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-08-17 20:05:40 -07:00
xie xingguo
968b72d859 crush: rebuild shadow trees on removing crush rule
In case this is the last crush rule which is still referencing
a specific device class. Otherwise the device class might stay
hanging.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-18 10:37:12 +08:00
Jos Collin
a96cb5b4da msg: drop unnecessary polling_stop()
Drop the unnecessary polling_stop() in the ~RDMAStack(). The RDMADispatcher object contained in
RDMAStack will get distroyed when RDMAStack gets distroyed. Thus ~RDMADispatcher() will be
called automatically and executes the polling_stop().

Fixes:
The below coverity scan reports.
1. CID 1416590:  Memory - corruptions
2. CID 1416593:  Memory - illegal accesses
3. CID 1416595:  Memory - corruptions
4. CID 1416597:  Memory - illegal accesses

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-08-18 07:02:40 +05:30
songweibin
19dd4203eb common: add new line break when get command descriptions
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2017-08-18 08:54:07 +08:00
songweibin
992829d38c rbd: adding newline operation when only '--format' used
Signed-off-by: songweibin <song.weibin@zte.com.cn>
2017-08-18 08:54:07 +08:00
Jason Dillaman
5d3d5ea5ac test/librbd: TestMirroringWatcher unit tests should ignore duplicates
Fixes: http://tracker.ceph.com/issues/21029
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-08-17 18:39:05 -04:00
Jason Dillaman
1b21476f33 Merge pull request #17062 from trociny/wip-qa-rbd-mirror-data-pool
qa/workunits/rbd: test data pool is mirrored correctly

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-17 18:24:37 -04:00
Jason Dillaman
509ab39e82 Merge pull request #16517 from gohighsec/master
rbd: check if an image is already mapped before rbd map

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-17 18:10:47 -04:00
Jason Dillaman
9cdaa7ff0d Merge pull request #16591 from PCzhangPC/fix7
rbd: introduce commands of "image-meta ls/rm"

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-17 18:08:44 -04:00
Jason Dillaman
1fe275f920 Merge pull request #17073 from dillaman/wip-20567
rbd-mirror: Set the data pool correctly when creating images

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-17 16:50:49 -04:00
J. Eric Ivancich
1c4df03394 osd: adjust osd_min_pg_log_entries
Return osd_min_pg_log_entries to its original values, which matches
osd_pg_log_dups_tracked, so the extended dup log is not used in the
general case.

This helps address: http://tracker.ceph.com/issues/21026

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2017-08-17 16:12:35 -04:00
Adam Wolfe Gordon
1af67b7529 doc: Update mirroring docs to mention data-pool configuration
Signed-off-by: Adam Wolfe Gordon <awg@digitalocean.com>
(cherry picked from commit 1e001c19e9)
2017-08-17 15:45:25 -04:00
Adam Wolfe Gordon
07e4b72680 rbd-mirror: Set the data pool correctly when creating images
Previously the data-pool option was ignored by rbd-mirror, so when using
erasure coding data for the image on the secondary site would end up in
the metadata pool.

Configure the data-pool using the data-pool's name from the primary site
when creating images on the secondary site.

Fixes: http://tracker.ceph.com/issues/20567

Signed-off-by: Adam Wolfe Gordon <awg@digitalocean.com>
(cherry picked from commit dffaac83d1)
2017-08-17 15:45:17 -04:00
David Galloway
cd50aad45a Merge pull request #17069 from yuriw/wip_add_luminous
Decreased amount of jobs on master, kraken, luminous runs
2017-08-17 15:27:19 -04:00
Matt Benjamin
e7b14d03bc Merge pull request #17040 from mdw-at-linuxbox/rgw-master-fix-plus
Rgw master fix plus
2017-08-17 14:54:51 -04:00
Ken Dreyer
5c1e9f55d3 rpm: rm macros in comments
rpm expands all macros in a .spec file, even those in comments. Drop the
percent signs so rpm will not expand these.

This change silences rpmlint's warning about macros in comments.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2017-08-17 12:20:01 -06:00
Gregory Farnum
b5220e202e Merge pull request #17066 from amitkumar50/cov-os-1
os: Initializing uninitialized members aio_info

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-08-17 10:21:15 -07:00
amitkuma
a5626dd238 os: Initializing uninitialized members aio_info
Fixes the coverity issue:

** 717332 Uninitialized pointer field
2. uninit_member: Non-static class member field iocb.data is not
initialized in this constructor nor in any functions that it calls.
4. uninit_member: Non-static class member field iocb.key is not
initialized in this constructor nor in any functions that it calls.
6. uninit_member: Non-static class member field iocb.__pad2 is not
initialized in this constructor nor in any functions that it calls.
8. uninit_member: Non-static class member field iocb.aio_lio_opcode
is not initialized in this constructor nor in any functions that it calls.
10. uninit_member: Non-static class member field iocb.aio_reqprio
is not initialized in this constructor nor in any functions that it calls.

CID 717332 (#1 of 1): Uninitialized pointer field (UNINIT_CTOR)
12. uninit_member: Non-static class member field iocb.aio_fildes is not
initialized in this constructor nor in any functions that it calls.

Signed-off-by: Amit Kumar amitkuma@redhat.com
2017-08-17 22:30:22 +05:30
Yingxin
4186d9efa4 osd/OpRequest: fix reqid assignment for reply messages
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2017-08-17 12:40:35 -04:00
Yuri Weinstein
6b7331e038 Decreased amount of jobs on master, kraken, luminous runs
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2017-08-17 09:32:09 -07:00
fang.yuxiang
40db1fdbc7 rgw: break sending data-log list infinitely
radosgw send data-log list infinitely when opposite end trimmed the data-log and in quiescence.
Fixes: http://tracker.ceph.com/issues/20951

Signed-off-by: fang yuxiang fang.yuxiang@eisoo.com
2017-08-18 00:24:22 +08:00
Yuri Weinstein
8a63a83c6f Merge pull request #16896 from amitkumar50/cov-librado-2
rados: Initializing members of librados/TestCase.h

Reviewed-by: Sage Weil <sage@redhat.com>
2017-08-17 07:42:10 -07:00
Jason Dillaman
e949906715 Merge pull request #16939 from trociny/wip-nonlinux-fsx
test/librbd: make fsx build on non-linux platform

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-08-17 10:32:01 -04:00
Kefu Chai
164fd5fdc6 osd: exit(1) directly without lock if init fails
if init fails to connect to a monitor, we just exit(1), there is no need
to set the `r` or lock the grand osd_lock for this. this change also
silences the warning of clang analyzer:

Value stored to 'r' is never read

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-17 21:56:10 +08:00
Abhishek Lekshmanan
93a858392a rgw_lc: add support for optional filter argument and make ID optional
Support Filter tag in Lifecycle XML similar to AWS S3, while S3 docs
mention that this tag is mandatory, older clients still default to
Prefix, and S3 itself seems to relaxed in enforcing the rule, this
implementation also follows a similar pattern. Filter optionally
supports filtering via (multiple) Object Tags, this is still a TODO. The
current implementation of object tags is still as an object xattr, and
since the LC processing still iterates over the bucket index which
currently doesn't have any info. on tags, this requires some thought
into for implementing without a larger performance penalty

Fixes: http://tracker.ceph.com/issues/20872
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-08-17 13:59:47 +02:00
Xie Xingguo
ccc40482b6 Merge pull request #17027 from joscollin/wip-cleanup-Wsign-compare
test/osd: silence warnings from -Wsign-compare

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-17 19:53:02 +08:00
xie xingguo
3e4fe5bc74 crush: fix CrushCompiler won't compile maps with empty shadow tree
Steps to reproduce:
(1) ceph osd crush rm-device-class osd.0
(2) ceph osd crush set-device-class foo osd.0
(3) ceph osd crush rule create-replicated foo_rule default host foo
(4) ceph osd crush rm-device-class osd.0
(5) ceph osd getcrushmap -o crushmap
(6) crushtool -d crushmap -o crushmap.txt
(7) crushtool -c crushmap.txt -o crushmap
    unknown device class 'foo'

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-17 18:11:36 +08:00
Mykola Golub
c4c7075029 qa/workunits/rbd: test data pool is mirrored correctly
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-08-17 10:07:12 +02:00
Kefu Chai
b567261208 cmake: require lz4 v1.7 for building lz4 compressor
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-17 16:01:55 +08:00
Kefu Chai
b5ea349c0d compressor: conditionalize on HAVE_LZ4
do not enable lz4 compressor plugin unless HAVE_LZ4 is ON. so, for
example, when the compressor type is "random", the compressor factory
won't complain with:

load failed dlopen(): "/usr/lib64/ceph/compressor/libceph_lz4.so: cannot
open shared object file: No such file or directory"

anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-08-17 15:12:25 +08:00
xie xingguo
7c67f95201 crush, mon: "ceph osd crush rule ls-by-class" support
This command returns all crush rules that are currently
referencing the device class specified by user.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-08-17 13:34:36 +08:00
amitkuma
6cd5d470d6 mds: Initializing uninitiazed members SnapServer
Fixes te coveity issue:

** 1316251 Uninitialized pointer field
CID 1316251 (#1 of 1): Uninitialized pointer field (UNINIT_CTOR)
2. uninit_member: Non-static class member mon_client is not initialized
in this constructor nor in any functions that it calls.

Signed-off-by: Amit Kumar amitkuma@redhat.com
2017-08-17 10:07:05 +05:30
Jason Dillaman
e16e52ee1d mgr/dashboard: fix duplicate images listed on iSCSI status page
Fixes: http://tracker.ceph.com/issues/21017
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-08-16 20:43:58 -04:00
Patrick Donnelly
588e5d03b6
Merge PR #16891 into master
* refs/remotes/upstream/pull/16891/head:
	mds/MDSDaemon: add 'is_valid=false' when failed to parse caps

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-16 14:42:09 -07:00
Patrick Donnelly
08b077338c
ceph-fuse: load supplementary groups by default
Partially addresses POSIX test failures in [1] due to the config setting being
false by default.

[1] https://bugzilla.redhat.com/show_bug.cgi?id=1480182#c6

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-16 11:20:04 -07:00
Patrick Donnelly
24c9de5d11
client: clear suid/sgid bits on non-zero write
According to [1], these bits should be cleared regardless of any exe bits on
the file. Also, add the required non-zero write check.

[1] http://pubs.opengroup.org/onlinepubs/9699919799/functions/pwrite.html

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-16 11:20:04 -07:00
Patrick Donnelly
3f806c72dd
client: add missing space in debug msg
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-16 11:20:04 -07:00
Patrick Donnelly
d306d74a60
cephfs: clear suid/sgid if regular file is exe
According to [1], the suid/sgid should be cleared if any of the executable bits
are set.

Found this while experimenting for [2].

[1] http://pubs.opengroup.org/onlinepubs/9699919799/functions/chown.html
[2] https://bugzilla.redhat.com/show_bug.cgi?id=1480182

Fixes: http://tracker.ceph.com/issues/21004

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-16 11:19:40 -07:00
Gregory Farnum
f7f8318098 Merge pull request #17022 from ceph/wip-doc-sans-gitbuilder
Update docs to remove gitbuilder and add shaman references

Reviewed-By: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2017-08-16 10:09:53 -07:00
Patrick Donnelly
6448d4927f
client: refactor clear set uid/gid if -1
libfuse already does not set FUSE_SET_ATTR_UID if the chown uid is -1. However,
another libcephfs client could call setattr directly with -1 as the uid/gid so we
should handle that potential case.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-16 09:50:05 -07:00
David Zafman
4d56de3608 tests: Increase sleep in test_pidfile.sh
Signed-off-by: David Zafman <dzafman@redhat.com>
2017-08-16 09:41:01 -07:00
Casey Bodley
f27ebabe55 test/rgw: add kms encryption key for teuthology
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-16 12:22:31 -04:00
Casey Bodley
acb953a9ed test/rgw: add multisite test_encrypted_object_sync
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-16 12:22:31 -04:00
Casey Bodley
adf7a33301 rgw: rgwx-skip-decrypt header bypasses decryption filter on GetObj
Fixes: http://tracker.ceph.com/issues/20668
Fixes: http://tracker.ceph.com/issues/20671

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-16 12:22:31 -04:00
Casey Bodley
2a7a5be4b4 rgw: add skip_decrypt to RGWRESTConn::get_obj()
this adds a rgwx-skip-decrypt header to requests from
RGWRados::fetch_remote_obj()

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-16 12:22:31 -04:00
Casey Bodley
9bd1aa7fac rgw: name arguments to RGWRESTConn::get_obj()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-08-16 12:22:31 -04:00
Alfredo Deza
b2c861ed62 doc/rados/configuration comment out '...' on ini blocks
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-16 11:08:59 -04:00
Alfredo Deza
e7a3bb94fb doc/rados/api comment out '...' on ini blocks
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2017-08-16 11:06:49 -04:00