Commit Graph

69600 Commits

Author SHA1 Message Date
Ali Maredia
6307add5f8 vstart: --help usage for rgw_num, mgr_num, mon, mds, osd
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2017-03-14 15:23:46 -04:00
Casey Bodley
6ba4858772 Merge pull request #13949 from cbodley/wip-15618
rgw: clear old zone short ids on period update

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-14 14:26:32 -04:00
Casey Bodley
13e758782f Merge pull request #13948 from cbodley/wip-rgw-data-sync-versioned
rgw: data sync includes instance in rgw_obj_index_key

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-14 14:26:12 -04:00
Casey Bodley
8e77ea4549 Merge pull request #13586 from Liuchang0812/wip-add-override-in-rgw
rgw: add override in header files mostly

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-03-14 13:39:45 -04:00
Casey Bodley
67ffcf895d Merge pull request #12793 from zhangsw/fix-rgw-abortmultipart
rgw: AbortMultipart request returns NoSuchUpload error if the meta obj doesn't exist

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-03-14 12:19:00 -04:00
Casey Bodley
849589d917 Merge pull request #13900 from oritwas/wip-rgw-19231
fix upgrate from hammer when zone doesn't have zoneparams

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-03-14 12:10:00 -04:00
Casey Bodley
c952e85270 Merge pull request #13354 from Liuchang0812/wip-18828
rgw: don't return skew time error in pre-signed url

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2017-03-14 10:43:32 -04:00
Kefu Chai
8a7103e85f Merge pull request #13798 from tchaikov/wip-brag-count-mds
brag: count the number of mds in fsmap not in mdsmap

Reviewed-by: John Spray <john.spray@redhat.com>
2017-03-14 21:17:07 +08:00
John Spray
6586f32f35 Merge branch 'wip-omap-getkeys-mds' 2017-03-14 11:51:51 +00:00
Sage Weil
ecff8c6ce0 qa/suites/fs/basic: vary omap osd-side limit
Ensure that the omap looping paths are exercised.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-14 11:51:25 +00:00
Sage Weil
d7baef4ff8 mds/CDir: set sane max keys per op
Set default to 16384, which is > than the max frag size of 10000.  We will
loop if there are more.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-14 11:51:25 +00:00
Sage Weil
8e740c07a1 mds/CDir: fetch dir omap in batches as needed
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-14 11:51:25 +00:00
Sage Weil
82f162c9e6 mds/SessionMap: use pmore for loading sessions
Keep the result size check for a while since older OSDs won't populate
the pmore field for us.  Eventually we can remove it.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-14 11:51:24 +00:00
Ilya Dryomov
aa647f43c4 Merge pull request #13812 from idryomov/wip-krbd-feature-disable-msg
rbd: spell out image features unsupported by the kernel

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-03-14 10:22:42 +01:00
Kefu Chai
6dbb4f072c Merge pull request #13924 from tchaikov/wip-silence-gcc-warnings
os/bluestore,test/ceph_test_objectstore: silence gcc warnings

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-03-14 13:01:44 +08:00
liuchang0812
3b247475a2 rgw/cleanup: add override in headers
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-03-14 12:09:29 +08:00
Kefu Chai
16b03c43d8 Merge pull request #13700 from yuyuyu101/wip-msgr-lossy
msg/async: avoid lossy connection sending ack message

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-14 10:56:05 +08:00
Josh Durgin
7852b80613 Merge pull request #13805 from tchaikov/wip-qa-upgrade-tiering
qa/suites/upgrade: add tiering test to hammer-jewel-x

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-03-13 15:26:58 -07:00
Sage Weil
b1261e0b2f Merge pull request #13727 from jcsp/wip-send-command
osdc: clean up osd_command/start_mon_command interfaces

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-13 14:59:29 -05:00
Yuri Weinstein
8a76c88a65 Merge pull request #13825 from wjwithagen/wip-wjw-stack-compat
msg/async/Stack.cc: use of pthread_setname_np() needs compat.h

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-03-13 12:58:12 -07:00
Yuri Weinstein
b198061fce Merge pull request #10272 from yonghengdexin735/wip-zzz-delete=
msg/simple/Pipe:the returned value for do_recv unequal to zero

Reviewed-by: Loic Dachary <loic@dachary.org>
Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-13 12:57:06 -07:00
Sage Weil
abce6de351 Merge pull request #12578 from kylinstorage/wip-filestore-ref
os/filestore: avoid unnecessary copy in filestore::_do_transaction

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-13 14:55:26 -05:00
Yuri Weinstein
421f6711a2 Merge pull request #13894 from majianpeng/do_op_duplicated_code
osd/PrimaryLogPG: remove duplicated code.

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2017-03-13 12:52:27 -07:00
Casey Bodley
9c45633c83 rgw: clear old zone short ids on period update
the short ids of old, removed zones were being kept in the period to
guard against hash collisions with new zones

but for a hash collision to cause a wrong object to sync, that object
would have to be uploaded simultaneously to two different zones that had
the same short id

to avoid this, we just have to prevent the period from containing two
colliding zones at the same time - we don't have to remember old zone
short ids forever

Fixes: http://tracker.ceph.com/issues/15618

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-03-13 15:51:12 -04:00
Casey Bodley
f332fb1c15 rgw: data sync includes instance in rgw_obj_index_key
this was breaking the versioned object test in test_multi.py, because we
were trying to create delete markers instead of unlinking a specific
object instance

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-03-13 14:51:39 -04:00
Mykola Golub
0e7027f150 Merge pull request #13919 from dillaman/wip-19256
rbd: prevent adding multiple mirror peers to a single pool

Reviewed-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-03-13 18:26:52 +02:00
Casey Bodley
3fa11cf67e Merge pull request #12264 from cbodley/wip-rgw-print-is-admin
rgw: print is_admin as int instead of __u8

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-13 10:27:49 -04:00
Loic Dachary
b1a2f9fbc9 Merge pull request #13722 from dachary/wip-crush-doc
crush: document tunables and rule step set_

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-13 15:07:47 +01:00
Loic Dachary
42aa85bd95 crush: document tunables and rule step set_
Signed-off-by: Loic Dachary <loic@dachary.org>
2017-03-13 13:50:16 +01:00
Nathan Cutler
0c2f5f7214 Merge pull request #13781 from SUSE/wip-19184
build/ops: make package groups comply with openSUSE guidelines

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
2017-03-13 08:34:27 +01:00
Jason Dillaman
c0c9d1014d rbd: prevent adding multiple mirror peers to a single pool
The rbd-mirror daemon does not currently support replication
from multiple peers. Until that is supported, add a temporary
restriction to prevent confusion.

Fixes: http://tracker.ceph.com/issues/19256
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-03-12 11:18:02 -04:00
Jason Dillaman
04d524bbc1 Merge pull request #13926 from trociny/wip-19260
librbd: fix clang compilation error

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-03-12 10:51:58 -04:00
Mykola Golub
5dd78f2242 librbd: make build with clang
Fixes: http://tracker.ceph.com/issues/19260
Signed-off-by: Mykola Golub <mgolub@mirantis.com>
2017-03-11 19:19:33 +00:00
Mykola Golub
c6b78d4273 Merge pull request #13694 from liupan1111/wip-fix-no-error-map
rbd-nbd: warn when kernel parameters are ignored

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-03-11 17:05:49 +02:00
Pan Liu
37aa18858b rbd-nbd: only try to load nbd module once when open nbd device, during do_map operation.
Signed-off-by: Pan Liu <liupan1111@gmail.com>
2017-03-11 21:50:00 +08:00
Pan Liu
58a273d194 rbd-nbd: warn when kernel parameters are ignored
Fixes: http://tracker.ceph.com/issues/19108
Signed-off-by: Pan Liu <liupan1111@gmail.com>
2017-03-11 21:48:37 +08:00
Kefu Chai
b32cd0e9af os/bluestore: silence gcc warning
silences following warning:

src/os/bluestore/BitAllocator.h:410:8: warning: ‘virtual bool
BitMapAreaIN::child_check_n_lock(BitMapArea*, int64_t, bool)’ was hidden
[-Wover\
loaded-virtual]
   bool child_check_n_lock(BitMapArea *child, int64_t required, bool
lock) {
        ^~~~~~~~~~~~~~~~~~
/var/ceph/ceph/src/os/bluestore/BitAllocator.h:489:8: warning:   by
‘BitMapAreaLeaf::child_check_n_lock’ [-Woverloaded-virtual]
   bool child_check_n_lock(BitMapZone* child, int64_t required, bool
lock);
        ^~~~~~~~~~~~~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-11 17:34:38 +08:00
Kefu Chai
1bf8f45691 test/ceph_test_objectstore: silence gcc warning
silence following warning:

store_test.cc: In member function ‘virtual void
StoreTest_ManyObjectTest_Test::TestBody()’:
/var/ceph/ceph/src/test/objectstore/store_test.cc:3153:6: warning:
suggest explicit braces to avoid ambiguous ‘else’ [-Wdangling-else]
   if (listed2.size())
      ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-11 17:34:38 +08:00
Xie Xingguo
9650e5b62c Merge pull request #13801 from xiexingguo/wip-fix-func-name
osd: fix func name in log produced by handle_pg_peering_evt()

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-11 09:55:44 +08:00
Yehuda Sadeh
1ed22887ef Merge pull request #13856 from zhangsw/cleanup-radosgw-admin-tier_type
rgw: remove useless --tier_type in radosgw-admin.

Reviewed-by: Jiaying Ren <mikulely@gmail.com>
2017-03-10 13:54:23 -08:00
Ilya Dryomov
eec00159e0 rbd: spell out image features unsupported by the kernel
/sys/bus/rbd/supported_features is available on kernels starting with
4.11.  Example output:

    $ sudo rbd map x
    rbd: sysfs write failed
    RBD image feature set mismatch. This image cannot be mapped because the following immutable features are unsupported by the kernel: data-pool.
    In some cases useful info is found in syslog - try "dmesg | tail".
    rbd: map failed: (6) No such device or address

    $ sudo rbd map -p foo y
    rbd: sysfs write failed
    RBD image feature set mismatch. You can disable features unsupported by the kernel with "rbd feature disable foo/y object-map fast-diff deep-flatten".
    In some cases useful info is found in syslog - try "dmesg | tail".
    rbd: map failed: (6) No such device or address

or, if /sys/bus/rbd/supported_features isn't there:

    $ sudo rbd map z
    rbd: sysfs write failed
    RBD image feature set mismatch. Try disabling features unsupported by the kernel with "rbd feature disable".
    In some cases useful info is found in syslog - try "dmesg | tail".
    rbd: map failed: (6) No such device or address

Fixes: http://tracker.ceph.com/issues/19095
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-03-10 21:03:09 +01:00
Yehuda Sadeh
5a91efd14b Merge pull request #13920 from cbodley/wip-rgw-fix-cleanup-meta-sync
rgw: fix transition from full to incremental meta sync

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-10 11:27:03 -08:00
Yehuda Sadeh
19f8f77918 Merge pull request #11586 from cbodley/wip-rgw-fetchallmeta-yield-break
rgw: fix break inside of yield in RGWFetchAllMetaCR

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-10 11:10:58 -08:00
Sage Weil
68ba724db5 Merge pull request #10407 from yonghengdexin735/wip-zzz-perf-counters
common/perf_counters.: Remove unnecessary judgment

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-10 10:55:21 -06:00
Casey Bodley
0705cef395 rgw: fix transition from full to incremental meta sync
when transitioning to incremental sync, we need to write temp_marker
instead of sync_marker, because temp_marker has replaced the full sync
marker (which is a metadata key, rather than an log marker) with
next_step_marker

this was breaking the metadata checkpoint in test_multi.py, because it
was comparing metadata keys (i.e. 'user:zone.user') against mdlog
markers

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-03-10 11:31:49 -05:00
Nathan Cutler
af9f92ca69 build/ops: extend rpm spec file copyright period to 2017
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-03-10 16:17:11 +01:00
Nathan Cutler
b679b1dee3 build/ops: make package groups comply with openSUSE guidelines
. . . and put all Group: lines in SUSE conditional blocks.

Fixes: http://tracker.ceph.com/issues/19184
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-03-10 16:17:11 +01:00
Mykola Golub
25c2482735 Merge pull request #13737 from dillaman/wip-19104
test: support blacklisting within librados_test_stub

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-03-10 17:00:43 +02:00
Jason Dillaman
6be6625024 rbd-mirror: correct race conditions within leader watcher
It was possible for multiple, concurrent acquire attempts to be
running for a single instance due to notification messages. Now
only a single acquire state machine can be running.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-03-09 21:17:07 -05:00
Jason Dillaman
00591653bc librbd: improve debug log messages for managed lock
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-03-09 20:25:18 -05:00