Commit Graph

69464 Commits

Author SHA1 Message Date
Nathan Cutler
769b695465 build/ops: add psmisc dependency to ceph-base (deb and rpm)
Fixes: http://tracker.ceph.com/issues/19129
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-03-02 12:42:34 +01:00
Radoslaw Zarzynski
fab7d54486 os/bluestore: switch to alloc_dbg_assert in BmapEntityListIter::next().
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-03-02 12:05:37 +01:00
Radoslaw Zarzynski
a4a9d19ec9 os/bluestore: inline for the sake of BitMapAreaLeaf::child_check_n_lock.
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-03-02 12:03:59 +01:00
Zhao Chao
01d816cb55 mailmap: fix Zhao Chao affiliation.
Signed-off-by: Zhao Chao <zhaochao1984@gmail.com>
2017-03-02 18:50:29 +08:00
Kefu Chai
a15e5045ff Merge pull request #13427 from ly798/update-info
mailmap: Liu Yang affiliation

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-03-02 17:00:48 +08:00
Haomai Wang
73fdc579b5 Merge pull request #13738 from yuyuyu101/wip-fix-ib
msg/async/rdma: fix potential racing connection usage

Reviewed-by: Adir lev <adirl@mellanox.com>
2017-03-02 15:52:03 +08:00
Haomai Wang
2ce11e1872 Merge pull request #13655 from Adirl/ulimit
msg/async/rdma: check ulimit

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-03-02 15:02:21 +08:00
Sarit Zubakov
750bd5e7df msg/async/rdma: check ulimit
On RDMA, memlock should be unlimited. If it is not then
warn the user

issue: 973654

Change-Id: If1e07722aaca9df88714828ca3f7398a2504e262
Signed-off-by: Sarit Zubakov <saritz@mellanox.com>
Signed-off-by: Adir Lev <adirl@mellanox.com>
2017-03-02 08:59:35 +02:00
Haomai Wang
911fbf30a0 Merge pull request #13510 from yuyuyu101/wip-rdma-buffer-size
common/config_opts: improve rdma buffer size to 128k
2017-03-02 14:47:01 +08:00
liuchang0812
efe027dcb2 test: unittest_hostname compile error on freebsd
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-03-02 14:29:57 +08:00
Kefu Chai
d34df3183c Merge pull request #13713 from drunkard/master
doc: misc minor fixes

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-03-02 14:16:48 +08:00
Kefu Chai
9132269421 rpm: disable dwz to speed up valgrind
Fixes: http://tracker.ceph.com/issues/19099
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-03-02 13:08:19 +08:00
Haomai Wang
f7c6bffdec msg/async/rdma: fix incorrect method name
Signed-off-by: Haomai Wang <haomai@xsky.com>
2017-03-02 11:53:13 +08:00
Haomai Wang
4323ec25c4 msg/async/rdma: keep qp_conns lock to prevent connection alive
Signed-off-by: Haomai Wang <haomai@xsky.com>
2017-03-02 11:44:59 +08:00
Haomai Wang
97e0486979 msg/async/rdma: remove unused variables
Signed-off-by: Haomai Wang <haomai@xsky.com>
2017-03-02 11:41:52 +08:00
Haomai Wang
595f945cbd Merge pull request #13525 from yuyuyu101/wip-infiniband-fork
msg/async/rdma: make Infiniband can be forkable
2017-03-02 11:36:51 +08:00
Haomai Wang
522555070b msg/async/rdma: restart Infiniband resources to handle fork properly
Signed-off-by: Haomai Wang <haomai@xsky.com>
2017-03-02 11:36:12 +08:00
Haomai Wang
f1ae21ba2e Merge pull request #13666 from Adirl/chunk_size
msg/async/rdma: rename chunk_size to buffer_size

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-03-02 11:34:44 +08:00
Drunkard Zhang
230605eeeb doc: add missed commas
Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2017-03-02 11:04:35 +08:00
Drunkard Zhang
d46fca02c4 doc: add mark for quoted content
Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2017-03-02 11:04:35 +08:00
Drunkard Zhang
7088fe7718 doc: command typo fix, s/radosgw_admin/radosgw-admin
Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2017-03-02 11:04:35 +08:00
Drunkard Zhang
590da965e7 doc: fix aiming of command ping
Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2017-03-02 11:04:35 +08:00
Drunkard Zhang
bcb89fbe0d doc: hyperlink typo fix in dev/index
The doc compiler complains about this.

Signed-off-by: Drunkard Zhang <gongfan193@gmail.com>
2017-03-02 11:04:35 +08:00
Radoslaw Zarzynski
342502e87f os/bluestore: leverage the type knowledge in BitMapAreaLeaf.
We're sure the only element type BitMapAreaLeaf aggregates is
BitMapZone. There is no business to go through vptrs and thus
prohibit compiler to inline in a method that is crucial for
overall performance of the BitMap allocator.

Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-03-02 03:24:00 +01:00
Haomai Wang
1a457beb3e Merge pull request #13680 from yuyuyu101/wip-tx-zerocopy
msg/async/rdma: refactor tx handle flow to get rid of locks

Reviewed-by: Adir lev <adirl@mellanox.com>
2017-03-02 10:00:16 +08:00
Sage Weil
2e3ea53b41 qa/suites/upgrade/jewel-x/parallel: fix upgrade to luminous
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-01 19:50:23 -06:00
Sage Weil
1e0e53c80d qa/suite/upgrade/jewel-x: drop x86 ec test
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-01 19:50:23 -06:00
Sage Weil
269eafb202 qa/suites/upgrade/jewel-x: fix upgrade order; fix split grouping
Signed-off-by: Sage Weil <sage@redhat.com>
2017-03-01 19:50:23 -06:00
Zack Cerza
49aee217e0 Merge pull request #13706 from zmc/wip-openstack-volumes
qa/suites/ceph-deploy: Drop OpenStack volume count
2017-03-01 16:35:42 -07:00
Brad Hubbard
f321309c9c Merge pull request #13657 from badone/wip-rgw-setuid-no-coredump
rgw: set dumpable flag after setuid post ff0e521

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2017-03-02 08:54:37 +10:00
Yehuda Sadeh
6069f4b812 test/librados: extend pool list test to include cursor
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-01 14:49:12 -08:00
Yehuda Sadeh
152159fce4 librados: nobjects list get and seek to cursor
cursor is of ObjectCursor type

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-01 14:49:12 -08:00
Yehuda Sadeh
38f0870f7c librados: ObjectCursor adjustments and additions
add missing constructor, operators, and to/from str functionality

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2017-03-01 14:49:12 -08:00
Sage Weil
8d179d2a14 Merge pull request #12998 from Liuchang0812/wip-11081
common: fix that $host always expands to localhost instead of actual hostname

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-01 16:30:24 -06:00
Sage Weil
ad5f382aa4 Merge pull request #13651 from rzarzynski/wip-bs-bitmap-nocct-in-entry
os/bluestore: remove CephContext* from BmapEntry.

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-01 16:29:09 -06:00
Sage Weil
86f2d14c96 Merge pull request #13662 from majianpeng/aio-memset
os/aio: remove the redundant memset(struct iocb)

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-01 16:28:38 -06:00
Sage Weil
7a1d9170d3 Merge pull request #13668 from songbaisen/m3
osd: the osd should not share map with others when it is in stopping state

Reviewed-by: Sage Weil <sage@redhat.com>
2017-03-01 16:27:24 -06:00
Sage Weil
f85cec8315 Merge pull request #13702 from liewegas/wip-trackedop-desc
common/TrackedOp: make TrackedOp::reset_desc() safe

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-03-01 16:26:54 -06:00
Zack Cerza
5fa96a60d7 qa/suites/ceph-deploy: Drop OpenStack volume count
Looks like we only need two per node, since there is only one OSD per
node, and ceph-deploy wants two disks per OSD to account for the
journal.

Signed-off-by: Zack Cerza <zack@redhat.com>
2017-03-01 15:15:49 -07:00
Mykola Golub
496cc53de9 Merge pull request #13729 from dillaman/wip-librbd-compile-warnings
librbd: eliminate compiler warnings

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-03-01 23:57:54 +02:00
Ilya Dryomov
a6009d1039 osd/OSDMap: don't set weight to IN when OSD is destroyed
Since commit 4e28f9e636 ("osd/OSDMap: clear osd_info, osd_xinfo on
osd deletion"), weight is set to IN when OSD is deleted.  This changes
the result of applying an incremental for clients, not just OSDs.
Because CRUSH computations are obviously affected, pre-4e28f9e63644
servers disagree with post-4e28f9e63644 clients on object placement,
resulting in misdirected requests.

Fixes: http://tracker.ceph.com/issues/19119
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-03-01 19:20:38 +01:00
Kefu Chai
2f157ae3ff Merge pull request #11995 from SUSE/wip_timeouts_ceph-create-keys
ceph-create-keys: Add connection timeouts.

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-03-02 01:07:22 +08:00
Patrick Donnelly
c22c643540
mds: remove unused method
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-03-01 11:55:12 -05:00
Patrick Donnelly
8f5691e4c5
mds: remove redundant mds object count tracking
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-03-01 11:54:57 -05:00
Loic Dachary
c7311e141d crush: device classes mini cluster sanity check
Run a mini cluster and verify that modifying the crushmap,
sending it to the cluster produces the intended effect.

Refs: http://tracker.ceph.com/issues/18943

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2017-03-01 17:24:09 +01:00
Loic Dachary
154f3d3d27 crush: document the class qualifier
The class qualifier is documented for devices and step take
only. Although it shows in the buckets and could be set by the user, it
would be very error prone to do so.

Refs: http://tracker.ceph.com/issues/18943

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2017-03-01 17:24:09 +01:00
Loic Dachary
f9eb206943 crush: update device classes where relevant
The device classes are implemented by modifying:

- the argument of step TAKE in rules
- cloning bucket trees when required by a rule step

This happens (via populate_classes):

- before compiling a rule step TAKE

When the crush map is encoded, the device class information is stored
with it, independently from the rules and the buckets, as a map of
classes for each device & bucket and a map of classes for each rule step
TAKE.

The extra buckets created but not used by any rule do not need to be
preserved and they are removed (via cleanup_classes):

- before decompilation
- after compilation
- after decoding

The client and daemons that are not aware of the device classes are
compatible because the crushmap modified with the new buckets is fully
functional. The invalid names used in the for the generated
buckets (bucket~class) can be CrushWrapper::decode by any existing
client because there is no verification of the name validity during
decoding. It can also be CrushWrapper::dump or CrushCompiler::decompile
via ceph osd dump or crushtool. It cannot, however, be compiled again
because CrushCompiler::compile will try to set the name with
CrushWrapper::set_item_name and it will fail with EINVAL because of the
~.

Fixes: http://tracker.ceph.com/issues/18943

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2017-03-01 17:24:09 +01:00
Loic Dachary
57e66c6f2d crush: clear bucket class ids when removed
Refs: http://tracker.ceph.com/issues/18943

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2017-03-01 17:24:09 +01:00
Loic Dachary
fb111a813c crush: do not erase non existent name
Signed-off-by: Loic Dachary <ldachary@redhat.com>
2017-03-01 17:24:09 +01:00
Loic Dachary
9cf9d814b3 crush: implement {populate,cleanup}_classes
Refs: http://tracker.ceph.com/issues/18943

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2017-03-01 17:24:09 +01:00