Commit Graph

71472 Commits

Author SHA1 Message Date
wangzhengyong
bfc334b537 ceph osd: add support for new op cmpext
This adds support for a new op cmpext. The request will read
extent.length bytes and compare them to extent.length bytes at
extent.offset on disk. return 0 on success, negative error code
on failure, (-MAX_ERRNO - mismatch_off) on mismatch

rbd will use this in a multi op request to implement the
SCSI COMPARE_AND_WRITE request which is used by VMware for
its atomic test and set request.

Signed-off-by: Zhengyong Wang <wangzhengyong@cmss.chinamobile.com>
Signed-off-by: Mike Christie <mchristi@redhat.com>
[ddiss@suse.de: ReplicatedPG -> PrimaryLogPG]
Reviewed-by: David Disseldorp <ddiss@suse.de>
2017-04-26 09:08:22 +08:00
Yuri Weinstein
024314e912 Merge pull request #14755 from cbodley/wip-msg-direct
core: introduce DirectMessenger

Reviewed-by: Greg Farnum gfarnum@redhat.com
Reviewed-by: Sage Weil sage@redhat.com
2017-04-25 16:52:11 -07:00
Sage Weil
64ae61a516 osd/OSDMap: put OSDMap[::Incremental] itself in mempool too
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-25 18:26:08 -04:00
Sage Weil
691bc44d59 Merge pull request #14783 from dachary/wip-crush-classe-test
test: use 7130 for crush-classes.sh

Reviewed-by: Dan Mick <dmick@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-25 16:56:11 -05:00
Sage Weil
7e2a286446 Merge pull request #14651 from tchaikov/wip-silent-boost-build
cmake: pass -d0 to b2 if not CMAKE_VERBOSE_MAKEFILE

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-25 16:53:58 -05:00
Sage Weil
d754fbcca4 Merge pull request #14731 from ceph/wip-bluestore-type
os/bluestore: use correct bound encode size for unused

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-04-25 16:53:44 -05:00
Sage Weil
5af0944afa Merge pull request #14738 from liupan1111/wip-fix-initial
src/common: change last_work_queue to next_work_queue. 

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-04-25 16:53:23 -05:00
Sage Weil
4ba4567bd2 Merge pull request #14757 from dmick/wip-einval
common: Better handling for missing/inaccessible ceph.conf files

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-04-25 16:52:46 -05:00
Sage Weil
fee612f16f Merge pull request #14764 from Liuchang0812/wip-strip-pglog-op-name
osd: strip pglog op name

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-25 16:52:28 -05:00
Sage Weil
c46f74f8e6 Merge pull request #14772 from majianpeng/bluestore-remove-extentfreelist
os/bluestore: Remove ExtentFreeListManager.

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-25 16:52:14 -05:00
Sage Weil
e70eff2292 Merge pull request #14777 from tchaikov/wip-19398
osd/PGMonitor: always update pgmap with latest osdmap

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-25 16:51:53 -05:00
Jianpeng Ma
ad14422b3d os/bluestore: Remove ExtentFreeListManager.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2017-04-26 04:25:47 +08:00
Casey Bodley
5cc99db524 test/rgw: wait for realm reload after set_master_zone
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-04-25 15:26:30 -04:00
Casey Bodley
2976fd36cd test/rgw: fixes for test_multi_period_incremental_sync()
test was only creating objects in subsequent periods, which wasn't
adding any entries to the mdlog. this wasn't correctly testing
incremental metadata sync across periods

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-04-25 15:22:51 -04:00
Casey Bodley
20df35ad94 test/rgw: meta checkpoint compares realm epoch
avoid marker comparisons between different periods

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-04-25 14:48:28 -04:00
Ilya Dryomov
c72d8b0409 rbd: recognize exclusive map option
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2017-04-25 20:15:41 +02:00
Loic Dachary
7a84a43095 test: use 7130 for crush-classes.sh
7127 is already used by mon/misc.sh

Signed-off-by: Loic Dachary <loic@dachary.org>
2017-04-25 19:44:28 +02:00
Sage Weil
a88b0f601b Merge pull request #14350 from batrick/maintainer-update
AUTHORS: update tech leads

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-25 12:25:21 -05:00
Sage Weil
1b81fcf9c1 Merge pull request #14352 from batrick/peoplemap-update
peoplemap: add pdonnell alias
2017-04-25 12:25:03 -05:00
Sage Weil
1919297826 Merge pull request #14494 from drunkard/master
doc: two minor fixes
2017-04-25 12:11:03 -05:00
Sage Weil
c135254de3 Merge pull request #14493 from johnzzpcrystal/FileJournal-typo
os/filestore/FileJournal: Fix typo in the comment
2017-04-25 12:10:28 -05:00
Sage Weil
fb90918a1d Merge pull request #14503 from wjwithagen/wip-wjw-freebsd-doc-dev
doc/dev: add some info about FreeBSD
2017-04-25 12:09:02 -05:00
Sage Weil
cff7f931cd Merge pull request #14560 from wjwithagen/wip-wjw-freebsd-init-ceph
src/init-ceph.in:  allow one((re)?start|stop) as commands

Reviewed-by: Jos Collin <jcollin@redhat.com>
2017-04-25 12:08:36 -05:00
Sage Weil
e17c85c22f Merge pull request #14625 from theanalyst/doc/releases/12.0.2
doc: v12.0.2 (dev) release notes
2017-04-25 12:06:24 -05:00
Haomai Wang
b2ee4c277e msg/async/rdma: add inqueue rx chunks perf counter
with rdma backend, we always spent a lot of time on why it stop receiving
new message. most of probability is just lack of rx memory which may abused.

Just make it clear how much rx memory inqueue!

Signed-off-by: Haomai Wang <haomai@xsky.com>
2017-04-25 23:58:00 +08:00
Sage Weil
dffcfbfce1 Merge pull request #14713 from smithfarm/wip-19740
tests: set -x in suites/iozone.sh workunit

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2017-04-25 10:56:17 -05:00
Abhishek Lekshmanan
70d7d23c50 rgw_ldap: log the ldap err in case of bind failure
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-04-25 17:49:38 +02:00
Sage Weil
a2f8e50c0f Merge pull request #14756 from yehudasa/wip-rgw-suite-fix
qa/suite: replace reference to fs/xfs.yaml
2017-04-25 10:44:41 -05:00
Abhishek L
88e331af3b Merge pull request #14747 from Liuchang0812/wip-mailmap
mailmap: update organization info

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-04-25 17:12:52 +02:00
Nathan Cutler
4b79ac9a72 build/ops: rpm: package crypto on x86_64 only
ca40e12845 added the following lines to the spec
file:

%dir %{_libdir}/ceph/crypto
%{_libdir}/ceph/crypto/libceph_*.so*

and 350932979b made it so those build artifacts
are generated on x86_64 only.

The result is a build failure on non-x86_64 architectures:

error: Directory not found: /home/abuild/rpmbuild/BUILDROOT/ceph-12.0.2+git.1493119152.181baf6-1.1.ppc64le/usr/lib64/ceph/crypto
error: File not found by glob: /home/abuild/rpmbuild/BUILDROOT/ceph-12.0.2+git.1493119152.181baf6-1.1.ppc64le/usr/lib64/ceph/crypto/libceph_*.so*

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-04-25 16:47:36 +02:00
Sage Weil
0d31587d41 Merge pull request #14718 from liewegas/wip-bluestore-tool
ceph-kvstore-tool: allow 'bluestore-kv' as kvdb type; add escaping, compaction

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-04-25 09:43:56 -05:00
Casey Bodley
c293b5925d core: introduce DirectMessenger
DirectMessenger provides an efficient mechanism to support
in-process embedding of Ceph components (e.g., embedding of the
Ceph OSD in storage targets such as NFSv4 or iSCSI targets).

Signed-off-by: Casey Bodley <cbodley@redhat.com>
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-04-25 10:37:50 -04:00
Kefu Chai
8b6821bd00 osd/PGMonitor: always update pgmap with latest osdmap
without this change, we always update the pgmap with the latest osdmap in
PGMonitor::check_osd_map(), but assign pending_inc.osdmap_epoch with the
epoch passed to PGMonitor::check_osd_map(), even if the osdmap could be
be much newer than "epoch". for example, we could end up with an
MOSDPGCreate with an ancient epoch, but carrying some creating pgs whose
pools do not exist in osdmap of that ancient epoch yet. this happens
when RetryCheckOSDMap is involved.

Fixes: http://tracker.ceph.com/issues/19398
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-04-25 22:33:25 +08:00
Sage Weil
138b7b9f4d Merge pull request #14725 from tchaikov/wip-cmake
cmake: do not compile crush twice

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-04-25 09:31:13 -05:00
Sage Weil
c9106d48ec Merge pull request #14730 from tchaikov/wip-19744
mon/OSDMonitor: update pg_creatings even the new acting set is empty

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-25 09:30:36 -05:00
Sage Weil
79a7c21546 Merge pull request #14744 from ceph/wip-bluefs-alloc-size
os/bluestore: align reclaim size to bluefs_alloc_size

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-25 09:30:10 -05:00
Sage Weil
0b2b544406 Merge pull request #14749 from ifed01/wip-bluestore-nolock-alloc
os/bluestore: get rid off excessive lock at BitMapAllocator

Reviewed-by: Sage Weil <sage@redhat.com>
2017-04-25 09:29:48 -05:00
Sage Weil
4b1d6b05d2 osd/OSDMap: move to 'osdmap' mempool
We leave a few things out:

- strings (to annoying, and they are small)
- erasure code profiles (ditto)

Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-25 09:11:50 -04:00
Sage Weil
db49e0d79e include/mempool: add osdmap mempool
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-25 09:11:50 -04:00
Sage Weil
5a1a4051f1 crush: templatize weights arg for do_rule
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-25 09:11:50 -04:00
Sage Weil
28b7d27943 include/encoding: use more auto
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-25 09:11:49 -04:00
Sage Weil
b3b86254a1 osd/OSDMap: use auto where possible
Signed-off-by: Sage Weil <sage@redhat.com>
2017-04-25 09:11:49 -04:00
Mykola Golub
dba3de2a8c Merge pull request #14762 from zy751713126/add-bench-notes
rbd/bench: add notes of default values, it's easy to use

Reviewed-by: Dongsheng Yang <dongsheng.yang@easystack.cn>
Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-04-25 15:07:49 +03:00
zy751713126
79b6695689 rbd/bench: add notes of default values, it's more easy to use
Signed-off-by: Zheng Yin <zhengyin@chinac.com>
2017-04-25 18:08:43 +08:00
Pan Liu
60f4e0e452 src/common: change last_work_queue to next_work_queue.
Signed-off-by: Pan Liu <liupan1111@gmail.com>
2017-04-25 18:05:20 +08:00
liuchang0812
2d43791d41 mailmap: update organization info
Signed-off-by: liuchang0812 <liuchang0812@gmail.com>
2017-04-25 16:45:23 +08:00
Dan Mick
4bdc18a739 squashme: review comments
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2017-04-24 23:39:52 -07:00
Dan Mick
1fc50db592 test/cli/ceph-conf/env-vs-args.t: accept new error messages
Failing to load ceph.conf now dumps more errors for the user

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2017-04-24 23:36:38 -07:00
Dan Mick
0825f4e262 test/librados_test_stub/LibradosTestStub.cc: accept ENOENT
Missing ceph.conf now returns ENOENT rather than EINVAL

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2017-04-24 23:35:40 -07:00
Dan Mick
9a5954fc66 global/global_init.cc global_pre_init: look for ENOENT
EINVAL for no conf file found changes to ENOENT

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2017-04-24 23:34:27 -07:00