Commit Graph

80999 Commits

Author SHA1 Message Date
Xiaoxi Chen
95389413dd OSD/admin_socket: add get_mapped_pools
get_mapped_pools will return all pool_id that
mapped to the paticular OSD.

It is super useful for monitoring system that want to
**group** OSDs based on application. PoolID is a nature
grouping tag to be attached to OSDs.

Signed-off-by: Xiaoxi Chen <xiaoxchen@ebay.com>
2017-11-23 20:37:25 -07:00
Kefu Chai
e3b703eb12 cmake: check bootstrap.sh instead before downloading boost
config.hpp does not exist if boost is not configured. so a boost source
directory unpacked from dist tarball does not have this file. the
bootstrap.sh instead, it is used to create the necessary config files
for jam.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-24 11:13:16 +08:00
Kefu Chai
2218efa005 make-dist: repackage boost in the correct path
before this change, boost is put into ./src. after this change, it is
put into $outfile/src. i.e. something like
ceph-12.1.2-4592-gf5f2ced624/src .

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-24 11:13:16 +08:00
Boris Ranto
c2b98819d9
Merge pull request #19026 from badone/wip-selinux-policy-doc-rawhide-build
build/ops: rpm: selinux-policy fixes

Reviewed - by: branto@redhat.com
2017-11-23 13:54:52 +01:00
Kefu Chai
e25300cb6a
Merge pull request #18614 from tchaikov/wip-osd-mgrreport
osd,mgr: report slow requests and pending creating pgs to mgr

Reviewed-by: John Spray <john.spray@redhat.com>
2017-11-23 15:01:01 +08:00
Kefu Chai
46cc6eed99
Merge pull request #18890 from pjjw/pjjw/prom-deep-scrub-state-missing
mgr/prometheus: add missing 'deep' state to PG_STATES in ceph-mgr prometheus plugin

Reviewed-by: John Spray <john.spray@redhat.com>
2017-11-23 14:06:16 +08:00
Kefu Chai
f21ef22cbb
Merge pull request #19030 from tangwenjun3/wip-fix-bluefs-allocate
os/bluestore: fix the allocate in bluefs

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2017-11-23 14:05:34 +08:00
Kefu Chai
1bfbb528af
Merge pull request #18785 from majianpeng/bluestore-remove-collection
os/bluestore: avoid omit cache for remove-collection.

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-11-23 14:04:07 +08:00
Kefu Chai
e2fcb7b31d
Merge pull request #18760 from david-z/wip-mon-ceph-report
mon: dump servicemap along with MgrStatMonitor dump info

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-23 14:03:07 +08:00
Kefu Chai
afcb24ac3c
Merge pull request #17596 from amitkumar50/cov-message-10
messages: Silence uninitialized member warnings

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-11-23 14:01:42 +08:00
Kefu Chai
4a1f2a5c78 qa: silence SLOW_OPS,PENDING_CREATING_PGS warnings
this is an intermediate step to deprecate REQUEST_SLOW warnings.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-23 13:59:42 +08:00
Kefu Chai
7e7978732d mgr: summarize osd metrics in MMgrReport and sent it to mon
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-23 13:55:15 +08:00
Jiaying Ren
042a8346cb rgw: drop useless includes in rgw_{main.cc, common.h}
Signed-off-by: Jiaying Ren <jiaying.ren@umcloud.com>
2017-11-23 12:04:24 +08:00
Patrick Donnelly
23a86a404a
Merge PR #18697 into master
* refs/pull/18697/head:
	mds: limit size of MExportDir message
	mds: optimize MDCache::try_subtree_merge
	mds: optimize import/export state access

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-22 13:40:21 -08:00
Patrick Donnelly
e56c383717
Merge PR #18748 into master
* refs/pull/18748/head:
	client/Client.cc: trivial [Cleanup] Stop different types comparison

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 13:40:14 -08:00
Patrick Donnelly
de3662e460
Merge PR #18787 into master
* refs/pull/18787/head:
	mds: prevent filelock from being stuck at XSYN state
	mds: implement LOCK_XSYN_LOCK and LOCK_XSYN_MIX
	mds: cleanup set/drop loner code

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-22 13:40:07 -08:00
Patrick Donnelly
6b44fef7d3
Merge PR #18818 into master
* refs/pull/18818/head:
	libceph: Avoiding divide by zero

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 13:39:59 -08:00
Patrick Donnelly
658b53bcc1
Merge PR #18942 into master
* refs/pull/18942/head:
	mds: lookup snapped inodes by vinodeno_t

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-22 13:39:53 -08:00
Patrick Donnelly
b23a58effa
Merge PR #19007 into master
* refs/pull/19007/head:
	src/libcephfs.cc: Cleanup nullptr initializations against deleted objects, etc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
2017-11-22 13:39:46 -08:00
Patrick Donnelly
cb9a2d1dff
Merge PR #19014 into master
* refs/pull/19014/head:
	mds: properly execute scrub finish context

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-22 13:39:40 -08:00
Patrick Donnelly
96f1d95297
Merge PR #19018 into master
* refs/pull/19018/head:
	mds: don't delay processing completed requests in replay queue

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-22 13:39:32 -08:00
Patrick Donnelly
39dc865fb1
Merge PR #19060 into master
* refs/pull/19060/head:
	client: anchor Inode while trimming caps

Reviewed-by: Zheng Yan <zyan@redhat.com>
2017-11-22 13:39:19 -08:00
Sage Weil
1a1cdab2de
Merge pull request #19102 from jecluis/wip-qa-find-used-ports
qa: add simple and dirty script to find ports being used
2017-11-22 14:34:34 -06:00
Ilya Dryomov
98eb04476a
Merge pull request #19044 from idryomov/wip-resurrect-msg-auth
msg: resurrect support for !CEPH_FEATURE_MSG_AUTH

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-11-22 18:43:25 +01:00
Joao Eduardo Luis
0b30a1538a qa: add simple and dirty script to find ports being used
Seriously, having this is way better than realizing that one needs to
find an unused port each time a new test is created.

It's far from a perfect script. It's downright not elegant.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2017-11-22 16:58:34 +00:00
Jason Dillaman
5afd86ff66
Merge pull request #19082 from trociny/wip-qa-demote-fixup
qa/workunits/rbd: wait for status propagated only if daemon started

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-22 11:26:38 -05:00
Kefu Chai
a027dae517 osd: use prefix increment for non trivial iterator
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-22 16:25:18 +08:00
Yan, Zheng
ca5c987860 mds: limit size of MExportDir message
Only export port of subtree if whole subtree tree is too large for
sinlge MExportDir message. The un-exported portion are added to
export queue.

Fixes: http://tracker.ceph.com/issues/21892
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-11-22 16:25:05 +08:00
Yan, Zheng
1f27ebbef9 mds: optimize MDCache::try_subtree_merge
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-11-22 16:25:02 +08:00
Kefu Chai
8723353f2b
Merge pull request #19067 from tchaikov/wip-nvme-mgr-fixes
bluestore/NVMEDevice: do not deference a dangling pointer

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-22 15:03:16 +08:00
Brad Hubbard
ee4f172f98 build/ops: rpm: selinux-policy fixes
Requiring the file /usr/share/selinux/devel/policyhelp breaks fc27 and
Rawhide builds as they do not have that file. This exposed the fact this
code had not worked in some time due to changes in selinux policy
modules packaging. See
https://bugzilla.redhat.com/show_bug.cgi?id=999584

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2017-11-22 17:02:17 +10:00
Kefu Chai
76fb8c9d0e
Merge pull request #19035 from ifed01/wip-ifed-rep-backend-speedup
osd: make operations on ReplicatedBackend::in_progress_ops more effective

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-11-22 14:50:44 +08:00
Kefu Chai
7e568928a1
Merge pull request #17799 from amitkumar50/cov-misc-7
osd,messages: Initialize read_length,options,send_reply

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 14:44:24 +08:00
Kefu Chai
1a390bf3d2
Merge pull request #17792 from amitkumar50/cov-misc-5
messages,journal: Initialization of stats_period,m_active_set

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 14:44:06 +08:00
Kefu Chai
80da199dc2
Merge pull request #17772 from amitkumar50/cov-misc-3
client,osd,test: Initialize fuse_req_key,snap,who,seq

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 14:42:58 +08:00
Kefu Chai
7e89bf694a
Merge pull request #17767 from amitkumar50/cov-misc-2
messages,test,msg: initialize h,reply_type,owner

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 14:42:32 +08:00
Kefu Chai
23c8f67c6f
Merge pull request #17766 from amitkumar50/cov-misc-1
common,os: initialize commit_data,cmount,iocb

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 14:42:03 +08:00
Kefu Chai
5c7befbed8
Merge pull request #17443 from JiYou/restapi-default-port
ceph-rest-api: when port=0 use the DEFAULT_PORT instead

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 14:40:56 +08:00
Kefu Chai
eba596dfc8
Merge pull request #17085 from yaozongyou/remove_unused_using
librgw_file: remove unused `using` statement.

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-22 13:25:41 +08:00
Kefu Chai
fd3c5cf3e3 msg/simple: pass a char for reading from shutdown_rd_fd
Fixes the coverity issue:

> CID 1395794 (#1 of 1): Wrong size argument (SIZEOF_MISMATCH)
> suspicious_sizeof: Passing argument &ch of type int * and
> argument 1UL to function read is suspicious because sizeof
> (int) /*4*/ is expected.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-22 12:57:19 +08:00
Kefu Chai
68c52a669c
Merge pull request #19017 from tchaikov/wip-bluestore-without-aio
bluestore,cmake: enable building bluestore without aio

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-22 12:26:34 +08:00
Kefu Chai
6d78100919
Merge pull request #19029 from tchaikov/wip-cmake-sysctl-cleanup
cmake: only create sysctl file on linux

Reviewed-by: David Disseldorp <ddiss@suse.de>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2017-11-22 12:23:48 +08:00
Kefu Chai
04aa2b9ebb
Merge pull request #19072 from smithfarm/wip-22207
tests: ceph-disk: ignore E722 in flake8 test

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-22 11:12:15 +08:00
Patrick Donnelly
06e2cec1ea
Merge PR #17678 into master
* refs/pull/17678/head:
	mon/AuthMonitor: improve error message
	mon/OSDMonitor: disallow "all" as a key or value name
	cephfs, mon/AuthMonitor, OSD/osdcap: make 'all' a synonym for '*'
	vstart.sh: Create an admin user for each CephFS
	mon/AuthMonitor: Allow * wildcard for filesystem name
	OSD/OSDCap: Allow namespace and pool tag to be combined
	OSD/OSDCap: Namespace globbing
	mon/AuthMonitor: Use new osd auth caps for ceph fs authorize
	OSD/auth caps: Add OSD auth caps based on pool tag
	mon/FSCommands: Tag pools used for cephfs by default
	mon/OSDMonitor: Add key/value arguments for pool tagging

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-21 13:49:24 -08:00
Nathan Cutler
d1f2df37dd build/ops: rpm: fix systemd macros for ceph-volume@.service
Fixes: http://tracker.ceph.com/issues/22217
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-11-21 21:41:33 +01:00
Mykola Golub
7fb9920316 qa/workunits/rbd: wait for status propagated only if daemon started
Signed-off-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-21 22:29:16 +02:00
Mykola Golub
2db4e96335
Merge pull request #19000 from dillaman/wip-15322
rbd-mirror: removed dedicated thread from image deleter

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-21 21:21:41 +02:00
Yehuda Sadeh
387160098a
Merge pull request #17072 from rzarzynski/wip-rgw-21015
rgw: incorporate the Transfer-Encoding fix for CivetWeb.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-21 13:23:27 -05:00
Jason Dillaman
0502cb1573
Merge pull request #19073 from trociny/wip-qa-demote
qa/workunits/rbd: wait for demote status is propagated

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-21 12:52:08 -05:00
Andrew Schoen
7efdf3c50a
Merge pull request #19075 from tchaikov/wip-22154
qa/workunits: silence py warnings for ceph-disk tests

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2017-11-21 09:42:30 -06:00