Commit Graph

81087 Commits

Author SHA1 Message Date
myoungwon oh
09c03482ad osd: fix untracked ObjectContextRef
referecnce leak occur if sub_cop has ObjectContextRef

Signed-off-by: Myoungwon Oh <omwmw@sk.com>
2017-11-23 01:40:27 +09:00
Jason Dillaman
5afd86ff66
Merge pull request #19082 from trociny/wip-qa-demote-fixup
qa/workunits/rbd: wait for status propagated only if daemon started

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-22 11:26:38 -05:00
Jos Collin
10f93cf582 mds: Fix error message when mds not active
Fix error message for mds not active state. Also fixed the 'unrecognized command' logic by avoiding the new stringstream local object.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2017-11-22 17:15:49 +05:30
Kefu Chai
a027dae517 osd: use prefix increment for non trivial iterator
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-22 16:25:18 +08:00
Yan, Zheng
ca5c987860 mds: limit size of MExportDir message
Only export port of subtree if whole subtree tree is too large for
sinlge MExportDir message. The un-exported portion are added to
export queue.

Fixes: http://tracker.ceph.com/issues/21892
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-11-22 16:25:05 +08:00
Yan, Zheng
1f27ebbef9 mds: optimize MDCache::try_subtree_merge
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-11-22 16:25:02 +08:00
Kefu Chai
8723353f2b
Merge pull request #19067 from tchaikov/wip-nvme-mgr-fixes
bluestore/NVMEDevice: do not deference a dangling pointer

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2017-11-22 15:03:16 +08:00
liyan
0a752e634a qa/tasks/ceph_fuse: fix ceph-fuse mount failed
Fixes: http://tracker.ceph.com/issues/22205

Signed-off-by: liyan <liyan.wang@xtaotech.com>
2017-11-22 15:02:47 +08:00
Brad Hubbard
ee4f172f98 build/ops: rpm: selinux-policy fixes
Requiring the file /usr/share/selinux/devel/policyhelp breaks fc27 and
Rawhide builds as they do not have that file. This exposed the fact this
code had not worked in some time due to changes in selinux policy
modules packaging. See
https://bugzilla.redhat.com/show_bug.cgi?id=999584

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2017-11-22 17:02:17 +10:00
Kefu Chai
76fb8c9d0e
Merge pull request #19035 from ifed01/wip-ifed-rep-backend-speedup
osd: make operations on ReplicatedBackend::in_progress_ops more effective

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2017-11-22 14:50:44 +08:00
Kefu Chai
7e568928a1
Merge pull request #17799 from amitkumar50/cov-misc-7
osd,messages: Initialize read_length,options,send_reply

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 14:44:24 +08:00
Kefu Chai
1a390bf3d2
Merge pull request #17792 from amitkumar50/cov-misc-5
messages,journal: Initialization of stats_period,m_active_set

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 14:44:06 +08:00
Kefu Chai
80da199dc2
Merge pull request #17772 from amitkumar50/cov-misc-3
client,osd,test: Initialize fuse_req_key,snap,who,seq

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 14:42:58 +08:00
Kefu Chai
7e89bf694a
Merge pull request #17767 from amitkumar50/cov-misc-2
messages,test,msg: initialize h,reply_type,owner

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 14:42:32 +08:00
Kefu Chai
23c8f67c6f
Merge pull request #17766 from amitkumar50/cov-misc-1
common,os: initialize commit_data,cmount,iocb

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 14:42:03 +08:00
Kefu Chai
5c7befbed8
Merge pull request #17443 from JiYou/restapi-default-port
ceph-rest-api: when port=0 use the DEFAULT_PORT instead

Reviewed-by: Sage Weil <sage@redhat.com>
2017-11-22 14:40:56 +08:00
Patrick Donnelly
ef5699441e
test: pass correct buffer length to ceph_getdents
This test fails if the randvar r is 0.

Fixes: http://tracker.ceph.com/issues/22221

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-21 21:35:14 -08:00
Kefu Chai
eba596dfc8
Merge pull request #17085 from yaozongyou/remove_unused_using
librgw_file: remove unused `using` statement.

Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-22 13:25:41 +08:00
Kefu Chai
fd3c5cf3e3 msg/simple: pass a char for reading from shutdown_rd_fd
Fixes the coverity issue:

> CID 1395794 (#1 of 1): Wrong size argument (SIZEOF_MISMATCH)
> suspicious_sizeof: Passing argument &ch of type int * and
> argument 1UL to function read is suspicious because sizeof
> (int) /*4*/ is expected.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-22 12:57:19 +08:00
Kefu Chai
68c52a669c
Merge pull request #19017 from tchaikov/wip-bluestore-without-aio
bluestore,cmake: enable building bluestore without aio

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-22 12:26:34 +08:00
Kefu Chai
6d78100919
Merge pull request #19029 from tchaikov/wip-cmake-sysctl-cleanup
cmake: only create sysctl file on linux

Reviewed-by: David Disseldorp <ddiss@suse.de>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2017-11-22 12:23:48 +08:00
Kefu Chai
04aa2b9ebb
Merge pull request #19072 from smithfarm/wip-22207
tests: ceph-disk: ignore E722 in flake8 test

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-11-22 11:12:15 +08:00
Patrick Donnelly
06e2cec1ea
Merge PR #17678 into master
* refs/pull/17678/head:
	mon/AuthMonitor: improve error message
	mon/OSDMonitor: disallow "all" as a key or value name
	cephfs, mon/AuthMonitor, OSD/osdcap: make 'all' a synonym for '*'
	vstart.sh: Create an admin user for each CephFS
	mon/AuthMonitor: Allow * wildcard for filesystem name
	OSD/OSDCap: Allow namespace and pool tag to be combined
	OSD/OSDCap: Namespace globbing
	mon/AuthMonitor: Use new osd auth caps for ceph fs authorize
	OSD/auth caps: Add OSD auth caps based on pool tag
	mon/FSCommands: Tag pools used for cephfs by default
	mon/OSDMonitor: Add key/value arguments for pool tagging

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2017-11-21 13:49:24 -08:00
Nathan Cutler
d1f2df37dd build/ops: rpm: fix systemd macros for ceph-volume@.service
Fixes: http://tracker.ceph.com/issues/22217
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-11-21 21:41:33 +01:00
Mykola Golub
7fb9920316 qa/workunits/rbd: wait for status propagated only if daemon started
Signed-off-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-21 22:29:16 +02:00
Mykola Golub
2db4e96335
Merge pull request #19000 from dillaman/wip-15322
rbd-mirror: removed dedicated thread from image deleter

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-21 21:21:41 +02:00
Yehuda Sadeh
387160098a
Merge pull request #17072 from rzarzynski/wip-rgw-21015
rgw: incorporate the Transfer-Encoding fix for CivetWeb.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-11-21 13:23:27 -05:00
Jason Dillaman
0502cb1573
Merge pull request #19073 from trociny/wip-qa-demote
qa/workunits/rbd: wait for demote status is propagated

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-21 12:52:08 -05:00
Andrew Schoen
7efdf3c50a
Merge pull request #19075 from tchaikov/wip-22154
qa/workunits: silence py warnings for ceph-disk tests

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2017-11-21 09:42:30 -06:00
Jason Dillaman
d80aa6057c rbd-mirror: fix possible race condition in error path tests
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-21 10:09:18 -05:00
Sage Weil
e7d3b63c35
Merge pull request #19064 from qrGitHub/wip-rgw-typo-refity
rgw: correct typo refity to refit

Reviewed-by: Amit Kumar <amitkuma@redhat.com>
2017-11-21 08:35:09 -06:00
Jason Dillaman
273edbce67 rbd-mirror: removed dedicated thread from image deleter
Fixes: http://tracker.ceph.com/issues/15322
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-21 09:17:40 -05:00
Jason Dillaman
527a62c80a rbd-mirror: image deleter now takes a librados::IoCtx shared pointer
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-21 09:17:40 -05:00
Jason Dillaman
a2925d317b rbd-mirror: move image deletion to standalone state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-21 09:17:40 -05:00
Jason Dillaman
c79d74fe52 rbd-mirror: move snap purge to standalone state machine
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-21 09:17:40 -05:00
Jason Dillaman
b872078e67 librbd: ensure deep-copy can remove an unprotected snapshot
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-21 09:17:40 -05:00
Jason Dillaman
9d1fc4d8ad cls/rbd: added async version of get_snapcontext
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-21 09:17:40 -05:00
Jason Dillaman
d490872f27
Merge pull request #18790 from amitkumar50/cov-rbd-6
rbd: null check before pool_name use

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-11-21 08:51:03 -05:00
amitkuma
55c25726c4 rbd: null check before pool_name use
Fixes the coverity issue:

CID 1394846 (#1 of 1): Dereference after null check (FORWARD_NULL)
15. var_deref_model: Passing null pointer pool_name to regex_match,
which dereferences it.

Signed-off-by: Amit Kumar <amitkuma@redhat.com>
2017-11-21 21:26:50 +05:30
Kefu Chai
d44334f317 qa/workunits: silence py warnings for ceph-disk tests
ceph-disk now prints "depreacted" warning message when it starts. but
the tests parses its stdout and stderr for a json string. so we need to
silence the warnings for the tests.

Fixes: http://tracker.ceph.com/issues/22154
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-21 21:49:48 +08:00
tangwenjun
d4f868ae7b os/bluestore: fix the allocate in bluefs
when bluefs succeed to reserve but failed to alloc in db space,

it will cause a assert, just because of the space fragmentation.

in this situation, it could not use slow device space,

and it would happen in stupid or avl allocator.

Signed-off-by: tangwenjun <tang.wenjun3@zte.com.cn>
2017-11-21 19:27:25 +08:00
Mykola Golub
f4b88b2c9d qa/workunits/rbd: wait for demote status is propagated
(before promoting the image on another cluster)

Signed-off-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-21 13:22:50 +02:00
Mykola Golub
d77f40d10b
Merge pull request #19045 from dillaman/wip-22200
rbd: disk usage on empty pool no longer returns an error message

Reviewed-by: Mykola Golub <to.my.trociny@gmail.com>
2017-11-21 12:48:34 +02:00
Nathan Cutler
3600cd7bfd tests: ceph-disk: ignore E722 in flake8 test
Very old, and very new, versions of flake8 treat E722 as an error:

flake8 runtests: commands[0] | flake8 --ignore=H105,H405,E127 ceph_disk tests
ceph_disk/main.py:1575:9: E722 do not use bare except'
ceph_disk/main.py:1582:9: E722 do not use bare except'
ceph_disk/main.py:3252:5: E722 do not use bare except'
ceph_disk/main.py:3288:21: E722 do not use bare except'
ceph_disk/main.py:3296:17: E722 do not use bare except'
ceph_disk/main.py:4358:5: E722 do not use bare except'
tests/test_main.py:26:1: E722 do not use bare except'
ERROR: InvocationError: '/opt/j/ws/mkck/src/ceph-disk/.tox/flake8/bin/flake8 --ignore=H105,H405,E127 ceph_disk tests'

Fixes: http://tracker.ceph.com/issues/22207
References: https://gitlab.com/pycqa/flake8/issues/361

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2017-11-21 11:48:13 +01:00
Kefu Chai
9b3f9cd253 cmake: BuildDPDK: use ${CMAKE_MAKE_PROGRAM} when appropriate
DPDK requires GNU Make. see
spdk/dpdk/doc/guides/freebsd_gsg/build_dpdk.rst. so, we should use the
configured make program to do the job.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-21 17:47:17 +08:00
Kefu Chai
416082c1ce mon/health_check: s/std::list/list/
so it's self-contained, and .cc files including it are not obliged to `using namespace std`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-21 17:35:18 +08:00
Kefu Chai
f4b74125e4 osd: send health-checks to mgr
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-21 17:35:18 +08:00
Kefu Chai
7c3221fda1 cmake: BuildDPDK: use POSIX compliant syntax
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-21 17:06:50 +08:00
Kefu Chai
486515ae88 osd: remember is_primary when adding pending creating pgs
so mgr can avoid calculating the same PG from different OSDs.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-21 16:38:59 +08:00
Kefu Chai
721cff9a97 common/OpTracker: refactor check_ops_in_flight()
* add a function visit_ops_in_flight() so it accepts a std::function,
  which can be applied to all ops in flight. and is used to count
  slow ops. the # of slow ops will be sent to mgr.
* add a function with_slow_ops_in_flight(), so we can use it to
  implement command like "dump_slow_ops_in_flight". unlike the
  existing feature which dumps slow ops to clog periodically, it
  will dump the slow ops on demand. and backoff the warning
  interval only when the slow ops are dumped.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-11-21 16:38:59 +08:00