Commit Graph

100108 Commits

Author SHA1 Message Date
Patrick Donnelly
aba6e6d76e
Merge PR #29166 into master
* refs/pull/29166/head:
	mds: Reorganize class members in Capability header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-07-25 16:10:51 -07:00
Patrick Donnelly
7d32369cab
Merge PR #29149 into master
* refs/pull/29149/head:
	cephfs-shell: Fix flake8 E302 blank line error
	cephfs-shell: Fix flake8 indentation error

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 16:07:48 -07:00
Patrick Donnelly
fe1abce20b
Merge PR #28860 into master
* refs/pull/28860/head:
	mds: Move scalar type initializations of CDir data members to its header
	mds: Reorganize class members in CDir header

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-07-25 16:05:19 -07:00
Jason Dillaman
ea0a9adc88
Merge pull request #29036 from mikechristie/rbd-nbd-add-nl-resize
rbd-nbd: add nl resize

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-07-25 16:06:47 -04:00
Patrick Donnelly
2d47f3ebf8
Merge PR #28955 into master
* refs/pull/28955/head:
	doc: Update mount CephFS index

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-25 11:01:27 -07:00
Sage Weil
3968d564c5 Merge PR #29111 into master
* refs/pull/29111/head:
	qa/mgr/progress: Update the test suite for progress module

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-25 12:44:24 -05:00
Kefu Chai
b3abfe4812
Merge pull request #29117 from tchaikov/wip-mgr-set_health_checks-unicode
mgr: check for unicode passed to "set_health_checks()"

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-25 23:03:00 +08:00
Sage Weil
ed1f8b98d3 Merge PR #29320 into master
* refs/pull/29320/head:
	os/bluestore: remove unused arg to _get_deferred_op()

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-07-25 09:52:33 -05:00
Yuri Weinstein
633a3fa8ae
Merge pull request #29282 from yuriw/wip-yuriw-upgrade-rwg-splits-master
qa/tests: added rgw into upgrade sequence to improve coverage - splits
2019-07-25 07:16:24 -07:00
Sage Weil
58d02762ad os/bluestore: remove unused arg to _get_deferred_op()
Fixes: http://tracker.ceph.com/issues/40918
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-25 09:13:25 -05:00
Jos Collin
9db12b5fe8
doc: Update mount CephFS index
Updated based on the discussion:
https://github.com/ceph/ceph/pull/28900#discussion_r301812933

Signed-off-by: Jos Collin <jcollin@redhat.com>
2019-07-25 07:09:26 +05:30
Kefu Chai
a29700e5e7
Merge pull request #29296 from tchaikov/wip-remove-script/dep-report.sh
script: remove dep-report.sh

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-25 09:36:48 +08:00
Kefu Chai
104c88cfea mgr/PyFormatter.h: add necessary #include
this header uses `std::string`, `std::string_view` and
`std::stringstream`, so it should include the corresponding headers.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-25 09:00:28 +08:00
Kefu Chai
3409937003 mgr: check for unicode passed to "set_health_checks()"
in python2, in addition to `str`, a string could also be unicode
string. there is chance that user passes a unicode string to
`set_health_checks()`, so let's check for unicode string also.

in python3, all strings are `unicode` string, and `PyString_Check()` is
defined as an alias of `PyUnicode_Check()`, so we are fine with python3.

the wrapper method of `PyString_ToString()` returns a pair of converted
string and a bool. if it fails to detect a string, an empty string and
false are returned.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-25 09:00:28 +08:00
Kefu Chai
49ae4cf3b3 script: remove dep-report.sh
dep-report.sh depends on .Po and .Plo files under .deps/, which is
created by automake. but we've switched to CMake. so we cannot use
these depfile or temporary depfiles anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-25 08:12:37 +08:00
Sage Weil
0c0093e450 Merge PR #29034 into master
* refs/pull/29034/head:
	doc/mgr/crash: document missing commands, options
	qa/suites/rados/singleton/all/test-crash: whitelist RECENT_CRASH
	qa/suites/rados/mgr/tasks/insights: whitelist RECENT_CRASH
	qa/tasks/mgr/test_insights: crash module now rejects bad crash reports
	mgr/telemetry: fix remote into crash do_ls()
	mgr/crash: don't make these methods static
	mgr/BaseMgrModule: handle unicode health detail strings
	mgr/crash: verify timestamp is valid
	qa/suites/mgr: whitelist RECENT_CRASH
	mgr/crash: remove unused var
	mgr/crash: remove unused import 'six'
	qa/workunits/rados/test_crash: health check
	mgr/crash: improve validation on post
	mgr/crash: automatically prune old crashes after a year
	mgr/crash: raise RECENT_CRASH warning for recent (new) crashes
	mgr/crash: add 'crash ls-new'
	mgr/crash: add option and serve infra
	mgr/crash: keep copy of crashes in memory
	mgr/pg_autoscaler: adjust style to match built-in tables
	mgr/crash: make 'crash ls' a nice table with a NEW column
	mgr/crash: nicely format 'crash info' output
	mgr/crash: add 'crash archive <id>', 'crash archive-all' commands

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-24 17:20:21 -05:00
Matt Benjamin
9271226341
Merge pull request #26160 from linuxbox2/wip-rgw-lc-header
rgw: project and return lc expiration from GET/HEAD and PUT ops
2019-07-24 16:49:38 -04:00
Yuri Weinstein
c3df207003 qa/tests: added rgw into upgrade sequence to improve coverage - splits
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-24 13:25:32 -07:00
Sage Weil
1ea7570bb1 doc/mgr/crash: document missing commands, options
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-24 12:57:18 -05:00
Yuri Weinstein
2a733cd4ea
Merge pull request #29234 from yuriw/wip-yuriw-upgrade-rwg-master
qa/tests: added rgw into upgrade sequence to improve coverage
2019-07-24 09:00:49 -07:00
Jason Dillaman
ed6a047c71
Merge pull request #29263 from trociny/wip-rbd-external_callback
librbd: don't use complete_external_callback if ImageCtx destroyed

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-07-24 11:11:22 -04:00
Sage Weil
066f93b188 Merge PR #29180 into master
* refs/pull/29180/head:
	mon/FSCommand: set pg_num_min via 'fs new', not in mgr/volumes
	mon/FSCommands: set pg_autoscale_factor on 'fs new', not via mgr/volumes
	mon: set recovery_priority=5 on fs metadata pool

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-24 09:31:49 -05:00
Sage Weil
fe45db9007 Merge PR #27575 into master
* refs/pull/27575/head:
	osd: avoid prep_object_replica_pushes() on clone object when head missing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-24 08:54:59 -05:00
Nathan Cutler
610e9f750e
Merge pull request #29261 from jan--f/add-auth-to-ghub-api-calls
script/ceph-backport-sh: add access_token parameter to all ghub api c…

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-07-24 15:44:29 +02:00
Sage Weil
99d699a3d2 Merge PR #29124 into master
* refs/pull/29124/head:
	test/old/test*buffers.cc: remove tests against bufferlist
	test/old/test_*seek_read: remove this test
	test/old/test{crush,bucket}: remove stale tests
	test/old/testmpi.cc: remove this test
	test/old/testxattr.cc: remove this test
	test/old/testtree.cc: remove test for BinaryTree

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-24 08:37:22 -05:00
Jan Fajerski
c31be430f8 script/ceph-backport-sh: add access_token parameter to all ghub api calls
Otherwise one can get a "API rate limit exceeded for $YOUR_IP." message
when working from company offices and such.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2019-07-24 14:35:37 +02:00
Mykola Golub
634634fd8f librbd: don't use complete_external_callback if ImageCtx destroyed
complete_external_callback (which requires ImageCtx) is used to
prevent concurrent callbacks, and not needed in this particular case.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-07-24 13:35:01 +01:00
Kefu Chai
cfb69b81e3
Merge pull request #29148 from tchaikov/wip-cmake-python2
cmake: use python2 by default

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-07-24 20:14:01 +08:00
Varsha Rao
368a4e481d mds: Reorganize class members in Capability header
Fixes: https://tracker.ceph.com/issues/40866
Signed-off-by: Varsha Rao <varao@redhat.com>
2019-07-24 07:42:02 -04:00
Jan Fajerski
14f9b8a133
Merge pull request #28448 from shyukri/wip-25030
ceph-volume: util: Use proper param substition
2019-07-24 13:36:27 +02:00
Kefu Chai
af6c487758
Merge pull request #29073 from dillaman/wip-40790
mon/mgr: add 'rbd_support' to list of always-on mgr modules

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-07-24 14:18:50 +08:00
Kefu Chai
1a379bc202
Merge pull request #28765 from myoungwon/fix-chunk-scrub-dedup-tool
src/tools/ceph-dedup-tool: Fix chunk scrub

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-24 09:59:58 +08:00
Kefu Chai
511db86246
Merge pull request #28832 from majianpeng/osd-only-empty-do-wakeup
osd/OSD: only wake up empty pqueue.

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-24 09:58:32 +08:00
Kefu Chai
10af76ab1b
Merge pull request #28778 from myoungwon/wip-chunk-flush-op
src/osd: add tier-flush op

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-24 09:56:47 +08:00
Kefu Chai
361b7febcc
Merge pull request #28983 from myoungwon/wip-dedup-io-test
src/test, qa/suites/rados/thrash: add dedup test

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-24 09:54:54 +08:00
Kefu Chai
4c2ffc8f19
Merge pull request #29053 from dmick/master
ceph-crash: use open(..,'rb') to read bytes for Python3

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-24 09:53:51 +08:00
Kefu Chai
0869d95000
Merge pull request #28054 from iotcg/starlingx
pybind: add verbose error message

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-24 09:46:44 +08:00
Kefu Chai
285e1bc55b
Merge pull request #26724 from jecluis/dev/wip-mon-osd-info
mon: add `ceph osd info` to obtain info on osds rather than parsing `osd dump`

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-24 09:44:50 +08:00
Kefu Chai
e6aee61076
Merge pull request #28772 from neha-ojha/wip-40528-2
osd: add hdd, ssd and hybrid variants for osd_snap_trim_sleep

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2019-07-24 09:24:14 +08:00
Yuri Weinstein
99d6890d0f qa/tests: added rgw into upgrade sequence to improve coverage
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-23 17:37:40 -07:00
Josh Durgin
a51ecb9edc
Merge pull request #29026 from markhpc/wip-rocksdb-v6.1.2
rocksdb: Updated to v6.1.2

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-23 16:59:48 -07:00
Ilya Dryomov
0a6e01ab6c
Merge pull request #29083 from dillaman/wip-40802
doc/rbd: update krbd version support for RBD features

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2019-07-24 01:33:36 +02:00
Mike Christie
ca3fad1af3 rbd-nbd: Fix spacing in UpdateWatchCtx
UpdateWatchCtx used a mix of 2 spaces and 4 spaces. This fixes the
function to use 2 spaces which is used in the rest of the file.

Signed-off-by: Mike Christie <mchristi@redhat.com>
2019-07-23 13:23:42 -04:00
Mike Christie
488f30c9dc rbd-nbd: Add resize support
This adds resize support to rbd nbd when using the netlink interface.
It requires this linux kernel patch:

https://marc.info/?l=linux-block&m=155916096905474&w=2

which has been merged into the block tree for 5.4.

Signed-off-by: Mike Christie <mchristi@redhat.com>
2019-07-23 13:23:37 -04:00
Kefu Chai
9a47b328b8 do_cmake.sh: specify the supported py versions for different distros
there is chance that a distro offer a newer python3 version than the
supported one, so we need to avoid using the latest python3 version by
specifying the supported python3

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-24 00:45:22 +08:00
Kefu Chai
1e33464c0a cmake: use exact version of python if minor version is specified
`find_package(Python ${version}...)` tries to find the greater python version
which is greater than `${version}`, on fc30, at the time of writing, both
python3.8 and python3.7 are offered. but `python3-Cython` is packaged only
for python3.7. so if user installs python3.8, this will prevent user from
building Ceph. as Ceph will not be able to find Cython python module, as it
will try to run `python3.8 -m cython --version`, where python3.8 is the
greatest python version available in the system. but since cython module is
not available to python3.8, cmake will fail to find cython even if is available
to python3.7.

in this change, if user specifies a python version with minor version, we
will use the exact specified version instead of trying to use a version
greater than the specified one.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-24 00:45:22 +08:00
Kefu Chai
805e2b0687
Merge pull request #29152 from tchaikov/wip-cmake-crimson-test
test/crimson/: use 256M mem and 1 cpu core for each test

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-07-23 23:56:37 +08:00
Sage Weil
08ffd10039 mon/FSCommand: set pg_num_min via 'fs new', not in mgr/volumes
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-23 09:23:58 -05:00
Sage Weil
5a827e3a52 mon/FSCommands: set pg_autoscale_factor on 'fs new', not via mgr/volumes
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-23 09:23:58 -05:00
Sage Weil
48af504666 mon: set recovery_priority=5 on fs metadata pool
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-23 09:23:58 -05:00