Commit Graph

100308 Commits

Author SHA1 Message Date
Kefu Chai
af6c487758
Merge pull request #29073 from dillaman/wip-40790
mon/mgr: add 'rbd_support' to list of always-on mgr modules

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-07-24 14:18:50 +08:00
Kefu Chai
310ccd9f9f qa/tasks/ceph_manager.py: always use self.logger
in fbd4836d, a regression is introduced:

self.log("failed to read erasure_code_profile. %s was likely removed",
pool)

because `self.log` is actually a lambda which just do

self.logger.info(x)

in this change

* `Thrasher.log()` is added for three reasons:
 - in PEP-8,

> Always use a def statement instead of an assignment statement that
> binds a lambda expression directly to an identifier
so a better way is to define a method using `def`
 - and i think it helps with the readability
* `logger` parameter is now mandatory now in the constructor of
  `Thrasher` class. because the instance of this class is only created
by `qa/tasks/thrashosds.py`, like:

thrash_proc = ceph_manager.Thrasher(
        cluster_manager,
        config,
        logger=log.getChild('thrasher')
        )

and `log.getChild()` does not return `None`, so there is no need to
handle that case.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-24 10:28:00 +08:00
Kefu Chai
1a379bc202
Merge pull request #28765 from myoungwon/fix-chunk-scrub-dedup-tool
src/tools/ceph-dedup-tool: Fix chunk scrub

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-24 09:59:58 +08:00
Kefu Chai
511db86246
Merge pull request #28832 from majianpeng/osd-only-empty-do-wakeup
osd/OSD: only wake up empty pqueue.

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-24 09:58:32 +08:00
Kefu Chai
10af76ab1b
Merge pull request #28778 from myoungwon/wip-chunk-flush-op
src/osd: add tier-flush op

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-24 09:56:47 +08:00
Kefu Chai
361b7febcc
Merge pull request #28983 from myoungwon/wip-dedup-io-test
src/test, qa/suites/rados/thrash: add dedup test

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-24 09:54:54 +08:00
Kefu Chai
4c2ffc8f19
Merge pull request #29053 from dmick/master
ceph-crash: use open(..,'rb') to read bytes for Python3

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-24 09:53:51 +08:00
Kefu Chai
0869d95000
Merge pull request #28054 from iotcg/starlingx
pybind: add verbose error message

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-24 09:46:44 +08:00
Xiangyang Yu
91f6f8fdb1 os/bluestore: it's better to erase spanning blob only once
when several extents use the same spanning blob, we reclaim the
blob if all Pextent are to be released, but we erase the spanning blob
from spanning blob map several times. Although it's not a error, I think
it's better to erase the spanning blob with the last Oldextent who's
blob empty flag will be set true.

Signed-off-by: Xiangyang Yu <penglaiyxy@gmail.com>
2019-07-24 09:46:26 +08:00
Kefu Chai
285e1bc55b
Merge pull request #26724 from jecluis/dev/wip-mon-osd-info
mon: add `ceph osd info` to obtain info on osds rather than parsing `osd dump`

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-24 09:44:50 +08:00
Kefu Chai
e6aee61076
Merge pull request #28772 from neha-ojha/wip-40528-2
osd: add hdd, ssd and hybrid variants for osd_snap_trim_sleep

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2019-07-24 09:24:14 +08:00
Yuri Weinstein
99d6890d0f qa/tests: added rgw into upgrade sequence to improve coverage
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-07-23 17:37:40 -07:00
Josh Durgin
a51ecb9edc
Merge pull request #29026 from markhpc/wip-rocksdb-v6.1.2
rocksdb: Updated to v6.1.2

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-07-23 16:59:48 -07:00
Ilya Dryomov
0a6e01ab6c
Merge pull request #29083 from dillaman/wip-40802
doc/rbd: update krbd version support for RBD features

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2019-07-24 01:33:36 +02:00
Adam King
050bbe5f13 mgr/dashboard: RGW user E2E Tests
Tests creating, editing and deleting RGW users.
Tests providing invalid input to user creation and editing forms.

Fixes: https://tracker.ceph.com/issues/40364
Fixes: https://tracker.ceph.com/issues/40908

Signed-off-by: Adam King <adking@redhat.com>
Signed-off-by: Rafael Quintero <rquinter@redhat.com>
2019-07-23 15:51:21 -04:00
Mike Christie
ca3fad1af3 rbd-nbd: Fix spacing in UpdateWatchCtx
UpdateWatchCtx used a mix of 2 spaces and 4 spaces. This fixes the
function to use 2 spaces which is used in the rest of the file.

Signed-off-by: Mike Christie <mchristi@redhat.com>
2019-07-23 13:23:42 -04:00
Mike Christie
488f30c9dc rbd-nbd: Add resize support
This adds resize support to rbd nbd when using the netlink interface.
It requires this linux kernel patch:

https://marc.info/?l=linux-block&m=155916096905474&w=2

which has been merged into the block tree for 5.4.

Signed-off-by: Mike Christie <mchristi@redhat.com>
2019-07-23 13:23:37 -04:00
Kefu Chai
9a47b328b8 do_cmake.sh: specify the supported py versions for different distros
there is chance that a distro offer a newer python3 version than the
supported one, so we need to avoid using the latest python3 version by
specifying the supported python3

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-24 00:45:22 +08:00
Kefu Chai
1e33464c0a cmake: use exact version of python if minor version is specified
`find_package(Python ${version}...)` tries to find the greater python version
which is greater than `${version}`, on fc30, at the time of writing, both
python3.8 and python3.7 are offered. but `python3-Cython` is packaged only
for python3.7. so if user installs python3.8, this will prevent user from
building Ceph. as Ceph will not be able to find Cython python module, as it
will try to run `python3.8 -m cython --version`, where python3.8 is the
greatest python version available in the system. but since cython module is
not available to python3.8, cmake will fail to find cython even if is available
to python3.7.

in this change, if user specifies a python version with minor version, we
will use the exact specified version instead of trying to use a version
greater than the specified one.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-07-24 00:45:22 +08:00
Kefu Chai
805e2b0687
Merge pull request #29152 from tchaikov/wip-cmake-crimson-test
test/crimson/: use 256M mem and 1 cpu core for each test

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-07-23 23:56:37 +08:00
Sage Weil
08ffd10039 mon/FSCommand: set pg_num_min via 'fs new', not in mgr/volumes
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-23 09:23:58 -05:00
Sage Weil
5a827e3a52 mon/FSCommands: set pg_autoscale_factor on 'fs new', not via mgr/volumes
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-23 09:23:58 -05:00
Sage Weil
48af504666 mon: set recovery_priority=5 on fs metadata pool
Signed-off-by: Sage Weil <sage@redhat.com>
2019-07-23 09:23:58 -05:00
Sage Weil
31b5c43806 Merge PR #29114 into master
* refs/pull/29114/head:
	mgr/dashboard: qa: whitelist client eviction warning

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-07-23 09:09:15 -05:00
Sage Weil
ca541c72ed Merge PR #29164 into master
* refs/pull/29164/head:
	mgr: cleanup idle debug log at level 4.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-23 09:08:42 -05:00
Sage Weil
c237f9a430 Merge PR #29172 into master
* refs/pull/29172/head:
	mgr/dashboard: Fix dashboard health test failure

Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-23 09:08:26 -05:00
Sage Weil
468cbcd3be Merge PR #29169 into master
* refs/pull/29169/head:
	qa/suites/rados/mgr/tasks/module_selftest: whitelist mgr client getting backlisted

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2019-07-23 09:07:31 -05:00
Casey Bodley
1814f2f8ea
Merge pull request #26690 from jecluis/dev/wip-vstart-fix-rgw
vstart.sh: run multiple rgws with different ids

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-07-23 10:03:09 -04:00
Jason Dillaman
a9400a0378
Merge pull request #29195 from ricardoasmarques/fix-ceph-iscsi-required-version
doc: Update 'ceph-iscsi' min version

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-07-23 08:30:08 -04:00
Jason Dillaman
984868038d doc/rbd: update krbd version support for RBD features
Fixes: http://tracker.ceph.com/issues/40802
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-07-23 08:12:51 -04:00
Joao Eduardo Luis
65d6ba8713 vstart.sh: run multiple rgws with different ids
We should expect being able to run multiple rgws with different ids
using vstart, and yet that was not the case as they were sharing the
same name (and same key).

We now mimic each rgw running on a different host, with ids being their
ports; as such, we'll have 'client.rgw.X', 'client.rgw.X+1', and so
forth. These will match the ports the daemons are running on.

Signed-off-by: Joao Eduardo Luis <joao@suse.com>
2019-07-23 10:08:23 +00:00
Ricardo Marques
799a9cc136
Merge pull request #29132 from votdev/issue_40829
mgr/dashboard: RGW User quota validation is not working correctly

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-07-23 11:03:38 +01:00
Ricardo Marques
b434c2910a doc: Update 'ceph-iscsi' min version
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-07-23 10:38:24 +01:00
Fabian Bonk
79b9021805 mgr/dashboard: support setting password hashes
Signed-off-by: Fabian Bonk <fabian.bonk@croit.io>
2019-07-23 11:33:15 +02:00
simon gao
f8291627a6 ceph-mds: dump all info of ceph_file_layout, InodeStoreBase, frag_info_t, inode_t
Signed-off-by: simon gao <simon29rock@gmail.com>
2019-07-23 04:56:51 -04:00
Sebastian Wagner
4a91c6b001
Merge pull request #28986 from sebastian-philipp/orchestrator-verify-certificate
pybind/mgr: Remove code duplication

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2019-07-23 09:46:02 +02:00
Joao Eduardo Luis
2bb205d851
Merge pull request #29184 from neha-ojha/wip-1731894
mon/OSDMonitor.cc: better error message about min_size
2019-07-23 08:43:47 +01:00
Ricardo Marques
8f46c4c9ce
Merge pull request #29070 from adk3798/reformat
mgr/dashboard: Update formatting of e2e test files

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-07-23 08:31:49 +01:00
Sebastian Wagner
d0855cf5e5
Merge pull request #29042 from sebastian-philipp/orchestrator-doc-disable
mgr/orchestrator: Fix disabling the orchestrator

Reviewed-by: Tim Serong <tserong@suse.com>
2019-07-23 09:03:48 +02:00
dependabot[bot]
3216311315
build(deps): bump lodash in /src/pybind/mgr/dashboard/frontend
Bumps [lodash](https://github.com/lodash/lodash) from 4.17.11 to 4.17.13.
- [Release notes](https://github.com/lodash/lodash/releases)
- [Commits](https://github.com/lodash/lodash/compare/4.17.11...4.17.13)

Signed-off-by: dependabot[bot] <support@github.com>
2019-07-23 04:57:22 +00:00
Kefu Chai
4e7b91fa9b
Merge pull request #29058 from tchaikov/wip-ceph-conf
tool/ceph-conf: s/global_pre_init()/global_init()/

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-07-23 10:34:46 +08:00
Kefu Chai
4e10548810
Merge pull request #29151 from tchaikov/wip-rgw-kill-gcc-warnings
rgw/rgw_crypt.cc: silence -Wsign-compare GCC warning

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-07-23 10:23:26 +08:00
Kefu Chai
f58b5a915b
Merge pull request #29155 from tchaikov/wip-msg-cleanup
msg/Message: remove unused local variables

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-23 10:22:40 +08:00
Neha Ojha
ce25ac0a91 mon/OSDMonitor.cc: better error message about min_size
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-07-22 17:50:31 -07:00
Neha Ojha
ad4c2b8143
Merge pull request #29183 from gabriellasroman/patch-2
doc/dev/developer_guide: remove web address

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-07-22 17:44:22 -07:00
Patrick Donnelly
c02ca24da0
Merge PR #29136 into master
* refs/pull/29136/head:
	Client: bump ll_ref from int32 to uint64_t

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-22 16:33:51 -07:00
Patrick Donnelly
1fa2737aa8
Merge PR #29119 into master
* refs/pull/29119/head:
	common: add ref header

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-07-22 16:31:46 -07:00
Patrick Donnelly
1b42308e03
Merge PR #28686 into master
* refs/pull/28686/head:
	mds: cleanup truncating inodes when standby replay mds trim log segments

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-22 16:30:01 -07:00
Patrick Donnelly
8a9ba5713a
Merge PR #28628 into master
* refs/pull/28628/head:
	pybind: Fixes print of path as byte object in error message
	pybind: Print standard error messages

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-07-22 16:29:03 -07:00
Patrick Donnelly
04b5bce8d0
Merge PR #28557 into master
* refs/pull/28557/head:
	ceph_volume_client: don't convert None to str object
	ceph_volume_client: convert string to bytes object
	ceph_volume_client: make UTF-8 encoding explicit

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2019-07-22 16:27:21 -07:00