Commit Graph

107370 Commits

Author SHA1 Message Date
Jan Fajerski
ffe5b5732a ceph-volume: add get_device_lvs to easily retrieve all lvs per device
Also drop the sep argument from get_lvs and siblings, unused.
Introduce LV_CMD_OPTIONS to unify options to lvs.

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2020-02-06 16:47:08 +01:00
Tatjana Dehler
4515ab32fa
Merge pull request #32546 from votdev/issue_43089_passwd_cmplx_config
mgr/dashboard: Make password policy check configurable

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2020-02-06 09:44:48 +01:00
Kefu Chai
9805feeca2
Merge pull request #32881 from tchaikov/wip-43657
mgr/orchestrator: use deepcopy for copying exceptions

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-06 16:05:31 +08:00
Kefu Chai
edca34ea67 qa/tasks/cephadm: test "orchestrator host ls"
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-06 09:53:17 +08:00
Kefu Chai
062e0365ea qa/tasks: drop test_cephadm_orchestrator.py
this test will end with a failure like

```
2020-01-30T18:15:15.870 INFO:tasks.ceph.mgr.x.smithi042.stderr:Warning: Permanently added 'smithi042.front.sepia.ceph.com,172.21.15.42' (ECDSA) to the list of known hosts.
2020-01-30T18:15:15.925 INFO:tasks.ceph.mgr.x.smithi042.stderr:Permission denied, please try again.
2020-01-30T18:15:15.932 INFO:tasks.ceph.mgr.x.smithi042.stderr:Permission denied, please try again.
2020-01-30T18:15:15.939 INFO:tasks.ceph.mgr.x.smithi042.stderr:root@smithi042.front.sepia.ceph.com: Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).
```

because mgr is not able to establish an ssh connection to that host with "root".
please note, the teuthology worker is acting using the "ubuntu" account on the
test node, and by default, "root" does not have its pubkey. and actually
`qa/tasks/cephadm.py` does push the pubkey to all the managed hosts before
testing cephadm.

since `qa/tasks/cephadm.py` is a better test for cephadm, let's just
drop this one.

as suites/rados/cephadm already covers cephadm

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-06 09:53:17 +08:00
Kefu Chai
ec7b160a55 mgr/orchestrator: use deepcopy for copying exceptions
since rexec module has been removed in python3, we cannot use it
anymore.

Fixes: https://tracker.ceph.com/issues/43657
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-06 09:53:17 +08:00
Sage Weil
5948bd5545 Merge PR #32946 into master
* refs/pull/32946/head:
	qa/suites/rados: improve valgrind leak check
	common/ceph_context: add an asok command to deliberately leak memory

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-02-05 16:47:21 -06:00
Sage Weil
2611a73d57 Merge PR #33055 into master
* refs/pull/33055/head:
	qa/tasks/mgr/test_orchestrator_cli: support multiple DriveGroups

Reviewed-by: Joshua Schmid <jschmid@suse.de>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-05 16:09:12 -06:00
Sage Weil
e7b7e2e36f Merge PR #33056 into master
* refs/pull/33056/head:
	common: fix clang compile errors from cython_modules

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-05 16:08:41 -06:00
Sage Weil
572425e823 Merge PR #33058 into master
* refs/pull/33058/head:
	mgr/cephadm: enforce that a host is a valid DNS name
	mgr/cephadm: verify host's hostname matches our host name
	cephadm: check-host: add optional --expect-hostname

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2020-02-05 16:07:43 -06:00
Sage Weil
1d1778d66e Merge PR #33069 into master
* refs/pull/33069/head:
	cephadm: use appropriate default image for non-ceph components

Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-05 16:07:28 -06:00
Sage Weil
e640a95b89 Merge PR #33039 into master
* refs/pull/33039/head:
	osd/OSD: prevent down osds from immediately rejoining the culster
	osd/OSD: trim osd_markdown_log in tick() thread

Reviewed-by: yanjun <yan.jun8@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-05 12:55:53 -06:00
Sage Weil
93dba1e711 mgr/cephadm: enforce that a host is a valid DNS name
This combines the hostname restrictions

 * 1-63 chars
 * a-z, A-Z, 0-9, -

and the DNS name restrictions

 * .-delimited
 * no empty components (or leading or trailing .)
 * 250 chars total max

Note that this allows bare IPv4 addresses (which are indistinguishable from
a valid DNS name, AFAICS), but disallows bare IPv6 addresses.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-05 12:49:49 -06:00
Kefu Chai
7b7826d847
Merge pull request #33085 from rzarzynski/wip-client-bl_iter_advance
client: fix FTBFS due to bl::iterator::advance().

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-06 00:26:12 +08:00
Radoslaw Zarzynski
c7bdf1bcd8 client: fix FTBFS due to bl::iterator::advance().
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-02-05 17:13:38 +01:00
Kefu Chai
5c5e1105bb
Merge pull request #33026 from liewegas/wip-el81
qa/distros: add rhel/centos 8.1

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-05 23:44:15 +08:00
Casey Bodley
8dbb92e4a1
Merge pull request #32996 from cbodley/wip-rgw-put-multipart-stripe
rgw: MultipartObjectProcessor supports stripe size > chunk size

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-02-05 08:42:50 -05:00
Casey Bodley
18ccc3e5f0
Merge pull request #32811 from multi-arch/master
test/rgw: fix test_rgw_reshard_wait with -DHAVE_BOOST_CONTEXT=OFF

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-02-05 08:40:08 -05:00
Sage Weil
6c9131405e Merge PR #33051 into master
* refs/pull/33051/head:
	mgr/telemetry: check get_metadata return val

Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-05 07:36:01 -06:00
Kefu Chai
22da7813ef
Merge pull request #33018 from mgfritch/cephadm-docker-disabled
qa/workunits/cephadm/test_cephadm.sh: skip docker when service is disabled

Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-05 20:46:16 +08:00
Kefu Chai
068d72230d
Merge pull request #32982 from krig/cephadm-fixes
cephadm: Read ceph version from io.ceph.version label if set

Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-05 20:44:58 +08:00
Kefu Chai
07e77aceba
Merge pull request #33025 from neha-ojha/wip-no-mgr
mon/MgrMonitor.cc: warn about missing mgr in a cluster with osds

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-05 20:36:12 +08:00
Jan Fajerski
1b8963147f
Merge pull request #33077 from guits/guits-cv_fix_listing
ceph-volume: fix lvm list

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2020-02-05 13:29:43 +01:00
Kefu Chai
bdc3634101
Merge pull request #33004 from matthewoliver/argparge_matchcnt_kwargs
ceph_argparse: increment matchcnt on kwargs

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-05 20:29:35 +08:00
Jan Fajerski
18f23bdf4d
Merge pull request #33074 from guits/guits-cv_quick_fix
ceph-volume: fix has_bluestore_label() function

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2020-02-05 13:29:03 +01:00
Kefu Chai
3198146d6f
Merge pull request #33015 from rouming/double-unlock-p1-fix
msg/async: open() should be called with connection locked

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: David Disseldorp <ddiss@suse.de>
2020-02-05 20:18:56 +08:00
Kefu Chai
882d1fb28a
Merge pull request #33029 from yaarith/wip-telemetry-show-device
mgr/telemetry: anonymizing smartctl report itself

Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-05 20:11:39 +08:00
Kefu Chai
e1107bb35e
Merge pull request #33003 from tchaikov/wip-buffer-list-advance
include/buffer: add operator+=() for list::iterator

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-02-05 20:10:42 +08:00
Kefu Chai
0af38ea25b
Merge pull request #33034 from rzarzynski/wip-include-ceph_atomic_in_mempool
include: switch mempool.h to ceph::atomic.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-05 20:00:46 +08:00
Guillaume Abrioux
7f8371c32b ceph-volume: remove stderr in has_bluestore_label()
We don't want to generate this log when a call to
`has_bluestore_label()` fails.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2020-02-05 08:49:16 +01:00
Guillaume Abrioux
148069a20f ceph-volume: fix has_bluestore_label() function
When using vg/lv, this function throws an error like following:

```
 stderr: unable to read label for test_group/data-lv2: (2) No such file or directory
 stderr: 2020-02-04T21:03:32.153+0000 7fe091af4200 -1 bluestore(test_group/data-lv2) _read_bdev_label failed to open test_group/data-lv2: (2) No such file or directory
```

using `self.abspath` fixes this error.

Fixes: https://tracker.ceph.com/issues/43970

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2020-02-05 08:49:03 +01:00
Guillaume Abrioux
0179fed3ab ceph-volume: fix lvm list
17957d9beb introduced a regression in `lvm
list`.

When passing a vg/lv path for generating a single report, it fails
because the filter used in the `lvs` command isn't right. It uses the lv
name instead of the vg name because `os.path.basename(device)` is used
while it should be `os.path.dirname(device)`

Fixes: https://tracker.ceph.com/issues/43969

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2020-02-05 08:39:29 +01:00
Kefu Chai
b456d7de7a
Merge pull request #33076 from liu-chunmei/fix_crimson_pg_coll
crimson: fix crimson pg coll usage error

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-05 12:50:25 +08:00
Kefu Chai
d41d53be87
Merge pull request #33057 from wjwithagen/wjw-fix-buffer.copy
rbd-ggate: fix fallout from bufferlist.copy() change

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-05 11:15:37 +08:00
Chunmei Liu
cdb08c26e5 crimson: fix crimson pg coll usage error
coll in pg isn't initialized, should use coll_ref->get_cid() insead.

Signed-off-by: Chunmei Liu <chunmei.liu@intel.com>
2020-02-04 16:42:21 -08:00
Sage Weil
97def7cb60 cephadm: use appropriate default image for non-ceph components
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-04 16:50:51 -06:00
Gregory Farnum
7ac858ca09
Merge pull request #33066 from gregsfortytwo/wip-specfile
rpm: fix up a specfile syntax error

Reviewed-by:  Kefu Chai <kchai@redhat.com>
Reviewed-by:  Brad Hubbard <bhubbard@redhat.com>
2020-02-04 14:08:14 -08:00
Abhishek L
e7c7e513ae
Merge pull request #30033 from theanalyst/rgw/public-buckets
rgw: add PublicAccessBlock set of APIs on buckets

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2020-02-04 19:01:05 +01:00
Greg Farnum
1adda08a4b rpm: fix up a specfile syntax error
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2020-02-04 09:10:17 -08:00
Casey Bodley
3326ded944
Merge pull request #33049 from yuvalif/wip-yuval-fix-43768
qa/rgw/pubsub: fix tests to sync from master

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-02-04 11:44:46 -05:00
Sage Weil
7a1439a368 mgr/cephadm: verify host's hostname matches our host name
This ensures that we have a consistent view between the hosts that cephadm
is using and the hostname being reported as metadata by the ceph daemons.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-04 10:30:53 -06:00
Sage Weil
dd56bba731 cephadm: check-host: add optional --expect-hostname
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-04 10:30:53 -06:00
Abhishek Lekshmanan
df384ea95f doc: add Pending Release Notes entry on public access config
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2020-02-04 17:28:46 +01:00
Abhishek L
e2020c7834
Merge pull request #32119 from joke-lee/rgw-sts-crash-duration-invalid
rgw: fix rgw crash when duration is invalid in sts request
2020-02-04 17:24:12 +01:00
Abhishek L
72763b2deb
Merge pull request #31987 from linuxbox2/rgw-putacls-no-body
rgw: s3: don't require a body in S3 put-object-acl
2020-02-04 17:22:35 +01:00
Abhishek L
7c1a690560
Merge pull request #30684 from theanalyst/rgw/qa/rgw-admin-user-stats
qa: radosgw_admin: validate a simple user stats output

Reviewed-By: Casey Bodley <cbodley@redhat.com>
2020-02-04 17:21:25 +01:00
Sage Weil
19928c13ec Merge PR #33048 into master
* refs/pull/33048/head:
	cephadm: fix error handling in `command_check_host()`
	cephadm: increase default retry_max value

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-04 07:08:22 -06:00
Sage Weil
b9a38a0371 Merge PR #32995 into master
* refs/pull/32995/head:
	cephadm: add group 'disk' to privileged container
	cephadm: adopt: disable ceph-volume unit on host
	cephadm: refactor privileged arg handling
	cephadm: chown block symlink targets
	cephadm-adoption-corpus: add stud-mon.tgz
	cephadm: adopt: rename leveldb *.ldb -> *.sst
	cephadm: adopt: by default, pull first
	cephadm: adopt: chown data content

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-04 07:07:01 -06:00
Willem Jan Withagen
2eafdbed4e rbd-ggate: fix fallout from bufferlist.copy() change
fixes: #3281
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2020-02-04 14:07:00 +01:00
Mark Kogan
b460173235 common: fix clang compile errors from cython_modules
Signed-off-by: Mark Kogan <mkogan@redhat.com>
2020-02-04 14:32:05 +02:00