Commit Graph

109312 Commits

Author SHA1 Message Date
Sage Weil
0bd14ab080 Revert "qa/suites/rados/verify: debug_ms = 1, osd_heartbeat_grace = 60"
This reverts commit 4f742f200d.

This was in the wrong file.. see valgrind.yaml

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00
Sage Weil
12105ed9d7 Revert "qa/suites/rados/verify/validator/valgrind: debug refs = 5"
This reverts commit 65e81e6eb4.

This slows things down too much with valgrind.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00
Sage Weil
2183edcc65 ceph_test_watch_notify: try notify 10x if ALLOW_TIMEOUTS is set
See https://tracker.ceph.com/issues/44062

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00
Sage Weil
3a57e70028 ceph_test_rados_api_misc: ShutdownRace timeout if ALLOW_TIMEOUTS is set
See https://tracker.ceph.com/issues/44582

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 18:24:12 -05:00
Sage Weil
40a7bcea70 qa/suites/rados/verify: set ALLOW_TIMEOUTS for workunits
When running under valgrind (and thrashing) things can be slow.  Tell
tests in case they need to tolerate timeouts.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 18:24:12 -05:00
Sage Weil
126c4446ac Merge PR #33974 into octopus
* refs/pull/33974/head:
	use quay octopus tip until 15.2 tag is available
	update default container images

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-17 14:52:28 -05:00
Sage Weil
fff8d11496 Merge PR #33442 into octopus
* refs/pull/33442/head:
	cephadm: add allow_ptrace option to enable SYS_PTRACE

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-17 12:05:46 -05:00
Sage Weil
72a7e91a38 Merge PR #33997 into octopus
* refs/pull/33997/head:
	mon/MgrMonitor: make 'mgr fail' work with no arguments

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-17 12:05:12 -05:00
Sage Weil
d036599c56 Merge PR #34000 into octopus
* refs/pull/34000/head:
	mgr/dashboard: adapt create_osds interface change

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-03-17 12:05:00 -05:00
Sage Weil
1f05f75787 use quay octopus tip until 15.2 tag is available
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 10:05:17 -05:00
Kiefer Chang
6009d2d654
mgr/dashboard: adapt create_osds interface change
Support the parameter change of create_osds since
https://github.com/ceph/ceph/pull/33922.

Fixes: https://tracker.ceph.com/issues/44632
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-03-17 16:07:45 +08:00
Sage Weil
e86360ed5e mon/MgrMonitor: make 'mgr fail' work with no arguments
Fail the active mgr so you don't have to check ceph -s and cut&paste it or
do some jq shenanigans with 'mgr dump'.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 21:05:21 -05:00
Sage Weil
d7de2abc2f cephadm: add allow_ptrace option to enable SYS_PTRACE
In any environments it is helpful to have SYS_PTRACE so that you can
gdb attach or strace a daemon.

Leave this off by default so that the container is more secure.

Enable this in teuthology and vstart.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 21:04:22 -05:00
Sage Weil
a9b15c7e1a update default container images
- For tests, use bleeding-edge octopus branch
- For production defaults, use ceph/ceph:v15.2 tag
- For bootstrap, grab cephadm script from latest octopus branch

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 20:53:57 -05:00
Sage Weil
513f1c56d5 Merge PR #33961 into octopus
* refs/pull/33961/head:
	cephadm: add-repo: add --version
	cephadm: rename distro args in repo methods

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-03-16 17:37:13 -05:00
Sage Weil
ccf85a1fef Merge PR #33952 into octopus
* refs/pull/33952/head:
	qa/workunits/cephadm: --skip-mon-network when using 127.0.0.1
	cephadm: add tests
	qa/tasks/cephadm: pass -v to bootstrap
	mgr/cephadm: only try to place mons on hosts matching public_network
	mgr/cephadm: keep track of host networks, ips
	cephadm: automatically infer mon public_network, if we can
	cephadm: add list-networks command

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-16 17:36:43 -05:00
Sage Weil
5bc09d2c8a Merge PR #33990 into octopus
* refs/pull/33990/head:
	mgr/orch: add --all-available-devices to 'orch apply osd'

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-16 17:36:33 -05:00
Sage Weil
ae9915f87a Merge PR #33955 into octopus
* refs/pull/33955/head:
	mgr/cephadm: respect 'unmanaged' flag in spec
	mgr/orch: orch ls: show <no spec> or <unmanaged> as appropriate
	mgr/orch: orch ls: rename SPEC -> PLACEMENT
	mgr/orch: add 'unmanaged' property to ServiceSpec
	mgr/orch: combine 'orch daemon add <type> ...' into one command
	mgr/orch: combine 'orch apply <type> [<placement>]' into one command

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-16 17:36:17 -05:00
Sage Weil
3a8f964d7d Merge PR #33936 into octopus
* refs/pull/33936/head:
	cephadm: bootstrap: deploy monitoring stack by default

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
2020-03-16 15:17:48 -05:00
Sage Weil
f999c3c0a3 mgr/orch: add --all-available-devices to 'orch apply osd'
Provide a super-simple "use any avaialable device" command for
'orch apply osd'.  This will work for many (maybe even most?) users.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 14:39:38 -05:00
Sage Weil
8ab7a91615 qa/workunits/cephadm: --skip-mon-network when using 127.0.0.1
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 14:38:22 -05:00
Sage Weil
b4a77b7393 cephadm: add tests
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 14:38:22 -05:00
Sage Weil
1a54da0b01 qa/tasks/cephadm: pass -v to bootstrap
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 14:38:22 -05:00
Sage Weil
8edd5d8984 mgr/cephadm: only try to place mons on hosts matching public_network
Only try to schedule new mons on hosts that match the configured
public_network, if any.  If we do not have one configured, then don't
try to place new mons at all.

Note that there are other restrictions that ceph-mon supports that we
aren't considering, here: public_network_interface in particular, which
might further limit which IPs we consider binding to.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 14:38:22 -05:00
Sage Weil
87b58989ef mgr/cephadm: keep track of host networks, ips
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 14:38:22 -05:00
Sage Weil
ba6247ebd8 cephadm: automatically infer mon public_network, if we can
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 14:38:22 -05:00
Sage Weil
9ef71a8e72 cephadm: add list-networks command
Summarize CIDR networks and our IPs in them.  Result looks like this:

{
    "10.3.64.0/24": [
        "10.3.64.23",
        "10.3.64.27"
    ],
    "10.88.0.0/16": [
        "10.88.0.1"
    ],
    "192.168.122.0/24": [
        "192.168.122.1"
    ]
}

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 14:38:22 -05:00
Sage Weil
7957655227 cephadm: bootstrap: deploy monitoring stack by default
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 12:39:44 -05:00
Sage Weil
dd20ffe2f5 Merge PR #33979 into octopus
* refs/pull/33979/head:
	cephadm: implement 'install' command

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-03-16 12:34:16 -05:00
Mykola Golub
252be9014d
Merge pull request #33988 from dillaman/wip-44391
rbd-mirror: hold lock while updating local image name

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-03-16 19:18:35 +02:00
Sage Weil
fd08725d60 cephadm: add-repo: add --version
Instead of --release octopus, which would get the latest octopus
version (whatever it might be), or possibly a repo with many build versions
inside, you can instead do --version 15.2.1 to get a repo with a
specific version and that version only.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 10:50:40 -05:00
Sage Weil
11890948ab mgr/cephadm: respect 'unmanaged' flag in spec
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 08:28:45 -05:00
Sage Weil
01ffd25345 mgr/orch: orch ls: show <no spec> or <unmanaged> as appropriate
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 08:28:45 -05:00
Sage Weil
bae6bb405d mgr/orch: orch ls: rename SPEC -> PLACEMENT
More accurate, I think.  We only ever show placement here.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 08:28:45 -05:00
Sage Weil
d1fb105db6 mgr/orch: add 'unmanaged' property to ServiceSpec
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 08:28:45 -05:00
Sage Weil
f979dd1ebf cephadm: implement 'install' command
This was present, but a no-op.

By default, install cephadm.

Optionally take a list of packages to install instead (e.g., ceph-common).

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-16 08:24:36 -05:00
Jason Dillaman
b3c7efbd45 rbd-mirror: hold lock while updating local image name
There is a potential for an independently scheduled status update to
request the local image name from the bootstrap state machine during its
initialization.

Fixes: https://tracker.ceph.com/issues/44391
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-03-16 09:16:03 -04:00
Kefu Chai
a2a44e05d3
Merge pull request #33987 from tchaikov/wip-octopus-formatting
doc/releases/octopus.rst: formatting tweaks

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-16 21:04:41 +08:00
Sage Weil
85aecea51a Merge PR #33980 into octopus
* refs/pull/33980/head:
	cephadm: bootstrap: allow --output-dir
	cephadm: do not infer image for bootstrap
	cephadm: write output files to /etc/ceph by default
	cephadm: verify the output files' containing directory exists

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-03-16 07:44:59 -05:00
Kefu Chai
1b17f742c9 doc/releases/octopus.rst: use note directive for notes
so the note stands out in the text

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-16 20:12:53 +08:00
Kefu Chai
fbd4b59742 doc/releases/octopus.rst: add '$' as prompt
to help the BashSession lexer to render the text starting with "#" as comments

see https://pygments.org/docs/lexers/#lexers-for-various-shells

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-16 20:12:53 +08:00
Kefu Chai
2a2ce99dc5 doc/releases/octopus: decrease the indent level
for less and better horizontal spacing

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-16 20:12:53 +08:00
Kefu Chai
c555a4e10d doc/_static/css: fine tune the spacing
* `ul.simple > li` is also used in front page, where the items are too
  sparse now. so we need to restore the default spacing.
* `ul.simple > li > ul > li:last-child` is used to control the spacing
  between nested unordered list. we need have more spacing there.
* `div.section > ul > li > p` is added to decrease the spacing of nested
  list items.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-16 20:12:38 +08:00
Kefu Chai
a9a93ad7e5
Merge pull request #33971 from tchaikov/octopus-doc-release
doc/releases/octopus.rst: format tweaks

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-16 11:11:15 +08:00
Sage Weil
c74d7a0667 Merge PR #33968 into octopus
* refs/pull/33968/head:
	mgr/cephadm: do not include 'osd' service in 'orch ls' output

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-03-15 21:26:20 -05:00
Sage Weil
9194a33adb Merge PR #33970 into octopus
* refs/pull/33970/head:
	python-common: 'all:true' -> '*'

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-03-15 21:01:50 -05:00
Sage Weil
334dede198 Merge PR #33973 into octopus
* refs/pull/33973/head:
	mgr/orch,cephadm: elevate --force flag for daemons to interface
	cephadm: backup data when we remove stateful daemons (mon, osd, prometheus)
	cephadm: do not zap disk after removing an OSD daemon

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-03-15 21:01:07 -05:00
Sage Weil
05b8f07313 Merge PR #33935 into octopus
* refs/pull/33935/head:
	mgr/cephadm: fix host connection exception
	doc/cephadm: use ssh-copy-id

Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-03-15 14:38:30 -05:00
Kefu Chai
5d6a1998c7 doc/releases/octopus.rst: reindent top-level items
reduce the indent level, so these items are better formated

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-16 02:00:46 +08:00
Kefu Chai
0299336c69 doc/releases/octopus.rst: formatting tweaks
* use console lexer for highlighting command lines
  otherwise they will be rendered as python code
* use bold font instead italic in subsection headers,
  they look more formal this way
* fix a typo: delineated

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-16 02:00:46 +08:00