Commit Graph

109605 Commits

Author SHA1 Message Date
Neha
6edd1cb686 qa/standalone/osd/osd-backfill-stats.sh: get_latest_osdmap to propagate map change
Fixes: https://tracker.ceph.com/issues/44518
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-03-18 22:57:41 +00:00
Sage Weil
282932867a remove ceph_test_rados_watch_notify
This is an old test, we have good watch/notify coverage in the newer
tests, and it is buggy.

Fixes: https://tracker.ceph.com/issues/43861
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-18 17:45:17 -05:00
Sage Weil
2e7f7efc85 Merge PR #34014 into octopus
* refs/pull/34014/head:
	mgr/balancer: tolerate pgs outside of target weight map

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2020-03-18 17:42:48 -05:00
Sage Weil
08571b790b Merge PR #34001 into octopus
* refs/pull/34001/head:
	mgr/cephadm: pytest: Enable SpecStore
	mgr/orchestrator: add test for default implementation for apply()
	python-common: validate ServiceSpec.service_type
	fixup mgr/cephadm: Fix ceph orch apply -i
	mgr/dashbaord: orchestrator service: Revert wait_api_result to a single completion
	mgr/orchestrator: `orch daemon add` accepts a yaml
	mgr/cephadm: apply_drivegroups() returns a single Completion
	mgr/cephadm: remove `trivial_result()`
	mgr/cephadm: Fix `ceph orch apply -i`

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-18 17:42:10 -05:00
Sage Weil
bf06f6cc19 python-common/ceph/deployment/service_spec: add ssl to RGWSpec
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-18 17:23:18 -04:00
Tiago Melo
e96cfbd8c5 mgr/dashboard: Update Angular and fix npm audits
This fixes a new audit problem found in older versions of "acorn"
and updates Angular to latest v8 version.

Fixes: https://tracker.ceph.com/issues/44580

 Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-03-18 20:04:02 -01:00
Sage Weil
8d8e09a5f1 cephadm: only infer image for shell, run, inspect-image, pull, ceph-volume
Use a decorators for infer, require, and default.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-18 15:03:04 -05:00
Sage Weil
11d607d0b7 Merge PR #34011 into octopus
* refs/pull/34011/head:
	qa/suites/rados/verify/validater/valgrind: tolerate SLOW_OPS
	qa/suites/rados/verify/validater/valgrind: less bluestore logging
	qa/suites/rados/verify/validater: increase heartbeat grace
	Revert "qa/suites/rados/verify: debug_ms = 1, osd_heartbeat_grace = 60"
	Revert "qa/suites/rados/verify/validator/valgrind: debug refs = 5"
	ceph_test_watch_notify: try notify 10x if ALLOW_TIMEOUTS is set
	ceph_test_rados_api_misc: ShutdownRace timeout if ALLOW_TIMEOUTS is set
	qa/suites/rados/verify: set ALLOW_TIMEOUTS for workunits

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-03-18 12:12:54 -05:00
Jason Dillaman
477570a974 qa/workunits/rbd: use context managers to control Rados lifespan
There is a potential race between the expected exceptions being
thrown and Python shutting down racing with librados background
threads. Ensure that librados is properly shut down prior to
exiting Python.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-03-18 12:56:14 -04:00
Mykola Golub
e2a3842a6d
Merge pull request #34032 from dillaman/wip-rbd-octopus-docs
doc/releases/octopus: add additional RBD improvements

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-03-18 18:45:43 +02:00
Jason Dillaman
965c300434 doc/releases/octopus: add additional RBD improvements
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-03-18 12:16:28 -04:00
Sage Weil
acbda9d19d qa/workunits/cephadm/test_cephadm: mark services unmanaged for test
We are deploying containers manually.  Mark them unmanaged so that we
do not fight against mgr/cephadm cleaning up orphan daemons.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-18 10:44:42 -05:00
Sage Weil
ba82677408 mgr/cephadm: do not reconfig unmanaged services
Fixes: https://tracker.ceph.com/issues/44615
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-18 10:09:00 -05:00
Sage Weil
9ea587142a Merge PR #33981 into octopus
* refs/pull/33981/head:
	doc/install: edits
	doc/cephadm: more edits
	doc/cephadm/install: edits
	doc/cephadm/adoption: improvements
	doc/cephadm/install: a few edits
	doc/cephadm/install: do not install ceph-common on host (by default)
	doc/cephadm: drop os recs link
	doc/cephadm/upgrade: improvements
	doc/cephadm/upgrade: document upgrade
	doc/cephadm/install: revamp install docs
	doc: reorganize cephadm docs
	doc/cephadm/administration: update docs on customizing SSH config
	doc/cephadm/administration: add a note about the 'removed' dir

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-18 09:45:16 -05:00
Ramana Raja
e3bf5e7c7b
Merge pull request #34018 from ajarr/octopus-subvolume-clone-cancel
mgr/volumes: add FS subvolume clone cancel

 Reviewed-by: Ramana Raja <rraja@redhat.com>
2020-03-18 19:22:06 +05:30
Sage Weil
ee108d4395 qa/workunits/cephadm/test_cephadm: output file for pub key
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-18 08:44:10 -05:00
Sage Weil
610ec12ac2 Merge PR #33866 into octopus
* refs/pull/33866/head:
	mgr/cephadm: limit number of times check host is performed in the serve loop

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-03-18 08:14:19 -05:00
Sage Weil
a12b90da5d Merge PR #34005 into octopus
* refs/pull/34005/head:
	python-common: reduce output of ServiceSpec.to_json()
	python-common,mgr/cephadm: move assert_valid_host to service_spec
	mgr/cephadm: add HostAssignment.validate()

Reviewed-by: Sage Weil <sage@redhat.com>
2020-03-18 08:14:06 -05:00
Sage Weil
1e25680552 Merge PR #34013 into octopus
* refs/pull/34013/head:
	qa/workunits/cephadm/test_cephadm: --skip-monitoring-stack

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-03-18 08:13:56 -05:00
Igor Fedotov
85abb02ad7 os/bluestore: fix extent leak after main device expand.
To reproduce the issue one can expand device of 3,147,480,064 bytes to
4,147,480,064 using bluefs-bdev-expand command.
Subsequent fsck will detect the leakage.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-03-18 15:53:17 +03:00
Sebastian Wagner
d7a5edc521 mgr/cephadm: pytest: Enable SpecStore
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-18 13:44:49 +01:00
Sebastian Wagner
096542e1c0 mgr/orchestrator: add test for default implementation for apply()
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-18 13:44:49 +01:00
Sebastian Wagner
8fd7087042 python-common: validate ServiceSpec.service_type
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-18 13:44:49 +01:00
Sebastian Wagner
1a75c46df7 fixup mgr/cephadm: Fix ceph orch apply -i
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-18 13:44:49 +01:00
Kiefer Chang
31ad70d8f1 mgr/test_orchestrator: fix service filtering when using dummy data
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-03-18 20:10:36 +08:00
Kiefer Chang
4f2db7e60e mgr/dashboard: fix adding/removing host errors
Send a HostSpec instance to the Orchestrator when adding a host.

Also, to be consistent with other components:
- Reword from Add/Remove hosts to Create/Delete hosts
- Display a modal when there is no Orchestrator backend enabled

Fixes: https://tracker.ceph.com/issues/44664
Signed-off-by: Kiefer Chang <kiefer.chang@suse.com>
2020-03-18 20:10:28 +08:00
Jan Fajerski
d7753e3a02
Merge pull request #33787 from jan--f/c-v-prepare-slots
ceph-volume: prepare: use *-slots arguments for implicit sizing
2020-03-18 13:04:16 +01:00
Lenz Grimmer
921199b679
Merge pull request #33760 from tspmelo/wip-update-prettier
mgr/dashboard: Update prettier

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2020-03-18 12:24:00 +01:00
Sebastian Wagner
37f21075f8 mgr/dashbaord: orchestrator service: Revert wait_api_result to a single completion
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-18 11:03:20 +01:00
Sebastian Wagner
9c12b1b8d3 mgr/orchestrator: orch daemon add accepts a yaml
Fixes: https://tracker.ceph.com/issues/44622
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-18 11:03:20 +01:00
Sebastian Wagner
a66793034d mgr/cephadm: apply_drivegroups() returns a single Completion
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-18 11:03:20 +01:00
Sebastian Wagner
a44abb4b8a mgr/cephadm: remove trivial_result()
Replaced with `@trivial_completion`, otherwise
`self._apply()` would have needed to accept a list
of specs.

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-18 11:03:19 +01:00
Sebastian Wagner
0127282201 mgr/cephadm: Fix ceph orch apply -i
* We had two implementations for `ceph orcha apply`
* Remove yaml pasing in `mgr/cephadm`

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-03-18 11:02:55 +01:00
Kefu Chai
32bcb7964c
Merge pull request #34010 from grinapo/patch-1
doc/rbd: s/use use/use/

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-03-18 16:27:30 +08:00
Mykola Golub
7f16137997
Merge pull request #33994 from dillaman/wip-librbd-poll-event-race
librbd: defer event socket completion until after callback issued

Reviewed-by: Dehao Shang <dehao.shang@intel.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-03-18 10:08:25 +02:00
Peter Gervai
cb20e2bc89 doc/rbd: s/use use/use/
just a typo, really.

Signed-off-by: Peter Gervai <grin@grin.hu>
2020-03-18 15:44:16 +08:00
Venky Shankar
60105f6101 doc: document clone cancel command
Fixes: http://tracker.ceph.com/issues/44208
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-18 11:03:21 +05:30
Venky Shankar
ba4b9358e1 test: add clone cancel tests
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-18 11:03:17 +05:30
Venky Shankar
a427c7074c mgr/volumes: introduce "clone cancel" volume command
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-18 11:03:11 +05:30
Venky Shankar
89a16c7867 mgr/volumes: allow canceling a single asynchronous job for a volume
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-18 11:03:06 +05:30
Venky Shankar
2dc41ea2db mgr/volumes: helper for looking up a clone entry index
... this would be used when canceling a clone operation to
find the clone index for a given clone.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-18 11:02:56 +05:30
Venky Shankar
2f93b3beb4 mgr/volumes: periodically check if clone operations should be canceled
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-18 11:02:52 +05:30
Venky Shankar
9a0507acb6 mgr/volumes: periodically check if copy operations should be canceled
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-18 11:02:46 +05:30
Venky Shankar
ac9d697b1c mgr/volumes: introduce 'canceled' state in clone op state machine
When fetching the next execution state, -EINTR jumps to 'canceled'
state signifying a canceled (interrupted) operation. Also include
a helper routine to check if a given state machine is in initial
state.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2020-03-18 11:02:41 +05:30
Kefu Chai
293e8bdf6c ceph.spec.in: add build deps for Debug build of seastar
it's a regression introduced by
6158bcfdef, which dropped the change to
make Sanitizers optional

since we've switched from xenial to bionic. there is no need to disable
this anymore. we ran into an issue caused by the ancient linker shipped
by xenial before.

Fixes: https://tracker.ceph.com/issues/44658
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-03-18 11:02:23 +08:00
Sage Weil
7c19c1534b qa/suites/rados/verify/validater/valgrind: tolerate SLOW_OPS
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00
Sage Weil
baeb051910 qa/suites/rados/verify/validater/valgrind: less bluestore logging
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00
Sage Weil
4fda9d50f0 qa/suites/rados/verify/validater: increase heartbeat grace
Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00
Sage Weil
0bd14ab080 Revert "qa/suites/rados/verify: debug_ms = 1, osd_heartbeat_grace = 60"
This reverts commit 4f742f200d.

This was in the wrong file.. see valgrind.yaml

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00
Sage Weil
12105ed9d7 Revert "qa/suites/rados/verify/validator/valgrind: debug refs = 5"
This reverts commit 65e81e6eb4.

This slows things down too much with valgrind.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-03-17 19:32:42 -05:00