Commit Graph

107528 Commits

Author SHA1 Message Date
Yuri Weinstein
b753947d8f
Merge pull request #33186 from yuriw/wip-yuriw-crontab-master
qa/tests: removed all runs for luminous - EOL
2020-02-10 16:16:13 -08:00
Sage Weil
6526203a66 Merge PR #33179 into master
* refs/pull/33179/head:
	mgr/orchestrator: Use `pickle` to pass exceptions across sub-interpreters

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-10 17:14:48 -06:00
Sage Weil
923df792dc Merge PR #33184 into master
* refs/pull/33184/head:
	qa/suites/rados/multimon/tasks/mon_clock_with_skews: whitelist MOST_DOWN
	qa/suites/rados/multimon/tasks/mon_clock_with_skews: disable ntpd etc

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-10 17:14:02 -06:00
Sage Weil
34fae12918 Merge PR #33043 into master
* refs/pull/33043/head:
	doc/releases: octopus draft notes

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-02-10 14:49:35 -06:00
Jason Dillaman
68a2372af6
Merge pull request #32965 from Dmole/patch-3
doc: quick-rbd.rst de-duplicate

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-02-10 15:41:13 -05:00
Sage Weil
9243a502c8 Merge PR #33181 into master
* refs/pull/33181/head:
	qa/workunits/cephadm/test_cephadm: fix typo

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-10 13:29:08 -06:00
Sage Weil
a216baa83e doc/releases: octopus draft notes
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-10 12:56:13 -06:00
Sage Weil
366d3fc33e Merge PR #33131 into master
* refs/pull/33131/head:
	mgr/orch: 'ceph orchestrator ...' -> 'ceph orch ...'

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-10 12:17:45 -06:00
Sage Weil
786aa2904a Merge PR #33162 into master
* refs/pull/33162/head:
	cephadm: KillMode=none in unit file
	cephadm: clean up unit string syntax a bit

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-10 12:17:17 -06:00
Kefu Chai
9fe6b76043
Merge pull request #33185 from tchaikov/wip-44063
pybind/mgr: bump six to 1.14

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-02-11 01:01:25 +08:00
Yuri Weinstein
e59705618e qa/tests: removed all runs for luminous - EOL
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-02-10 08:20:59 -08:00
Tim
3f367ce718 doc: quick-rbd.rst de-duplicate
Remove code duplication from the dependency.

Signed-off-by: Tim <elatllat@gmail.com>
2020-02-10 10:44:14 -05:00
Kefu Chai
363809a219 pybind/mgr: bump six to 1.14
otherwise some packages which uses six.ensure_text will fail, as it
was introduced by 1.12. and 1.14 is the latest stable version of
six. so let's use it instead.

Fixes: https://tracker.ceph.com/issues/44063
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-02-10 23:30:37 +08:00
Sage Weil
9169a037d9 Merge PR #33137 into master
* refs/pull/33137/head:
	mon/PGMap: fix digest summary of PGs by state
	mon/PGMap: fix compat encoding of num_pg_by_state

Reviewed-by: yanjun <yan.jun8@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-10 08:54:51 -06:00
Sebastian Wagner
5a32ffcfc3 mgr/orchestrator: Use pickle to pass exceptions across sub-interpreters
`copy.deepcopy` doesn't work to cross sub-interpreter boundaries.

Fixes: https://tracker.ceph.com/issues/43913
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-02-10 14:20:25 +01:00
Kefu Chai
d352315e52 Merge pull request #33035 from jdurgin/wip-target-ratio
mgr/pg_autoscaler: treat target ratios as weights

Reviewed-by: Sage Weil <sage@redhat.com>
2020-02-10 18:41:07 +08:00
Josh Durgin
fff3b704de mgr/pg_autoscaler: add unit tests for effective_target_ratio
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 13:00:00 +08:00
Josh Durgin
63f2a06568 mgr/pg_autoscaler: remove unused imports
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Josh Durgin
37519d26bb mgr/pg_autoscaler: cleanup pool_id type
Keep it as an int so we don't have to cast back and forth.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Josh Durgin
2050cc2a09 mgr/pg_autoscaler: correct and simplify progress tracking
Reset the progress each time we make an adjustment, and track progress
from that initial state to that new target. Previously we were also
using the wrong target: the current pg_num_target, not the new value
(pg_num_final) that we set.

Look up the pool by name, not id, in _maybe_adjust(), since that is how it is
retrieved by osdmap.get_pools_by_name().

Dedupe some logic into PgAdjustmentProgress to simplify things.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Josh Durgin
9118065c4c PendingReleaseNotes: mention target_size_ratio change
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Josh Durgin
0a29cf7d6c doc: update autoscaler docs for target ratio
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Josh Durgin
9758197afa mgr/pg_autoscaler: include effective target ratio in status
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Josh Durgin
772d7c1d3c mgr/pg_autoscaler: add warning when target bytes and ratio are both set
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Josh Durgin
d62c121ee3 mgr/pg_autoscaler: remove target ratio warning
Since the ratios are normalized, they cannot exceed 1.0 or overcommit
combined with target_bytes.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Josh Durgin
1ea8ce3480 qa: use ratios >1 in pg_autoscaler test
Also check for pg_num_target being set correctly, rather than pg_num,
so the test doesn't depend on merging/splitting speed.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Josh Durgin
435c56a03b mgr/pg_autoscaler: treat target ratios as weights
Normalize across pools so that it's simpler to use - this way you
don't have to adjust every other pool when you add one.

Handle pools with target_bytes by taking their capacity off the top,
and dividing the rest into the pools with a target_ratio.

If both target bytes and ratio are specified, ignore bytes. This
matches the docs and makes accounting simpler.

Fixes: https://tracker.ceph.com/issues/43947

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-02-10 10:08:36 +08:00
Sage Weil
20205e70c4 mgr/orch: 'ceph orchestrator ...' -> 'ceph orch ...'
Less typing for all!

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 15:39:57 -06:00
Sage Weil
132b5a09b6 qa/workunits/cephadm/test_cephadm: fix typo
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 15:38:48 -06:00
Sage Weil
67a2a4e7aa Merge PR #33126 into master
* refs/pull/33126/head:
	doc/mgr/orchestrator_cli: update support table
	mgr/deepsea: remove
	mgr/ansible: remove

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-09 15:36:32 -06:00
Sage Weil
ceff81c9a5 Merge PR #33136 into master
* refs/pull/33136/head:
	cephadm: fix ceph version probe

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-09 15:34:59 -06:00
Sage Weil
a7d5d5cc8c cephadm: fix ceph version probe
docker returns '<no value>' if the label isn't present, in which case we
still need to run ceph -v.

Also, don't probe non-ceph (e.g., monitoring) containers.

Also, only probe each image id once.

Add a simple test.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 14:00:50 -06:00
Sage Weil
9dba764c02 Merge PR #33133 into master
* refs/pull/33133/head:
	qa/workunits/cephadm/test_cephadm.sh: make monitoring tests faster
	qa/workunits/cephadm/test_cephadm: 2 OSDs is enough
	cephadm: disable node-exporter cpu/memory limits for the time being

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-09 13:55:27 -06:00
Sage Weil
08b6a2bc00 qa/suites/rados/multimon/tasks/mon_clock_with_skews: whitelist MOST_DOWN
The skewed clock makes some mons miss elections.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 13:40:46 -06:00
Sage Weil
c11d031bab Merge PR #33134 into master
* refs/pull/33134/head:
	qa/workunits/cephadm/test_repos: don't try to use the refspec

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-02-09 12:48:09 -06:00
Sage Weil
9f2a854b17 qa/suites/rados/multimon/tasks/mon_clock_with_skews: disable ntpd etc
Fixes: https://tracker.ceph.com/issues/43889
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 10:55:03 -06:00
Sage Weil
b5a01b7a3b doc/mgr/orchestrator_cli: update support table
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 09:47:40 -06:00
Sage Weil
2e3ed251a6 mgr/deepsea: remove
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 09:45:36 -06:00
Sage Weil
0fff7d61b5 Merge PR #33117 into master
* refs/pull/33117/head:
	qa/suites/upgrade/nautilus-x-singleton: ensure hit sets behave across upgrade
	osd/PrimaryLogPG: use legacy timestamp rendering for hit_set objects
	include/utime: allow legacy rendering of timestamp

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-09 09:40:10 -06:00
Sage Weil
1453154c25 mon/PGMap: fix digest summary of PGs by state
This fixes the PG state summary seen in 'ceph -s' to reflect PG state bits
beyond 32 bits.

Fixes: https://tracker.ceph.com/issues/44052
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 09:27:53 -06:00
Sage Weil
b9359d0f54 mon/PGMap: fix compat encoding of num_pg_by_state
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-09 09:22:56 -06:00
Kefu Chai
5560680929
Merge pull request #32928 from ljishen/wip-rados-bench-latency
rados bench: fix the delayed checking of completed ops

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-02-09 18:43:38 +08:00
Kefu Chai
1867afcef0
Merge pull request #32934 from rzarzynski/wip-bl-32bytes
include, common: make ceph::bufferlist 32 bytes long on x86

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-09 18:41:03 +08:00
Kefu Chai
97182e75da
Merge pull request #33099 from howard0su/wip_ceph_fix
ceph.in: print decoded output in interactive mode

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-09 18:36:03 +08:00
Kefu Chai
f66dc746c8
Merge pull request #33101 from tchaikov/wip-thread-join
pybind/ceph_argparse: avoid int overflow

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-02-09 18:33:26 +08:00
Yuval Lifshitz
2277588617
Merge pull request #33068 from yuvalif/verify-pubsub-inc-sync
qa/rgw/pubsub: verify incremental sync is used in pubsub
2020-02-09 11:55:57 +02:00
Patrick Donnelly
16e58d65d4
Merge PR #32816 into master
* refs/pull/32816/head:
	mds: check inode type when deciding if filelock should be in EXCL state
	mds: don't delegate inos when handling replayed requests
	mds: process re-sent async dir operations at clientreplay stage
	mds: consider async dirops when checking directory empty
	mds: always suppress issuing caps in Locker::issue_new_caps()
	mds: try reconnect cap only when replayed request creates new inode
	mds: set cap id to 1 for newly created inode

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-02-08 17:51:56 -08:00
Sage Weil
9f92c971ce cephadm: KillMode=none in unit file
The unit already has a ExecStop command that runs 'podman|docker stop',
so systemd should not *also* try to kill the process or else it may
screw up the container state

From https://www.redhat.com/sysadmin/podman-shareable-systemd-services

"Note: It’s important to set the kill mode to none. Otherwise, systemd
will start competing with Podman to stop and kill the container processes.
which can lead to various undesired side effects and invalid states."

Hopefully-fixes: https://tracker.ceph.com/issues/43883
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-08 18:21:05 -06:00
Sage Weil
278cd54afb cephadm: clean up unit string syntax a bit
Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-08 18:17:34 -06:00
Sage Weil
36daf1cc29 qa/workunits/cephadm/test_cephadm.sh: make monitoring tests faster
The sleep 90 was way overkill.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-02-08 18:00:37 -06:00