Commit Graph

119228 Commits

Author SHA1 Message Date
Sebastian Wagner
9c4df44fc5
Merge pull request #37144 from jmolmo/storage_devices_mgmt
doc: High level workflow for storage devices

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
2021-01-29 19:16:54 +01:00
Sage Weil
e19e99a8a7 src/test/cli/monmaptool: adjust for new monmap features
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-29 11:45:11 -06:00
Sage Weil
5842058d12 qa/tasks/cephadm: allow custom git_url for cephadm_branch pull
Normally the git_url is git://git.ceph.com/ceph-ci.git, which mirrors
upstream ceph-ci.git.  However, the release branches aren't present there.
Allow a custom git_url so we can pull these from the main ceph.git.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-29 11:45:02 -06:00
Sage Weil
db31d09efa mgr/devicehealth: make CLI commands error when pool doesn't exist
This is better than silently failing to do anything.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-29 10:40:44 -06:00
Sage Weil
2abf4f1fc3 mgr/devicehealth: only create pool when we have some osds
If we create the pool before we have OSDs, the PGs won't be active+clean
and we'll raise a health warning that we shouldn't.  This will annoy
a new users deploying a new cluster, and (more importantly?) make
qa tests fail while deploying initial clusters due to the health
warning.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-29 10:40:19 -06:00
Casey Bodley
09bdf42b0f
Merge pull request #39025 from yuvalif/wip-yuval-fix-48963
rgw: fix valgrind errors when protected_fixedsize_stack is used

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-01-29 11:01:14 -05:00
Sage Weil
38b3ca2a73 mgr/orchestrator: remove 'host' arg for 'orch ls'
The host arg is unused, and also missing from the documentation.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-29 09:45:16 -06:00
Neha Ojha
07f7e3647e
Merge pull request #39152 from neha-ojha/wip-46323
qa/*/thrash_cache_writeback_proxy_none.yaml: disable writeback overlay tests

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-01-29 07:37:52 -08:00
Kefu Chai
1d6829f41c
Merge pull request #39118 from tchaikov/wip-cmake-rook-client
cmake: install rook-client-python using ExternalProject

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-01-29 19:49:06 +08:00
Kefu Chai
b442a88d3d pybind/mgr/snap-schedule: silence flake8 warnings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Kefu Chai
e9e4ae8378 pybind/mgr/snap-schedule: use use_fs if fs is not specified
the "vol_name" parameter of "fs subvolume getpath" command is not
optional, so we have to pass an fs name to it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Kefu Chai
52d17e5852 pybind/mgr/snap-schedule: close a string with single quote
if it starts with single quote, we should close it with a single quote
also.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Kefu Chai
80cbf407c2 pybind/mgr/snap-schedule: add typing annotations
please note, the behavior of `updates_schedule_db()` is changed so that
it now returns the return value of the decorated function. this change
makes it a real decorator which keeps the signature of the decorated
function unchanged. the reason why we need this change is that mypy does
not allow us to match the parameter pack of a Callable at the time of
writing.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Kefu Chai
9d888ee42c pybind/mgr/status: flake8 cleanup
* remove unused import
* wrap long lines
* remove comments which do not start with "# "

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Kefu Chai
60bef081f8 pybind/mgr/status: add typing annotations
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Kefu Chai
6f68dea55c pybind/mgr/status: always map 'mds_version' to a list of dict
more consistent this way, as json format is supposed to be consumed by a
parser not human being.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Kefu Chai
5ac2901f54 pybind/mgr/status: construct defaultdict without key
it's simply wrong to construct defaultdict with the key which does not
have the mapped value, what we should do is to specify the
"default_factory" which construct the default value whose key does not
exist in the dict when being accessed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Kefu Chai
f1ebf6b34d pybind/mgr/status: cast return value to int
the return value of get_rate() is fed to mgr_util.format_dimless(),
which always cast the formatted value to int.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Kefu Chai
3649ecf64c pybind/mgr: correct a MgrModule annotation
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Kefu Chai
2966e1f46c pybind/mgr/status: use CLIReadCommand for defining commands
simpler this way. and will be more consistent with other mgr modules

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Kefu Chai
7ee1301a02 pybind/mgr/iostat: add typing annotations
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Kefu Chai
367f264100 pybind/mgr: silence flake8 warnings
silence following warnings from flake8

* line too long (107 > 100 characters) [E501]

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-29 19:42:32 +08:00
Sebastian Wagner
d055d855ea
Merge pull request #38686 from wornet-mwo/wip-doc-add-section-declarative-orch-cmd
doc: added section about retival of Service Specication

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
2021-01-29 12:37:15 +01:00
Sebastian Wagner
ae167bd496
Merge pull request #38875 from pcuzner/new-host-to-maintenance
mgr/orchestrator: add maintenance mode for new hosts

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-01-29 10:27:11 +01:00
Sebastian Wagner
de0723c5aa
Merge pull request #39083 from genesiscloud/orch-non-rotational-filter-fix
python-common/drivegroups: avoid dropping "rotational: 0" from Device Selection

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-01-29 10:26:27 +01:00
Sebastian Wagner
46188c4caa
Merge pull request #39007 from mgfritch/cephadm-podman-2.0
cephadm: require podman >= 2.0.0

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-01-29 10:26:03 +01:00
Kefu Chai
5a7f2827ee
Merge pull request #39157 from xxhdx1985126/wip-crimson-bug-fix
crimson/osd: capture "intervals_included" by value in ReplicatedRecoveryBackend::submit_push_data

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-29 16:24:19 +08:00
Kefu Chai
d58481a6c4
Merge pull request #39057 from aclamk/wip-mempool-shards-check-random
common/mempool: Improve mempool shard selection

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-01-29 15:21:51 +08:00
Xuehan Xu
e1f8b585bd crimson/osd: capture "intervals_included" by value in ReplicatedRecoveryBackend::submit_push_data
ReplicatedRecoveryBackend::submit_push_data()'s parameter "intervals_included" might be an
local varaiable in the outer method, so we should capture it by value to avoid a dangling
reference in the inner lambda

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-01-29 14:44:36 +08:00
galsalomon66
b73c6c40bf diagnose zero segment while s3select
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

using s3-test with the fix fix_test_file_permission_add_attrib

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

update s3select{1ea37ae459f957786b9d198510637dfa12f83350} ; add log tracing zero segments locations

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

s3select submodule update

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

fix comments

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

updating the s3select new features; covering the gap between latest documentation and latest faetures update

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

add some more examples; fixes

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

add between expression to doc; typo

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

typo

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

skipping empty segments

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>

skip empty segments to the next segments

Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2021-01-29 08:15:01 +02:00
Neha Ojha
be710cdf39 qa/*/thrash_cache_writeback_proxy_none.yaml: disable writeback overlay tests
thrash_cache_writeback_proxy_none tests have been failing consistently. Some investigation
shows that the writeback overlay tests are reponsible for it. Instead of removing these
cache tiering tests entirely, we'll disable them for now.

Related to: https://tracker.ceph.com/issues/46323
Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-01-28 23:12:03 +00:00
Patrick Donnelly
a651247b93
libradosstriper: make default layout const and static
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-28 14:33:10 -08:00
pcuzner
9fea82cacc
Merge pull request #39112 from pcuzner/fix-gather-facts
cephadm:add missing kernel_security property
2021-01-29 10:35:33 +13:00
Sage Weil
a78dab9e53 qa/workunits/cephadm/test_cephadm: show exporter output
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 15:15:02 -06:00
Sage Weil
5b437f334d qa/suites/rados/upgrade: include pacific-x
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
0c3462e938 qa/suites/upgrade/pacific-x/parallel
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
a9c4d1f1e7 qa/suites: some clean up for quincy
- remove upgrades from nautilus
- stubs for completing upgrade to quincy

Still missing the pacific-x upgrade tests.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
7bbc92eda3 mon: updates for quincy
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
d777adb89e mon: update for quincy ondisk features
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
8a0cd401a8 script: add pacific
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
fbd4356f0d doc/dev/release-checklist: we tagged v17.0.0
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
1c039854cb ceph-volume: change to quincy
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
f1ecf99a86 include/ceph_features: retire MON_SINGLE_PAXOS
X-3 = Q-3 = Nautilus

Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
f954c7e985 include/ceph_features: define FEATURE_SERVER_QUINCY
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:28 -06:00
Sage Weil
348ed248f4 mon/MgrMonitor: add always_on_modules for quincy
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:27 -06:00
Sage Weil
beb62c029a add feature/release name quincy
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:27 -06:00
Sage Weil
d730a522e3 kickoff v17 quincy
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:27 -06:00
Sage Weil
0a13114341 doc/dev/release-checklists: uncheck everything!
Signed-off-by: Sage Weil <sage@newdream.net>
2021-01-28 13:29:27 -06:00
Adam King
10214317ae cephadm: fix get_data_dir calls for ha-rgw daemons
calls need to use the context's data dir rather than daemon type
puts these calls in line with the other daemons

Signed-off-by: Adam King <adking@redhat.com>
2021-01-28 12:12:57 -05:00
Sebastian Wagner
ba3deab632 mgr/alerts: type checking
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-01-28 15:46:24 +01:00