Commit Graph

119771 Commits

Author SHA1 Message Date
Zac Dover
cc362c2fd6 doc/dev: t7gy s/Priority/N/
"N" just looks better in this table than does
"Priority". I've been thinking about this all
day, and I just decided to make this change.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-02-19 02:46:57 +10:00
Kefu Chai
13c0f27837
Merge pull request #39548 from pkubaj/master
crc32c: fix build on ppc64le with clang

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-18 23:14:55 +08:00
Piotr Kubaj
4b39d33c4f crc32c: fix build on ppc64le with clang
Ceph uses assembly files from https://github.com/antonblanchard/crc32-vpmsum
Update them to the newest versions, which fixes build with Clang.

Signed-off-by: Piotr Kubaj <pkubaj@FreeBSD.org>
2021-02-18 14:40:23 +01:00
Sebastian Wagner
5ce097b48d
Merge pull request #38881 from ceph/default_images
mgr/cephadm: Put together default container images references

Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-02-18 12:10:33 +01:00
Sebastian Wagner
767634e2ac
Merge pull request #39330 from sebastian-philipp/orch-rm-apply-funcs
mgr/orch: remove a bunch of duplicated code

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
2021-02-18 12:08:56 +01:00
Kefu Chai
ccf9becd2e
Merge pull request #39542 from tchaikov/wip-devicehealth-flake8
mgr/devicehealth: silence flake8 warnings

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-02-18 17:06:23 +08:00
Gal Salomon
0b4ab1922c
Merge pull request #39514 from ceph/fix_buffer_overflow
rgw: fix buffer overflow in s3 select op
2021-02-18 10:42:19 +02:00
Kefu Chai
f921598888
Merge pull request #39356 from xxhdx1985126/wip-crimson-client-request-idempotent
crimson/osd: make client_requests idempotent

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-18 14:39:22 +08:00
Xuehan Xu
14b322ec02 crimson/osd: make client_requests idempotent
When redoing client requests, they might have already taken effect
on the underlying disk. This commit deals with that situation by
making those requests immediately reply to clients if they are already
done

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-02-18 14:37:52 +08:00
Kefu Chai
56c5853ef2 mgr/devicehealth: silence flake8 warnings
turns out 4840507cfc was racing with
99805d9cff. so we failed to identify this
before merging the former.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-18 12:59:48 +08:00
Kefu Chai
521dc776f1
Merge pull request #39413 from ronen-fr/wip-ronenf-blue-log
os/bluestore: reduce number of wasted checks for low-priority logs

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2021-02-18 11:50:24 +08:00
Kefu Chai
dcb04bfea3
Merge pull request #39365 from liewegas/mgr-ssd-used
mgr/devicehealth: extract and present SSD wear %

Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>
2021-02-18 11:42:34 +08:00
Kefu Chai
cc631d6b3f
Merge pull request #39346 from tchaikov/wip-ipv6-lo
common/ipaddr: Allow binding ipv6 addr on lo

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-02-18 11:31:32 +08:00
Kefu Chai
92b1f4fad1
Merge pull request #39374 from tchaikov/wip-ceph-health-newline
mon/Monitor: add newline at end of output "ceph health -f json"

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-02-18 11:30:55 +08:00
Kefu Chai
02a9ead8cc
Merge pull request #39391 from tchaikov/wip-mgr-more-flake8
pybind/mgr: add more modules to flake8

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-02-18 11:30:07 +08:00
Josh Durgin
6c20b0e9ad
Merge pull request #39528 from zdover23/wip-doc-dev-teuthology-intro-testing-priority-2021-Feb-17
doc/dev: intro: rewrite "testing priority"

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-17 17:51:45 -08:00
Kefu Chai
0d80d88414
Merge pull request #39516 from rzarzynski/wip-crimson-6threads-in-alienstore
crimson/osd: tune the default for crimson_alien_op_num_threads.

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-18 09:35:00 +08:00
Kefu Chai
0c079852cd
Merge pull request #39506 from tchaikov/wip-rpm-multi-thread-xz
ceph.spec.in: use multi-threaded xz compression and cleanups

Reviewed-by: David Galloway <dgallowa@redhat.com>
2021-02-18 09:32:27 +08:00
Casey Bodley
6bfdef8d9e
Merge pull request #39456 from cbodley/wip-qa-rgw-multisite-upgrade
qa/rgw: run multisite tests with mixed cluster versions

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2021-02-17 13:29:00 -05:00
Zac Dover
e25c54c188 doc/dev: intro: rewrite "testing priority"
This PR improves the English in the "Testing
Priority" section and makes a few structural
changes to make the intent clearer.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-02-18 01:31:55 +10:00
Kefu Chai
70ba94744a
Merge pull request #39363 from rhcs-dashboard/fix-orch-host-e2e
mgr/dashboard: check .badge instead of text for expected label

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2021-02-17 22:32:24 +08:00
Jan Fajerski
72113d574d Merge PR #38610 into master
* refs/pull/38610/head:
	ceph-volume: pass --filter-for-batch from drive-group subcommand

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-02-17 15:24:21 +01:00
Casey Bodley
f1e4f6f9dc qa/rgw: add pacific-x upgrade suite for multisite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-02-17 09:14:44 -05:00
Casey Bodley
b6773dd3f1 qa/rgw: add octopus-x upgrade suite for multisite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-02-17 09:14:44 -05:00
Casey Bodley
6f2af91518 qa/rgw: add 'branch' option to rgw-multisite-tests task
Fixes: https://tracker.ceph.com/issues/49330

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-02-17 09:01:05 -05:00
Sebastian Wagner
c071aef83f
Merge pull request #39467 from sebastian-philipp/doc-cephadm-mon-quorum
doc/cephadm: Restoring the MON quorum

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2021-02-17 14:58:44 +01:00
Sebastian Wagner
5661356697
Merge pull request #39496 from liewegas/cephadm-refresh-health-update
mgr/cephadm: fix host refresh

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-02-17 14:57:06 +01:00
Ernesto Puerta
f81c94c1a2
Merge pull request #39372 from rhcs-dashboard/avoid-document-write
mgr/dashboard: avoid using document.write()

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-02-17 14:17:40 +01:00
Ernesto Puerta
dff5b78d3b
Merge pull request #39462 from rhcs-dashboard/fix-alerts-mtuMismatch
mgr/dashboard: fix MTU Mismatch alert

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-02-17 14:14:17 +01:00
Kefu Chai
144bf31087 ceph.spec.in: use %make_install macro
hide buildroot in the implementation of this macro

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-17 21:06:18 +08:00
Kefu Chai
0e511973f7 ceph.spec.in: use %make_build instead of "make"
so we can hide the `_smp_mflags` in `%make_build` macro

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-17 21:06:18 +08:00
Kefu Chai
43b441f9a3 ceph.spec.in: use a macro helper to limit number of jobs
so it can work with the rpm macros better.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-17 21:06:18 +08:00
Radoslaw Zarzynski
a906cbd312 crimson/osd: tune the default for crimson_alien_op_num_threads.
This commit tries to optimize the default size of AlienStore's
thread pool. Recent testing has shown the intial value, which
is `16`, is far from being optimal while the optimum is close
to `4`:

  https://gist.github.com/rzarzynski/c851212f4b0baef4097a6087533ba17b

Further testing by Mark Nelson suggests that the sweet spot is
closer to `8` taking into account 4 KB writes with lower queue
depths:

  https://docs.google.com/spreadsheets/d/1IR9ysWRkaGdX5e9w_YV8kfeeglR2pEY3V9hovY0ECV8/edit#gid=1884533182

As a kind of compromise `6` is proposed in this commit.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-02-17 12:37:59 +00:00
Nizamudeen A
6156055a78 mgr/dashboard: check .badge instead of text for expected label
this change fixes a regression introduced by
8c5e31ec1a which broke the 01-hosts.e2e-spec.ts test
driven by test_dashboard_e2e.sh

Fixes: https://tracker.ceph.com/issues/49205
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-02-17 17:46:17 +05:30
Sebastian Wagner
72e9d4ad5f
Merge pull request #39464 from sebastian-philipp/doc-cephadm-unmanaged
doc/cephadm: Disable automatic deployment of daemons

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
2021-02-17 12:58:50 +01:00
galsalomon66
f59f60c5a2 there could a case where capacity is equal to string size, and cause invalid write(4 bytes); thus also the last 4-bytes are appended
Signed-off-by: galsalomon66 <gal.salomon@gmail.com>
2021-02-17 11:51:08 +02:00
Sebastian Wagner
9bdc3b9f6f
Merge pull request #39459 from tchaikov/wip-doc-api-command
doc: wrap example command

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-02-17 10:38:54 +01:00
Kefu Chai
35d1ba003d ceph.spec.in: specify cmake variable type
for better readablity

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-17 12:39:55 +08:00
Kefu Chai
da7030db79 ceph.spec.in: use %cmake macro
%cmake passes a bunch of default flags, so we can save some efforts.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-17 12:39:55 +08:00
Kefu Chai
bd4da136ba ceph.spec.in: use RPM_BUILD_NCPUS for number of jobs
this env variable is defined by /usr/lib/rpm/macros. let's used it
instead of inventing our own version.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-17 12:39:55 +08:00
Kefu Chai
b50fc9e61c ceph.spec.in: use multi-threaded xz compression
so we can build the compressed src rpm and binary rpms with smaller
latency.

see also
https://access.redhat.com/documentation/en-us/red_hat_enterprise_linux/7/html/7.3_release_notes/technology_previews_installation_and_booting

by default, rpm uses

w9.gzdio

which means: gzip level 9. but since xz is able to compress using
multiple threads, let's switch to xz.

xz's default compression level is 6, but ceph's source and binary
packages are relatively large. let's use a higher compression level.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-17 11:25:37 +08:00
Sage Weil
3f5e778ad6 Merge PR #39490 into master
* refs/pull/39490/head:
	cephadm: fix selinux mount mis-indent

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-02-16 22:17:18 -05:00
zdover23
f3312bbdb3
Merge pull request #39497 from zdover23/wip-doc-dev-teuthology-intro-workbench-removal-16-Feb-2021
doc/dev: removing workbench docs (part 2)

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-02-17 12:16:47 +10:00
zdover23
9ee08b90d6
Merge pull request #39499 from zdover23/wip-doc-dev-teuthology-teuthology-describe-tests-repair-2021-Feb-16
doc/dev: correct "teuthology-describe-tests"

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-02-17 12:15:17 +10:00
Ernesto Puerta
e2d73297cf
Merge pull request #38030 from p-se/prom-alert-package-drops-leeway
mgr/dashboard: prometheus alerting: add some leeway for package drops and errors

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-02-16 20:45:44 +01:00
Neha Ojha
51b6b63d08
Merge pull request #39422 from kamoltat/wip-ksirivad-autoscaler-release-notes
PendingReleaseNotes: mgr/pg_autoscaler

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-02-16 10:14:39 -08:00
Zac Dover
67298e2492 doc/dev: correct "teuthology-describe-tests"
This tiny commit does this:

s/teuthology-describe-tests/teuthology-describe/

The name of this feature was changed from "teuthology-
describe-tests" to "teuthology-describe", and this
commit brings up to date the title of the section
detailing it.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-02-17 04:14:30 +10:00
Zac Dover
745934320d doc/dev: removing workbench docs (part 2)
This removes a paragraph in the section "How
Integration Tests Are Run" that described
ceph-workbench. ceph-workbench is deprecated,
so that paragraph is now gone.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-02-17 03:45:49 +10:00
Sage Weil
9df5a6d73e mgr/cephadm: fix host refresh
Fixes: 01f60cf4e0
Signed-off-by: Sage Weil <sage@newdream.net>
2021-02-16 11:07:08 -06:00
Sebastian Wagner
6871b0da8e
Merge pull request #39323 from sebastian-philipp/cephadm-simplify-cephadmservice-config
mgr/cephadm: Add config() to CephadmService

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2021-02-16 18:00:40 +01:00