Commit Graph

117281 Commits

Author SHA1 Message Date
Kefu Chai
52c9525385
Merge pull request #36118 from rzarzynski/wip-crimson-backfill-part1
crimson: add support for backfill, part 1 -- unit testing

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-01 23:00:06 +08:00
Patrick Donnelly
96bc10822b
Merge PR #38365 into master
* refs/pull/38365/head:
	doc/mds: fix the default value for mds_dir_max_commit_size

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2020-12-01 06:56:38 -08:00
Kefu Chai
a6eb62e107
Merge pull request #38218 from aaugustinas/patch-1
doc: Remove duplicate sentence in sync module documentation

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-12-01 22:38:43 +08:00
Jason Dillaman
4e9da32ab7
Merge pull request #38008 from trociny/wip-47388
librbd: serialize maintenance operations by type

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-12-01 08:24:45 -05:00
Radoslaw Zarzynski
2c2062cfca crimson: fix the condition in the loop of BackfillState::Enqueuing.
The bug here was that if a backfill target has an object-to-delete
placed after the very last object of primary, it will be missed.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:55:27 +01:00
Radoslaw Zarzynski
e681ffb72f crimson/tests: bring two_pseudorandomized_replicas.
It discovered an issue with occasional missing deletion
of the very last object on replica if it doesn't exist
on primary.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:16 +01:00
Radoslaw Zarzynski
ea3515ded7 crimson: fix mismatch between backfill's enqueue_push() and recovery.
The unittesting discovered an issue between `BackfillState` and
the low-layer recovery code: `RecoveryBackend::recover_object()`.
`BackfillState::enqueue_push()` was assuming it controlls also
to which backfill target the push is sent while `recover_object()`
calculated the set on its own.
Fixing this is the reason why `enqueue_push()` loses the `const
pg_shard_t& target` parameter.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:16 +01:00
Radoslaw Zarzynski
0a6b5767f0 crimson/tests: add simple multi-replica test for backfill.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:16 +01:00
Radoslaw Zarzynski
0f738f1a93 crimson: adhere to aliasing of a variable in BackfillState::Enqueuing.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:16 +01:00
Radoslaw Zarzynski
30258bc14d crimson/tests: implement randomized testing for backfill.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:15 +01:00
Radoslaw Zarzynski
a44b937b2c tests: modernize all occurrences of rand_choose().
We should consider deduplication as well.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:15 +01:00
Radoslaw Zarzynski
d3e4e6ca0e crimson/tests: add unittesting for backfill.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:15 +01:00
Radoslaw Zarzynski
b34647b18c crimson/osd: drop unnecessary includes from backfill_state.{cc,h}.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:15 +01:00
Radoslaw Zarzynski
670c433050 crimson/osd: do not refence PGLog in BackfillState.
This commit makes the backfill code unware about pg log
implementation details. The benefit is easier unit testing.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:15 +01:00
Radoslaw Zarzynski
eaa1e967da crimson/osd: drop the depedency on pg_info_t from PGFacade.
`get_info()` gets replaced with `get_last_update() and
`get_log_tail()`. This entirely removes the awareness of
`pg_info_t` in the backfill code.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:21:56 +01:00
Radoslaw Zarzynski
649e83e2ec crimson/osd: replace get_peer_info() in BackfillState::PGFacade.
`get_peer_info()` gets replaced with `get_peer_last_backfill()`.
The benefit is no need to mock peer's `pg_info_t` in unit test.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:20:15 +01:00
Xiubo Li
51e4c7caf2 doc/mds: fix the default value for mds_dir_max_commit_size
The default value has changed to 10MB.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-01 14:42:43 +08:00
Patrick Donnelly
5c9fbc7948
Merge PR #38093 into master
* refs/pull/38093/head:
	qa: add debug information for client address for kclient
	qa/kernel_mount.py: rename _read_debug_file to read_debug_file

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-11-30 20:04:18 -08:00
Patrick Donnelly
63ab00e1df
Merge PR #38083 into master
* refs/pull/38083/head:
	mds: don't access mds->mdsmap without holding mds_lock

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-11-30 19:46:03 -08:00
Brad Hubbard
effe296b42
Merge pull request #38315 from badone/wip-mon-scrub-testing
Test mon scrub and exercise mon scrub error injectors

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-12-01 11:59:47 +10:00
Kefu Chai
f440f6d297
Merge pull request #38127 from tchaikov/wip-crimson-client-request-wait
crimson/osd: do not wait for sent epoch

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2020-12-01 07:15:49 +08:00
Kefu Chai
c722452c4d
Merge pull request #38203 from tchaikov/wip-doc-build-releases.yaml
doc/conf: generate releases.json in conf.py and cleanups

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-12-01 07:13:34 +08:00
Kefu Chai
be36679b5c
Merge pull request #38239 from tchaikov/wip-48320
mon/OSDMonitor: drop osd_epoch of manually marked out osd

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-12-01 07:13:12 +08:00
Kefu Chai
e59c088e3b
Merge pull request #38281 from tchaikov/wip-mgr-no-kv-options
mgr: do not migrate conf from config-key store to new-style conf

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-01 07:12:43 +08:00
Kefu Chai
1403974039
Merge pull request #38305 from tchaikov/wip-crimson-finally
crimson: fix finally and erroratorize PG::with_*_obc()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2020-12-01 07:11:51 +08:00
Patrick Donnelly
71a0c64000
Merge PR #38248 into master
* refs/pull/38248/head:
	doc: Adding missing Ceph Foundation board members

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-11-30 14:02:36 -08:00
Jason Dillaman
d713b2c365
Merge pull request #38313 from wjwithagen/wjw-fix-src-HttpClient.h
librbd: fix Clang warnings

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2020-11-30 10:51:20 -05:00
Ernesto Puerta
7cbb478efc
Merge pull request #38113 from rhcs-dashboard/login-name-cleanup
mgr/dashboard: Change the text 'Login' to 'Log in'

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-11-30 12:15:56 +01:00
Ernesto Puerta
6911e753b4
Merge pull request #38209 from votdev/issue_44404_placement_column
mgr/dashboard: display placement column in service table

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-11-30 11:33:07 +01:00
Ernesto Puerta
4a4d4e75a5
Merge pull request #38163 from bk201/wip-48245
mgr/dashboard: fix exception in get_smart_data_by_daemon

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: p-se <pseidensal@suse.com>
2020-11-30 11:26:38 +01:00
Kefu Chai
563b6a05f5
Merge pull request #38330 from tchaikov/wip-librados-no-reuse
include/rados/librados.h: note that {read,write}_op cannot be reused

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-11-30 18:24:07 +08:00
Ernesto Puerta
264a61efc7
Merge pull request #37994 from s0nea/wip-dashboard-button-panel
mgr/dashboard: refactor the order of buttons shown in forms

Reviewed-by: Courtney Caldwell <ccaldwel@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2020-11-30 11:22:56 +01:00
Kefu Chai
4bcf237003 include/rados/librados.h: note that {read,write}_op cannot be reused
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-11-30 15:02:10 +08:00
Ali Maredia
1bfdd2c1c2
Merge pull request #37503 from TRYTOBE8TME/wip-rgw-sts-web-identity
Wip rgw sts web identity
2020-11-29 11:24:05 -05:00
Kalpesh Pandya
64db3a9aca qa: STS Web Identity task files
This commit comprises of 3 things:
1) Keycloak task (to bring up keycloak in teuthology inorder to execute Assume_Role_With_Web_Identity tests).
2) The required changes for this in s3tests.py which consists of writing some parameters to configuration file.
3) The yaml files which executes these tasks.

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2020-11-29 04:52:19 +05:30
Kefu Chai
fd3c0f905b
Merge pull request #38277 from b-ranto/wip-prom-fixes
mgr/prometheus: Make module more stable

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-28 16:15:30 +08:00
Kefu Chai
8cdc8c73bd
Merge pull request #38286 from votdev/issue_48360_disable_tlsv1
mgr/dashboard: Disable TLS 1.0 and 1.1

Reviewed-by: Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2020-11-28 16:14:03 +08:00
Kefu Chai
d04928cfda
Merge pull request #38321 from rhcs-dashboard/add-dashboard-master
mailmap: add dashboard contributors

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-28 09:26:20 +08:00
Patrick Donnelly
af6c6ace31
Merge PR #38221 into master
* refs/pull/38221/head:
	.github: add mon and mgr labelers

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2020-11-27 13:38:44 -08:00
Ernesto Puerta
1cdc61395a
mailmap: add dashboard contributors
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2020-11-27 20:01:36 +01:00
Nizamudeen A
c5be7e5a9a mgr/dashboard: Change the text 'Login' to 'Log in'
Fixes: https://tracker.ceph.com/issues/48253
Signed-off-by: Nizamudeen A <nia@redhat.com>
2020-11-27 19:03:02 +05:30
Sebastian Wagner
9ab1b5cb65
Merge pull request #38304 from sebastian-philipp/cephadm-inventory-cache-docstring
mgr/cephadm: add docstring describing the HostCache

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2020-11-27 11:10:46 +01:00
Kefu Chai
592920070b
Merge pull request #38078 from zdover23/wip-doc-docs-style-guide-prompts-nov-2020
doc/start: update prompts in documenting-ceph.rst

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-27 14:47:06 +08:00
Kefu Chai
139a6e3692
Merge pull request #38303 from aclamk/wip-bs-types-test-leak
os/bluestore: Fixed memory leak in test

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2020-11-27 14:35:04 +08:00
Kefu Chai
cdc9b5214c
Merge pull request #38058 from lxbsz/rbd_expand11
global: reexpand the config meta just after the fork() is done

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-11-27 14:30:28 +08:00
Kefu Chai
12c2cad5f3
Merge pull request #38240 from ifed01/wip-ifed-is-valid-io-log
blk: log is_valid_io() parameters when unsuccessful.

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2020-11-27 14:23:27 +08:00
Kefu Chai
86931cf580
Merge pull request #38262 from tchaikov/wip-librbd-gcc-10
neorados: use lambda instead of std::mem_fn()

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-11-27 14:22:12 +08:00
Kefu Chai
bc4a8a55dc
Merge pull request #38278 from votdev/fix_cephadm_typo
pybind/mgr/cephadm: Fix various typos

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-11-27 14:21:25 +08:00
Kefu Chai
f792e90374
Merge pull request #38211 from ricardoasmarques/sort-host-device-ls
mgr/orchestrator: Sort 'ceph orch device ls' by host

Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-11-27 14:19:39 +08:00
Kefu Chai
d7f1674b4f
Merge pull request #38138 from batrick/centos-8.2
qa: update centos release to 8.2

Reviewed-by: Yuri Weinstein <yweinste@redhat.com>
2020-11-27 14:18:29 +08:00