Commit Graph

117518 Commits

Author SHA1 Message Date
Radoslaw Zarzynski
a44b937b2c tests: modernize all occurrences of rand_choose().
We should consider deduplication as well.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:15 +01:00
Radoslaw Zarzynski
d3e4e6ca0e crimson/tests: add unittesting for backfill.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:15 +01:00
Radoslaw Zarzynski
b34647b18c crimson/osd: drop unnecessary includes from backfill_state.{cc,h}.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:15 +01:00
Radoslaw Zarzynski
670c433050 crimson/osd: do not refence PGLog in BackfillState.
This commit makes the backfill code unware about pg log
implementation details. The benefit is easier unit testing.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:22:15 +01:00
Radoslaw Zarzynski
eaa1e967da crimson/osd: drop the depedency on pg_info_t from PGFacade.
`get_info()` gets replaced with `get_last_update() and
`get_log_tail()`. This entirely removes the awareness of
`pg_info_t` in the backfill code.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:21:56 +01:00
Radoslaw Zarzynski
649e83e2ec crimson/osd: replace get_peer_info() in BackfillState::PGFacade.
`get_peer_info()` gets replaced with `get_peer_last_backfill()`.
The benefit is no need to mock peer's `pg_info_t` in unit test.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-01 13:20:15 +01:00
Kefu Chai
94488f911a doc/conf: find the latest stable release in releases.yml
instead of hardwiring the "|stable-release|" to "octopus" use the latest
release name found in 'doc/releases/releases.yml'

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-01 15:41:45 +08:00
Kefu Chai
beb218c41d doc/conf: read version and release from src/ceph_release
instead of hardwiring them to 'dev' and 'dev', use the src/ceph_release
as the source of truth.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-01 15:41:45 +08:00
Kefu Chai
be26c566e5 doc: remove edit_on_github sphinx extension
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-01 15:41:45 +08:00
zhangjiao
8d796acb40 pybind/test_rados: test remove_omap_range2()
Signed-off-by: Zhang Jiao <zhangjiao_yewu@cmss.chinamobile.com>
2020-12-01 15:36:00 +08:00
Avan Thakkar
5d65089469 mgr/dashboard: SSO not working after REST API versioning
Fixes: https://tracker.ceph.com/issues/48362

Signed-off-by: Avan Thakkar <athakkar@redhat.com>

saml2: Fix versioning parameter for saml2 endpoints, including minor fix for
endpoints with xml=true
2020-12-01 12:14:38 +05:30
Xiubo Li
51e4c7caf2 doc/mds: fix the default value for mds_dir_max_commit_size
The default value has changed to 10MB.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-01 14:42:43 +08:00
Xiubo Li
503b7bd995 mds/CDir: make the data length as long as possible for each op
The max_write_size is 10M as default, and every time when the len
of the op data exceed it with a very small size it will be split
into two ops, one of which will always be very small.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-01 12:36:34 +08:00
Xiubo Li
4d09ebce0d mds/CDir: correct the write_size
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-12-01 12:33:07 +08:00
Patrick Donnelly
5c9fbc7948
Merge PR #38093 into master
* refs/pull/38093/head:
	qa: add debug information for client address for kclient
	qa/kernel_mount.py: rename _read_debug_file to read_debug_file

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-11-30 20:04:18 -08:00
Patrick Donnelly
63ab00e1df
Merge PR #38083 into master
* refs/pull/38083/head:
	mds: don't access mds->mdsmap without holding mds_lock

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-11-30 19:46:03 -08:00
Abutalib Aghayev
3895e3720b os/bluestore: Introduce plumbing necessary for garbage collecting zones.
Signed-off-by: Abutalib Aghayev <agayev@psu.edu>
2020-11-30 22:10:15 -05:00
myoungwon oh
b7c09a8f9f osd: remove unused bufferlist
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsumg.com>
2020-12-01 11:43:34 +09:00
Brad Hubbard
effe296b42
Merge pull request #38315 from badone/wip-mon-scrub-testing
Test mon scrub and exercise mon scrub error injectors

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-12-01 11:59:47 +10:00
Yingxin Cheng
659420c64c crimson/net: ms_dispatch() use ConnectionRef
The future returned by ms_dispatch() is only for throttling, not for
Connection lifecycle management. And Messenger may not hold the
connection reference once it is closed.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-12-01 09:34:42 +08:00
Yingxin Cheng
200244520f crimson/test: implement get_server_addr()
So we can distinguish which messenger test is still pending when we have
bind failure.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-12-01 09:34:42 +08:00
Yingxin Cheng
4698d3f001 crimson/net: avoid using finally
Messenger will only throw unexpected exceptions when there is a bug. In
that case, we should not do any further operations which may result in
segmentation fault and hide the original exception.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-12-01 09:34:42 +08:00
Yingxin Cheng
44585adc78 crimson/net: make bind()/try_bind() return errorated future
Also fixed callers to handle the error: abort immediately upon bind
failure and report error. Previously, these callers didn't handle bind
failures correctly and would result in misleading undefined behaviors.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-12-01 09:34:42 +08:00
Yingxin Cheng
5d251fc592 crimson/osd: fix incorrect header
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-12-01 09:34:42 +08:00
Yingxin Cheng
ff2c3b597d crimson/net: cleanup interfaces to start and stop a messenger
There is no on-going iterations in the new
ChainedDispatchers::ms_dispatch() implementation, so we no longer need
to worry about removing dispatchers when stopping the messenger. So the
""boost::intrusive::slist" is not needed, and we can use cleaner
interfaces to start and stop the messenger.

Also fixed an regression issue in perf_crimson_msgr caused by
ChainedDispatchers.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-12-01 09:33:29 +08:00
Anthony D'Atri
f7ead5e83a doc/rados/operations: typo in stretch-mode.rst 2020-11-30 15:31:15 -08:00
Kefu Chai
f440f6d297
Merge pull request #38127 from tchaikov/wip-crimson-client-request-wait
crimson/osd: do not wait for sent epoch

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2020-12-01 07:15:49 +08:00
Kefu Chai
c722452c4d
Merge pull request #38203 from tchaikov/wip-doc-build-releases.yaml
doc/conf: generate releases.json in conf.py and cleanups

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-12-01 07:13:34 +08:00
Kefu Chai
be36679b5c
Merge pull request #38239 from tchaikov/wip-48320
mon/OSDMonitor: drop osd_epoch of manually marked out osd

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-12-01 07:13:12 +08:00
Kefu Chai
e59c088e3b
Merge pull request #38281 from tchaikov/wip-mgr-no-kv-options
mgr: do not migrate conf from config-key store to new-style conf

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-01 07:12:43 +08:00
Kefu Chai
1403974039
Merge pull request #38305 from tchaikov/wip-crimson-finally
crimson: fix finally and erroratorize PG::with_*_obc()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2020-12-01 07:11:51 +08:00
Patrick Donnelly
71a0c64000
Merge PR #38248 into master
* refs/pull/38248/head:
	doc: Adding missing Ceph Foundation board members

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-11-30 14:02:36 -08:00
Patrick Donnelly
0615f517cb
librados: initialize rados_mon_op_client
The timeout was not initialized with the current config value during
RadosClient construction.

Fixes a8a23747aa
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-11-30 14:00:58 -08:00
Patrick Donnelly
8c363d195a
librados: add RadosClient to conf observers
Commit 306eebe05b added the RadosClient to
the config observer interface but forgot to add it to the observer list.
This meant that the RadosClient was never receiving callbacks to
handle_conf_change. Commit a8a23747aa
exposed this issue because the mon timeout was configured at run-time.

Fixes: https://tracker.ceph.com/issues/48030
Fixes: a8a23747aa
Fixes: 306eebe05b
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-11-30 11:56:08 -08:00
Jason Dillaman
898ae63141 librbd/migration: use shared_ptr for streams
This will permit proper IO tracking through the stream layer to
ensure streams cannot be closed prematurely.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-11-30 14:33:03 -05:00
Jason Dillaman
d713b2c365
Merge pull request #38313 from wjwithagen/wjw-fix-src-HttpClient.h
librbd: fix Clang warnings

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2020-11-30 10:51:20 -05:00
Ernesto Puerta
7cbb478efc
Merge pull request #38113 from rhcs-dashboard/login-name-cleanup
mgr/dashboard: Change the text 'Login' to 'Log in'

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-11-30 12:15:56 +01:00
Ernesto Puerta
6911e753b4
Merge pull request #38209 from votdev/issue_44404_placement_column
mgr/dashboard: display placement column in service table

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-11-30 11:33:07 +01:00
Ernesto Puerta
4a4d4e75a5
Merge pull request #38163 from bk201/wip-48245
mgr/dashboard: fix exception in get_smart_data_by_daemon

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: p-se <pseidensal@suse.com>
2020-11-30 11:26:38 +01:00
Kefu Chai
563b6a05f5
Merge pull request #38330 from tchaikov/wip-librados-no-reuse
include/rados/librados.h: note that {read,write}_op cannot be reused

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-11-30 18:24:07 +08:00
Ernesto Puerta
264a61efc7
Merge pull request #37994 from s0nea/wip-dashboard-button-panel
mgr/dashboard: refactor the order of buttons shown in forms

Reviewed-by: Courtney Caldwell <ccaldwel@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2020-11-30 11:22:56 +01:00
Kefu Chai
4bcf237003 include/rados/librados.h: note that {read,write}_op cannot be reused
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-11-30 15:02:10 +08:00
Yingxin Cheng
060bcec94e crimson/net: make Dispatcher::ms_dispatch() a pure virtual interface
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-11-30 11:58:22 +08:00
Yingxin Cheng
67c87a3573 crimson/net: link the throttling future in both v1 and v2
The current implementations are correct and will not link the
throttleing future with unrelated futures.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-11-30 11:58:22 +08:00
Xiubo Li
be94c9b524 client: cleanup the handle_mds_map() code
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-11-30 11:01:00 +08:00
Ali Maredia
1bfdd2c1c2
Merge pull request #37503 from TRYTOBE8TME/wip-rgw-sts-web-identity
Wip rgw sts web identity
2020-11-29 11:24:05 -05:00
Adam Kupczyk
b0e2964ac8 os/bluestore: Only pass that decremented nref to 0 deletes object
Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2020-11-29 04:05:01 -05:00
Kalpesh Pandya
64db3a9aca qa: STS Web Identity task files
This commit comprises of 3 things:
1) Keycloak task (to bring up keycloak in teuthology inorder to execute Assume_Role_With_Web_Identity tests).
2) The required changes for this in s3tests.py which consists of writing some parameters to configuration file.
3) The yaml files which executes these tasks.

Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
2020-11-29 04:52:19 +05:30
Willem Jan Withagen
f22cb92d51 nasm-wrapper: Make nasm-wrapper OS independent
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2020-11-28 15:57:14 +01:00
Kefu Chai
fd3c0f905b
Merge pull request #38277 from b-ranto/wip-prom-fixes
mgr/prometheus: Make module more stable

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-11-28 16:15:30 +08:00