Commit Graph

118032 Commits

Author SHA1 Message Date
Courtney Caldwell
065fbf9603 mgr/dashboard: replace cdCopy2ClipboardButton Directive with a component
Replaces Directive-Based copy2ClipboardButton with a Component-based version.
Further replaces all instances of Directive use with Component version.
Similar toastr logic used.
Fixes: https://tracker.ceph.com/issues/44960

Signed-off-by: Courtney Caldwell <ccaldwel@redhat.com>
2020-12-15 11:41:18 -05:00
Neha Ojha
9f80520670 mon, messages: use TOPNSPC::common for crimson compatibility
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-12-15 16:02:15 +00:00
Neha Ojha
f4b3d6b769 mgr/ActivePyModules.cc: don't log config value in get_typed_config
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-12-15 16:02:15 +00:00
Neha Ojha
77932ae49b mon/ConfigMonitor.cc: don't log config values in refresh_config
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-12-15 16:02:15 +00:00
Neha Ojha
19000fad57 mgr: don't add config values to mgr log in config_callback and module_config
The original code has been commented out and left for future debugging
purposes.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-12-15 16:02:15 +00:00
Neha Ojha
a68b459778 mon/ConfigMonitor.cc: don't dump all keys and values in config map
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-12-15 16:02:15 +00:00
Neha Ojha
4b83dfb1f7 mon: don't log "config set" and "config-key set" dispatch and finished messages
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-12-15 16:02:15 +00:00
Neha Ojha
3d54660ca1 messages/MMonCommand, MMonCommandAck: don't log values for "config set" and "config-key set"
This acts like a big hammer to avoid adding sensitive information, like passwords
into mon/mgr/cluster logs when using "config set" and "config-key set" to set keys
whose values should be secure.

Fixes: https://tracker.ceph.com/issues/37503
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-12-15 16:02:06 +00:00
Casey Bodley
71b485f096
Merge pull request #38010 from cbodley/wip-rgw-doc-reshard-syncstop
doc/rgw: update reshard design regarding 'bucket sync disable'

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2020-12-15 08:51:07 -05:00
Kefu Chai
32921b7003
Merge pull request #38585 from tchaikov/wip-doc-dev-errorator
doc/dev/crimson: highlight code blocks using C++ lexer

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-15 20:28:57 +08:00
Kefu Chai
28408bb50f
Merge pull request #38582 from tchaikov/wip-crimson-cleanup
crimson/osd: cleanups

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-15 20:26:52 +08:00
Kefu Chai
c03415caf1 doc/dev/crimson: quote inline codeblock using "``"
backquote is used for quoting italic typed text.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 17:50:43 +08:00
Kefu Chai
370f04fa82 doc/dev/crimson: highlight code blocks using C++ lexer
also remove redundant ":", normally "::" would suffice to start a
codeblock.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 17:48:02 +08:00
Kefu Chai
cc9a63ab57 crimson/osd: handle error using handle_error()
no need to use safe_then() for this purpose.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 17:21:10 +08:00
Kefu Chai
7ab794971d crimson/osd: do not use __func__ in lambda
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 17:15:17 +08:00
Kefu Chai
474ddbfe27 crimson/osd: drop log messages only for debugging
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 17:15:17 +08:00
Kefu Chai
5b1b050750 crimson/osd: do not capture dup variable
first can be deduced by variable already captured, so store it as a
local variable. it's less expensive than storing it as a captured
variable.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 17:15:17 +08:00
Kefu Chai
feea66b30b crimson/osd: do not use do_with() unless necessary
in this change, a seastar::do_with() is removed, as the captured
variables are passed to submit_push_data() by value. so no need to keep
them alive after the call.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 17:15:17 +08:00
Kefu Chai
e683404caf crimson/osd: let trim_pushed_data() return extents
trim_pushed_data() is responsible for building up the extents to be used
for pushing. so let it return the extents.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 17:15:17 +08:00
Kefu Chai
d346c526b1 crimson/osd: use range-based for loop
also add comment explaining
ReplicatedRecoveryBackend::trim_pushed_data()

and move the definition of local variable closer to where it is used.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 17:15:17 +08:00
Mykola Golub
6828213a11
Merge pull request #38539 from dillaman/wip-48526
librbd/object_map: don't assert if a snapshot doesn't exist

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-15 11:00:08 +02:00
Yingxin Cheng
2015d5b3da crimson/net: abort on-going v1 protocol when closed
Fixes: http://tracker.ceph.com/issues/48108
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-12-15 15:55:05 +08:00
Yingxin Cheng
9cb8f90307 crimson/net: track closing connections for v1
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-12-15 15:51:01 +08:00
Yingxin Cheng
9856769098 crimson/net: report unexpected exceptions during closing
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-12-15 15:48:43 +08:00
Yingxin Cheng
eabd41ac2c crimson/net: assert connection gate is not unexpectedly closed
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-12-15 15:45:52 +08:00
Yingxin Cheng
795dca10f2 crimson/net: fix test error report
Report unexpected exceptions before destructing the tests.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-12-15 15:42:02 +08:00
Kefu Chai
0b03c58b24
Merge pull request #38570 from rzarzynski/wip-crimson-recover_missing-noopt
crimson/osd: recover_missing() doesn't return std::optional anymore.

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-15 15:14:53 +08:00
Kefu Chai
fe126d34b5
Merge pull request #38569 from tchaikov/wip-crimson-cleanups
crimson/osd: cleanups

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2020-12-15 14:08:04 +08:00
Tim Serong
c6cb0f3383
Merge pull request #38525 from varshar16/wip-ls-nfs-services
mgr/rook: Fix various 'orch ls' issues

Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
2020-12-15 16:48:57 +11:00
Tim Serong
11006fd325
Merge pull request #38557 from pcuzner/bootstrap-allocate-output-dir
cephadm: create default output dir during bootstrap

Reviewed-by: Tim Serong <tserong@suse.com>
2020-12-15 16:43:03 +11:00
Kefu Chai
a2865143a4
Merge pull request #38577 from athanatos/sjust/wip-fix-crimson-nbd
crimson/tools: fix bugs introduced in 3333ff

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-15 13:28:44 +08:00
Aashish Sharma
10e911aad4 mgr/dashboard: new generic HTTP error page component
Added a generic Error component for HTTP Errors such as 404,403,501

Fixes:https://tracker.ceph.com/issues/39128
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2020-12-15 10:05:32 +05:30
Yingxin Cheng
4f8d2871de crimson/onode-staged-tree: fix match_stage_t related compile issue
Change the type to int8_t for potential negative value when
substantiating the templates.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2020-12-15 11:52:00 +08:00
Samuel Just
68b61b3497 crimson/tools: fix bugs introduced in 3333ff
You can't actually mix buffered and direct io on a stream.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-15 03:04:17 +00:00
Kefu Chai
8fc5c0a3f3
Merge pull request #38572 from rzarzynski/wip-crimson-obc-not-blocker
crimson/osd: ObjectContext is not a Blocker anymore.

Reviewed-by: Samuel Just <sjust@redhat.com>
2020-12-15 09:09:45 +08:00
Kefu Chai
64b9f850f3
Merge pull request #38563 from tchaikov/wip-admin-breathe
admin/doc-requirements.txt: require breathe >= 4.20

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-12-15 09:07:12 +08:00
Kefu Chai
8fc74bc47c
Merge pull request #38567 from rzarzynski/wip-doc-dev-errorator
doc/dev/crimson: exemplify errorator usage in error-handling.rst

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-15 09:04:20 +08:00
Kefu Chai
de92b80084 messages,osd,crimson: let MOSDPGPull::take_pulls() return pulls
so the caller can grab the pulls without creating a pull vector first.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 09:01:44 +08:00
Kefu Chai
2f88d7fbd4 crimson/osd: let build_push_op() return PushOp
for better readability

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 09:01:44 +08:00
Samuel Just
591a455498
Merge pull request #38111 from ronen-fr/wip-ronenf-scrub-v2
osd: Extracting scrub-related code from the PG & friends

Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2020-12-14 14:29:26 -08:00
Jason Dillaman
fb69efc6c1 rbd-mirror: validate that remote start snapshot still exists
Perform a basic sanity check to verify that the remote start snapshot
still exists. This was previosly being deleted as part of the unlink
process due to a race condition between the remote side completing
a sync between snapshots 1 and 2 and snapshot 2 being unlinked due
to reaching max snapshots.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-14 15:59:40 -05:00
Samuel Just
739f599019
Merge pull request #38566 from tchaikov/crimson-tools
crimson/tools: use helpers from byteorder.hh

Reviewed-by: Samuel Just <sjust@redhat.com>
2020-12-14 12:19:16 -08:00
Samuel Just
883c4b4b3d
Merge pull request #38565 from tchaikov/wip-crimson-cmake
cmake: add alien::cflags and move SubProcess.cc into crimson-alien-common

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2020-12-14 12:17:11 -08:00
Paul Cuzner
9ef60e9111 cephadm: update permissions on newly created dirs
Use 755 instead of 700 on new directories created during
bootstrap

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2020-12-15 09:12:36 +13:00
Radoslaw Zarzynski
54bc1bd5d4 crimson/osd: ObjectContext is not a Blocker anymore.
This is a follow-up to the c2dc437f78cd8be393c4d2eb8d79ce9c351ec4de
which removes unused OBC mebers after the with_lock() transition.

I'm not sure there is a reason to keep the `Blocker` bits as all
`ObjectContext::dump_detail()` does is just dumping `object_state_t`
while entering the OBC stage is already denoted by `PGPipeline::get_obc`.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-14 19:33:35 +01:00
Radoslaw Zarzynski
151d9b8895 crimson/osd: recover_missing() doesn't return std::optional anymore.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-14 18:55:43 +01:00
Kefu Chai
4fe5665403 cmake: add "alien::cflags" library
which exposes the definitions needed for building alienized bluestore
and the shared facilities compiled with -DWITH_ALIEN and -DWITH_SEASTAR

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 01:55:38 +08:00
Kefu Chai
ff9cc3b44c cmake: move SubProcess.cc from crimson-common to crimson-alien-common
SubProcess is used by blkdev.cc only

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 01:55:38 +08:00
Kefu Chai
7b2ab64ed0 crimson/osd: let prep_push() return a map of PushOp
ReplicatedRecoveryBackend::prep_push() is responsible for building
PushOps, so it's more natural to let it return a map of PushOp.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 01:47:18 +08:00
Kefu Chai
b030f717e0 crimson/osd: move unrelated continuation out of do_with()
if the variables held by do_with() is not used by the continuation, and
the continuation does not depend on the other continuations called in
the do_with(), let's move it out for smaller lexical scope. and hence
better readability.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-15 01:47:17 +08:00