Commit Graph

120460 Commits

Author SHA1 Message Date
Daniel Gryniewicz
26670586c0 RGW Zipper - Meta list API
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2021-03-02 07:35:05 -05:00
Daniel Gryniewicz
69dc092bfe RGW Zipper - zipify RGWUserAdminOpState
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2021-03-02 07:35:05 -05:00
Daniel Gryniewicz
715a026d12 RGW Zipper - Clean up get_user* APIs.
The main get_user() function doesn't query the cluster, but the rest of
them do.  Rename the functions to match, and add comments to clarify.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2021-03-02 07:35:05 -05:00
Daniel Gryniewicz
b67d5bca22 Zipper - zipperify the Auth code
This also removes the only user of s->sysobj_ctx, so that can be removed
as well.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2021-03-02 07:35:05 -05:00
Daniel Gryniewicz
a3f1d9dae1 Zipper - remove duplicate get_user()
Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2021-03-02 07:35:05 -05:00
Daniel Gryniewicz
72d1a36326 RGW - Zipper 10: Pull The Thread
This commit changes the RGWStoreManager to return a RGWStore* rather
than a RGWRadosStore*.  This is the thread that unravels the rest of the
Zipper work, removing hard-coded uses of the RGWRados* classes.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2021-03-02 07:35:05 -05:00
Kefu Chai
957653d1b2
Merge pull request #39779 from tchaikov/wip-crimson-monc-cleanup
crimson/mon: resend mon command when connected and cleanups

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-03-02 20:32:25 +08:00
Kefu Chai
195c5bb962 crimson/os: return an errorator::future in an erroratorized chain
errorator does not convert a "void" continuation to a ready future at
the time of writing.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:55:50 +08:00
Kefu Chai
c951ec3eb2 crimson/os: capture structured binding labels with new variable
structured binding does not define variables. unlike GCC, Clang does
not allow this.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:54:14 +08:00
Kefu Chai
cec783344e crimson/os: mark unused variable with [[maybe_unused]]
`MAX_FLAT_BLOCK_SIZE` is only used in Debug builds.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:54:14 +08:00
Kefu Chai
50f29bf2b7 crimson/os: do not capture unused variables
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:54:13 +08:00
Ernesto Puerta
206f9f2ea1
mgr/dashboard: report mgr fsid
Add mgr fsid from the ceph mgr API.

Fixes: https://tracker.ceph.com/issues/49283
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2021-03-02 12:51:29 +01:00
Yuval Lifshitz
9975472244 rgw/notification: fixing the "persistent=false" flag
when setting "persistent=false" a non persistent
topic should be created

Fixes: https://tracker.ceph.com/issues/49552

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2021-03-02 13:42:45 +02:00
Kefu Chai
db9b319aab crimson/mon: do not use futurize_invoke
flatten the call in seastar::futurize_invoke().

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:13:22 +08:00
Rishabh Dave
b2030edc15 qa/vstart_runner: dont log "not Ceph bin" msg too often
The message is logged everytime a binary not from Ceph repo's build
directory is executed, which it too often.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2021-03-02 16:41:09 +05:30
Sebastian Wagner
8287a34aea
Merge pull request #39744 from zdover23/wip-doc-cephadm-install-install-cephadm-rewrite-2021-Feb-28
doc/cephadm: rewrite "install cephadm"

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-03-02 12:05:30 +01:00
Kefu Chai
6b6537d5b1 crimson/mon: let reopen_session() return future<bool>
this change is for improve the readability. to emphasis that the
next steps are performed only if a connection to monitor is
established.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:04:28 +08:00
Kefu Chai
3edaaab493 crimson/mon: use a vector for mon_commands
for smaller memory foot print. as we don't have lots of mon_command in
flight, hence not likely to benefit from a O(log(n)) lookup.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:04:28 +08:00
Kefu Chai
44e45cfc76 crimson/mon: resend mon command when session established
this behavior matches that of `MonClient::_resend_mon_commands()`. so
far the only user which sends mon command in crimson is
`OSD::_add_me_to_crush()`, but there is still (rare) chance that the connected
monitor cannot be reached when we send the command to it, in that case,
we should retry when the connection is re-established.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:04:28 +08:00
Kefu Chai
d30e4c2318 crimson/mon: pass a string to Client::run_command()
as the reason why MMonCommand uses a vector is but for legacy reasons,
there is no need to expose this via the interface.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:04:28 +08:00
Kefu Chai
3a9fd7d711 crimson/mon: move keyring and sub renewals into on_session_opened()
both of them fall into the category of jobs which we should do after
the connection to monitor is established.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:04:28 +08:00
Kefu Chai
e971624d77 crimson/mon: let on_session_opened() return a future
so we can expand its responsibility to perform some async calls.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:04:28 +08:00
Kefu Chai
94a8772afe crimson/mon: s/send_pendings/on_session_opened/
will use this method also for sending requests which are not acked

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:04:28 +08:00
Kefu Chai
aea159c626 crimson/mon: pending_messages should not be empty if active_conn
we always send all pending_messages, and clear it when establishing a
connection to mon, so there is no need to check for it when calling
`send_message()`.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:04:28 +08:00
Kefu Chai
83d2e322a3 crimson/mon: check for active_con before calling send_pendings()
before this change, we guard the `send_pendings()` call only in
`Client::send_message()`, after this change, all of the
`send_pendings()` calls are guarded with this check.

more consistent this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-03-02 19:04:28 +08:00
Sebastian Wagner
90f908a84d
Merge pull request #39760 from zdover23/wip-doc-cephadm-install-bootstrap-rewrite-2021-Mar-01
doc/cephadm: rewrite "b.strap a new cluster"

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-03-02 11:46:08 +01:00
Kefu Chai
5a50d986f4
Merge pull request #39685 from tchaikov/wip-mgr-dashboard-requests
pybind/mgr/dashboard: bump up requests to 2.25.1

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2021-03-02 18:31:39 +08:00
Milind Changire
7e7d9e4a41 mds/client: create cephfs errno aliases
Replace system errno macros with cephfs aliases

Fixes: https://tracker.ceph.com/issues/48802
Signed-off-by: Milind Changire <mchangir@redhat.com>
2021-03-02 14:43:45 +05:30
Kefu Chai
4d0273d7fc
Merge pull request #39673 from rzarzynski/wip-crimson-drop-protocol-v1
crimson: drop the support of ProtocolV1

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-02 12:44:31 +08:00
Kefu Chai
005b836f2d
Merge pull request #39768 from rzarzynski/wip-crimson-monc-renew-subs
crimson/monc: renew subscriptions when reopening a session.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-03-02 11:25:26 +08:00
Josh Durgin
6ce7048a3f
Merge pull request #39718 from zdover23/wip-doc-dev-t8y-label-in-toc-2021-Feb-26
doc/dev: add t8y label to index.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-03-01 16:26:46 -08:00
Brad Hubbard
08af21c9c0
Merge pull request #39601 from badone/wip-ceph_test_rados_api_watch_notify-enoent-failure
tests: ceph_test_rados_api_watch_notify: Allow for reconnect

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-03-02 08:10:10 +10:00
Radoslaw Zarzynski
2eaa5ac501 crimson/monc: renew subscriptions when reopening a session.
Lack of this feature was the root cause of an issue in
teuthology testing in which a socket failure injection
happened exactly during `mon_subscribe`; after the OSD
reconnected, the message hasn't been resent and entire
boot process has frozen.

```
DEBUG 2021-02-25 11:42:53,757 [shard 0] ms - [osd.2(client) v2:172.21.15.204:6804/33459@57376 >> mon.0 v2:172.21.15.204:3300/0] --> #6 === mon_subscribe({osdmap=1}) v3
(15)
DEBUG 2021-02-25 11:42:53,757 [shard 0] ms - authenticated_encrypt_update plaintext.length()=80 buffer.length()=80
DEBUG 2021-02-25 11:42:53,757 [shard 0] ms - authenticated_encrypt_final buffer.length()=96 final_len=0
DEBUG 2021-02-25 11:42:53,757 [shard 0] ms - authenticated_encrypt_update plaintext.length()=48 buffer.length()=48
DEBUG 2021-02-25 11:42:53,757 [shard 0] ms - authenticated_encrypt_update plaintext.length()=16 buffer.length()=64
DEBUG 2021-02-25 11:42:53,757 [shard 0] ms - authenticated_encrypt_final buffer.length()=80 final_len=0
INFO  2021-02-25 11:42:53,758 [shard 0] ms - [osd.2(client) v2:172.21.15.204:6804/33459@57376 >> mon.0 v2:172.21.15.204:3300/0] execute_ready(): fault at READY on lossy
 channel, going to CLOSING -- std::system_error (error crimson::net:4, read eof)
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-03-01 21:29:43 +00:00
Nathan Cutler
f27484e84c rpm/luarocks: simplify conditional and support Leap 15.3
The luarocks conditional had gotten hard to read, and the openSUSE Leap 15.3
build needs lua53 as well.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2021-03-01 21:20:45 +01:00
Patrick Donnelly
c991e28a92
Merge PR #39680 into master
* refs/pull/39680/head:
	mds: allow `fs authorize` command to work

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-03-01 12:07:32 -08:00
Patrick Donnelly
4a6b11ac49
Merge PR #39710 into master
* refs/pull/39710/head:
	qa: run fs:verify on all distros

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-03-01 12:05:47 -08:00
Patrick Donnelly
944e2e8c5e
Merge PR #39725 into master
* refs/pull/39725/head:
	qa: delete all fs during tearDown

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-03-01 11:35:58 -08:00
Zac Dover
1b626b9895 doc/cephadm: rewrite "install cephadm"
This PR breaks the "Deploying a New Ceph Cluster"
section into several sub-sections, so that each sub-section
pertains to only one subject. I've also added some explanatory
text that puts the instructions into context more than they were
before.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-03-02 05:06:00 +10:00
Jason Dillaman
03cf50fe82
Merge pull request #39732 from mychoxin/resolve_compile_error
test/librbd: resolve compile error on centos

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-03-01 13:25:25 -05:00
Jason Dillaman
2bda8970e1
Merge pull request #39731 from mychoxin/use_unified_zero_func
rbd: use portable zero-ing memory function

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-03-01 13:24:46 -05:00
Zac Dover
2ec313caba doc/cephadm: rewrite "b.strap a new cluster"
This PR rewrites the section "Bootstrap A New
Cluster" in the Cephadm Guide, in the Install
Chapter. I've broken this section up into what
seem to me to be the topics that the content
naturally divides into.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-03-02 04:20:35 +10:00
Sage Weil
576823bcb6 cephadm: set CEPH_USE_RANDOM_NONCE if using --init
This ensures that daemon messenger nonces don't collide by using PIDs that are
no longer unique for the IP address.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-01 11:27:22 -05:00
Sage Weil
d18f60854e msg/Messenger: use random nonce if CEPH_USE_RANDOM_NONCE or pid == 1
If we are in a container, then we do not have a unique pid, and need to
use a random nonce.  We normally detect this if our pid is 1, but that
doesn't work when we have a init process--we'll (probably?) have a small
pid (in my tests, the OSDs were getting pid 7).

To be safe, also check for an environment variable set by cephadm.

This avoids problems that arise when we don't have a unique address.

Fixes: https://tracker.ceph.com/issues/49534
Signed-off-by: Sage Weil <sage@newdream.net>
2021-03-01 11:27:18 -05:00
Sage Weil
a16e46ef05 Revert "Merge PR #39482 into master"
This reverts commit 9200b1ea8e, reversing
changes made to e42bbba9ca.

For running tests to narrow down the root cause of:
https://tracker.ceph.com/issues/49237

Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-03-01 11:27:18 -05:00
Sebastian Wagner
0f22f24a35 mgr/test_orchestrator: Refactor create_osds
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-03-01 16:50:42 +01:00
Sebastian Wagner
a455dff412 mgr/volumes: adapt to now orch interface
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-03-01 16:50:42 +01:00
Sebastian Wagner
d529f1db82 doc/mgr/orchestrator_modules: adapt to now orch interface
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-03-01 16:50:42 +01:00
Sebastian Wagner
828992d7fe mgr/selftest: adapt to now orch interface
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-03-01 16:50:42 +01:00
Sebastian Wagner
b92dc71205 mgr/dashboard: adapt to now orch interface
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-03-01 16:50:42 +01:00
Sebastian Wagner
bca36ab3cf mgr/mds_autoscaler: Add to tox.ini
Fixes: f69abe6291
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-03-01 16:50:42 +01:00