Commit Graph

129568 Commits

Author SHA1 Message Date
Anthony D'Atri
e5b9173836
Merge pull request #44898 from taggelos/patch-1
doc/man/8: Fix spelling in user rename example
2022-02-12 02:52:16 -08:00
Yuri Weinstein
1ead2229ae
Merge pull request #44780 from sosodev/dump-blocked-ops-count
mds, osd: add dump_blocked_ops_count command

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-02-11 14:51:00 -08:00
Yuri Weinstein
66e651ce3c
Merge pull request #44752 from NitzanMordhai/wip-nitzan-osd-status
pybind/mgr: ceph osd status crash with ZeroDivisionError

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-02-11 14:50:31 -08:00
Yuri Weinstein
2624f51a72
Merge pull request #44588 from kamoltat/wip-ksirivad-disable-progress-by-default
pybind/mgr/progress: disable pg recovery event by default

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-02-11 14:49:17 -08:00
Yuri Weinstein
0549f3b07b
Merge pull request #44289 from Vicente-Cheng/fix-outgoing-bl-overflow
msg/async: fix outgoing_bl overflow and reset state_offset

Reviewed-by: Kefu Chai <kchai@redhat.com>
2022-02-11 14:48:18 -08:00
Samuel Just
ec2fb479f4
Merge pull request #44809 from cyx1231st/wip-crimson-cleanup-epm
crimson/os/seastore: allow EPM to make decisions on the general allocation path

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2022-02-11 13:36:57 -08:00
Sarthak0702
db3eb10fa1
Merge pull request #44849 from rhcs-dashboard/bugfix-cephfs-invalid-dir-permission
mgr/dashboard: Directories Menu Can't Use on Ceph File System Dashboard
2022-02-11 15:29:20 +05:30
Venky Shankar
4c78eb81ad
Merge pull request #44970 from kotreshhr/fix-clone-uid-gid
mgr/volumes: Fix clone uid/gid mismatch

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-11 13:11:24 +05:30
Yingxin Cheng
cc5619ff10 crimson/os/seastore: misc log improvements
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-11 09:51:58 +08:00
Yingxin Cheng
3b54d41c78 crimson/os/seastore: initialize segment_info_t correctly when open/empty
Previously, segment_info_t was not initialized for out-of-line segments
when open, including journal_segment_seq and the legacy out_of_line.

And the journal_segment_seq was not reset when empty.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-11 09:51:58 +08:00
Yingxin Cheng
1d6d93a6ee crimson/os/seastore: replace out_of_line by segment_type_t
Leverage segment_seq_t to identify the type of the segment.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-11 09:42:45 +08:00
Yingxin Cheng
1446c58acd crimson/os/seastore: cleanup dependency between epm and journal
OOL segments won't contain deltas and don't need to replay. There is no
need to assign segment sequence from journal.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-11 09:26:22 +08:00
Yingxin Cheng
d83627c066 crimson/os/seastore: cleanup dependency between epm and lba_manager
Move lba_manamger->update_mapping() from epm to transaction manager.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-11 09:26:22 +08:00
Yingxin Cheng
cc67f3262d crimson/os/seastore: update_mapping related cleanups
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-11 09:26:22 +08:00
Yingxin Cheng
32da0e0ecb crimson/os/seastore: allow EPM to make decisions on the general extent allocation path
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-11 09:26:22 +08:00
Yingxin Cheng
d483557c56 crimson/os/seastore: drop the unnecessary backend_type in every cached extent
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-11 09:26:22 +08:00
Yingxin Cheng
bcd5c73540 crimson/os/seastore/epm: cleanup unnecessary cache dependency when mark extent ool
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-11 09:26:22 +08:00
Yingxin Cheng
00a27c8fef crimson/os/seastore: cleanup delayed paddr
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-11 09:26:22 +08:00
Samuel Just
5f252053d8
Merge pull request #44968 from cyx1231st/wip-crimson-cleanup-cleaner-1
crimson/os/seastore/segment_cleaner: minor cleanups

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2022-02-10 14:45:59 -08:00
Neha Ojha
7809ff5cc0
Merge pull request #44964 from yaarith/pending-release-notes-perf
PendingReleaseNotes: add a note about perf channel

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-02-10 14:40:38 -08:00
Neha Ojha
fc54d1a616
Merge pull request #44963 from ljflores/wip-peering-state-docs
doc/dev: add section on using the gen_state_diagram.py script

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-02-10 14:07:31 -08:00
Laura Flores
b544e6986c doc/dev: add section on using the gen_state_diagram.py script
Commands sourced from Jianshen Liu's blog post on the Ceph peering state machine: https://jianshenliu.com/blog/development/ceph-peering-state-machine/

Also fixed the formatting of "PG info".

Signed-off-by: Laura Flores <lflores@redhat.com>
2022-02-10 09:12:05 -06:00
Guillaume Abrioux
2bd3dd512a
Merge pull request #44765 from guits/guits-fix-cve-cv
ceph-volume: honour osd_dmcrypt_key_size option
2022-02-10 13:38:13 +01:00
Ernesto Puerta
f1dcdf4356
Merge pull request #44808 from rhcs-dashboard/support-snmp-service-creation
mgr/dashboard: support snmp-gateway service creation from UI

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>
2022-02-10 12:54:00 +01:00
Kotresh HR
b3c9e6b50c mgr/volumes: Fix clone uid/gid mismatch
This is the regression caused by commit 18b85c53a.
The 'set_attrs' function sets the uid/gid of the
group to the subvolume if uid/gid is not passed.
The attrs of the clone should match the source
snapshot. Hence, don't use the 'set_attrs'
function to set only the quota attrs for the
clone.

Fixes: https://tracker.ceph.com/issues/54066
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-02-10 15:16:22 +05:30
Venky Shankar
236fcc32af
Merge pull request #44953 from aejv/spellingerror
purge_queue.py: fixed typo

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-10 12:21:47 +05:30
Yingxin Cheng
d352970d61 crimson/os/seastore/segment_cleaner: mark get_next_gc_target() private
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-10 13:22:10 +08:00
Yingxin Cheng
b81b0e4796 crimson/os/seastore/segment_cleaner: make init_mark_segment_closed() private
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-10 13:22:10 +08:00
Yingxin Cheng
f241023393 crimson/os/seastore/segment_cleaner: drop unused code
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-10 13:09:44 +08:00
Yingxin Cheng
7907253147 crimson/net/socket: add a missing header
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-02-10 13:09:44 +08:00
Guillaume Abrioux
5ac1ec65cb ceph-volume/activate: load the config from lv tag
When `ceph-volume lvm trigger` is called with an OSD where the tag
`ceph.cluster_name` is not 'ceph', it fails.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-02-10 02:46:59 +01:00
Guillaume Abrioux
2b793952bb ceph-volume/tests: use centos/stream8 images
Since recent move from CentOS 8 to CentOS Stream 8, let's do the same here.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-02-10 02:39:47 +01:00
Guillaume Abrioux
db48850745 ceph-volume/tests: add tests in util/encryption.py
this adds some unit tests in order to cover `luks_format()` and `luks_open()`
in `util/encryption.py`.

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-02-10 02:39:45 +01:00
Guillaume Abrioux
47c33179f9 ceph-volume: honour osd_dmcrypt_key_size option
ceph-volume doesn't honour osd_dmcrypt_key_size.
It means the default size is always applied.

It also changes the default value in `get_key_size_from_conf()`

From cryptsetup manpage:

> For XTS mode you can optionally set a key size of 512 bits with the -s option.

Using more than 512bits will end up with the following error message:

```
Key size in XTS mode must be 256 or 512 bits.
```

Fixes: https://tracker.ceph.com/issues/54006

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-02-10 02:39:03 +01:00
Yaarit Hatuka
85f4b5b839 PendingReleaseNotes: add a note about perf channel
Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-02-09 21:48:51 +00:00
Ernesto Puerta
f5b79d7e6b
Merge pull request #44956 from rhcs-dashboard/appli-fix
mgr/dashboard: change the readFile to readFileSync

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-02-09 20:44:55 +01:00
Casey Bodley
2f6f32bd9c
Merge pull request #44939 from soumyakoduri/wip-skoduri-dbstore-tests
rgw/dbstore: Add dbstore-tests to `make check`

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-02-09 13:01:22 -05:00
Nizamudeen A
cbfdd551d9 mgr/dashboard: change the readFile to readFileSync
Apparently the readFile i added in #44934 is async and that's not what
we want. so changing it to the synchronous call that is readFileSync

Fixes: https://tracker.ceph.com/issues/54190
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-02-09 22:08:09 +05:30
Patrick Donnelly
e883dc3b82
Merge PR #42000 into master
* refs/pull/42000/head:
	qa: update rhel kclient to setup container tools
	qa: stop overriding distro for k-testing
	qa: only use RHEL for workload testing
	qa: convert fs:workload to use cephadm
	qa: split fs begin task
	qa/tasks/cephadm: setup CephManager when OSDs are provisioned
	qa/tasks/cephadm: setup file system if MDS are provisioned

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-09 09:34:49 -05:00
Judah van der Ster
bb78fb51a3 purge_queue.py: fixed typo
Signed-off-by: Judah van der Ster <jevanderster@gmail.com>
2022-02-09 15:25:58 +01:00
Ilya Dryomov
1a06950c17
Merge pull request #44937 from idryomov/wip-rbd-help-positional-optional
rbd: mark optional positional arguments as such in help output

Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-02-09 15:08:58 +01:00
Casey Bodley
682fe1267e
Merge pull request #44492 from xijiacun/master
rgw: Erase old storage class attr when the object is rewrited using r…

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-02-09 08:37:35 -05:00
Sarthak0702
ea1af5438d mgr/dashboard:Directories Menu Can't Use on Ceph File System Dashboard
Added exception handling to opendir() in cephfs.py for directories with no execute permission.

Fixes: https://tracker.ceph.com/issues/51611
Signed-off-by: Sarthak0702 <sarthak.0702@gmail.com>
2022-02-09 17:29:37 +05:30
Avan Thakkar
76dcf6a881 mgr/dashboard: add snmp-gateway service e2e tests
Fixes: https://tracker.ceph.com/issues/54034
Signed-off-by: Avan Thakkar <athakkar@redhat.com>
2022-02-09 16:50:07 +05:30
Ernesto Puerta
97c2760d10
Merge pull request #44934 from rhcs-dashboard/applitools-baseline-branch
mgr/dashboard: set appropriate baseline branch for applitools 

Reviewed-by: aaryanporwal <NOT@FOUND>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-02-09 12:05:21 +01:00
Soumya Koduri
5b91ca9d48 rgw/dbstore: Add dbstore-tests to make check
Include and run dbstore-tests as part of `make check` target

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2022-02-09 15:16:34 +05:30
Nizamudeen A
40c902ac59 mgr/dashboard: set appropriate baseline branch for applitools
All the dashboard PRs are checked against a baseline branch called
'default' in the visual regresstion testing. This will cause issues when
testing PRs in different branches. For eg: currently our master and
pacific has to save two different screenshots since the two of them
differ slightly.

Disabling the applitools logs as well because its too 'noisy'

Fixes: https://tracker.ceph.com/issues/54190
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-02-09 11:46:21 +05:30
Venky Shankar
e15a52997b
Merge pull request #44477 from SMIL-Infra/fix-expire_recursive-segfault
mds: fix seg fault in expire_recursive

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-09 11:38:58 +05:30
Venky Shankar
f33030c074
Merge pull request #44638 from yunfeiguan/wip-53911
mds: kill session state are open when mds do ms_handle_remote_reset

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-09 11:37:20 +05:30
Venky Shankar
b7af2a94a4
Merge pull request #42549 from ajarr/wip-add-volume-rename
mgr/volumes: Add `fs volume rename` command

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-09 11:34:32 +05:30