Commit Graph

137542 Commits

Author SHA1 Message Date
chunmei
7a673d006d cirmson/os: seperate futurizedStore interface
into futurizedStore and futurizedShardStore
and modification the other parts in osd and objectstore

Signed-off-by: chunmei <chunmei.liu@intel.com>
2023-04-20 19:58:16 +00:00
chunmei
6a121c0852 crimson/seastore: fix heap-used-after-free bug
Signed-off-by: chunmei <chunmei.liu@intel.com>
2023-04-20 18:46:41 +00:00
Nizamudeen A
f79b94300e
Merge pull request #51153 from rhcs-dashboard/applitools-fix
mgr/dashboard: ignore Details card in applitools vrt

Reviewed-by: Pegonzal <NOT@FOUND>
2023-04-20 23:07:48 +05:30
Nizamudeen A
d36d554041
Merge pull request #51163 from rhcs-dashboard/hide-rbd-force-promote-notification
mgr/dashboard: hide notification on force promote

Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-04-20 23:05:45 +05:30
Samuel Just
49bd470185
Merge pull request #50835 from cyx1231st/wip-seastar-adjust-conn-ref
crimson/net: change ConnectionRef to be a local_shared_foreign_ptr

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-04-20 09:09:39 -07:00
Pedro Gonzalez Gomez
abe1e5101c mgr/dashboard: hide notification on force promote
Fixes: https://tracker.ceph.com/issues/59500
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2023-04-20 17:31:52 +02:00
Rishabh Dave
ac9ca5d14b
Merge pull request #51127 from rishabh-d-dave/fs-qa-caps_helper-bug
qa/cephfs/caps_helper: fix a bug in methods that generate cap string

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-04-20 19:27:19 +05:30
Rishabh Dave
9be6de9185
Merge pull request #50882 from rishabh-d-dave/fs-qa-CapTester
qa/cephfs: improvements in caps_helper

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-04-20 19:27:02 +05:30
Ilya Dryomov
d13bf0da9f
Merge pull request #51159 from idryomov/wip-rbd-man-filestore
doc/man/rbd: resurrect filestore alloc_size note

Reviewed-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
2023-04-20 12:43:57 +02:00
Ilya Dryomov
d3558c49bf doc/man/rbd: resurrect filestore alloc_size note
Mistakenly removed in commit d79f2a8154 ("docs: warning and remove
few docs section for Filestore Update docs after filestore removal.").
The kernel client, however new, will continue to be able to talk to
FileStore OSDs for as long as they exist.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-20 12:08:40 +02:00
Nizamudeen A
4cd6864014
Merge pull request #50580 from ceph/dependabot-npm_and_yarn-src-pybind-mgr-dashboard-frontend-webpack-and-angular-devkit-build-angular-5.76.1
mgr/dashboard: bump webpack and @angular-devkit/build-angular in /src/pybind/mgr/dashboard/frontend 

Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-04-20 15:37:28 +05:30
Nizamudeen A
f31053b5fa mgr/dashboard: ignore Details card in applitools vrt
because the details card includes the FSID and Ceph Version which can
change on different clusters.

also don't run the 800x600 resolution because for new dashboard it looks
really weird.

Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-04-20 13:10:27 +05:30
zdover23
353a81f362
Merge pull request #51140 from zdover23/wip-doc-2023-04-18-rados-operations-2-of-x
doc/rados: edit user-management (2 of x)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-04-20 08:18:04 +02:00
Zac Dover
e3575bb72f doc/rados: edit user-management (2 of x)
Line-edit doc/rados/user-management.rst (2 of x). Some internal
references had to be removed, but these will be repaired when the next
part of this file is updated in a future PR.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-20 08:09:57 +02:00
zdover23
195262cf6b
Merge pull request #51143 from NitzanMordhai/wip-nitzan-filestore-removal-docs-update
docs: warning and remove few docs section for Filestore

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-04-20 07:42:58 +02:00
Nitzan Mordechai
d79f2a8154 docs: warning and remove few docs section for Filestore
Update docs after filestore removal.

Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2023-04-20 05:01:53 +00:00
Casey Bodley
1c49dc213d
Merge pull request #51068 from cbodley/wip-59269
cmake/rgw: librgw tests depend on ALLOC_LIBS

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-04-19 12:43:53 -04:00
Casey Bodley
5609383d5b
Merge pull request #51031 from cbodley/wip-59423
rgw/aio: fix recursion from tracing changes

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-04-19 11:36:15 -04:00
Yuval Lifshitz
fba5b3f898
Merge pull request #50975 from yuvalif/wip-yuval-fix-59381
rgw/lua: fix CopyFrom crash
2023-04-19 16:30:29 +03:00
Yuval Lifshitz
cfbc2129c6
Merge pull request #50965 from yuvalif/wip-yuval-fix-59383
rgw/kafka: failed to reconnect to broker after idle timeout
2023-04-19 16:29:50 +03:00
Nizamudeen A
eeba8e5f43
Merge pull request #50918 from rhcs-dashboard/delete-ceph-authx
mgr/dashboard: delete-ceph-authx

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-04-19 13:10:57 +05:30
Venky Shankar
6d1eb725be Merge PR #50089 into main
* refs/pull/50089/head:
	doc: add a note for minimum compatible python version and supported distros
	tools/cephfs/top/CMakeList.txt: check the minimum compatible python version for cephfs-top

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-04-19 11:30:54 +05:30
Rishabh Dave
f0ffade052 qa/cephfs/cap_tester: simplify CapTester and its instantiation
Class CapTester contains two distinct immiscible group of methods: one
that tests MON caps and other that tests MDS caps. When using CapTester
for the former reason the instantiation neither needs mount object and
the path where files for testing will be created nor it needs to run the
method that creates files for testing rw permissions. When using
this class for latter the case is the exact opposite.

Create 2 separate classes for each of these purpose and class that
inherits both of these classes so that instantiating the class becomes
as simple as it can be.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-04-18 20:32:15 +05:30
Rishabh Dave
95c6daa45b qa/cephfs: update method caps_helper.CapTester.run_cap_tests()
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-04-18 19:42:55 +05:30
Rishabh Dave
ea9f13e553 qa/cephfs: move few methods such that they can be reused
Move get_mon_cap_from_keyring() and get_fsnmes_from_moncap() from class
CapTester to main namespace of caps_helper.py so that they can be
imported freely and reused by tests.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-04-18 19:42:55 +05:30
Rishabh Dave
ad68a55121 qa/cephfs: improve caps_helper.CapTester.run_mon_cap_tests()
This method checks if the output of the command "ceph fs ls" for client
ID it receives is same as the output printed for client.admin. Don't do
so, limit the test to only checking if "ceph fs ls --id client.x -k
keyring_file" prints fs name for which client.x has permissions.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-04-18 19:42:55 +05:30
Rishabh Dave
008dbe91e2 qa/cephfs: improve caps_helper.CapTester
Improvement #1:

CapTester.write_test_files() not only creates the test file but also
does the following for every mount object it receives in parameters -

* carefully produces the path for the test file as per parameters
  received
* generates the unique data for each test file on a CephFS mount
* creates a data structure -- list of lists -- that holds all this
  information along with mount object itself for each mount object so
  that tests can be conducted at a later point

Untangle this mess of code by splitting this method into 3 separate
methods -

1. To produce the path for test file (as per user's need).
2. To generate the data that will be written into the test file.
3. To actually create the test file on CephFS.

Improvement #2:

Remove the internal data structure used for testing -- self.test_set --
and use separate class attributes to store all the data required for
testing instead of a tuple. This serves two purpose -

One, it makes it easy to manipulate all this data from helper methods
and during debugging session, especially while using a PDB session.

And two, make it impossible to have multiple mounts/multiple "test sets"
within same CapTester instance for the sake of simplicity. Users can
instead create two instances of CapTester instances if needed.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-04-18 19:42:55 +05:30
Rishabh Dave
e8bdf94b81 qa/cephfs: don't inherit CephFSTestCase in CapTester
Inheritting CephFSTestCase in CapTester just for methods assertEqual()
and assertIn() from class unittest.TestCase is odd and heavy-weight.
Don't inherit CephFSTestCase and use simple assert instead.

Reference: https://github.com/ceph/ceph/pull/50882#discussion_r1160611549.

To avoid code duplication, a couple of similar methods have been added
instead.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-04-18 19:34:40 +05:30
Ilya Dryomov
af9762e39f
Merge pull request #50916 from petrutlucian94/avoid_pip
win32_deps_build: avoid pip

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-04-18 13:49:41 +02:00
Jos Collin
535291142d
doc: add a note for minimum compatible python version and supported distros
Fixes: https://tracker.ceph.com/issues/58677
Signed-off-by: Jos Collin <jcollin@redhat.com>
2023-04-18 16:44:15 +05:30
Jos Collin
d1de1cae2b
tools/cephfs/top/CMakeList.txt: check the minimum compatible python version for cephfs-top
Fixes: https://tracker.ceph.com/issues/58677
Signed-off-by: Jos Collin <jcollin@redhat.com>
2023-04-18 16:44:15 +05:30
Rishabh Dave
64e3dd7e62 qa/cephfs/caps_helper: fix a bug in methods that generate cap string
The tuple was not meant to be passed as a whole but its individual
members are to be passed as a list of positional arguments.

Introduced-by: 87025d1585
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-04-18 16:28:03 +05:30
Lucian Petrut
041618ea9b win32_deps_build: avoid pip
We're currently installing cython with pip when using Ubuntu
to cross compile Ceph for Windows. This can fail with recent
Python versions if attempting to use the global env:

  error: externally-managed-environment

  × This environment is externally managed
  ╰─> To install Python packages system-wide, try apt install
      python3-xyz, where xyz is the package you are trying to
      install.

Cython isn't really needed by the Windows build so we can go
ahead and drop it. We were hoping to use the Python bindings
on Windows, however Python extensions can't be cross compiled.

We're no longer using pip either, so we're dropping the dependency.
g++ was getting installed as a pip dependency, so we'll have to
include that instead. Note that g++ is used when building the boost
b2 tool.

While at it, we'll also ensure that git is installed.

Fixes: https://tracker.ceph.com/issues/59354

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2023-04-18 09:55:52 +00:00
Anthony D'Atri
cdceabd684
Merge pull request #50639 from bitfehler/bitfehler/doc-pg-num
doc: account for PG autoscaling being the default
2023-04-17 22:58:51 +02:00
Ilya Dryomov
7f6c674fc2
Merge pull request #51043 from petrutlucian94/fix_jaeger_encoding
common/tracer: fix decoding when jaeger tracing is disabled

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2023-04-17 18:58:00 +02:00
zdover23
5e13ccfb99
Merge pull request #49762 from Svelar/vstart2
vstart: fix text format

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-04-17 18:42:34 +02:00
Nizamudeen A
e5a5817679
Merge pull request #50820 from rhcs-dashboard/update-landing-page-e2e-tests
mgr/dashboard: update landing page e2e tests 

Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-04-17 19:07:44 +05:30
Nizamudeen A
467ceca923
Merge pull request #51082 from rhcs-dashboard/skip-osds-conditionally-in-e2e
mgr/dashboard: skip Create OSDs step in Cluster expansion

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
2023-04-17 19:05:59 +05:30
Nizamudeen A
1e9072344d
Merge pull request #51115 from rhcs-dashboard/remove-hyperlink-mgr
mgr/dashboard: remove unncessary hyperlink in landing page

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
2023-04-17 19:05:16 +05:30
zdover23
2078c5d6e1
Merge pull request #51114 from colemitchell/wip-doc-2023-04-17-radosgw-s3select-formatting-1
doc/radosgw: format part of s3select

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-04-17 12:07:57 +02:00
Cole Mitchell
13cf134c06 doc/radosgw: format part of s3select
Partially format the 'Basic Workflow' section's introduction and 'Basic Functionalities' subsection in s3select. Nothing else is being fixed.

Signed-off-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2023-04-17 05:51:53 -04:00
Nizamudeen A
7e7da95544 mgr/dashboard: remove unncessary hyperlink in landing page
Fixes: https://tracker.ceph.com/issues/59462
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-04-17 15:09:50 +05:30
Nizamudeen A
7870a6290d
Merge pull request #48869 from rhcs-dashboard/more-grafana-configs
mgr/dashboard: expose more grafana configs in service form

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-04-17 12:31:56 +05:30
Pedro Gonzalez Gomez
1157e3bff9 mgr/dashboard: update landing page e2e tests
ignore the region that can vary on different clusters like charts

fixes: https://tracker.ceph.com/issues/59142
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2023-04-17 12:24:37 +05:30
Nizamudeen A
0f6d23a7aa mgr/dashboard: skip Create OSDs step in Cluster expansion
Its to ensure OSDs are not deployed on all hosts because that would make
the host draining impossible

Fixes: https://tracker.ceph.com/issues/59457
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-04-17 12:23:17 +05:30
Patrick Donnelly
1e889d24a4
Merge PR #50941 into main
* refs/pull/50941/head:
	doc/foundation: Update Foundation members for April 2023

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2023-04-16 11:34:35 -04:00
zdover23
2f43f2c23e
Merge pull request #51103 from colemitchell/wip-doc-2023-04-16-radosgw-s3select-formatting-1
doc/radosgw: format part of s3select

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-04-16 15:48:32 +02:00
Cole Mitchell
a6a84471a7 doc/radosgw: format part of s3select
Format the first section of s3select. Nothing else is being fixed.

Signed-off-by: Cole Mitchell <cole.mitchell.ceph@gmail.com>
2023-04-16 09:13:56 -04:00
Anthony D'Atri
51fd06fe8e
Merge pull request #51099 from zdover23/wip-doc-2023-04-16-dev-cephfs-mirroring-creating-users-command-formatting
doc/dev: format command in cephfs-mirroring
2023-04-16 14:39:53 +02:00
Zac Dover
408219bfca doc/dev: format command in cephfs-mirroring
Correctly format a command in doc/dev/cephfs-mirroring/#creating-users.

Reported by casanlin@init7.net at
https://pad.ceph.com/p/Report_Documentation_Bugs

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-16 11:11:27 +02:00