Commit Graph

139696 Commits

Author SHA1 Message Date
Ronen Friedman
4f5356d062 osd: formatters for PastIntervals and its subclasses
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-08-15 07:32:46 -05:00
Ronen Friedman
bb75d351a9 osd: formatter for pg_log_entry_t
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-08-15 07:32:46 -05:00
Ronen Friedman
8f61a4ba0b osd: formatter for ObjectRecoveryProgress
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-08-15 07:32:46 -05:00
Ronen Friedman
80ef7f2391 osd: formatter for ObjectRecoveryInfo
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-08-15 07:32:46 -05:00
Ronen Friedman
27e073c935 commom,osd: support for default fmtlib formatters
Declaring formatters for all classes that supply
either fmt_print() or alt_fmt_print() member functions
(both must adhere to a specific signature).

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-08-15 07:32:46 -05:00
zdover23
c0b217e155
Merge pull request #52989 from phlogistonjohn/jjm-installing-pkgs-cephadm
doc: do not recommend pulling cephadm from git

Reviewed-by: Adam King <adking@redhat.com>
2023-08-15 21:08:46 +10:00
Zac Dover
578fdb27a0 doc: improve submodule update command - README.md
Improve the portion of README.md that directs the reader to update the
submodules. Previously, the text assumed that the reader knew that they
should cd into the ceph directory. Now the text is explicit about the
necessity of this action.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-08-15 21:07:13 +10:00
Nizamudeen A
932299fbed
Merge pull request #52898 from rhcs-dashboard/cephfs-subvolumegroup-edit
mgr/dashboard: Cephfs subvolumegroup edit

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-08-15 16:25:27 +05:30
Yuval Lifshitz
12aee03996
Merge pull request #52926 from kchheda3/wip_notif_s3user
rgw/notification: Store user info while creating notification topics

reviewed-by: yuvalif
2023-08-15 12:55:54 +03:00
Yingxin
1d9a0f6420
Merge pull request #52857 from cyx1231st/wip-crimson-cleanup-osd-sharddispatcher
crimson/osd: cleanup and drop OSD::ShardDispatcher

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Matan Breizman <mbreizma@redhat.com>
2023-08-15 10:57:47 +08:00
John Mulligan
c1a47f74ca doc: minor improvements of the cephadm section of the packages doc
* Don't call cephadm a script, it could be misleading
* Use the current release in the example for copy-pasters
* Improve grammar (I think)

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-08-14 14:23:05 -04:00
John Mulligan
336e8022b5 doc: do not recommend pulling cephadm from git
First off, these instructions are wrong because the file has been
renamed to cephadm.py, and will not succeed as written. Amusingly, due
to curl's default behavior (and my lack of access to a time machine) the
initial command will seem to have succeeded until the user discovers
that HTML delivered as part of the body of a 404 response is not an
executable script.

Furthermore, in preparation for Reef we updated the documentation in the
cephadm subsection to use the results of a build, rather than source
files, because reef now contains a "compiled" cephadm. Currently, the
contents of the compilation is essentially the same-old cephadm script
but that will no longer be the case in the very near future (see
7c6a2cad96). We missed this general
section of the Ceph docs that repeats the instructions to copy a raw
python file out of the Ceph tree on GitHub.  Update the section to
contain a simplified version of the instruction found in
doc/cephadm/install.rst.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-08-14 14:11:23 -04:00
Nizamudeen A
3441b89ad4 .github: fix add to dashboard failing
```
Error: Request failed due to following response errors:
 - Could not resolve to a ProjectV2 with the number 2.
```

On further investigation, it looks like it could be a permission issue.
I followed the recommendation in their documentation to fix it: https://github.com/actions/add-to-project#creating-a-pat-and-adding-it-to-your-repository

Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-08-14 23:23:11 +05:30
Pedro Gonzalez Gomez
44fc6f7cd3 mgr/dashboard: edit cephfs subvolumegroup
Fixes: https://tracker.ceph.com/issues/62370
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2023-08-14 23:14:17 +05:30
Nizamudeen A
4a7807978c
Merge pull request #52869 from rhcs-dashboard/fs-subvolumes-rm
mgr/dashboard: cephfs subvolume remove

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: cloudbehl <NOT@FOUND>
2023-08-14 22:25:29 +05:30
Nizamudeen A
3d53395174 mgr/dashboard: cephfs subvolume remove
Fixes: https://tracker.ceph.com/issues/62349
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-08-14 19:19:16 +05:30
avanthakkar
3157728eee mgr/dashboard: cluster upgrade progress UI
Fixes: https://tracker.ceph.com/issues/62343
Signed-off-by: avanthakkar <avanjohn@gmail.com>
Co-Authored-By: Nizamudeen A <nia@redhat.com>
2023-08-14 19:17:43 +05:30
Venky Shankar
9545e578a4 Merge PR #52547 into main
* refs/pull/52547/head:
	qa: add test cases for vanilla ops commands
	mds: dump locks when printing mutation ops
	common/TrackedOp: support overriding the _dump method
	mds: remove op field obsoleted by more usable "reqid"
	mds: dump metareq_t instead of full op
	mds: add lock type to formatter dump of SimpleLock
	mds: mark print methods const
	mds: drop MDRequestImpl::msg_lock
	mds: lock TrackedOp when dumping
	mds: avoid recursive locks dumping state
	common/TrackedOp: fix race updating description with proper lock
	common/Formatter: add support for dumping null
	common/Formatter: refactor generating xml name

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-08-14 17:52:47 +05:30
Venky Shankar
64369be51a Merge PR #52577 into main
* refs/pull/52577/head:
	mds: adjust cap acquisition throttles

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-08-14 17:51:50 +05:30
Venky Shankar
7910a4e765 Merge PR #52834 into main
* refs/pull/52834/head:
	mount.fuse.ceph: strip the 'nofail' option from those that fuse will see

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-08-14 17:50:47 +05:30
Ilya Dryomov
2f4720d9a8
Merge pull request #48705 from theanalyst/cmake-fmt-versionbump
cmake: ensure fmt lib is at least 8.1.1

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2023-08-14 11:47:58 +02:00
Nizamudeen A
82d0c50723
Merge pull request #52865 from cloudbehl/status-popover
mgr/dashboard: open popup with hover for cluster status

Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-08-14 12:28:25 +05:30
Nizamudeen A
026b9a2198
Merge pull request #52861 from rhcs-dashboard/fs-subvolumes-edit
mgr/dashboard: provide ability to edit cephfs subvolume 

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-08-14 12:18:37 +05:30
zdover23
6836a2b27b
Merge pull request #52966 from zdover23/wip-doc-2023-08-14-src-tools-rados
doc: update rados.cc

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-08-14 15:01:52 +10:00
Yingxin
56fd6d1185
Merge pull request #51141 from xxhdx1985126/wip-seastore-clone
crimson/os/seastore: OP_CLONE in seastore

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2023-08-14 09:47:38 +08:00
Zac Dover
152a0fdc68 doc: update rados.cc
Clarify a line in ceph/src/tools/rados/rados.cc.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-08-14 09:47:46 +10:00
zdover23
67fde040f3
Merge pull request #52963 from zdover23/wip-doc-2023-08-13-rados-troubleshooting-cpu-profiling
doc/troubleshooting: edit cpu-profiling.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-08-14 04:07:13 +10:00
Zac Dover
513c436aef doc/troubleshooting: edit cpu-profiling.rst
Improve the language in the "oprofile" section of the RADOS
Troubleshooting Guide.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-08-13 16:55:55 +10:00
zdover23
96cf3bd3c9
Merge pull request #52957 from zdover23/wip-doc-2023-08-12-rados-ops-monitoring-osd
doc/rados: update monitoring-osd-pg.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-08-12 05:06:56 +10:00
Nizamudeen A
07bc21f34f mgr/dashboard: provide ability to edit cephfs subvolume
Fixes: https://tracker.ceph.com/issues/62347
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-08-12 00:26:37 +05:30
Nizamudeen A
91f75abf4c
Merge pull request #52645 from rhcs-dashboard/cephfs-vol-rm
mgr/dashboard: cephfs volume rm and rename

Reviewed-by: Pegonzal <NOT@FOUND>
Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-08-12 00:23:00 +05:30
cloudbehl
c49435e889 mgr/dashboard: minor usability improvements
Fixes: https://tracker.ceph.com/issues/62365

Signed-off-by: cloudbehl <cloudbehl@gmail.com>
2023-08-12 00:16:22 +05:30
avanthakkar
d756fadde3 mgr/dashboard: cephfs volume rm and rename
Fixes: https://tracker.ceph.com/issues/62408
Signed-off-by: avanthakkar <avanjohn@gmail.com>
2023-08-11 22:25:12 +05:30
Adam King
101b778631
Merge pull request #52932 from adk3798/cephadm-reef-latest-stable-release
cephadm: bump LATEST_STABLE_RELEASE to "reef"

Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-08-11 11:50:18 -04:00
Casey Bodley
875dae764a
Merge pull request #52510 from pritha-srivastava/wip-rgw-61916-test-failures
rgw/auth: Fix the return code returned by AuthStrategy,

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-08-11 11:36:37 -04:00
Zac Dover
73503d4e26 doc/rados: update monitoring-osd-pg.rst
Ingest Anthony D'Atri's notes from
https://github.com/ceph/ceph/pull/50856#discussion_r1289532902
which should have been included earlier.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-08-12 01:25:32 +10:00
zdover23
95de599faa
Merge pull request #50856 from zdover23/wip-doc-2023-04-04-rados-operations-monitoring-osd-pg-question-1
doc/rados/ops: question about down and in OSDS

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-08-12 00:15:40 +10:00
Nizamudeen A
ab116431a3
Merge pull request #52907 from cloudbehl/add-telemetry
mgr/dashboard: Add telemetry link in dashboard

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Yaarit Hatuka <yaarithatuka@gmail.com>
2023-08-11 18:58:26 +05:30
Nizamudeen A
83370f66be
Merge pull request #52903 from cloudbehl/rgw-details
mgr/dashboard: RGW Details card cleanup

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-08-11 18:36:04 +05:30
Zac Dover
276d1fcbdd doc/rados/ops: question about down and in OSDS
Clear up a confusing sentence that purports to explain OSDS that are
both "down" and "in".

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-08-11 22:27:22 +10:00
zdover23
5a0475e0c3
Merge pull request #52945 from kotreshhr/doc-mgr-deadlock
doc: Add a note on possible deadlock on volume deletion

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-08-11 22:10:59 +10:00
Kotresh HR
b93b3364ae doc: Add a note on possible deadlock on volume deletion
Fixes: https://tracker.ceph.com/issues/62407
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2023-08-11 17:04:59 +05:30
Lucian Petrut
849757a462 test/lirbd/fsx: fix Windows issues
There are a few more issues that need to be addressed in order to
run this test on Windows:

* aligned_free (compat.h wrapper) needs to be used after allocating
  memory using posix_memalign, "free" causes a crash on Windows
* long (4B) can't store x64 pointers on Windows, we'll use
  uintptr_t instead.
* use O_BINARY when opening files, otherwise certain characters
  get translated (e.g. LF to CRLF).

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2023-08-11 11:33:10 +00:00
Lucian Petrut
14d5c7cf8e test/librbd: enable the functional tests on Windows
Right now, the librbd tests are skipped on Windows.

This change enables the functional tests, which can run with
just a few modifications.

We'll continue skipping the unit tests however, which require
too much OSD code that hasn't been ported (e.g. cls, libosd, etc).

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2023-08-11 11:32:54 +00:00
Pere Diaz Bou
e97aa857c2 os/bluestore: fix bluefs log runway enospc
With these changes, every call to log compaction will try to expand its
runway in case of insufficient log space. async compaction will ignore
the `log_forbidden_to_expand` atomic since we know it should't be
harmful. In any other case, expansion of log will wait until compaction
is completed.

in order to ensure op_file_update_inc fits on disk we increase the size
of logs as previously used in _maybe_extend_log. This means we too bring
back _maybe_extend_log with a different usage.

_maybe_extend_log increases the size of the log if the runway is less
than the min runway and if the current transaction is too big to fit.

Fixes: https://tracker.ceph.com/issues/58759
Signed-off-by: Pere Diaz Bou <pere-altea@hotmail.com>
2023-08-11 10:38:57 +02:00
cloudbehl
3a64f67930 mgr/dashboard: Add telemetry link in dashboard
Fixes: https://tracker.ceph.com/issues/62380

Signed-off-by: cloudbehl <cloudbehl@gmail.com>
2023-08-11 13:37:59 +05:30
Rishabh Dave
e5ff7e1f90 qa/cephfs: check if re-installing this mpich fixes the issue
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-08-11 13:32:07 +05:30
Venky Shankar
53f89ea09b Merge PR #52765 into main
* refs/pull/52765/head:
	mgr/volumes: Fix pending_subvolume_deletions in volume info
	qa: Add testcase for pending_subvolume_deletions count

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
2023-08-11 11:39:52 +05:30
Adam King
90ddff61a3 cephadm: bump LATEST_STABLE_RELEASE to "reef"
Now that reef is out, we should tell users
that it's the latest stable release, rather
than quincy

Signed-off-by: Adam King <adking@redhat.com>
2023-08-10 11:04:55 -04:00
Pedro Gonzalez Gomez
141cb3d143
Merge pull request #52886 from rhcs-dashboard/cephfs-sbuvolumegroup-create
mgr/dashboard: create subvolume groups


Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: cloudbehl <NOT@FOUND>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-08-10 16:49:50 +02:00