Commit Graph

1182 Commits

Author SHA1 Message Date
Vallari Agrawal
b896bebf38
Merge pull request #54209 from VallariAg/wip-xml-scanner
qa: use Remote.run_unit_test and ValgrindScanner
2023-11-29 12:21:02 +05:30
Adam King
91a16bca05
Merge pull request #54173 from phlogistonjohn/jjm-cephadm-jinja-2
cephadm: expand support for dependencies bundled into the zipapp

Reviewed-by: Adam King <adking@redhat.com>
2023-11-16 19:40:16 -05:00
Zac Dover
91ed10bc73 doc/rados: edit t-mon "common issues" (3 of x)
Edit the second part of the section "Most Common Monitor Issues" in
doc/rados/troubleshooting/troubleshooting-mon.rst.

Follows https://github.com/ceph/ceph/pull/54417.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-11-09 20:20:20 +10:00
John Mulligan
fed4066a85 doc/dev/cephadm: describe advanced build options
Describe the advanced build options provided by build.py and how
to use `cephadm version --verbose` to print the internal metadata.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-11-06 13:38:23 -05:00
Yuri Weinstein
ddd2c61077
Merge pull request #52545 from Matan-B/wip-matanb-trim-61962
osd/OSD: fix trim_maps() - possible leak on `skip_maps`

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-11-01 12:09:44 -07:00
Rishabh Dave
b1bf543127
Merge pull request #54210 from rishabh-d-dave/progress-submodule-update
add --progress flag to git submodule update commands

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2023-11-01 10:59:59 +05:30
Rishabh Dave
eb6995436f cmake: add --progress flag to git submodule update commands
Ceph has lots of submodules that needs to be cloned before building
binaries from the repository. Seeing the progress when these submodules
are being cloned is useful, especially when developers/users have a
network issue or a slow network.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-10-31 23:14:49 +05:30
Vallari Agrawal
4719bfbda6
doc/dev/developer_guide: mention unit_test_summary.yaml & valgrind.yaml
In tests-integration-testing-teuthology-workflow.rst,
briefly mention unit_test_summary.yaml and valgrind.yaml
as other files that exist in teuthology archive.

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2023-10-31 17:07:49 +05:30
Yuri Weinstein
25ea834ce4
Merge pull request #54198 from ceph/wip-yuriw-release-process-main
docs: revised Distro Codemap, removed `octopus`, added `reef`

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2023-10-30 12:59:51 -07:00
Casey Bodley
a57765022a
Merge pull request #53003 from alimaredia/wip-rgw-perf-counters-cache
Perf counters cache + Labeled RGW Op counters

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-10-27 14:40:19 +01:00
Yuri Weinstein
5eb14cf180 docs: revised Distro Codemap, removed octopus, added reef
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2023-10-25 15:05:56 -07:00
tanchangzhi
a7502cb512 doc: Update mClock QOS documentation to discard osd_mclock_cost_per_*
The cost parameters (osd_mclock_cost_per_*) have been removed.
The cost of an operation is now determined using the random IOPS
and maximum sequential bandwidth capability of the OSD's underlying device.

Fixes: https://tracker.ceph.com/issues/58529
Signed-off-by: tanchangzhi <544463199@qq.com>
2023-10-17 17:00:31 +08:00
Zac Dover
073b0919ed doc/dev: remove cache-pool
Remove cache-pool, which is deprecated in Reef.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-10-14 04:17:44 +10:00
Ali Maredia
56c7cc8c59 rgw: misc labeled op counters work
Highlights of this commit include:
- splitting the rgw perf counters cache int two
caches for bucket labeled and user labeled op counters
- add config overrides to verify suite for CI
- add tenant label for op counters
- misc cleanup cleanup
- add docs for rgw metrics

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2023-10-12 15:46:08 -04:00
Dhairya Parmar
1f78a32a18 doc: remove egg fragment from dev/developer_guide/running-tests-locally
DEPRECATION: git+https://github.com/ceph/teuthology#egg=teuthology
[test] contains an egg fragment with a non-PEP 508 name pip 25.0 will enforce
this behaviour change. A possible replacement is to use the req @ url syntax,
and remove the egg fragment. Discussion can be found at
https://github.com/pypa/pip/issues/11617

Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2023-10-05 20:17:14 +05:30
Nizamudeen A
47f49e5b1a mgr/dashboard: update nodejs to 18.17.0
the latest npm doesn't support setting python as a config like `npm
config set python3` instead it needs to be either set in the node-gyp
explicitly using the node-gyp command or through an environment
variable.
Since we are calling the node-gyp through npm, we need to set the
environment variable which is documented here: https://github.com/nodejs/node-gyp?tab=readme-ov-file#configuring-python-dependency

Accordingly the CMakeLists.txt for dashboard is adapted

Fixes: https://tracker.ceph.com/issues/62844
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-09-22 12:19:29 +05:30
Daniel Parkes
06358e8d17 doc/dev: Fix typos in files cephfs-mirroring.rst and deduplication.rst
Typo Error in Doc cephfs-mirroring.rst , replace RAODS with RADOS
Typo Error in Doc deduplication.rst , replace RAODS with RADOS

Signed-off-by: Daniel Parkes <dparkes@redhat.com>
2023-09-19 00:39:40 +02:00
Matan Breizman
527b34e628 doc/dev/osd_internals/past_intervals.rst: add OSDSuperblock::maps
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-09-13 15:29:57 +00:00
John Mulligan
d09e32ad2b doc: update release checklist for new cephadm constants file
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-08-30 14:02:15 -04:00
Laura Flores
d378c06a93 doc: clarify upmap balancer documentation
In https://github.com/ceph/ceph/pull/51499, some language was added
that refers to the upmap balancer as the "capacity" balancer,
but we don't want to insinuate that there is anything "new" that was
added or changed. It should be clear that this section refers to the
existing upmap balancer, which has existed for several releases.

Signed-off-by: Laura Flores <lflores@redhat.com>
2023-08-02 21:44:46 +00:00
zdover23
7931020f09
Merge pull request #51960 from rzarzynski/wip-doc-encoding
doc: improve doc/dev/encoding.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Neha Ojha <nohja@redhat.com>
2023-08-02 17:45:51 +10:00
Nizamudeen A
692a45362d deps: increase the node version to 16
With node 14, the angular 13 is going into some issues with node-gyp.
```
prebuild-install || node-gyp rebuild

prebuild-install WARN install No prebuilt binaries found (target=14.20.0 runtime=node arch=x64 libc= platform=linux)
make: Entering directory '/home/jenkins-build/build/workspace/ceph-dashboard-cephadm-e2e/src/pybind/mgr/dashboard/frontend/node_modules/tree-sitter/build'
  CC(target) Release/obj.target/tree_sitter/vendor/tree-sitter/lib/src/lib.o
  AR(target) Release/obj.target/tree_sitter.a
  COPY Release/tree_sitter.a
  CXX(target) Release/obj.target/tree_sitter_runtime_binding/src/binding.o
```
and in some other environments its like `cb() never called` and stops
the whole `npm ci` process.

After some research, looks like updating node is the way to stop this.

Also, ` npm 7 will block installations if an upstream dependency
conflict is present that cannot be automatically resolved.` https://github.blog/2021-02-02-npm-7-is-now-generally-available/#peer-dependencies

Fixes: https://tracker.ceph.com/issues/62107
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-07-21 11:33:18 +05:30
Yuri Weinstein
c57faa651d
Merge pull request #51947 from alimaredia/wip-counter-dump-array-add
common: `counter dump` command revision

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2023-07-14 16:26:00 -04:00
Zac Dover
ce96ddd4c7 doc/dev: remove seqdiag assets
Remove seqdiag assets to determine whether the docs can be built if they
are absent. (Currently they cannot be built when they are present.) If
this works, then these diagrams will be replaced, probably with .png
files.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-07-05 03:37:10 +10:00
zdover23
46cfee7ae0
Merge pull request #51845 from ssdohammer-sl/doc-update-deduplication
doc:dev update how to use deduplication

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-06-26 11:46:07 +10:00
Sungmin Lee
9b74a33fa1 doc:dev update how to use deduplication
Add prerequisite for deduplication, example outputs, and chunk-repair operation.

Signed-off-by: Sungmin Lee <sung_min.lee@samsung.com>
2023-06-26 00:29:46 +00:00
Laura Flores
4fcab2e7fc doc/man/8: add documentation about read balancer
Signed-off-by: Laura Flores <lflores@redhat.com>
Co-authored-by: Josh Salomon <josh.salomon@gmail.com>
2023-06-22 09:54:48 -05:00
Zac Dover
e83949e7ed doc/dev: fix "deploying dev cluster" link
Fix a link to "Deploying a Development Cluster" that had been broken
since the transition from master to main.

This is the first part of an initiative to improve the vstart
documentation.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-06-13 21:51:26 +10:00
Ali Maredia
78a1488693 common: counter dump command revision
`counter dump` now emits an array of
<labels,counters> pairs for each individual key.

Commit includes revisions to perf counters unit
test.

Fixes: https://tracker.ceph.com/issues/61587
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2023-06-12 13:53:21 -04:00
Laura Flores
3b25afc6f2 doc/dev: update release checklist
Signed-off-by: Laura Flores <lflores@redhat.com>
2023-06-09 10:20:36 -05:00
Radosław Zarzyński
83bef6668d doc: improve doc/dev/encoding.rst
Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-06-07 16:15:38 +02:00
John Mulligan
421147f97c doc: add instructions for compiling cephadm
Now that cephadm is based on zipapp, add a short section to the
developer docs explaining how to build cephadm yourself.

Note: This commit is a cherry-pick of
9ad38033cc, which was introduced by John
Mulligan in #48180. This is one of three commits introduced in that PR,
and this cherry-pick cleans up omissions I (Zac Dover) inadvertently
introduced while attempting to rectify the merge conflicts in #51843. I
expect that one more cherry-picked commit (specifically,
d11cf0e82a, which cannot be merged easily
until d7921e88d6 has been merged into
main, for reasons that are too
Rick-and-Morty-there-should-never-be-more-than-one-dot to go into here)
will follow this one.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
(cherry picked from commit 9ad38033cc)
2023-05-31 21:44:21 +08:00
John Mulligan
d11cf0e82a doc: update the cephadm download instructions
Starting with reef, cephadm is a compiled (zipapp) python application.
The cephadm script has been renamed and thus the old curl-based
download instructions will no loner work. While cephadm still has
no dependencies outside the Python stdlib, this will be changed in
future versions so it is no longer appropriate to just download the
source file of cephadm and run it either.

This change updates the `Install cephadm` section of the doc to explain
how to acquire a "compiled" version of cephadm as well as:
* moving and tweaking the note that the two installation methods are
  distinct
* adding a new note linking to instructions on building cephadm
* moving the distribution-specific installations before the curl-based
  installation to subtly hint that we prefer you to get it using
  packages if you can
* Noting cephadm's minimal required python verision and how to run it
  with a particular python version.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-05-30 11:49:21 -04:00
John Mulligan
9ad38033cc doc: add instructions for compiling cephadm
Now that cephadm is based on zipapp, add a short section to the
developer docs explaining how to build cephadm yourself.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-05-30 11:49:21 -04:00
Nizamudeen A
54e8e8b96b mgr/dashboard: remove deprecated preserveOnce
cypress is deprecating preserveOnce and instead favoring using
cy.session(). session is already introduced as part of the upgrade to
cypress 10. So removing the preserveOnce here

Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-05-25 13:45:24 +05:30
Anthony D'Atri
5e60e0de27 doc: Update jerasure.org references
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2023-05-23 19:13:33 -04:00
Anthony D'Atri
524901d3cf doc/dev/crimson: Improve crimson.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2023-05-22 05:08:44 -04:00
Radoslaw Zarzynski
622829cebc doc/dev/encoding.txt: update per std::optional
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-05-08 14:41:22 +00:00
Laura Flores
f6f6671b8e
Merge pull request #51146 from ceph/wip-yuriw-release-process-main
docs: added note for the TAG option
2023-05-05 12:06:49 -05:00
Josh Soref
94ade0cd16 orchestrator: fix spelling errors
* a new
* accommodated
* adopted
* appended
* because
* bootstrap
* bootstrapping
* brackets
* classes
* cluster
* compatible
* completely
* confusion
* daemon
* daemons
* dashboard
* enclosure
* existing
* explicit
* following
* format
* host
* implementation
* inferred
* keepalived
* kubic
* maintenance
* necessarily
* necessary
* network
* notifier
* octopus
* permanent
* presenting
* related
* see
* snapshot
* stateful
* the
* track
* version
* wasn't
* weird

Signed-off-by: Josh Soref <2119212+jsoref@users.noreply.github.com>
2023-04-26 09:21:42 -04:00
Laura Flores
044acf3bcf doc/dev: add some checkpoints to verify commits before starting the release
Signed-off-by: Laura Flores <lflores@redhat.com>
2023-04-25 11:54:11 -05:00
Yuri Weinstein
b2f2418dbc docs: added note for the TAG option and a note for 'cherry-pick'
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2023-04-24 12:50:51 -07:00
Nitzan Mordechai
d79f2a8154 docs: warning and remove few docs section for Filestore
Update docs after filestore removal.

Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2023-04-20 05:01:53 +00:00
Zac Dover
408219bfca doc/dev: format command in cephfs-mirroring
Correctly format a command in doc/dev/cephfs-mirroring/#creating-users.

Reported by casanlin@init7.net at
https://pad.ceph.com/p/Report_Documentation_Bugs

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-04-16 11:11:27 +02:00
Neha Ojha
313921afcf
Merge pull request #50534 from neha-ojha/wip-release-cl
doc/dev/release-checklists.rst: add after dev freeze section

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-03-15 12:50:42 -07:00
Zhang Song
b40f6421f0 src/vstart.sh: support specify the type of secondary device
doc/crimson: add options and example about SeaStore

Signed-off-by: Zhang Song <zhangsong325@gmail.com>
2023-03-15 09:22:31 +08:00
Neha Ojha
1e048aade9 doc/dev/release-checklists.rst: add after dev freeze section
- add release to redmine
- add milestone

Signed-off-by: Neha Ojha <nojha@redhat.com>
2023-03-14 18:45:30 +00:00
zdover23
334fbf20ee
Merge pull request #50390 from Svelar/vstart-doc
doc/crimson: add SeaStore when using vstart.

Reviewed-by: Zac Dover <zac.dover@proton.me>
2023-03-15 00:23:02 +10:00
zdover23
5852e5a7f2
Merge pull request #50500 from jdurgin/wip-release-checklist
doc/dev/release-checklist: add another step for ceph-build

Reviewed-by: Neha Ojha <nojha@redhat.com>
2023-03-14 11:40:53 +10:00
Josh Durgin
4fcad7161f doc/dev/release-checklist: add another step for ceph-build
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2023-03-13 07:45:07 -07:00