Commit Graph

1209 Commits

Author SHA1 Message Date
Laura Flores
24dcb42d41
Merge pull request #55067 from yaarith/telemetry-pool-flags
mgr/telemetry: add pool flags
2024-01-23 12:22:32 -06:00
Yaarit Hatuka
937aa7ec21 mgr/telemetry: add pool flags
Pool flags can help us learn how certain features are being used, for
example, the "crimson" flag implies a crimson cluster.

We add a basic_pool_flags collection to the "basic" channel for this
purpose.

Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2024-01-05 17:44:30 +00:00
Radosław Zarzyński
66e9815d0c doc/dev/release-checklist: mark ceph-container changes done
Per https://github.com/ceph/ceph-container/pull/2174.

Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-12-05 19:07:49 +01:00
Radosław Zarzyński
4d420e1f30 osd, doc: make OSDMap::pending_require_osd_release() aware about squid
Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-12-05 18:38:46 +01:00
Radosław Zarzyński
2eb298c76a doc/dev/release-checklist: enlist OSDMap::pending_require_osd_release()
Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-12-05 18:35:57 +01:00
Radoslaw Zarzynski
70b70c5a6b release-checklists.rst: mark section for ceph-build as complete
This bases on https://github.com/ceph/ceph-build/pull/2160.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
4a81193f70 test/cli/monmaptool: adjust for the squid monmap features
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
7af05d0944 qa: bring qa/suites/upgrade/reef-x
Bases on quincy-x.

```
$ cp -R qa/suites/upgrade/quincy-x/ qa/suites/upgrade/reef-x
$ git add qa/suites/upgrade/reef-x
$ git mv qa/suites/upgrade/reef-x/filestore-remove-check/1-ceph-install/quincy.yaml qa/suites/upgrade/reef-x/filestore-remove-check/1-ceph-install/reef.yaml
$ find qa/suites/upgrade/reef-x/ -type f -exec sed -i 's/quincy/reef/g' {} +
```

A note from rebase: changes from 05e24270a2
have been pulled in.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radosław Zarzyński
b35871b920 qa: bring test_telemetry_reef.sh for squid
Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
6d25c05312 qa: bring test_telemetry_reef_x.sh for squid
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
081177f6a4 qa: stubs and clean up for reef
- remove upgrades from octopus
- stubs for completing upgrade to reef

Still missing the quincy-x upgrade tests.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
dea8aa67c2 common, mon, qa: Mon-related updates for squid
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
f44c70236e mon: update for squid ondisk features
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
c9f9174b32 doc/dev/release-checklists: mark ceph-release-notes is already done
This happened in 5d944bb237.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
b23a134baf doc/dev/release-checklists: mark backport-resolve-issue is already done
This happened in 3d15f685a8.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
93a898ea6c ceph-volume: change to squid
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
0d18c1f67f include/ceph_features: retire deprecated bits
Nothing has been deprecated in Mimic, so this commit is just
updates the release checklist.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:51 +01:00
Radoslaw Zarzynski
2963ca6eb8 doc, mon: add always_on_modules for squid
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:50 +01:00
Radoslaw Zarzynski
da25e58dc1 doc, qa/standalone/mon/misc: verify that len(monmap.features.persistent) == 11
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:50 +01:00
Radoslaw Zarzynski
b6986466f7 cephadm: update DEFAULT_IMAGE_RELEASE to squid
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:50 +01:00
Radoslaw Zarzynski
adc05c510a tools/monmaptool, test/cli, doc: pacific to quincy for default min_mon_release
This is modelled after 4210e0a95e.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:50 +01:00
Radosław Zarzyński
72a2301922 include/ceph_features, doc: define FEATURE_SERVER_SQUID
I've departed from 35d483af54
in that way the _incarnation_ is selected to be the very next
one to the retired bit's one.

Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-12-04 16:27:50 +01:00
Radosław Zarzyński
61c7b30bbd common, doc, include, mds, mon: add feature/release name squid
Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-12-04 16:27:50 +01:00
Radosław Zarzyński
d2639a30b8 ceph_release, doc: bump to 19/squid
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:50 +01:00
Radosław Zarzyński
1b2c8394cb cmake, doc: bump librbd version to 19.0.0 for squid
Signed-off-by: Radosław Zarzyński <rzarzyns@redhat.com>
2023-12-04 16:27:50 +01:00
Radoslaw Zarzynski
0c0767e243 cmake, doc: bump project version to 19.0.0 for squid
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:50 +01:00
Radoslaw Zarzynski
217c9dbed6 doc/dev/release-checklists: uncheck everything!
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2023-12-04 16:27:50 +01:00
Vallari Agrawal
b896bebf38
Merge pull request #54209 from VallariAg/wip-xml-scanner
qa: use Remote.run_unit_test and ValgrindScanner
2023-11-29 12:21:02 +05:30
Adam King
91a16bca05
Merge pull request #54173 from phlogistonjohn/jjm-cephadm-jinja-2
cephadm: expand support for dependencies bundled into the zipapp

Reviewed-by: Adam King <adking@redhat.com>
2023-11-16 19:40:16 -05:00
Zac Dover
91ed10bc73 doc/rados: edit t-mon "common issues" (3 of x)
Edit the second part of the section "Most Common Monitor Issues" in
doc/rados/troubleshooting/troubleshooting-mon.rst.

Follows https://github.com/ceph/ceph/pull/54417.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-11-09 20:20:20 +10:00
John Mulligan
fed4066a85 doc/dev/cephadm: describe advanced build options
Describe the advanced build options provided by build.py and how
to use `cephadm version --verbose` to print the internal metadata.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-11-06 13:38:23 -05:00
Yuri Weinstein
ddd2c61077
Merge pull request #52545 from Matan-B/wip-matanb-trim-61962
osd/OSD: fix trim_maps() - possible leak on `skip_maps`

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-11-01 12:09:44 -07:00
Rishabh Dave
b1bf543127
Merge pull request #54210 from rishabh-d-dave/progress-submodule-update
add --progress flag to git submodule update commands

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2023-11-01 10:59:59 +05:30
Rishabh Dave
eb6995436f cmake: add --progress flag to git submodule update commands
Ceph has lots of submodules that needs to be cloned before building
binaries from the repository. Seeing the progress when these submodules
are being cloned is useful, especially when developers/users have a
network issue or a slow network.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-10-31 23:14:49 +05:30
Vallari Agrawal
4719bfbda6
doc/dev/developer_guide: mention unit_test_summary.yaml & valgrind.yaml
In tests-integration-testing-teuthology-workflow.rst,
briefly mention unit_test_summary.yaml and valgrind.yaml
as other files that exist in teuthology archive.

Signed-off-by: Vallari Agrawal <val.agl002@gmail.com>
2023-10-31 17:07:49 +05:30
Yuri Weinstein
25ea834ce4
Merge pull request #54198 from ceph/wip-yuriw-release-process-main
docs: revised Distro Codemap, removed `octopus`, added `reef`

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2023-10-30 12:59:51 -07:00
Casey Bodley
a57765022a
Merge pull request #53003 from alimaredia/wip-rgw-perf-counters-cache
Perf counters cache + Labeled RGW Op counters

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-10-27 14:40:19 +01:00
Yuri Weinstein
5eb14cf180 docs: revised Distro Codemap, removed octopus, added reef
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2023-10-25 15:05:56 -07:00
tanchangzhi
a7502cb512 doc: Update mClock QOS documentation to discard osd_mclock_cost_per_*
The cost parameters (osd_mclock_cost_per_*) have been removed.
The cost of an operation is now determined using the random IOPS
and maximum sequential bandwidth capability of the OSD's underlying device.

Fixes: https://tracker.ceph.com/issues/58529
Signed-off-by: tanchangzhi <544463199@qq.com>
2023-10-17 17:00:31 +08:00
Zac Dover
073b0919ed doc/dev: remove cache-pool
Remove cache-pool, which is deprecated in Reef.

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-10-14 04:17:44 +10:00
Ali Maredia
56c7cc8c59 rgw: misc labeled op counters work
Highlights of this commit include:
- splitting the rgw perf counters cache int two
caches for bucket labeled and user labeled op counters
- add config overrides to verify suite for CI
- add tenant label for op counters
- misc cleanup cleanup
- add docs for rgw metrics

Signed-off-by: Ali Maredia <amaredia@redhat.com>
2023-10-12 15:46:08 -04:00
Dhairya Parmar
1f78a32a18 doc: remove egg fragment from dev/developer_guide/running-tests-locally
DEPRECATION: git+https://github.com/ceph/teuthology#egg=teuthology
[test] contains an egg fragment with a non-PEP 508 name pip 25.0 will enforce
this behaviour change. A possible replacement is to use the req @ url syntax,
and remove the egg fragment. Discussion can be found at
https://github.com/pypa/pip/issues/11617

Signed-off-by: Dhairya Parmar <dparmar@redhat.com>
2023-10-05 20:17:14 +05:30
Nizamudeen A
47f49e5b1a mgr/dashboard: update nodejs to 18.17.0
the latest npm doesn't support setting python as a config like `npm
config set python3` instead it needs to be either set in the node-gyp
explicitly using the node-gyp command or through an environment
variable.
Since we are calling the node-gyp through npm, we need to set the
environment variable which is documented here: https://github.com/nodejs/node-gyp?tab=readme-ov-file#configuring-python-dependency

Accordingly the CMakeLists.txt for dashboard is adapted

Fixes: https://tracker.ceph.com/issues/62844
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-09-22 12:19:29 +05:30
Daniel Parkes
06358e8d17 doc/dev: Fix typos in files cephfs-mirroring.rst and deduplication.rst
Typo Error in Doc cephfs-mirroring.rst , replace RAODS with RADOS
Typo Error in Doc deduplication.rst , replace RAODS with RADOS

Signed-off-by: Daniel Parkes <dparkes@redhat.com>
2023-09-19 00:39:40 +02:00
Matan Breizman
527b34e628 doc/dev/osd_internals/past_intervals.rst: add OSDSuperblock::maps
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2023-09-13 15:29:57 +00:00
John Mulligan
d09e32ad2b doc: update release checklist for new cephadm constants file
Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-08-30 14:02:15 -04:00
Laura Flores
d378c06a93 doc: clarify upmap balancer documentation
In https://github.com/ceph/ceph/pull/51499, some language was added
that refers to the upmap balancer as the "capacity" balancer,
but we don't want to insinuate that there is anything "new" that was
added or changed. It should be clear that this section refers to the
existing upmap balancer, which has existed for several releases.

Signed-off-by: Laura Flores <lflores@redhat.com>
2023-08-02 21:44:46 +00:00
zdover23
7931020f09
Merge pull request #51960 from rzarzynski/wip-doc-encoding
doc: improve doc/dev/encoding.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Neha Ojha <nohja@redhat.com>
2023-08-02 17:45:51 +10:00
Nizamudeen A
692a45362d deps: increase the node version to 16
With node 14, the angular 13 is going into some issues with node-gyp.
```
prebuild-install || node-gyp rebuild

prebuild-install WARN install No prebuilt binaries found (target=14.20.0 runtime=node arch=x64 libc= platform=linux)
make: Entering directory '/home/jenkins-build/build/workspace/ceph-dashboard-cephadm-e2e/src/pybind/mgr/dashboard/frontend/node_modules/tree-sitter/build'
  CC(target) Release/obj.target/tree_sitter/vendor/tree-sitter/lib/src/lib.o
  AR(target) Release/obj.target/tree_sitter.a
  COPY Release/tree_sitter.a
  CXX(target) Release/obj.target/tree_sitter_runtime_binding/src/binding.o
```
and in some other environments its like `cb() never called` and stops
the whole `npm ci` process.

After some research, looks like updating node is the way to stop this.

Also, ` npm 7 will block installations if an upstream dependency
conflict is present that cannot be automatically resolved.` https://github.blog/2021-02-02-npm-7-is-now-generally-available/#peer-dependencies

Fixes: https://tracker.ceph.com/issues/62107
Signed-off-by: Nizamudeen A <nia@redhat.com>
2023-07-21 11:33:18 +05:30
Yuri Weinstein
c57faa651d
Merge pull request #51947 from alimaredia/wip-counter-dump-array-add
common: `counter dump` command revision

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2023-07-14 16:26:00 -04:00