Commit Graph

8843 Commits

Author SHA1 Message Date
Sebastian Wagner
9e8b2d8282
Merge pull request #44510 from rzarzynski/wip-cephadm-docfix
doc/cephadm: improve the development doc a bit

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-17 10:21:45 +01:00
Neha Ojha
ed7fe35439
Merge pull request #44552 from jdurgin/wip-releases-doc
doc/releases: remove outdated info and versions; mark nautilus eol

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-14 09:42:08 -08:00
Yuri Weinstein
f5b4f3f4d9
Merge pull request #44251 from yaarith/telemetry-opt-in
mgr/telemetry: introduce new design for varying report data

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-01-14 09:06:11 -08:00
Ernesto Puerta
f7cd4b2873
Merge pull request #43685 from p-se/fix-grafana-graphs-ceph_daemon
mgr/dashboard: fix Grafana OSD/host panels

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: p-se <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-01-14 12:50:13 +01:00
Josh Durgin
5ecc3d9776 doc/releases: remove dev and pre-nautilus releases from timeline
Improve readability of the table - all this information is still
preserved in older branches.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2022-01-13 19:52:20 -05:00
Yaarit Hatuka
2d1550cf05 mgr/telemetry: add enable / disable channel all
Enable or disable all telemetry channels at once with:
    ceph telemetry enable channel all
    ceph telemetry disable channel all

Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-01-13 21:54:07 +00:00
Yaarit Hatuka
77a032526d mgr/telemetry: improve output of ceph telemetry collection ls
STATUS column now indicates whether a collection is being reported, and
the reasons why it's not (either the user is not opted-in to this
collection, or its channel is off).

Also, removed the ENROLLED and DEFAULT columns due to potential
confusion they may cause.

In case a user is not opted-in to certain collections, a message will
appear above the table with the missing collections:

    New collections are available:
    ['basic_base', 'basic_mds_metadata', 'crash_base', 'device_base',
    'ident_base', 'perf_perf']
    Run `ceph telemetry on` to opt-in to these collections.

Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-01-13 21:54:07 +00:00
Yaarit Hatuka
4c110ed2a5 doc/mgr/telemetry: document new commands
New commands:

  ceph telemetry enable channel <channel_name>
  ceph telemetry disable channel <channel_name>
  ceph telemetry channel ls
  ceph telemetry collection ls
  ceph telemetry collection diff
  ceph telemetry preview
  ceph telemetry preview-device
  ceph telemetry preview-all

Signed-off-by: Yaarit Hatuka <yaarit@redhat.com>
2022-01-13 21:53:47 +00:00
Josh Durgin
bd05cede10
Merge pull request #44554 from jdurgin/wip-rbd-qos-docs
doc/rbd: clarify and add more detail to librbd QoS docs

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-13 12:02:03 -08:00
Adam King
b064b1fb4f
Merge pull request #44394 from melissa-kun-li/enable-autotune
Enable autotune for osd_memory_target on bootstrap

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2022-01-13 12:06:46 -05:00
Josh Durgin
e1548ef36a doc/rbd/rbd-config-ref: add more detail on QoS settings
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2022-01-13 11:37:46 -05:00
Patrick Seidensal
18d3a71618 mgr/prometheus: Fix regression with OSD/host details/overview dashboards
Fix issues with PromQL expressions and vector matching with the
`ceph_disk_occupation` metric.

As it turns out, `ceph_disk_occupation` cannot simply be used as
expected, as there seem to be some edge cases for users that have
several OSDs on a single disk.  This leads to issues which cannot be
approached by PromQL alone (many-to-many PromQL erros).  The data we
have expected is simply different in some rare cases.

I have not found a sole PromQL solution to this issue. What we basically
need is the following.

1. Match on labels `host` and `instance` to get one or more OSD names
   from a metadata metric (`ceph_disk_occupation`) to let a user know
   about which OSDs belong to which disk.

2. Match on labels `ceph_daemon` of the `ceph_disk_occupation` metric,
   in which case the value of `ceph_daemon` must not refer to more than
   a single OSD. The exact opposite to requirement 1.

As both operations are currently performed on a single metric, and there
is no way to satisfy both requirements on a single metric, the intention
of this commit is to extend the metric by providing a similar metric
that satisfies one of the requirements. This enables the queries to
differentiate between a vector matching operation to show a string to
the user (where `ceph_daemon` could possibly be `osd.1` or
`osd.1+osd.2`) and to match a vector by having a single `ceph_daemon` in
the condition for the matching.

Although the `ceph_daemon` label is used on a variety of daemons, only
OSDs seem to be affected by this issue (only if more than one OSD is run
on a single disk).  This means that only the `ceph_disk_occupation`
metadata metric seems to need to be extended and provided as two
metrics.

`ceph_disk_occupation` is supposed to be used for matching the
`ceph_daemon` label value.

    foo * on(ceph_daemon) group_left ceph_disk_occupation

`ceph_disk_occupation_human` is supposed to be used for anything where
the resulting data is displayed to be consumed by humans (graphs, alert
messages, etc).

    foo * on(device,instance)
    group_left(ceph_daemon) ceph_disk_occupation_human

Fixes: https://tracker.ceph.com/issues/52974

Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
2022-01-13 13:27:55 +01:00
Yuri Weinstein
a8bb49d4d9
Merge pull request #39440 from pdvian/wip-warn-filestore-osds
mon/OSDMonitor, osd: Add warning on filestore deprecation and force use of wpq scheduler for filestore OSDs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-12 08:49:02 -08:00
Josh Durgin
52995842a9 doc/rbd/rbd-config-ref: group QoS options by throttle type
This makes it clearer that there are distinct throttles with the
same groups of settings.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2022-01-11 21:46:37 -05:00
Josh Durgin
146b40ecd6 doc/releases: mark nautilus eol
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2022-01-11 21:13:29 -05:00
Josh Durgin
3bc27e21e5 doc/releases: remove obsolete info
We haven't done dev releases for years, and versions prior to luminous
are no longer relevant.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2022-01-11 21:04:55 -05:00
Casey Bodley
81d3517bde
Merge pull request #42891 from ofriedma/wip-ofriedma-rgw-qos-finale
rgw: Add rgw rate limiting per user and per bucket

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-11 11:35:05 -05:00
Casey Bodley
3413886230
Merge pull request #38774 from linuxbox2/wip-doc-replsupport
rgw: document S3 bucket replication support

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-01-11 11:13:24 -05:00
Ernesto Puerta
310e8f5571
Merge pull request #43404 from rhcs-dashboard/angular-12-upgradee
mgr/dashboard: Update Angular version to 12 

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2022-01-11 13:02:07 +01:00
Ernesto Puerta
f5237e8b4a
Merge pull request #44088 from ceph/feature-48388-cache
mgr: TTL cache implementation

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
Reviewed-by: sebastian-philipp <NOT@FOUND>
2022-01-11 12:52:41 +01:00
Matt Benjamin
774a247b2b doc: rgw: document S3 bucket replication support
Support was added at Octopus.

Fixes: https://tracker.ceph.com/issues/48755

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-01-10 12:13:35 -05:00
Or Friedmann
fd084fd7fc rgw: Add admin ops API for rate limiting
Add admin ops API for rate limiting and some bug fixes

Signed-off-by: Or Friedmann <ofriedma@redhat.com>
2022-01-10 16:48:56 +00:00
Sebastian Wagner
62558af5a3
Merge pull request #42115 from sandrobonazzola/patch-2
doc/install: ensure to open ceph-mon firewall ports

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-10 15:41:32 +01:00
Radoslaw Zarzynski
4c58d71d2b doc/cephadm: improve the developer's guide a bit
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-01-10 14:18:00 +00:00
Radoslaw Zarzynski
e513869fd3 doc/cephadm: fix a typo in developing-cephadm.rst
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-01-10 14:15:23 +00:00
Yuval Lifshitz
493181d5dc
Merge pull request #44301 from yuvalif/wip-yuval-cloudevents
rgw/notifications: add cloudevents support to HTTP endpoint
2022-01-09 09:32:53 +02:00
Sebastian Wagner
af5f475a45
Merge pull request #44020 from adk3798/host-ls-scale
mgr/orchestrator: add filtering and count option for orch host ls

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2022-01-07 11:59:04 +01:00
yuval Lifshitz
e35d511cb7 rgw/notifications: add cloudevents support to HTTP endpoint
following the cloudevents HTTP spec:
https://github.com/cloudevents/spec/blob/v1.0.1/http-protocol-binding.md
and more specifically this aws-s3 spec:
https://github.com/cloudevents/spec/blob/main/cloudevents/adapters/aws-s3.md

Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>
2022-01-07 09:56:06 +02:00
Sage Weil
d2265e81fb Merge PR #44054 into master
* refs/pull/44054/head:
	doc/rados/operations: document pg_num_max
	mgr: set max of 32 pgs for .mgr pool
	mgr/dashboard: expect pg_num_max property for pools
	mon/OSDMonitor: add option --pg-num_max arg for create pool
	mon/OSDMonitor: disallow setting pg_num < min or > max
	mgr/pg_autoscaler: apply pg_num_max
	mon: add pg_num_max pool property

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-01-06 08:54:45 -05:00
Ilya Dryomov
3b7513e46a
Merge pull request #44157 from CongMinYin/pwl-small-fixes
librbd/cache/pwl: code cleanup and some minor fixes

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-06 14:54:31 +01:00
Melissa Li
0fad0fde9c doc/cephadm: warn about default enabling osd_memory_target_autotune
Fixes: https://tracker.ceph.com/issues/51562
Signed-off-by: Melissa Li <melissali@redhat.com>
2022-01-05 16:06:07 -05:00
Neha Ojha
24df4a2e83
Merge pull request #44474 from ljflores/wip-doc-integration-tests
doc/.../testing_integration_tests: fix formatting of teuthology-suite option

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-05 10:33:55 -08:00
Laura Flores
33ae23a150 doc/.../testing_integration_tests: fix formatting of teuthology-suite option
The `--subset` teuthology-suite option should be formatted.

Signed-off-by: Laura Flores <lflores@redhat.com>
2022-01-05 16:48:53 +00:00
Or Friedmann
71ffbaee08 rgw: Add rgw rate limiting per user and per bucket
Add rgw rate limiting per user and per bucket

Signed-off-by: Or Friedmann <ofriedma@redhat.com>
2022-01-05 15:22:13 +00:00
Matt Benjamin
2a465f806a
Merge pull request #39192 from linuxbox2/wip-lc-notify
rgwlc:  optionally support notifications on object expiration
2022-01-05 09:38:47 -05:00
Nizamudeen A
e3d92e4889 mgr/dashboard: Update Angular version to 12
A full changelog can be seen here: https://blog.angular.io/angular-v12-is-now-available-32ed51fbfd49

For us, the most I had to do is to take care of the min-max validation
and a small CSS change regarding the math()

Fixes: https://tracker.ceph.com/issues/53049
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-01-05 19:37:23 +05:30
Venky Shankar
206d444d37
Merge pull request #44279 from jtlayton/wip-50235
cephfs-shell: add the ability to mount a named filesystem

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-05 17:46:01 +05:30
Prashant D
658dbf4528 doc/rados/operations: Document health check OSD_FILESTORE
Signed-off-by: Prashant D <pdhange@redhat.com>
2022-01-05 10:08:25 +00:00
Waad AlKhoury
8f99e18380 doc/mgr: Add cli api documentation
Signed-off-by: Waad AlKhoury <walkhour@redhat.com>
2022-01-05 10:11:58 +01:00
Pere Diaz Bou
69aa388d90 doc/mgr: Add cache documentation
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-01-05 10:11:58 +01:00
Yuri Weinstein
3f21194f13
Merge pull request #43716 from kamoltat/wip-ksirivad-autoscale-global-flag
mgr/autoscaler: Introduce noautoscale flag

Reviewed-by: Vikhyat Umrao <vikhyat@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-01-04 14:42:41 -08:00
Laura Flores
f60e086072
Merge pull request #44433 from sebastian-schmid/master
docs/start: fixes typo in hardware recommendation docs
2022-01-04 11:21:59 -06:00
Alfonso Martínez
dae1b27022
Merge pull request #43580 from rhcs-dashboard/cephadm_box-docs
cephadm/box: DiD box documentation

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: sebastian-philipp <sewagner@redhat.com>
2022-01-04 17:24:44 +01:00
Sebastian Schmid
4842140311 docs/start: fixes typo and empty headline in hardware recommendation docs
Signed-off-by: Sebastian Schmid <mail@sebastian-schmid.de>
2022-01-04 17:15:51 +01:00
Matt Benjamin
7b74603513 rgwlc: harmonize lifecycle notifications with the others
After working with notification configurations, it seemed to make
more sense to organize the different lifecycle notification sub-types
along the same lines as the official AWS ones.  So, there are now
ObjectExpirationCurrent and ObjectExpirationNoncurrent types, and
an ObjectExpiration wildcard.  Similarly, ObjectTransition
contains Current and Noncurrent sub-types.

Note that I have defined an ObjectExpirationAbortMPU notification
sub-type, but do not currently generate it--this is to avoid changing
the rgw::sal interface, but most likely we would support this in
future.

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2022-01-04 09:26:16 -05:00
Venky Shankar
a612b3cb85
Merge pull request #43618 from kotreshhr/recover-symlink
mds: Store symlink target in first data object

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-01-04 14:39:22 +05:30
Sage Weil
7ae62167e3 doc/rados/operations: document pg_num_max
Signed-off-by: Sage Weil <sage@newdream.net>
2022-01-03 14:12:54 -05:00
Yin Congmin
1b4f4841bb doc/rbd: change persistent write-back cache to persistent write log cache
The full name of PWL is persistent write log, and the full name of
RWL is replica write log. Change the title to make it consistent
with the name of the feature and better reflect its design.

Signed-off-by: Yin Congmin <congmin.yin@intel.com>
2021-12-31 16:04:19 +08:00
Mara Sophie Grosch
5d872f3a28 doc: add docs for rbd_default_order
Adds documentation how to change default rbd object size. With the
previous option `--order` it was easy to guess the config name for the
default value, with the current option name `--object-size` thats hard
to guess.

Also extends the documentation for rbd_default_order to include
* how object-size is derived from the configured value
* allowed range of the value

In the first version of this commit I also added min and max for this
parameter (12/25, matching the object size range in `man 8
rbd`/Striping/object-size), but this made some tests fail, since some
seem to set values outside this range (and probably are fine since
included for some time already). To have this a doc-change only, I
removed the range.

Signed-off-by: Mara Sophie Grosch <littlefox@lf-net.org>
2021-12-27 19:58:56 +01:00
Kefu Chai
3b250938bc doc: remove references to SEASTAR_DEFAULT_ALLOCATOR
now that 067681b701
has been merged upstream, and our src/seastar submodule includes
this commit. there is no need to worry that the seastar's lockless
allocator does not work with seastar::alien anymore.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2021-12-26 13:13:56 +08:00