Commit Graph

8366 Commits

Author SHA1 Message Date
Casey Bodley
b3cffa193d
Merge pull request #42222 from flipkart-incubator/aws_sse_s3
rgw: Introduce BucketEncryption APIs to support SSE-S3 feature

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-07-27 10:52:23 -04:00
Patrick Donnelly
0e71ea4a13
Merge PR #42106 into master
* refs/pull/42106/head:
	mds: create file system with specific ID

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-23 11:15:33 -07:00
Josh Durgin
ce483a14ed
Merge pull request #42131 from tchaikov/wip-doc-dev-ci
doc/dev/continuous-integration: use ceph repos

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-07-23 09:35:58 -07:00
Neha Ojha
54b41f71d9
Merge pull request #42365 from PracticalMetal/typo
doc: Fix typos and grammar in ecbackend.rst

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-07-22 08:46:33 -07:00
Pulkit Mittal
8f84f121e1 doc: fix typo and grammar
Signed-off-by: Pulkit Mittal <2pulkit2@gmail.com>
2021-07-22 13:48:07 +05:30
Kefu Chai
bb129fc0ed doc/cephfs/journaler: document options using confval directive
better maintainablity this way. and drop unsupported options of

- journaler batch interval
- journaler batch max

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-22 11:16:56 +08:00
Kefu Chai
2bd034056a
Merge pull request #42408 from tchaikov/wip-mgr-always-on
mon/MgrMonitor: drop nautilus modules from always_on_modules

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-07-22 08:56:43 +08:00
Patrick Donnelly
4b1e101571
Merge PR #42295 into master
* refs/pull/42295/head:
	doc/cephfs: recover file system after recovering

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-21 13:13:43 -07:00
Neha Ojha
d09a04617e
Merge pull request #42402 from ljflores/perf-counter-docs
doc/dev/perf_counters: update docs to include more context about perf counter usage

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-07-21 10:40:46 -07:00
Kefu Chai
f54574d1ac doc/man/8/ceph-volume: specify "program" for subcommands
as per
https://www.sphinx-doc.org/en/master/usage/restructuredtext/domains.html

> Like py:currentmodule, this directive produces no output. Instead, it
> serves to notify Sphinx that all following option directives document
> options for the program called name.
> ...
> The program name may contain spaces (in case you want to document
> subcommands like svn add and svn commit separately).

and to avoid the warnings like:

doc/man/8/ceph-volume.rst:424: WARNING: Duplicate explicit target name:
"cmdoption-ceph-volume-h".

we should specify different "program" for different set of options.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-22 01:13:54 +08:00
Dimitri Savineau
99166e1044 doc/man/8/radosgw-admin: fix typo on max entries
This fixes a typo for the --max-entries option.

Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>
2021-07-20 10:49:41 -04:00
Sebastian Wagner
669660e706
Merge pull request #42304 from sebastian-philipp/doc-dameon-add-note
doc/cephadm: add notes to `orch daemon add`

Reviewed-by: Dimitri Savineau <dsavinea@redhat.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
2021-07-20 12:09:33 +02:00
Sebastian Wagner
657eacfc41
Merge pull request #42372 from sebastian-philipp/doc-cephadm-rgw-ssl
doc/cephadm: Add RGW ssl

Reviewed-by: Dimitri Savineau <dsavinea@redhat.com>
Reviewed-by: Zac Dover <zac.dover@gmail.com>
2021-07-20 12:09:20 +02:00
Yuval Lifshitz
04796910f9
Merge pull request #42355 from yuvalif/wip-yuval-fix-51681
rgw/notifications: send correct size in case of delete marker creation
2021-07-20 10:55:16 +03:00
Kefu Chai
9e5986c441 doc/mgr/administrator: document mgr_disabled_modules
this option prevent mgr from loading specified modules. which could
be handly when debugging issues with always_on_modules.

and document mgr_standby_modules as well.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-20 11:09:09 +08:00
Laura Flores
c0bd4e2269 doc/dev/perf_counters: update docs to include more context about perf counter usage
The Perf Counters docs, although informative, are lacking for users and developers who are wondering what they can do with their perf counter data. I wrote an extra paragraph here that outlines some ways in which the counters can be used, including diagnosing problems in a cluster and identifying workload patterns.

Signed-off-by: Laura Flores <lflores@redhat.com>
2021-07-19 19:07:39 +00:00
Ernesto Puerta
64dbe17fdb
Merge pull request #42188 from votdev/issue_51408_motd
mgr/dashboard: Add configurable MOTD or wall notification

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Paul Cuzner <pcuzner@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: sebastian-philipp <NOT@FOUND>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2021-07-19 19:56:50 +02:00
Yuval Lifshitz
6fb6a8e3ea
Merge pull request #42102 from Matan-B/lua-request-userId
rgw: Added request field to lua scripting
2021-07-19 18:01:27 +03:00
Yuval Lifshitz
cf0287dbd0
Merge pull request #41927 from Matan-B/rfe-51193-add-luarocks-version
rgw: add package version support to lua scripting
2021-07-19 18:00:51 +03:00
Rahul Dev Parashar
34befa4122 rgw: Address review comments, fix test cases for BucketEncryption APIs
Review comments are addressed.
Added documentation in authentication.rst for newly added IAM policies.
Test case failure due to incorrect IAM policy is fixed.

Signed-off-by: Rahul Dev Parashar <rahul.dev@flipkart.com>
2021-07-19 14:13:43 +05:30
Rahul Dev Parashar
95acefb2f5 rgw: Introduce BucketEncryption APIs to support SSE-S3 feature
This patch introduces support for 3 new BucketEncryption APIs which are listed
below and are helpful in supporting AWS SSE-S3 encryption mode.
PutBucketEncryption: https://docs.aws.amazon.com/AmazonS3/latest/API/API_PutBucketEncryption.html
GetBucketEncryption: https://docs.aws.amazon.com/AmazonS3/latest/API/API_GetBucketEncryption.html
DeleteBucketEncryption: https://docs.aws.amazon.com/AmazonS3/latest/API/API_DeleteBucketEncryption.html

The user provided parameters are parsed and stored in the bucket's extended
attributes RGW_ATTR_BUCKET_ENCRYPTION and
RGW_ATTR_BUCKET_ENCRYPTION_SSE_S3_KEY_ID.

Signed-off-by: Rahul Dev Parashar <rahul.dev@flipkart.com>
2021-07-19 12:48:14 +05:30
wangfei
7f476bea44 doc/cephadm: add missing "ceph"
The word ceph is missing.

Signed-off-by: "Wang,Fei" <wf.ab@126.com>
2021-07-19 13:40:17 +08:00
wangfei
0003abd49c doc/cephadm: correct a transposed word error
The positions of two words are interchanged:
scans each cluster in the host ----> scans each host in the cluster

Signed-off-by: "Wang,Fei" <wf.ab@126.com>
2021-07-19 13:35:37 +08:00
Ramana Raja
ffe5cfb687 doc/cephfs: recover file system after recovering
... monitor stores using OSDs. The steps are valid only to recover
single active MDS file systems.

Partially-fixes: https://tracker.ceph.com/issues/51341
Signed-off-by: Ramana Raja <rraja@redhat.com>
2021-07-16 17:20:35 -04:00
Yuval Lifshitz
d81e27faa1 rgw/notifications: send correct size in case of delete marker creation
Fixes: https://tracker.ceph.com/issues/51681

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2021-07-16 14:12:10 +03:00
Sebastian Wagner
0a77eee518 doc/cephadm: Add RGW ssl
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-07-16 12:54:00 +02:00
Patrick Donnelly
5ef5b74edf
Merge PR #42341 into master
* refs/pull/42341/head:
	doc/cephadm: operations.rst typo

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-15 12:41:56 -07:00
Casey Bodley
61b112e12d
Merge pull request #41579 from trociny/wip-50932
rgw: allow to set ssl options and ciphers for beast frontend

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-07-15 14:17:41 -04:00
Ilya Dryomov
c508f380d8 doc/releases: add linkage for 15.2.13
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-07-15 17:51:31 +02:00
Sage Weil
954abbe5e2 Merge PR #42073 into master
* refs/pull/42073/head:
	doc/mgr/nfs: fix 'export apply', pool name
	PendingReleaseNotes: document workaround for NFS storage change
	qa/tasks/mgr/test_orchestrator_cli: fix test
	qa/suites/orch/cephadm/mgr-nfs-upgrade: add test for nfs migration
	mgr/cephadm: migrate nfs grace file
	mgr/nfs: migrate pre-pacific nfs.ganesha-foo clusters to nfs.foo
	doc/cephfs/fs-nfs-exports: document new export apply capabilities
	qa/tasks/cephfs/test_nfs: define NFS_POOL_NAME
	mgr/nfs: use NFS_POOL_NAME in test_nfs.py
	mgr/nfs: test export apply on JSON list
	mgr/nfs: add test for ganesha conf apply/import
	qa/tasks/cephfs/test_nfs: retry mount a few times
	mgr/cephadm: migrate all legacy nfs exports to new .nfs pool
	mgr/nfs: adjust cephfs export caps if necessary
	python-common: don't accept pool/ns for NFSServiceSpec
	mgr/orchestrator: drop rados_config_location ServiceDescription property
	mgr/cephadm: move rados_config_location() out of NFSServiceSpec
	mgr/nfs: change nfs pool to .nfs
	mgr/nfs/export: accept a JSON or ganesha EXPORT config
	mgr/nfs: allow 'nfs export apply' to take a list of exports
	python-common: remove pool + namespace from NFSServiceSpec
	mgr/nfs: used fixed pool + ns
	mgr/rook: used fixed pool + ns
	mgr/dashboard: use fixed pool + ns
	mgr/cephadm: always use fixed pool and namespace
	mgr/nfs: adjust test to match pool name
	mgr/nfs: always create ganesha pool with well-defined name

Reviewed-by: Varsha Rao <varao@redhat.com>
2021-07-15 11:05:22 -04:00
Sage Weil
62e4ea5ff1 doc/mgr/nfs: fix 'export apply', pool name
Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-15 09:47:39 -04:00
Kefu Chai
ac001cbd2e
Merge pull request #42334 from tchaikov/wip-crimson-logging
crimson/common/log: print out logger.debug() when log level >=6

Reviewed-by: Mark Nelson <mnelson@readhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2021-07-15 11:06:34 +08:00
Sage Weil
3cfd779e5b doc/cephfs/fs-nfs-exports: document new export apply capabilities
- import list
- import ganesha conf

Signed-off-by: Sage Weil <sage@newdream.net>
2021-07-14 16:20:11 -04:00
Sage Weil
01c006c2de Merge PR #42041 into master
* refs/pull/42041/head:
	mgr/restful: ignore min/max_size
	test/crush: drop min/max_size refs
	qa/workunits/mon/pool_ops: remove test for min/max_size check
	qa: scrub a few remaining mentions of ruleset
	qa/standalone/mon/osd-*: fix tests
	PendingReleaseNotes: note min/max_size removal
	mgr/dashboard: remove max/min_size and ruleset
	mon/OSDMonitor: fix calls to CrushTester
	crush: eliminate min_size and max_size
	test/cli/crushtool: reunumber rulesets in test maps
	crushtool: require min/max or num-rep for --test
	crush: remove last traces of 'ruleset'
	test/cli/crushtool: use 'id' instead of 'ruleset' in crush inputs
	crushtool: take --min-rep and --max-rep explicitly
	crush/CrushTester: drop --ruleset
	doc: scrub 'ruleset' from docs
	src/erasure-code: rule, not ruleset
	mon/OSDMonitor: remove check_crush_rule() callers
	mon/OSDMonitor: rule, not ruleset
	crushtool: remove check for overlapped ruels
	crush/CrushWrapper: get_osd_pool_default_crush_replicated_ruleset -> rule
	crush: remove find_rule()
	mon/OSDMonitor: use pool's crush rule directly
	osd/OSDMap: drop checks for ruleset == ruleid
	osd/OSDMap: use pool's crush rule_id directly
	mon/PGMap: use pool's crush_rule directly
	mon/OSDMonitor: remove crush ruleset->rule rewrite

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
2021-07-14 14:38:59 -04:00
Zac Dover
86b53cc1eb doc/cephadm: operations.rst typo
s/any hosts that is/any host/

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-07-15 03:22:37 +10:00
zdover23
a0bbdb7725
Merge pull request #42327 from zdover23/wip-doc-cephadm-troubleshooting-1-of-x-2021-07-15
doc/cephadm: rewrite troubleshooting 1 of x

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-07-15 01:35:14 +10:00
Kefu Chai
83bf44a3c2 crimson/common/log: print out logger.debug() when log level >=6
less chatty when debug level is 5. this matches the behavior of classic
osd.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-14 21:25:54 +08:00
Sebastian Wagner
6b0d61554b
Merge pull request #42244 from zdover23/wip-doc-cephadm-operations-data-location-and-health-checks-2021-07-08
doc/cephadm: operations: Data location & ...

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-07-14 11:16:45 +02:00
Sebastian Wagner
b53af54adc
doc/cephadm: add notes to orch daemon add
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-07-14 11:07:52 +02:00
Volker Theile
f7f163e75c mgr/dashboard: Add configurable MOTD or wall notification
Fixes: https://tracker.ceph.com/issues/51408

Signed-off-by: Volker Theile <vtheile@suse.com>
2021-07-14 10:48:49 +02:00
Mykola Golub
fb31c87c2d rgw: set default ssl options for beast frontend
to 'no_sslv2:no_sslv3:no_tlsv1:no_tlsv1_1'

Signed-off-by: Mykola Golub <mgolub@suse.com>
2021-07-14 09:20:15 +01:00
Mykola Golub
91abede635 rgw: allow to set ssl options and ciphers for beast frontend
Two new conf keys are added for "beast" framework:

- ssl_options: a colon separated list of ssl context options,
  documented in boost's ssl::context_base;

- ssl_ciphers: a colon separated list of ciphers, documented
  in openssl's ciphers(1) manual.

Example:

  rgw frontends = beast ...  ssl_options=default_workarounds:no_tlsv1:no_tlsv1_1 ssl_ciphers=HIGH:!aNULL:!MD5

Fixes: https://tracker.ceph.com/issues/50932
Signed-off-by: Mykola Golub <mgolub@suse.com>
2021-07-14 09:20:15 +01:00
Zac Dover
bd24b6d392 doc/cephadm: rewrite troubleshooting 1 of x
This PR improves the readability and format
of the troubleshooting.rst file. This also
makes a change to the markdown of one of the
sub-subsections so that it is made of tildes
(~) instead of carets (^), because that's
the RST standard.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-07-14 16:17:19 +10:00
Sage Weil
a32133ec83 Merge PR #42278 into master
* refs/pull/42278/head:
	doc/mgr/nfs: update about RGW exports
	doc/cephfs/nfs: update about nfs module
	doc/mgr/nfs: update cephfs export create command about client and squash arguments
	doc/mgr/nfs: update nfs links
	doc/mgr/nfs: add missing cluster_id to export info command
	doc/cephfs: move nfs doc under mgr docs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-07-13 16:26:33 -04:00
Kefu Chai
287eebb388
Merge pull request #42301 from tchaikov/wip-doc-crimson-nbd
doc/dev/crimson: add a section for testing with crimson-store-nbd

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-07-14 01:04:07 +08:00
Kefu Chai
51b34df130 doc/dev/crimson: add a section for testing with crimson-store-nbd
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-14 00:37:08 +08:00
Sage Weil
ea7ac19e0a Merge PR #42227 into master
* refs/pull/42227/head:
	doc/man/8/cephadm: add --log-to-file (and --single-host-defaults)
	cephadm: add bootstrap --log-to-file option

Reviewed-by: Adam King <adking@redhat.com>
2021-07-13 12:04:55 -04:00
Kefu Chai
ec5b56c98f doc/dev/crimson: add a missing not
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-07-14 00:00:22 +08:00
Sebastian Wagner
507ee67848
Merge pull request #42209 from sebastian-philipp/doc-dev-cephadm-define-vars
doc/dev/cephadm: Define variables

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-07-13 16:06:01 +02:00
Varsha Rao
387369373c doc/mgr/nfs: update about RGW exports
This patch just moves the RGW exports created using nfs module to mgr/nfs
document. The RGW requirements will be updated in a different PR.

Signed-off-by: Varsha Rao <varao@redhat.com>
2021-07-13 15:04:54 +05:30