Commit Graph

8714 Commits

Author SHA1 Message Date
Casey Bodley
d9f4940140 rgw/beast: add max_header_size option with 16k default, up from 4k
in f13c6914eb, we switched to a static 64k
parse buffer. this gives us a lot of room to raise the header_limit
above 4k

adds a "max_header_size" frontend option with default 16k and maximum
value equal to the 64k parse buffer size

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 14:55:25 -05:00
Deepika Upadhyay
742e6cbd5f
Merge pull request #43764 from gregsfortytwo/wip-rbd-crash-consistency
doc: fix up rbd snapshot docs around crash consistency

Reviewed-by: Mykola Golub <mykola.golub@clyso.com>
Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
2021-11-20 00:29:16 +05:30
Venky Shankar
93054a3fa9
Merge pull request #43886 from nmshelke/doc-fix-53054
doc: prerequisites fix for cephFS mount

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-11-19 10:10:59 +05:30
Neha Ojha
e76a9f4045
Merge pull request #43326 from pdvian/wip-doc-config-correction
doc/dev/config: Replace invalid config debug-pg

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-11-18 17:03:11 -08:00
Casey Bodley
483b1b7487
Merge pull request #35100 from soumyakoduri/cloudtiering
rgw/CloudTransition: Transition objects to cloud endpoint

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-11-18 09:27:46 -05:00
Sebastian Wagner
fa37ef0f32
Merge pull request #43969 from sebastian-philipp/core
doc/cephadm: core dumps

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2021-11-18 10:52:36 +01:00
Soumya Koduri
aa362e8899 rgw/CloudTransition: Include aws region name for remote endpoint
With commit#81ad226, aws auth v4 rquires region name for remote
endpoint connection. Include the same in the tier parameters.

& misc fixes

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-11-18 12:52:48 +05:30
Soumya Koduri
cf24116690 rgw/CloudTransition: Handle versioned objects
For versioned and locked objects, similar semantics as that of LifecycleExpiration are applied as stated below -

If the bucket versioning is enabled and the object transitioned to cloud is
 - current version, irrespective of what the config option "retain_object" value is, the object is not deleted but instead delete marker is created on the source rgw server.
 - noncurrent version, it is deleted or retained based on the config option "retain_object" value.

If the object is locked, and is
 - current version, it is transitioned to cloud post which it is made noncurrent with delete marker created.
 - noncurrent version, transition is skipped.

Also misc rebase fixes and cleanup -

* Rename config option to "retain_head_object"

to reflect its functionality to keep head object post transitioning
to cloud if enabled

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-11-18 12:52:48 +05:30
Soumya Koduri
9a2c48a520 rgw/CloudTransition: Change tier-type to cloud-s3
Currently the transition is supported to cloud providers
that are compatible with AWS/S3. Hence change the tier-type to
cloud-s3 to configure the S3 style endpoint details.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-11-18 12:52:48 +05:30
Soumya Koduri
728f13d8c6 rgw/CloudTransition: handle versioned objects
If the object is versioned, to avoid objects getting overwritten
post transition to cloud, append object versionID to the target
object name

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-11-18 12:52:48 +05:30
Soumya Koduri
076a7e7fee rgw/CloudTransition: Add documentation
Also to avoid object name collisions across various buckets
post cloud transition, add bucket name to the object prefix.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-11-18 12:52:48 +05:30
Sebastian Wagner
223af588a9
doc/cephadm: core dumps
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-17 16:46:09 +01:00
Sebastian Wagner
6e528ed7c5
Merge pull request #43095 from sebastian-philipp/_check_for_moved_osds
mgr/cephadm: Add _check_for_moved_osds

Reviewed-by: Adam King <adking@redhat.com>
2021-11-17 15:09:06 +01:00
Sebastian Wagner
4035ba419d
Merge pull request #42906 from sebastian-philipp/rm-ceph-orch-osd-i
mgr/orch: deprecated `ceph orch apply osd -i <osd_spec_file>`

Reviewed-by: Adam King <adking@redhat.com>
2021-11-17 11:18:51 +01:00
Nikhilkumar Shelke
e369dc1128 doc: prerequisites fix for cephFS mount
Fixes: https://tracker.ceph.com/issues/53054

Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2021-11-17 00:32:55 +05:30
Casey Bodley
874b2b304a
Merge pull request #42880 from Kalkulus1/patch-1
doc: adds a way to allow users set_contents_from_filename for rgw

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-11-16 11:01:00 -05:00
Sebastian Wagner
343708fb6e
Merge pull request #43780 from mgfritch/nfs-rgw-v4
doc/radosgw/nfs: add note about NFSv3 deprecation

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Sage Weil <sage@newdream.net>
Reviewed-by: Varsha Rao <rvarsha016@gmail.com>
2021-11-16 11:38:03 +01:00
Venky Shankar
785edd08a0
Merge pull request #42110 from joscollin/wip-doc-cephfs-top-misc-fixes
cephfs-top: fix Refresh interval

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-11-15 11:50:22 +05:30
Patrick Donnelly
6588d8ff77
Merge PR #43896 into master
* refs/pull/43896/head:
	doc: document subvolume (group) pins

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
2021-11-12 10:20:05 -05:00
Yuval Lifshitz
d69f196c0f
Merge pull request #43587 from zenomri/wip-omri-tracer-opentelemetry
common/tracer: Tracer implementation using opentelemetry sdk
2021-11-11 19:40:12 +02:00
Patrick Donnelly
6e569bfd14
doc: document subvolume (group) pins
Fixes: https://tracker.ceph.com/issues/53236
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-11 12:30:02 -05:00
Ernesto Puerta
45eb9dd328
Merge pull request #43464 from rsommer/wip-prometheus-standby-behaviour
mgr/prometheus: Make prometheus standby behaviour configurable

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-11-11 17:36:30 +01:00
Jos Collin
f7e86a92f2
cephfs-top, doc: fix Refresh interval
Signed-off-by: Jos Collin <jcollin@redhat.com>
2021-11-11 14:20:47 +05:30
Roland Sommer
c1570f870e mgr/prometheus: Make standby discoverable
Enable config settings to modify standby's behaviour on the index page
This makes the standby discoverable by reverse proxy or loadbalancer
setups. Testing for the empty response of the '/metrics' endpoint would
trigger metric collection on the active manager instance.

The newly added configuration options settings standby_behaviour and
standby_error_status_code are documented and flagged as runtime, as
modifying both settings has an immediate effect (no restart required).

Co-authored-by: Ernesto Puerta <37327689+epuertat@users.noreply.github.com>
Signed-off-by: Roland Sommer <rol@ndsommer.de>
Fixes: https://tracker.ceph.com/issues/53229
2021-11-11 08:28:40 +01:00
Laura Flores
92fcfbb464
Merge pull request #43411 from ljflores/wip-mgr-command-cleanup
mon: simplify 'mgr module ls' output
2021-11-10 14:09:51 -06:00
Sebastian Wagner
3fef006e0e
mgr/orch: Deprecate ceph orch apply -i <osd_spec_file>
* Remove usage
* Simplify error messages

Fixes: https://tracker.ceph.com/issues/47401

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-10 14:24:52 +01:00
Sebastian Wagner
501ecf035e
mgr/orch: Add DaemonDescriptionStatus starting and unknown
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-10 13:49:24 +01:00
David Galloway
ac6766c929
Merge pull request #43525 from ceph/wip-yuriw-release-15.2.15-master
doc: 15.2.15 Release Notes
2021-11-09 09:01:34 -05:00
Jos Collin
722f95e7ff
doc: update dev list and kernel client
Signed-off-by: Jos Collin <jcollin@redhat.com>
2021-11-09 16:38:12 +05:30
Jos Collin
5bec0dd750
doc: update #cephfs channel
Signed-off-by: Jos Collin <jcollin@redhat.com>
2021-11-09 16:38:12 +05:30
Sebastian Wagner
4f56c918e8
Merge pull request #43807 from sebastian-philipp/osd_memory_target_autotune-true
doc/cephadm: Recommend osd_memory_target_autotune

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sage Weil <sage@newdream.net>
2021-11-05 15:09:20 +01:00
Sebastian Wagner
41a487005c
doc/cephadm: Recommend osd_memory_target_autotune
In case the cluster runs on hardware that is used exclusively for
Ceph, let's recommend `osd_memory_target_autotune`

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-05 10:53:14 +01:00
Sage Weil
d87d2bd146 Merge PR #43611 into master
* refs/pull/43611/head:
	doc/mgr/nfs: document rgw user and bucket exports
	PendingReleaseNotes: add note about nfs CLI change(s)
	qa/suites/orch/cephadm/smoke-roleless: add rgw user nfs export case
	mgr/nfs: take user-id and/or bucket for 'nfs export create rgw'
	mgr/nfs: reorder 'nfs export creage rgw' arguments
	mgr/nfs: reorder 'nfs export create cephfs' arguments
	mgr/nfs: use keyword args for 'nfs export create rgw'
	mgr/nfs: document and use keyword args for 'nfs export create cephfs'
	qa/tasks/cephfs/test_nfs: use keyword args
	pybind/ceph_argparse: handle misordered keyword arguments

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2021-11-04 14:33:45 -04:00
Ernesto Puerta
f56baf291e
Merge pull request #43725 from rhcs-dashboard/nfs-export-form-fix
mgr/dashboard: NFS 'create export' form: fixes

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-11-04 17:00:13 +01:00
Sage Weil
b6d85e3975 doc/mgr/nfs: document rgw user and bucket exports
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-04 10:42:50 -04:00
Michael Fritch
a4fa3dd714
doc/radosgw/nfs: add note about NFSv3 deprecation
cephadm and rook based deployments have deprecated
the NFSv3 deprecated in favor of NFSv4

Signed-off-by: Michael Fritch <mfritch@suse.com>
2021-11-03 11:21:37 -06:00
Sebastian Wagner
ecf8b8ebde
doc/cephadm: purge
Fixes: https://tracker.ceph.com/issues/50534
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-03 14:47:32 +01:00
Alfonso Martínez
a6aeded514 mgr/dashboard: python unit tests refactoring
* Controller tests: cherrypy config: authentication disabled by default; ability to pass custom config (e.g. enable authentication).
* Auth controller: add tests; test that unauthorized request fails when authentication is enabled.
* DocsTest: clear ENDPOINT_MAP so the test_gen_tags test becomes deterministic.
* pylint: disable=no-name-in-module: fix imports in tests.

Fixes: https://tracker.ceph.com/issues/53083
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2021-11-03 10:36:47 +01:00
zdover23
db1b226cc5
Merge pull request #43750 from zdover23/wip-doc-2021-10-30-omap-format-conversion-data-corruption-bug-admonition
doc: add admonition for tracker 53062

Reviewed-by: Laura Flores <lflores@redhat.com>
2021-11-03 13:04:35 +10:00
Omri Zeneva
a1fc5c50f9 tracer, rgw, osd: rewrite Tracer class using opentelemetry sdk
Signed-off-by: Omri Zeneva <ozeneva@redhat.com>
2021-11-03 01:53:25 +02:00
Omri Zeneva
6b4382aac7 common/tracer: tracer implementation was moved to common/
Signed-off-by: Omri Zeneva <ozeneva@redhat.com>
2021-11-03 01:53:14 +02:00
Sage Weil
aef952bc46 mgr/nfs: use keyword args for 'nfs export create rgw'
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-02 17:06:58 -04:00
Sage Weil
9467f1e89e mgr/nfs: document and use keyword args for 'nfs export create cephfs'
Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-02 17:06:58 -04:00
Sebastian Wagner
0b81879f3c
Merge pull request #43762 from sebastian-philipp/doc-cephadm-ceph-monstore-tool
doc/cephadm: Calling miscellaneous ceph tools

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sage Weil <sage@newdream.net>
2021-11-02 17:07:42 +01:00
Sebastian Wagner
4ac06bc9be
doc/cephadm: Calling miscellaneous ceph tools
Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
2021-11-02 15:47:52 +01:00
Kefu Chai
3f5ff4ca00
Merge pull request #43765 from inspur-wyq/wip-doc-4
doc/rbd/rbd-mirroring.rst: fix typos

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-11-02 19:32:41 +08:00
Kefu Chai
9eb085e9a7
Merge pull request #43766 from inspur-wyq/wip-doc2
doc/radosgw/s3-notification-compatibility.rst: fix typos

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2021-11-02 10:09:07 +08:00
wangyunqing
2d64232884 doc/radosgw/s3-notification-compatibility.rst: fix typos
Signed-off-by: wangyunqing <wangyunqing@inspur.com>
2021-11-02 09:25:00 +08:00
Laura Flores
05bb4e3f02 doc/dev/developer_guide/testing_integration_tests: update "frequently used options"
The `subset` option is important in Teuthology runs for reducing the number of tests that are triggered. This option is outlined in another part of the Teuthology documentation, but I think it's important to place here as well.

Also, -n (for how many times the job will run) is incorrect; it should be -N.

Signed-off-by: Laura Flores <lflores@redhat.com>
2021-11-02 00:37:10 +00:00
Greg Farnum
1903ce28a9 doc: fix up rbd snapshot docs around crash consistency
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2021-11-01 23:36:47 +00:00