Commit Graph

131980 Commits

Author SHA1 Message Date
Yuval Lifshitz
e2aa88eddb
Merge pull request #46313 from zenomri/wip-omri-tracing-lua
rgw: add SetAttribute and AddEvent functions for TraceMetaTable in Lua

Reviewed-by: yuvalif
2022-06-14 12:22:21 +03:00
Ernesto Puerta
8bba174615
Merge pull request #46407 from melissa-kun-li/disable-create-image
mgr/dashboard: add rbd status endpoint and error page

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: sunilangadi2 <NOT@FOUND>
2022-06-14 11:00:21 +02:00
zdover23
6944600e6a
Merge pull request #46651 from zdover23/wip-doc-2022-06-13-dev-guide-essentials-master-to-main
doc/dev: s/master/main/ essentials.rst dev guide

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-06-14 16:27:14 +10:00
Anthony D'Atri
bb5f95a15a
Merge pull request #46659 from anthonyeleven/anthonyeleven-46637-followup
doc/start: Polish network section of hardware-recommendations.rst
2022-06-13 16:58:08 -07:00
Anthony D'Atri
2eb173fef9 doc/start: Polish network section of hardware-recommendations.rst
Harmonize network throughput notation, minor tweaks to wording.
Followup to #46637

Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-06-13 16:13:53 -07:00
Zac Dover
728b8f2674 doc/dev: s/master/main/ essentials.rst dev guide
This PR changes all reference to the "master" branch
to references to the "main" branch (because we renamed
"master" to main", and the docs now need to reflect that).

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-06-14 07:48:46 +10:00
zdover23
0eca78faef
Merge pull request #46637 from zdover23/wip-doc-2022-06-12-start-intro-networks-rewrite
doc/start: rewrite hardware-recs networks section

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-06-14 07:11:12 +10:00
Casey Bodley
6f765e25ab
Merge pull request #43597 from pritha-srivastava/wip-rgw-sts-role-multisite
rgw multisite: replicate metadata for iam roles

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-06-13 12:04:12 -04:00
Yuval Lifshitz
9e290f4012
Merge pull request #46568 from yuvalif/wip-yuval-lua-counters
rgw/lua: add counters to background table

Reviewed-by: mattbenjamin
Reviewed-by: Matan-b
2022-06-13 18:18:56 +03:00
Nizamudeen A
dcf0445153 mgr/dashboard: fix drain e2e failure
Cypress sometimes fail to register the click and that causes the
deselect/select to not happen properly. Deselecting the row immediately
after performing the action makes it pass from cypress.

Fixes: https://tracker.ceph.com/issues/55741
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-06-13 14:00:53 +05:30
Xiubo Li
1bbe6bbc29 client: do nothing when get a stale reply
In theory when we get a stale reply from incorrect session, that
means it's buggy in MDS. Anyway we should discard it without doing
anything.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2022-06-13 16:19:48 +08:00
Venky Shankar
2667314621
Merge pull request #44655 from lxbsz/wip-53741
mds: clear MDCache::rejoin_*_q queues before recovering file inodes 

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
Reviewed-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-06-13 13:40:04 +05:30
Venky Shankar
27f4729256
Merge pull request #45556 from mchangir/qa-add-subvolume-option-flavors
qa: add subvolume option flavors

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
2022-06-13 12:29:43 +05:30
Venky Shankar
f7bc95c2f7
Merge pull request #44347 from kotreshhr/subvolumegroup-quotas
mgr/volumes: subvolumegroup quotas

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2022-06-13 12:26:59 +05:30
Venky Shankar
67371c1ab4
Merge pull request #46332 from lxbsz/qa-snap
qa: enlarge the tag number and test more for the snapshot

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-06-13 12:25:44 +05:30
Omri Zeneva
6e43859106 doc: add explanation about the new two functions and example
Signed-off-by: Omri Zeneva <ozeneva@redhat.com>
2022-06-13 02:05:11 -04:00
Omri Zeneva
61054347f3 test: add unit tests
- added trace initialization
- opentelemetry linking when needed
- conditional ASSERT on SetBadAttribute, when we don't have opentelemetry (tracing sdk), we expect different result from the execute function.

Signed-off-by: Omri Zeneva <ozeneva@redhat.com>
2022-06-13 02:05:11 -04:00
Omri Zeneva
923f4542cf rgw: add functionality of SetAttribute and AddEvent method in postRequest context
opentelemetry supports mainly string, int64, double and boolean for values of trace's Attributes,
so we should validate those types and static cast to the proper type, which is different than Lua types

SetAttribute Closure will be returned to lua only if the request's trace is real and not noop span or even null like what happens in preRequest Context

AddEvent method comes to give us the ability to record an event. the event can be a single string that represents the event, or event name and key-value pairs.

Signed-off-by: Omri Zeneva <ozeneva@redhat.com>
2022-06-13 02:05:11 -04:00
Zac Dover
778d3c0b59 doc/start: rewrite hardware-recs networks section
This rewrites the first two-thirds of the "Networks"
section of the Hardware Recommendations page in the
Intro to Ceph document. I have tried to divide the
techincal content in this section into subsections
that foreground the various subjects covered.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-06-13 14:34:36 +10:00
Anthony D'Atri
6c46e1d842
Merge pull request #46634 from Huber-ming/pr_target_main
SubmittingPatches.rst: PRs should target "main"
2022-06-12 20:47:48 -07:00
Anthony D'Atri
052877aaef
Merge pull request #46583 from zdover23/wip-doc-2022-06-08-intro-hardware-recs-osd-acro-fix
doc/start: make OSD and MDS structures parallel
2022-06-12 20:32:05 -07:00
Anthony D'Atri
d4ef619a8d
Merge pull request #46633 from zdover23/wip-doc-2022-06-12-start-intro-crush-para-fix
doc/start: rewrite CRUSH para
2022-06-12 20:26:02 -07:00
Huber-ming
a892525c71 SubmittingPatches.rst: PRs should target "main"
Signed-off-by: Huber-ming <zhangsm01@inspur.com>
2022-06-13 09:38:40 +08:00
Zac Dover
4f6edb92b9 doc/start: make OSD and MDS structures parallel
This PR makes the "Ceph OSDs" and "MDSs" bullet points
parallel by naming "object storage daemon" before referring
to the (admittedly more common and colloquial, but surely
unknown to people who genuinely require a document called
'Intro') acronym "OSD".

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-06-13 10:12:57 +10:00
Zac Dover
ba1a85b292 doc/start: rewrite CRUSH para
This PR supersedes https://github.com/ceph/ceph/pull/46584
and makes changes suggested by Anthony D'Atri that improve
the coherence and consistency of the paragraph that explains
the basics of the CRUSH algorithm.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-06-13 09:41:28 +10:00
Anthony D'Atri
b3cc593774 src/ceph-volume/ceph_volume/activate: Improve usage message text
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-06-11 18:23:28 -07:00
Anthony D'Atri
3e24921adc doc/man/8: Tweak formatting and wording in ceph.rst
Signed-off-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
2022-06-11 14:21:50 -07:00
Anthony D'Atri
784f5bb9bf
Merge pull request #46200 from elacunza/doc-man-ceph-add-enable_stretch_mode
doc/man/8: Add enable_stretch_mode docs
2022-06-11 14:02:32 -07:00
Anthony D'Atri
de85ee65ed
Merge pull request #46462 from Thingee/update-foundation-mems-202205
doc: Updating Ceph Foundation members for May
2022-06-11 13:43:48 -07:00
Anthony D'Atri
5af1f5f3cc
Merge pull request #46195 from snosratiershad/fix-docs-double-dash-convertion-to-em-dash
doc: Disable double dashes "--" smartquotes conversion to en-dashes
2022-06-11 13:32:15 -07:00
Salar Nosrati-Ershad
26d44bcae8 doc: Disable double dashes "--" smartquotes conversion to en-dashes 2022-06-11 23:34:06 +04:30
Laura Flores
4c9fd0c272
Merge pull request #46604 from ljflores/wip-librados-test-fix
test/librados: modify LibRadosMiscConnectFailure.ConnectFailure to comply with new seconds unit
2022-06-10 11:56:19 -05:00
Yuri Weinstein
986146b0a6
Merge pull request #46606 from rzarzynski/wip-55982
osd: log the number of 'dups' entries in a PG Log

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-06-10 09:39:24 -07:00
Ilya Dryomov
5d18e44511
Merge pull request #46600 from idryomov/wip-pmdk-wno-error
cmake: pass -Wno-error when building PMDK

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-06-10 18:28:18 +02:00
Casey Bodley
991e56eab5
Merge pull request #46617 from yuvalif/wip-yuval-fix-55978
rgw/lua: pass correct value to "toplevel" param

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-06-10 09:36:38 -04:00
Casey Bodley
ffda5e50ee
Merge pull request #44648 from Huber-ming/index_cancel
rgw: delete redundant brackets

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-06-10 09:36:00 -04:00
Patrick Donnelly
d0b69a3cdf
Merge PR #46421 into main
* refs/pull/46421/head:
	doc/dev: move option -R to a different section of doc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Anthony D Atri <anthony.datri@gmail.com>
2022-06-09 20:12:49 -04:00
Radoslaw Zarzynski
8f1c8a7309 osd: log the number of 'dups' entries in a PG Log
We really want to have the ability to know how many
entries `PGLog::IndexedLog::dups` has inside.
The current ways are either invasive (stopping an OSD)
or indirect (examination of `dump_mempools`).

The code comes from Nitzan Mordechai (part of
ede37edd79a9d5560dfb417ec176327edfc0e4a3).

Fixes: https://tracker.ceph.com/issues/55982
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-06-09 20:01:40 +00:00
yuval Lifshitz
c1b7bcb2c0 rgw/lua: pass correct value to "toplevel" param
Fixes: https://tracker.ceph.com/issues/55978

Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>
2022-06-09 22:51:50 +03:00
Laura Flores
f357459e6b test/librados: modify LibRadosMiscConnectFailure.ConnectFailure to comply with new seconds unit
The unit type for `client_mount_timeout` was changed from "float" to "secs" in
983b10506d. To make this test comply with the new
seconds unit change, we need to change the value to an integer, as seconds
does not accept float values.

Fixes: https://tracker.ceph.com/issues/55971
Signed-off-by: Laura Flores <lflores@redhat.com>
2022-06-09 18:55:48 +00:00
yuval Lifshitz
0afa30f056 rgw/lua: replace int64_t with "long long int" for the background table
lua integer is "long long int" which works with GCC 11.2.1 (fedora 36)
but fails to compile on centos8 and ubuntu focal

Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>
2022-06-09 21:43:51 +03:00
yuval Lifshitz
c6065f733e rgw/lua: use constants for upvalue indexes
Signed-off-by: yuval Lifshitz <ylifshit@redhat.com>
2022-06-09 21:43:51 +03:00
Yuval Lifshitz
2a6039c2f6 rgw/lua: add atomic increment/decrement to RGW table
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2022-06-09 21:43:51 +03:00
Yuval Lifshitz
402c35cf97 rgw/lua: support multiple types in lua background table
Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2022-06-09 21:43:51 +03:00
Casey Bodley
16b73f58c6
Merge pull request #45806 from hualongfeng/qat_error_fix1
common/compressor: fix the issue that read more data

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-06-09 10:50:24 -04:00
Ilya Dryomov
03d27945a6 cmake: pass -Wno-error when building PMDK
It's hitting pacific with a nuisance -Werror=array-parameter= const
char * vs const char[37] mismatch.  Follow commit 91a616b26e ("cmake:
pass RTE_DEVEL_BUILD=n when building dpdk") and just disable -Werror.

Fixes: https://tracker.ceph.com/issues/55977
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-06-09 14:37:10 +02:00
Guillaume Abrioux
7ffea89992 ceph-volume: make is_valid() optional
There are cases where `ceph-volume` doesn't have to require
a `ceph.conf` file that has the `fsid` parameter.

See: https://github.com/rook/rook/pull/10333#pullrequestreview-994958873

Fixes: https://tracker.ceph.com/issues/55970

Signed-off-by: Guillaume Abrioux <gabrioux@redhat.com>
2022-06-09 10:50:58 +02:00
Sarthak0702
fa8a62fb8f mgr/dashboard: stop polling when page is not visible
Signed-off-by: Sarthak0702 <sarthak.dev.0702@gmail.com>
2022-06-09 13:24:36 +05:30
Yuval Lifshitz
98bfe85f1f
Merge pull request #45937 from faithuniterh/adding_go_examples
examples: Add Golang code showing object upload to Ceph RGW bucket 

Reviwed-by: anthonyeleven
Reviwed-by: yuvalif
2022-06-09 10:36:17 +03:00
Yuval Lifshitz
80ffccaa17
Merge pull request #45970 from faithuniterh/adding_java_examples
examples: Add Java code showing object upload to Ceph RGW bucket

Reviewed-by: anthonyeleven
Reviewed-by: yuvalif
2022-06-09 10:33:18 +03:00