Commit Graph

133514 Commits

Author SHA1 Message Date
Nikhilkumar Shelke
41b0cb70e0 qa: ignore disk quota exceeded failure in test
Quota enforcement takes some time. It is documented.
Test should ignore 'Disk Quota Exceeded' failure.

Fixes: https://tracker.ceph.com/issues/56632
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-08-29 13:42:11 +05:30
Ronen Friedman
07bfcac5ea
Merge pull request #47681 from ronen-fr/wip-rf-delog1
osd/scrub: improving scrub logs
Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>
2022-08-28 14:10:10 +03:00
Yuval Lifshitz
30078cd292
Merge pull request #47728 from yuvalif/wip-yuval-cont-lease
rgw/multisite: check for late lease renewals

reviewed-by: cbodley
2022-08-28 10:44:07 +03:00
Ronen Friedman
95dd59ba87 osd/scrub: reduce the amount of log lines
Following call chains, and removing repeated data.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-08-28 08:47:46 +03:00
Ronen Friedman
93dfb7e88b common: improving fmtlib handling of ceph::utime_t
1. fixing the output to show local-time instead of UTC format, matching
   operator<<() handling (and all the rest of our logs)
2. adding a 'short' mode (as {:s}) for when, e.g. in most scrub logs,
   we only need 3 digits for the sub-second, and do not need the
   trailing TZ designation.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-08-28 08:47:46 +03:00
zdover23
2b7c0a1238
Merge pull request #47736 from ceph/release-docs
doc: Update release process doc to accurately reflect current process

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-08-28 07:13:39 +10:00
David Galloway
4829af891c doc: Update release process doc to accurately reflect current process
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-08-28 06:40:49 +10:00
zdover23
75d4ce7169
Merge pull request #47810 from zdover23/wip-doc-2022-08-25-mgr-dashboard-prompt-correct
doc/mgr: add prompt directives to dashboard.rst

Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-08-27 05:45:28 +10:00
Laura Flores
8ccd4e2533
Merge pull request #47046 from rzarzynski/wip-dup-trimming-test2
osd, tools, kv: non-aggressive, on-line trimming of accumulated dups
2022-08-26 14:07:44 -05:00
Rishabh Dave
e7b6c9d8c2
Merge pull request #46994 from rishabh-d-dave/qa-caps-helper-upgrade
qa/cephfs: upgrade caps_helper.py

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-08-26 18:43:52 +05:30
Pere Diaz Bou
bcbf9d45d2
Merge pull request #47510 from nSedrickm/pagination-component-accesibility-update
mgr/dashboard: Improve level A accessibility for pagination component

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-08-26 15:09:37 +02:00
Rishabh Dave
42ef390ec4
Merge pull request #46902 from lxbsz/wip-56414
client: specify the quota type when finding the root quota realm

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
2022-08-26 18:33:13 +05:30
Yingxin
b826e0cba6
Merge pull request #47698 from cyx1231st/wip-seastore-RBM-trim-2
crimson/os/seastore: generalize journal tail calculations with CircularBoundedJournal

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2022-08-26 14:55:41 +08:00
Adam King
be59f2bfe7
Merge pull request #47811 from adk3798/fix-tox-mgr
mgr/orchestrator/tests: don't match exact whitespace in table output

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-08-25 19:05:44 -04:00
Casey Bodley
958b7e3e06
Merge pull request #47686 from cbodley/wip-rgw-rm-zonegroupmap
rgw: remove RGWRegionMap and RGWZoneGroupMap

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-08-25 14:17:25 -04:00
Casey Bodley
6d2e5c6420
Merge pull request #47735 from cbodley/wip-57232
cls/rgw: restore backward-compatible encoding of cls_rgw_bucket_instance_entry

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2022-08-25 14:17:00 -04:00
Ernesto Puerta
455da8bc7b
Merge pull request #46958 from nSedrickm/datatables-accessibility-update
mgr/dashboard: Improve accessibility for datatable component

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-08-25 19:31:09 +02:00
Yuval Lifshitz
1148464c26
Merge pull request #43436 from yuvalif/wip-yuval-fix-50611
rgw/notification: allow sending bucket notifications secrets in cleartext

reviewed-by: cbodley, mattbenjamin
2022-08-25 19:38:27 +03:00
Adam King
f64bf0e804 mgr/orchestrator/tests: don't match exact whitespace in table output
It seems that the exact spacing may differ a bit between
python versions. Currently seeing py3 (which cooresponds to py 3.6
on my system) passing these tests and py37 (which is python 3.7
obviously) failing. I think verifying against the exact whitespace
is unnecessary anyhow. As long as it isn't egregious, we don't
really need to worry about exactly what the spacing is.

Signed-off-by: Adam King <adking@redhat.com>
2022-08-25 12:09:49 -04:00
Zac Dover
d8064b4681 doc/mgr: add prompt directives to dashboard.rst
This commit adds prompt directives (.. prompt:: bash $) to
the commands in dashboard.rst.

There are several ".. include::" directives in the dashboard.rst
file, which means that part of this page is sourced from elsewhere
than the dashboard.rst file. Because I have not yet added prompt
directives to those files, there is an inconsistency in the rendering
of this file. Most of the commands on this page have unselectable
prompts (unselectable prompts are the prompts that don't get added to
the buffer when you copy them to one of the clipboards). But the
commands on this page that come from those ".. include::" directives
do not yet have unselectable prompts.

This file is over 1600 lines long. It was perhaps not optimally wise
of me to have edited all of it in one fell swoop. It took many hours,
and carefully checking it will probably take at least one hour. I
suggest that whoever reviews this should not spend much time on it,
but should instead make a quick pass over the page and make sure that
it looks passable.

The English syntax on this page (and throughout the Dashboard doc-
umentation) will be tightened to remove ambiguity and to improve
readability in the near future, so hold all English-language-related
comments for a future pull request.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-08-26 01:56:41 +10:00
Adam King
ee70013a86
Merge pull request #47674 from adk3798/distro-workunits
qa/cephadm: specify using container host distros for workunits

Reviewed-by: Laura Flores <lflores@redhat.com>
2022-08-25 11:21:35 -04:00
Yuval Lifshitz
c4960aa42a rgw/multisite: check for late lease renewals
also make lease renewal logs more uniform

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2022-08-25 14:40:09 +00:00
Adam King
c4a119ba9a
Merge pull request #47792 from adk3798/rgw-bad-example
doc/cephadm/services: fix example for specifying networks for rgw

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-08-25 09:11:30 -04:00
Yingxin
98a1a5fa49
Merge pull request #47599 from xxhdx1985126/wip-backref-minor-bug
crimson/os/seastore/cache: set extent's state to INVALID when invalidating it

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2022-08-25 10:36:09 +08:00
nsedrickm
363352163d mgr/dashboard: Improve level A accessibility for pagination component
Add custom pagination component based on patternfly design

Fixes: https://tracker.ceph.com/issues/55876
Signed-off-by: nsedrickm <nsedrick101@gmail.com>
2022-08-24 16:52:46 +01:00
Adam King
6b6f56a5b6 doc/cephadm: fix example for specifying networks for rgw
count_per_host must be used with underscores rather
than dashes to work, you need to pass service_id not
service_name and the option for the port is called
rgw_frontend_port not just "port"

Signed-off-by: Adam King <adking@redhat.com>
2022-08-24 10:36:53 -04:00
zdover23
f5c21acfdc
Merge pull request #47785 from rhcs-dashboard/doc-fix-monitoring
docs: fix doc link pointing to master in dashboard.rst

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-08-25 00:20:59 +10:00
Nizamudeen A
79bbaa5553 docs: fix doc link pointing to master in dashboard.rst
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-08-24 16:11:00 +05:30
NitzanMordhai
c916f568aa standalone/osd: Test adjust with new trimming function
Change the number of dups trimmied according to the new loop.

Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2022-08-24 08:19:18 +00:00
Yingxin
dc9b89d619
Merge pull request #47705 from xxhdx1985126/wip-skip-invalid-inline-extents
crimson/os/seastore/cache: skip invalid inline extents when completing commits

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-24 16:10:20 +08:00
Yingxin
48cf4e279e
Merge pull request #47745 from liu-chunmei/seastore-empty-delta
crimson/seastore: fix omap empty delta buffer

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
2022-08-24 16:08:29 +08:00
Venky Shankar
5128cf8e18
Merge pull request #46072 from neesingh-rh/fix_54978
cephfs-top: adding filesystem menu option

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2022-08-24 13:37:46 +05:30
Yingxin
2c916e1923
Merge pull request #47782 from tchaikov/wip-crimson-os-cleanups
crimson/os: use IsFullKey when appropriate 

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-24 16:07:07 +08:00
Venky Shankar
b17f0e5d1e
Merge pull request #46685 from Rethan/perf-limit-dump-loads-depth
mds/MDBalancer: add an arg to limit depth when dump loads for dirfrags

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2022-08-24 13:31:28 +05:30
Kefu Chai
8663e84938 crimson/os: replace full_key_t<KeyT::VIEW> with key_view_t
and replace full_key_t<KeyT::HOBJ> with key_hobj_t.

there is not need to have this indirection

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-24 14:51:21 +08:00
Kefu Chai
cb306cae7b crimson/os: use IsFullKey in staged::insert_size{,at}()
to fade out KeyT, so we can have more straightforward definitions.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-24 14:51:21 +08:00
Kefu Chai
0e138d314b crimson/os: use IsFullKey in staged::insert()
to fade out KeyT, so we can have more straightforward definitions.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-24 14:51:21 +08:00
Venky Shankar
d8ba839bcd
Merge pull request #46068 from neesingh-rh/change_perf_stats_o/p_structure
mgr/stats: change in structure of perf_stats o/p

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2022-08-24 11:13:07 +05:30
Yingxin
f91c194431
Merge pull request #47778 from xxhdx1985126/wip-fix-output-error-cleaner
crimson/os/seastore/async_cleaner: fix several log related errors

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-24 13:27:30 +08:00
zdover23
02c80b64cd
Merge pull request #47751 from zdover23/wip-doc-2022-08-23-mgr-orchestrator-editorial-pass
doc/mgr: edit orchestrator.rst

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-08-24 14:36:48 +10:00
Venky Shankar
49e66ed0c6
Merge pull request #47079 from neesingh-rh/fix_56483
mgr/stats: missing clients in perf stats command output.

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2022-08-24 09:49:47 +05:30
Kefu Chai
cadd5fcfc0
Merge pull request #47729 from tchaikov/wip-crimson-os-cleanup
crimson/os: use IsFullKey in *::insert_prefix{,_at}()

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-24 12:09:41 +08:00
Zac Dover
2172b7ec98 doc/mgr: edit orchestrator.rst
This PR improves the English language in the "Orchestrator CLI"
section of the MGR documentation. It adds a couple of section
headers in order to signpost the information in the document
a bit more than had already been done, but it makes no major
structural changes to the presentation of the information here.

This PR was motivated by feedback from the 2022 Ceph User Survey
in which one of the respondents wrote "better ceph orch documen-
tation".

The final section on this page, "Current Implementation Status",
must be verified by someone who is familiar with the current state
of "ceph orch" and a date stamp should be applied to the top of
the section so that the word "current" has a meaningful referent.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-08-24 13:21:25 +10:00
Yingxin Cheng
67a9109ca9 crimson/os/seastore/cache: workaround to drop delta with mismatched crc
The workaround is unreliable to identify whether the delta is out-dated,
need to drop it once the paddr->journal_seq_t mapping is introduced.

Note: this issue only happens with journal_type_t::CIRCULAR.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-24 11:04:04 +08:00
Xuehan Xu
66a8c0d4df crimson/os/seastore/async_cleaner: fix several log related errors
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-08-24 11:03:53 +08:00
myoungwon oh
0d941855ff crimson/os/seastore: enable CBJournal trim during transaction_manager unit test
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2022-08-24 11:00:05 +08:00
Yingxin Cheng
c2b9e770f7 crimson/os/seastore: generalize journal tail calculations
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-08-24 10:59:59 +08:00
Xuehan Xu
b4d7897fc6 crimson/os/seastore/async_cleaner: fill the semantic gap between backref get_mappings and space reclaim
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-08-24 10:26:25 +08:00
Xuehan Xu
d050a85ab4 crimson/common: parallel_for_each shouldn't accept rvalue reference of containers
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-08-24 10:26:25 +08:00
Xuehan Xu
e82f6714e8 crimson/os/seastore/cache: skip invalid inline extents when completing commits
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-08-24 10:26:23 +08:00