Commit Graph

133543 Commits

Author SHA1 Message Date
Ilya Dryomov
6bd89ea119 librbd: fix a bunch of issues with restarting RefreshRequest
Make RefreshRequest properly restartable, at least up until and including
V2_REFRESH_PARENT step:

- clear m_migration_spec when skipping GET_MIGRATION_HEADER
- don't rely on potentially stale m_incomplete_update on retry
- reset m_legacy_parent when retrying more than just V2_GET_PARENT
- don't rely on potentially stale m_parent_md.overlap and
  m_head_parent_overlap on retry
- clear m_metadata before fetching image metadata (but not before
  fetching pool metadata)
- clear m_op_features when skipping V2_GET_OP_FEATURES
- clear m_group_spec on EOPNOTSUPP error in V2_GET_GROUP
- reset m_legacy_snapshot when retrying more than just V2_GET_SNAPSHOTS
- don't rely on potentially stale m_snap_parents on retry

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-09-05 23:02:39 +02:00
Ilya Dryomov
ce6dff89c0 librbd: check *result consistently in RefreshRequest
Stick to *result >= 0 checks everywhere and add missing checks for
op_features_get_finish() and image_group_get_finish() errors.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-09-05 23:02:32 +02:00
Ilya Dryomov
ca36ffa347 librbd: reflect V2_GET_SNAPSHOTS ENOENT retry in state diagram
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-09-05 23:00:35 +02:00
Kefu Chai
976cd1a4e7
Merge pull request #47761 from tchaikov/wip-intarith-bit
include, os: s/ctz/std::countr_zero/

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-08-30 23:02:46 +08:00
Kefu Chai
f68dbeae37
Merge pull request #47830 from tchaikov/wip-fmtlib-v9
common, include, osd: compile with fmt v9

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-08-30 22:19:27 +08:00
Kefu Chai
63744eb5c7
Merge pull request #44993 from kamoltat/wip-ksirivad-fix-bug-50089
mon/Elector: Added sanity check when pinging a peer monitor

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2022-08-30 21:19:01 +08:00
zdover23
7a6bd1f963
Merge pull request #47843 from zdover23/wip-doc-2022-08-29-mgr-dashboard-includes-prompt-update
doc/mgr: update prompts in dboard.rst includes

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-08-30 21:14:17 +10:00
Pere Diaz Bou
1c5a8ad21f
Merge pull request #46962 from rhcs-dashboard/auto-coloring-badges-from-color-pool
mgr/dashboard: auto-coloring-badges-component

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: nSedrickm <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-08-30 12:59:01 +02:00
Arthur Outhenin-Chalandre
f744a93ef1
Merge pull request #47707 from bosc0/fix_alert
Ceph-mixin: Fix CephNodeNetworkPacket alerts
2022-08-30 12:49:23 +02:00
Arthur Outhenin-Chalandre
4909e795c9
Merge pull request #47669 from MrFreezeex/jb-path
ceph-mixin: fix PATH issues with jsonnet-bundler
2022-08-30 08:35:04 +02:00
Adam King
5444c98697
Merge pull request #47808 from phlogistonjohn/jjm-remove-tox-env-lint
pybind/mgr: tox.ini remove redundant `tox` env

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-08-29 15:52:17 -04:00
Pedro Gonzalez Gomez
29f510a522 mgr/dashboard: auto-coloring-badges-component
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2022-08-29 18:03:11 +02:00
Kefu Chai
28d890ebf6
Merge pull request #47834 from tchaikov/wip-56850
mon/MgrMonitor: do not propose again for "mgr fail"

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-08-30 00:00:37 +08:00
Casey Bodley
183a05643d
Merge pull request #47441 from mkogan1/wip-WITH_BOOST_VALGRIND
cmake: set WITH_BOOST_VALGRIND before building boost

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2022-08-29 09:51:21 -04:00
Arthur Outhenin-Chalandre
ff06790603
Merge pull request #47675 from bosc0/fix_multicluster
ceph-mixin: fix config inheritance
2022-08-29 14:55:43 +02:00
Zac Dover
fc70ccde75 doc/mgr: update prompts in dboard.rst includes
This PR adds unselectable prompts to three files that are
transcluded in the doc/mgr/dashboard.rst file. These three
files are:

 1. debug.inc.rst
 2. feature_toggles.inc.rst
 3. motd.inc.rst

The addition of unselectable prompts to these three files
completes the work begun in PR#47810 (d8064b4), which sought
to bring dashboard.rst into line with the unselectable prompt
standard introduced by Kefu Chai in 2020.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-08-29 10:39:51 +10:00
Ronen Friedman
07bfcac5ea
Merge pull request #47681 from ronen-fr/wip-rf-delog1
osd/scrub: improving scrub logs
Reviewed-by: Aishwarya Mathuria <amathuri@redhat.com>
2022-08-28 14:10:10 +03:00
Yuval Lifshitz
30078cd292
Merge pull request #47728 from yuvalif/wip-yuval-cont-lease
rgw/multisite: check for late lease renewals

reviewed-by: cbodley
2022-08-28 10:44:07 +03:00
Ronen Friedman
95dd59ba87 osd/scrub: reduce the amount of log lines
Following call chains, and removing repeated data.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-08-28 08:47:46 +03:00
Ronen Friedman
93dfb7e88b common: improving fmtlib handling of ceph::utime_t
1. fixing the output to show local-time instead of UTC format, matching
   operator<<() handling (and all the rest of our logs)
2. adding a 'short' mode (as {:s}) for when, e.g. in most scrub logs,
   we only need 3 digits for the sub-second, and do not need the
   trailing TZ designation.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-08-28 08:47:46 +03:00
zdover23
2b7c0a1238
Merge pull request #47736 from ceph/release-docs
doc: Update release process doc to accurately reflect current process

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-08-28 07:13:39 +10:00
David Galloway
4829af891c doc: Update release process doc to accurately reflect current process
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-08-28 06:40:49 +10:00
Kefu Chai
3d7a895d19 include/object_fmt: mark fmt::formatter<>::format() const
so these formatters can be used in methods with `const` specifier.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-27 23:59:24 +08:00
Kefu Chai
2901943618 common/LogEntry: specialize fmt::formatter<LogEntry>
so we can use the formatter defined for `LogEntry` in fmtlib v9.
in this new version of fmtlib, it is required to define a specialization
for the formatted type even when it comes to the types with an override of
operator<<(). since we already have an override for `LogEntry`, let's define
the specialization for `fmt::formatter<LogEntry>`.

this change should address the FTBFS when building with fmtlib v9.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-27 23:59:24 +08:00
Kefu Chai
6e223a6802 common/Journald: include msg/msg_fmt.h
so we can use the formatter defined for `entity_name_t`. in fmtlib v9,
it is required to define a specialization for the formatted type even
the type has an override of operator<<(). now that we already have a
formatter for `entity_name_t`, let's just use it.

this change should address the FTBFS when building with fmtlib v9.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-27 23:59:24 +08:00
Kefu Chai
5b1c6ad496 mon/MgrMonitor: do not propse again for "mgr fail"
in 23c3f76018, the change to fail the mgr
is proposed immediately. but `MgrMonitor::prepare_command()` method still
returns `true` in this case. its indirect caller of
`PaxosService::dispatch()` considers this as a sign that it needs to
propose the change with `propose_pending()`. but the pending change has
already been proposed by `MgrMonitor::prepare_command()`, and
`have_pending` is also cleared by this call. as we don't allow
consecutive paxos proposals, the second `propose_pending()` call is
delayed with a configured latency. but when the timer is fired, this
poseponed call would find itself trying to propose nothing. the change
to fail the mgr has been proposed. that's why we have
`ceph_assert(have_pending)` assertion failures.

in this change, the second proposal is not proposed anymore if the
proposal is proposed immediately. this should avoid the assertion
failure.

this change should address the regression introduced by
23c3f76018.

Fixes: https://tracker.ceph.com/issues/56850
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-27 23:57:40 +08:00
zdover23
75d4ce7169
Merge pull request #47810 from zdover23/wip-doc-2022-08-25-mgr-dashboard-prompt-correct
doc/mgr: add prompt directives to dashboard.rst

Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-08-27 05:45:28 +10:00
Laura Flores
8ccd4e2533
Merge pull request #47046 from rzarzynski/wip-dup-trimming-test2
osd, tools, kv: non-aggressive, on-line trimming of accumulated dups
2022-08-26 14:07:44 -05:00
Rishabh Dave
e7b6c9d8c2
Merge pull request #46994 from rishabh-d-dave/qa-caps-helper-upgrade
qa/cephfs: upgrade caps_helper.py

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-08-26 18:43:52 +05:30
Pere Diaz Bou
bcbf9d45d2
Merge pull request #47510 from nSedrickm/pagination-component-accesibility-update
mgr/dashboard: Improve level A accessibility for pagination component

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-08-26 15:09:37 +02:00
Rishabh Dave
42ef390ec4
Merge pull request #46902 from lxbsz/wip-56414
client: specify the quota type when finding the root quota realm

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
Reviewed-by: Kotresh HR <khiremat@redhat.com>
2022-08-26 18:33:13 +05:30
Yingxin
b826e0cba6
Merge pull request #47698 from cyx1231st/wip-seastore-RBM-trim-2
crimson/os/seastore: generalize journal tail calculations with CircularBoundedJournal

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2022-08-26 14:55:41 +08:00
Adam King
be59f2bfe7
Merge pull request #47811 from adk3798/fix-tox-mgr
mgr/orchestrator/tests: don't match exact whitespace in table output

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
2022-08-25 19:05:44 -04:00
Casey Bodley
958b7e3e06
Merge pull request #47686 from cbodley/wip-rgw-rm-zonegroupmap
rgw: remove RGWRegionMap and RGWZoneGroupMap

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-08-25 14:17:25 -04:00
Casey Bodley
6d2e5c6420
Merge pull request #47735 from cbodley/wip-57232
cls/rgw: restore backward-compatible encoding of cls_rgw_bucket_instance_entry

Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2022-08-25 14:17:00 -04:00
Ernesto Puerta
455da8bc7b
Merge pull request #46958 from nSedrickm/datatables-accessibility-update
mgr/dashboard: Improve accessibility for datatable component

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2022-08-25 19:31:09 +02:00
Yuval Lifshitz
1148464c26
Merge pull request #43436 from yuvalif/wip-yuval-fix-50611
rgw/notification: allow sending bucket notifications secrets in cleartext

reviewed-by: cbodley, mattbenjamin
2022-08-25 19:38:27 +03:00
Adam King
f64bf0e804 mgr/orchestrator/tests: don't match exact whitespace in table output
It seems that the exact spacing may differ a bit between
python versions. Currently seeing py3 (which cooresponds to py 3.6
on my system) passing these tests and py37 (which is python 3.7
obviously) failing. I think verifying against the exact whitespace
is unnecessary anyhow. As long as it isn't egregious, we don't
really need to worry about exactly what the spacing is.

Signed-off-by: Adam King <adking@redhat.com>
2022-08-25 12:09:49 -04:00
Zac Dover
d8064b4681 doc/mgr: add prompt directives to dashboard.rst
This commit adds prompt directives (.. prompt:: bash $) to
the commands in dashboard.rst.

There are several ".. include::" directives in the dashboard.rst
file, which means that part of this page is sourced from elsewhere
than the dashboard.rst file. Because I have not yet added prompt
directives to those files, there is an inconsistency in the rendering
of this file. Most of the commands on this page have unselectable
prompts (unselectable prompts are the prompts that don't get added to
the buffer when you copy them to one of the clipboards). But the
commands on this page that come from those ".. include::" directives
do not yet have unselectable prompts.

This file is over 1600 lines long. It was perhaps not optimally wise
of me to have edited all of it in one fell swoop. It took many hours,
and carefully checking it will probably take at least one hour. I
suggest that whoever reviews this should not spend much time on it,
but should instead make a quick pass over the page and make sure that
it looks passable.

The English syntax on this page (and throughout the Dashboard doc-
umentation) will be tightened to remove ambiguity and to improve
readability in the near future, so hold all English-language-related
comments for a future pull request.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-08-26 01:56:41 +10:00
Adam King
ee70013a86
Merge pull request #47674 from adk3798/distro-workunits
qa/cephadm: specify using container host distros for workunits

Reviewed-by: Laura Flores <lflores@redhat.com>
2022-08-25 11:21:35 -04:00
Yuval Lifshitz
c4960aa42a rgw/multisite: check for late lease renewals
also make lease renewal logs more uniform

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2022-08-25 14:40:09 +00:00
John Mulligan
f12aa75ea0 pybind/mgr: tox.ini remove redundant tox env
Fixes: https://tracker.ceph.com/issues/57153

The envlist contained an environment named `lint`. There was no specific
customization of the lint testenv so it is essentially the same as
running the `py3` testenv.

This was probably a typo and was meant to be `pylint`. Unfortunately,
the pylint test env does not appear to work, probably because it was
never run as part of any automation. At the risk of leaving old stuff
behind I'm not removing the pylint testenv at the moment, only the
`lint` item in order to not run redundant tests.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-08-25 10:01:34 -04:00
Adam King
c4a119ba9a
Merge pull request #47792 from adk3798/rgw-bad-example
doc/cephadm/services: fix example for specifying networks for rgw

Reviewed-by: Anthony D'Atri <anthonyeleven@users.noreply.github.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-08-25 09:11:30 -04:00
Yingxin
98a1a5fa49
Merge pull request #47599 from xxhdx1985126/wip-backref-minor-bug
crimson/os/seastore/cache: set extent's state to INVALID when invalidating it

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2022-08-25 10:36:09 +08:00
nsedrickm
363352163d mgr/dashboard: Improve level A accessibility for pagination component
Add custom pagination component based on patternfly design

Fixes: https://tracker.ceph.com/issues/55876
Signed-off-by: nsedrickm <nsedrick101@gmail.com>
2022-08-24 16:52:46 +01:00
Adam King
6b6f56a5b6 doc/cephadm: fix example for specifying networks for rgw
count_per_host must be used with underscores rather
than dashes to work, you need to pass service_id not
service_name and the option for the port is called
rgw_frontend_port not just "port"

Signed-off-by: Adam King <adking@redhat.com>
2022-08-24 10:36:53 -04:00
zdover23
f5c21acfdc
Merge pull request #47785 from rhcs-dashboard/doc-fix-monitoring
docs: fix doc link pointing to master in dashboard.rst

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2022-08-25 00:20:59 +10:00
Nizamudeen A
79bbaa5553 docs: fix doc link pointing to master in dashboard.rst
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-08-24 16:11:00 +05:30
Kefu Chai
8a8a6efcab include/intarith: s/8/CHAR_BIT/
less magic numbers

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-24 17:49:41 +08:00
Kefu Chai
e7114905c5 include/intarith: drop ctz()
it is not used anymore

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2022-08-24 17:49:41 +08:00