Commit Graph

133842 Commits

Author SHA1 Message Date
Adam King
c638d295dd mgr/cephadm: don't use "sudo" in commands if user is root
We had a patch earlier to make us not use sudo unless the
user is not root for our other commands, but this specific
one that just runs "true" with a timeout to check if the host
is online was missed.

Fixes: https://tracker.ceph.com/issues/57369

Signed-off-by: Adam King <adking@redhat.com>
2022-09-01 08:37:39 -04:00
Ernesto Puerta
14189b78d8
Merge pull request #47886 from ceph/chillout
.github: Give folks 30 seconds to fill out the checklist

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-09-01 11:18:43 +02:00
Nizamudeen A
6c7688ca5b mgr/dashboard: fix "can't read .ssh/known_hosts: No such file or directory"
Updates the fedora version too

Fixes: https://tracker.ceph.com/issues/57365
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-09-01 11:38:29 +05:30
Yingxin
1a6acf6772
Merge pull request #47816 from cyx1231st/wip-seastore-split-trimmer
crimson/os/seastore/async_cleaner: factor out journal trimming implementation

Reviewed-by: Myoungwon Oh <myoungwon.oh@samsung.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Zhang Song <zhangsong325@gmail.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2022-09-01 09:45:51 +08:00
Xuehan Xu
761e5296ff crimson/common/interrupt_future: simplify may_interrupt
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-09-01 09:41:27 +08:00
David Galloway
c123f1ab2b
Merge pull request #47880 from ionutbalutoiu/qa-update-branch-name
qa: update branch name for Windows job
2022-08-31 14:38:34 -04:00
David Galloway
41fcdd9a5b .github: Give folks 30 seconds to fill out the checklist
Otherwise GitHub sends an annoying e-mail right away when you file a PR that doesn't have the checklist filled out.  It's easier IMO to create the PR, then check the boxes instead of putting Xes in brackets while filling out the PR comment.

Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-08-31 14:21:16 -04:00
David Galloway
e2fba2d228 install-deps: Actually install libboost we built for Jammy
Follow up to 947ac23979

Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-08-31 14:02:36 -04:00
Aravind Ramesh
79a239ae0a crimson/zns: ensure writes happen at write pointer.
For ZNS SSDs, every write to a segment/zone has to happen at the zone's
write pointer. Any write request to an offset which is not at
write pointer will be failed by the drive.
In ZNSSegment::write() error out if write offset is not same as WP.

Signed-off-by: Aravind Ramesh <aravind.ramesh@wdc.com>
2022-08-31 23:05:12 +05:30
Ilya Dryomov
b24aed80d9
Merge pull request #47856 from idryomov/wip-56154
rbd-mirror: resume pending shutdown on error in snapshot replayer

Reviewed-by: Mykola Golub <mgolub@suse.com>
2022-08-31 18:57:40 +02:00
Ilya Dryomov
6a8134e0fd
Merge pull request #47835 from idryomov/wip-57317
librbd: use actual monitor addresses when creating a peer bootstrap token

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Christopher Hoffman <choffman@redhat.com>
2022-08-31 18:56:17 +02:00
Daniel Gryniewicz
285326cd45 RGW - Zipper - Pass invaliate down from RadosStore
When we invalidate the state of a RadosObject, we need to also
invalidate it in the ctx for that object.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2022-08-31 11:16:25 -04:00
Ernesto Puerta
c25bde9c5e
Merge pull request #47641 from rhcs-dashboard/value-error-centos
install-deps: script exit on "/ValueError" in centos_stream8

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2022-08-31 15:59:03 +02:00
Daniel Gryniewicz
f8526840a0 RGW - Zipper - Remove a number of casts from rgw_admin
There are still a ton of casts to RadosStore in rgw_admin.  Remove the
easy ones.  Many of the rest represent actual operations that are
specific to RadosStore, and need to be split out.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2022-08-31 09:44:01 -04:00
Pedro Gonzalez Gomez
b99845174b
Merge pull request #47673 from rhcs-dashboard/test_rbd_list
mgr/dashboard: ensure rbd image limit 0 returns 0 images


Reviewed-by: Pegonzal <pegonzal@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-08-31 15:08:19 +02:00
Ionut Balutoiu
2d6305cb61 qa: update branch name for Windows job
Use `main` instead of `master` in the workunit scripts for the
Windows Teuthology job.

Signed-off-by: Ionut Balutoiu <ibalutoiu@cloudbasesolutions.com>
2022-08-31 12:06:14 +00:00
Redouane Kachach
1c8833feaf
mgr/cephadm: Fix how we check if a host belongs to public network
Fixes: https://tracker.ceph.com/issues/57060

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-08-31 13:49:37 +02:00
Kefu Chai
0daef7c82e
Merge pull request #47802 from NitzanMordhai/wip-nitzan-leak-some-memory-with-memory-optimization
common/ceph_context: leak some memory fail to show in valgrind

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2022-08-31 17:55:05 +08:00
Kefu Chai
2e9f5ae081
Merge pull request #47829 from tchaikov/wip-cmake-CMP0135
cmake: set CMP0135 policy 

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-08-31 17:51:44 +08:00
Redouane Kachach
1a722f35c1
mgr/cephadm: allow binding to loopback for rgw daemons
Fixes: https://tracker.ceph.com/issues/57304

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-08-31 11:40:23 +02:00
Ilya Dryomov
1cec9e83c0 test/cli-integration/rbd: iSCSI REST API responses aren't pretty-printed anymore
See https://github.com/ceph/ceph-iscsi/pull/263 and
https://github.com/pallets/flask/pull/2193.  Flask stopped
pretty-printing by default in 1.0:

  Change the default for JSONIFY_PRETTYPRINT_REGULAR to False.
  json.jsonify returns a compact format by default, and an indented
  format in debug mode.

Fixes: https://tracker.ceph.com/issues/57343
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-31 11:01:12 +02:00
J. Eric Ivancich
91c57c3fb1
Merge pull request #47772 from ivancich/wip-dout_subsys-header
rgw: remove dout_subsys defs from header files

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2022-08-30 18:11:00 -04:00
J. Eric Ivancich
bccf6c3074 rgw: remove dout_subsys defs from header files
Each compilation unit should be able to define its own dout_subsys
without generating a redefinition warning. When dout_subsys is defined
in header files, it complicates this matter. This commit removes
definitions and header files and makes sure definitions are added to
.cc files as needed.

Additionally, at Adam Emerson's suggestion, use "static constexpr"
rather than "#define" to set "dout_subsys" in a few places as a
reminder to ultimately do it more broadly.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2022-08-30 13:04:32 -04:00
Kefu Chai
976cd1a4e7
Merge pull request #47761 from tchaikov/wip-intarith-bit
include, os: s/ctz/std::countr_zero/

Reviewed-by: Matan Breizman <mbreizma@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-08-30 23:02:46 +08:00
Redouane Kachach
028cb031dd
cephadm/mgr: adding logic to handle -no-overwrite for tuned profiles
Fixes: https://tracker.ceph.com/issues/57032

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-08-30 16:24:52 +02:00
Kefu Chai
f68dbeae37
Merge pull request #47830 from tchaikov/wip-fmtlib-v9
common, include, osd: compile with fmt v9

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2022-08-30 22:19:27 +08:00
Kefu Chai
63744eb5c7
Merge pull request #44993 from kamoltat/wip-ksirivad-fix-bug-50089
mon/Elector: Added sanity check when pinging a peer monitor

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2022-08-30 21:19:01 +08:00
Zac Dover
7bc6262547 doc/start: update documenting-ceph branch names
This PR updates the branch names in the
documenting-ceph.rst file. It gets rid of all references
to the "master" branch, and updates the language to
reflect the state of play in 2022.

inb4: This PR merely removes the most egregious inaccuracies,
the ones that were most readily evident on a cursory perusal.
The full text remains to be carefully read and fitted together
with care.

I had to start somewhere.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-08-30 21:48:08 +10:00
zdover23
7a6bd1f963
Merge pull request #47843 from zdover23/wip-doc-2022-08-29-mgr-dashboard-includes-prompt-update
doc/mgr: update prompts in dboard.rst includes

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-08-30 21:14:17 +10:00
Pere Diaz Bou
1c5a8ad21f
Merge pull request #46962 from rhcs-dashboard/auto-coloring-badges-from-color-pool
mgr/dashboard: auto-coloring-badges-component

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: nSedrickm <NOT@FOUND>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2022-08-30 12:59:01 +02:00
Arthur Outhenin-Chalandre
f744a93ef1
Merge pull request #47707 from bosc0/fix_alert
Ceph-mixin: Fix CephNodeNetworkPacket alerts
2022-08-30 12:49:23 +02:00
Ilya Dryomov
ced071f0de rbd-mirror: skip setting error code on snapshot replayer shutdown
This is regarding failures in unregister_remote_update_watcher() and
unregister_local_update_watcher().  handle_replay_complete() can't be
called in these cases anymore as it would blindly attempt to unregister
watchers from scratch again.  Dropping handle_replay_complete() calls
there means that these failures would only be logged and would not be
surfaced by snapshot replayer.  But the only caller ignores them
anyway:

  void ImageReplayer<I>::shut_down(int r) {
    ...
    // close the replayer
    if (m_replayer != nullptr) {
      ctx = new LambdaContext([this, ctx](int r) {
        m_replayer->destroy();
        m_replayer = nullptr;
        ctx->complete(0);             <------
      });
      ctx = new LambdaContext([this, ctx](int r) {
        m_replayer->shut_down(ctx);
      });
    }

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-30 12:01:35 +02:00
Nizamudeen A
b73d7d22d4 install-deps: script exit on /ValueError: in centos_stream8
this is happening locally as well as in our ceph-dev runs too https://github.com/rhcs-dashboard/ceph-dev/runs/7850564011

Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-08-30 14:50:40 +05:30
Yuval Lifshitz
0ecf8bc3a7 rgw/notifications: add region to bucket ARN
Fixes: https://tracker.ceph.com/issues/53186

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2022-08-30 11:00:48 +03:00
Arthur Outhenin-Chalandre
4909e795c9
Merge pull request #47669 from MrFreezeex/jb-path
ceph-mixin: fix PATH issues with jsonnet-bundler
2022-08-30 08:35:04 +02:00
Paul Cuzner
a6f10ebd57 cephadm: Fix disk size calculation
With native 4k sectors, the logical blocksize is set to
4096, which yields a disk size 8x the size of the actual
device. According to kernel source, device size only
uses 512 byte sectors, so the use of logical blocksize
is unnecessary.

Fixes: https://tracker.ceph.com/issues/57335

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2022-08-30 11:54:00 +12:00
Adam King
5444c98697
Merge pull request #47808 from phlogistonjohn/jjm-remove-tox-env-lint
pybind/mgr: tox.ini remove redundant `tox` env

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-08-29 15:52:17 -04:00
Ilya Dryomov
fc4cc575bc rbd-mirror: resume pending shutdown on error in snapshot replayer
If a shutdown is requested, e.g. by update_pool_replayers() because
remote RADOS instance got blocklisted, and Replayer::shut_down() pends
it on completion of current snapshot sync, it gets stuck if replayer
encounters an error in the interim.  This is particularly likely in the
blocklist case: a higher layer may detect that client got blocklisted
and request a shutdown first, and then when replayer sees EBLOCKLISTED
in turn, it calls handle_replay_complete() -- which does not resume
a pending shutdown.  Because update_pool_replayers() blocks on shutdown
with Mirror::m_lock held, eventually the entire daemon hangs in
perpetuity.

Fixes: https://tracker.ceph.com/issues/56154
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-08-29 20:14:17 +02:00
Pedro Gonzalez Gomez
29f510a522 mgr/dashboard: auto-coloring-badges-component
Signed-off-by: Pedro Gonzalez Gomez <pegonzal@redhat.com>
2022-08-29 18:03:11 +02:00
Kefu Chai
28d890ebf6
Merge pull request #47834 from tchaikov/wip-56850
mon/MgrMonitor: do not propose again for "mgr fail"

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2022-08-30 00:00:37 +08:00
Patrick Seidensal
79534e5dc3
mgr: Fix tox test issue due to PrettyTable update
Since the update of PrettyTable 3.3.0 to 3.4.0 on Aug 25, 2022, three
tests inside tox broke as the new version returns tables slightly
differently.

Alternatively, the tests could be adapted.

Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
2022-08-29 17:02:06 +02:00
Patrick Seidensal
3551d7f8b3
mgr/dashboard: enable addition custom Prometheus alerts
Fixes: https://tracker.ceph.com/issues/57294

Signed-off-by: Patrick Seidensal <pseidensal@suse.com>
2022-08-29 17:01:21 +02:00
John Mulligan
f8b0511d6c qa/tasks/kubeadm: set up tigera resources via kubectl create
Fixes: https://tracker.ceph.com/issues/57268

The tigera operator for the calico CNI has some pretty large resource
definitions. The length of the definitions can cause the "client side
apply", the default mode for `kubectl apply ....`, to fail due to the
length of the needed annotation that would result:

```
2022-08-22T20:24:55.636 INFO:teuthology.orchestra.run.smithi087.stdout:clusterrolebinding.rbac.authorization.k8s.io/tigera-operator created
2022-08-22T20:24:55.670 INFO:teuthology.orchestra.run.smithi087.stdout:deployment.apps/tigera-operator created
2022-08-22T20:24:55.671 INFO:teuthology.orchestra.run.smithi087.stderr:The CustomResourceDefinition "installations.operator.tigera.io" is invalid: metadata.annotations: Too long: must have at most 262144 bytes
2022-08-22T20:24:55.674 DEBUG:teuthology.orchestra.run:got remote process result: 1
```

There are two simple options for avoiding this error. One is to use
`kubectl create`. The create command will not make this lengthy
annotation. It will fail if any of the resources already exist. The
other option is to use server-side apply, via the `kubectl apply
--server-side ...` command. It is new in k8s 1.18. It will not create
the annotation either.

The block of code setting up the CNI already uses `kubectl create` to
create the custom resources that configure the tigera operator.
Therefore it should be safe to assume the block of code in question
doesn't need to be idempotent and we can also use `kubectl create`
elsewhere in the same block.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2022-08-29 10:03:01 -04:00
Casey Bodley
183a05643d
Merge pull request #47441 from mkogan1/wip-WITH_BOOST_VALGRIND
cmake: set WITH_BOOST_VALGRIND before building boost

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
Reviewed-by: Yuval Lifshitz <ylifshit@redhat.com>
2022-08-29 09:51:21 -04:00
Arthur Outhenin-Chalandre
ff06790603
Merge pull request #47675 from bosc0/fix_multicluster
ceph-mixin: fix config inheritance
2022-08-29 14:55:43 +02:00
Nizamudeen A
be5ab2f7bc mgr/dashboard: remove the remaining master tags
This actually broke the doc service when the developer environment is of
main branch

Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-08-29 13:42:58 +05:30
Nizamudeen A
23c00ed480 mgr/dashboard: fix nfs exports form issues with squash field
1. Squash is not a mandatory field.
2. If the export is created from backend, then squash can have many
   different names for each types of squash. for eg.
```
['root', 'root_squash', 'rootsquash', 'rootid', 'root_id_squash', 'rootidsquash', 'all', 'all_squash', 'allsquash', 'all_anomnymous', 'allanonymous', 'no_root_squash', 'none', 'noidsquash']
```
so we need a proper matching in the ui too otherwise the edit field will
not have any value for the squash field.

3. Removed unncessary dropdown helper if there are values for the squash
   and access types.

Fixes: https://tracker.ceph.com/issues/57114
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-08-29 13:42:56 +05:30
Nizamudeen A
a35651ee85 mgr/dashboard: fix unmanaged snmp service creation
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-08-29 13:35:43 +05:30
Nizamudeen A
7d157fe48e mgr/dashboard: fix unmanged iscsi service creation
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-08-29 13:35:43 +05:30
Nizamudeen A
ea68560e14 mgr/dashboard: fix unable to create ingress unmanaged
the following snipped is the error from backend

```
 File "/lib/python3.6/site-packages/ceph/deployment/service_spec.py", line 698, in _from_json_impl
                                                  _cls.validate()
                                                File "/lib/python3.6/site-packages/ceph/deployment/service_spec.py", line 1058, in validate
                                                  'Cannot add ingress: No frontend_port specified')
                                              ceph.deployment.hostspec.SpecValidationError: Cannot add ingress: No frontend_port specified
```

It looks like even if we set unmanaged flag, we need to input the
backend_service, frontend_port, monitor_port and virtual_ip, because there is a
validation going for that in the backend.

https://github.com/ceph/ceph/blob/main/src/python-common/ceph/deployment/service_spec.py#L1050

Fixes: https://tracker.ceph.com/issues/57284
Signed-off-by: Nizamudeen A <nia@redhat.com>
2022-08-29 13:35:42 +05:30