Commit Graph

140326 Commits

Author SHA1 Message Date
Rishabh Dave
a669cd6422 mon/AuthMonitor: check if entity is absent before creating it
Although this code path is not used for creating entities yet, it is
better to fix the bug sooner than later. Method
AuthMonitor::_update_or_create_entity() must exit (with appropriate
error code) when entity to be created on the Ceph cluster is already
present.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-10-06 14:22:14 +05:30
Rishabh Dave
4228df3f35 mds/MDSAuthCaps: re-word an error message for better clarity
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-10-06 14:22:14 +05:30
Rishabh Dave
6cfc4e73e9 mon/AuthMonitor: revise a comment
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-10-04 15:42:02 +05:30
Rishabh Dave
e404413e89 mon/AuthMonitor: make "ceph auth caps" print error messsages...
generated by MDSAuthCaps::parse(). Specifically, in this case, this
command is supposed to print an error message when permission flag passed
for MDS capability is incorrect.

This needs the method AuthMonitor::_update_or_create_entity() to be
fixed. The issue is that stderr stream is not passed from the block under
"else if" clause of "ceph auth caps" command to MDSAuthCaps::_parse()
method. Let's fix this by adding a parameter for stderr stream to every
method in stack that is between this block and MDSAuthCaps::parse()
method.

qa.tasks.cephfs.test_admin.TestPermErrMsg contains tests that checks
whether or not all the Ceph commands that accept MDS capabilites print
the error message when permission flag in this capaibility is incorrect.
Add a test to this class to check if "ceph auth caps" also print an error
message when perm flag in MDS capability sting is incorrect.

Fixes: https://tracker.ceph.com/issues/63020
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-09-28 19:52:03 +05:30
Rishabh Dave
9fedc1e062
Merge pull request #52524 from dparmar18/wip-62072
tools/cephfs_mirror: only perform actions if init succeed

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-22 20:15:04 +05:30
Venky Shankar
0aedb3cfdc Merge PR #53407 into main
* refs/pull/53407/head:
	Client: Fix nonblocking-io zero by read

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-22 20:11:49 +05:30
Venky Shankar
8a84a6cc70 Merge PR #53279 into main
* refs/pull/53279/head:
	qa: descrease pgbench scale factor to 32 for postgresql database test

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2023-09-22 20:11:12 +05:30
Venky Shankar
3b06ea9915 Merge PR #52747 into main
* refs/pull/52747/head:
	cephfs-mirror: restart failed/blocklisted replayer instances
	cephfs-mirror: do not run concurrent C_RestartMirroring context

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-09-22 20:10:42 +05:30
Venky Shankar
8f9fc152c5 Merge PR #53418 into main
* refs/pull/53418/head:
	qa: use exisitng ignorelist override list for fs:mirror[-ha]

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2023-09-22 20:09:44 +05:30
Rishabh Dave
954ed30f3c
Merge pull request #48027 from lxbsz/wip-57154
mds/client: check the cephx mds auth access in client side

Reviewed-by: Ramana Raja <rraja@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2023-09-22 20:08:10 +05:30
Casey Bodley
9b7cd7fc7d
Merge pull request #52576 from cfsnyder/wip-62075
rgw: add radosgw-admin bucket check olh/unlinked commands

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-09-22 15:33:25 +01:00
Rishabh Dave
c4f968b931
Merge pull request #52042 from rishabh-d-dave/better-errmsg-for-perm
MDSAuthCaps: print better error message for perm flag in MDS caps

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2023-09-22 20:02:40 +05:30
Rishabh Dave
3234c696de
Merge pull request #47533 from rishabh-d-dave/ceph-fuse-cmd
qa/cephfs: cleanup code for ceph-fuse command

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-09-22 20:01:13 +05:30
Casey Bodley
503c855f86
Merge pull request #52259 from cbodley/wip-61859
qa/rgw: disable 'rgw lc debug interval' in most suites

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Soumya Koduri <skoduri@redhat.com>
2023-09-22 15:08:36 +01:00
Ronen Friedman
5ecd20f620
Merge pull request #53531 from ronen-fr/wip-rf-squeue2
osd/scrub: extract scrub initiation code out of the OSD

Reviewed-by: Samuel Just <sjust@redhat.com>
2023-09-22 16:46:38 +03:00
Ilya Dryomov
f0c48dfcd6
Merge pull request #53311 from idryomov/wip-62711
qa/suites/{rbd,krbd}: disable POOL_APP_NOT_ENABLED health check

Reviewed-by: Ramana Raja <rraja@redhat.com>
2023-09-22 15:44:35 +02:00
Cory Snyder
6b057fe554 rgw: radosgw-admin bucket check should only print index entries with --check-objects flag
Printing all index entries can be very time consuming for large
buckets and the inability to switch this behavior off makes it
cumbersome to use the command for fixing bucket stats. This was
also preventing the command from outputting recalculated bucket
stats when the --fix flag wasn't specified.

Signed-off-by: Cory Snyder <csnyder@1111systems.com>
2023-09-22 08:35:22 +00:00
Rishabh Dave
104fd674b0
Merge pull request #53528 from rishabh-d-dave/cephfs-qa-mdtest
qa/cephfs: fix build failure for mdtest project

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-22 11:56:03 +05:30
Casey Bodley
b975270d4e qa/rgw: enable s3tests for 'storage classes'
other than the rgw/lifecycle subsuite, all of the other subsuites were just
adding storage classes to the rgw task, but not the s3tests task that
enables the storage class test cases

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-09-21 17:51:59 -04:00
Casey Bodley
d46af6d3de qa/rgw: disable 'rgw lc debug interval' in most suites
this has a performance cost, and the teuthology environment can
already be sluggish. if lifecycle expiration/transition testing
was limited to the rgw/lifecycle and rgw/cloud-transition suites,
the others would probably run significantly faster

Fixes: https://tracker.ceph.com/issues/61859

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-09-21 17:51:59 -04:00
Casey Bodley
c7f2bc42d9 qa/s3tests: use cloudtier_tests and lifecycle_tests to control filters
when `extra_attrs` was made additive, these tests were adding both
'not lifecycle_expiration' and 'lifecycle_expiration' to the command
line. use a yaml flag instead to control whether or not the s3tests task
adds the 'not' filter

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-09-21 17:51:59 -04:00
Casey Bodley
62245cb5f3 qa/rgw: remove duplicate overrides in rgw/lifecycle
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-09-21 17:51:59 -04:00
Ilya Dryomov
0b68a8b4c0 qa/suites/krbd: disable POOL_APP_NOT_ENABLED health check
... same as for rbd suite.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-09-21 23:36:07 +02:00
Ilya Dryomov
9e884ddeec qa/suites/rbd: drop POOL_APP_NOT_ENABLED from ignorelists
With "mon warn on pool no app = false" in the config, it's obviously
redundant.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-09-21 23:36:07 +02:00
Ilya Dryomov
e64830eb8e qa/suites/rbd: disable POOL_APP_NOT_ENABLED health check
Commit 990806e635 ("mon, qa: issue pool application warning even
if pool is empty") made it impossible to create a pool without raising
a (bogus) health alert.  See [1] for details.

[1] https://lists.ceph.io/hyperkitty/list/dev@ceph.io/thread/ZTDYC5HN677RR26EB4P6PORN6L2IFH4R/

Fixes: https://tracker.ceph.com/issues/62711
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-09-21 23:36:07 +02:00
Casey Bodley
e554b28b9e
Merge pull request #53448 from cbodley/wip-62378
rgw/crypt: don't deref null manifest_bl

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-09-21 22:15:37 +01:00
Casey Bodley
70973ad678
Merge pull request #53045 from smanjara/wip-shilpa-revert-51772
rgw/multisite: fixes assertion failure during realm reload

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-09-21 20:59:59 +01:00
Cory Snyder
570adec5bb rgw: prevent another leftover bucket index olh entry scenario
If a call to bucket_index_link_olh or bucket_index_unlink_instance
fails, its associated pending xattr may have prevented the olh object
from being removed by another thread. We should do a best effort
cleanup attempt for this case by calling update_olh before returning
an error to the caller.

Signed-off-by: Cory Snyder <csnyder@1111systems.com>
2023-09-21 19:27:57 +00:00
zdover23
773799febb
Merge pull request #53493 from zdover23/wip-doc-2023-09-18-architecture-7-of-x
doc/architecture: "Edit HA Auth" (one of several)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-09-22 03:41:21 +10:00
Casey Bodley
044b507077
Merge pull request #53505 from cbodley/wip-62771
rgw/sal: get_placement_target_names() returns void

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-09-21 18:30:07 +01:00
Yuval Lifshitz
94ac81981f
Merge pull request #52392 from yuvalif/wip-yuval-trace-name
rgw: rename request traces and change for tags

reviewed-by: cbodley
2023-09-21 20:12:01 +03:00
Patrick Donnelly
ab3e5ba744
Merge PR #50503 into main
* refs/pull/50503/head:
	mon: do not change pending if strategy is unchanged
	mon/MonmapMonitor: do not propose on error in prepare_update
	mon/MonmapMonitor: wait for commit before reply
	mon: use wait_for_commit to reply
	mon: add context list for commit wait
	mon: remove unused method
	test/mon: add commit benchmark script
	mon/MonClient: provide config to target specific rank

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2023-09-21 11:51:31 -04:00
Zac Dover
78804e1aad doc/architecture: "Edit HA Auth" (one of several)
Edit "High Availability Authentication" in doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-22 00:10:12 +10:00
Ronen Friedman
f7ddca67b6 osd/scrub: modify schedule_result_t to report error class
(which directly translates to the required followup action)
instead of reporting the exact failure. The specific of the failure
were never used by the scrub scheduler.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-09-21 07:57:58 -05:00
Ronen Friedman
693cdf3565 osd/scrub: scheduler refactoring - cleanups
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-09-21 07:57:58 -05:00
Rishabh Dave
8b62329195 qa/cephfs: add "set -x" in mdtest.yaml
Set the flag for printing the commands that will be executed so that
it's easier to go through teuthology.log

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-09-21 18:16:21 +05:30
Rishabh Dave
6a2e94b323 qa/cephfs: fix build failure for mdtest project
To fix the mdtest job failure (which happens because building mdtest
project fails) do -

1. Use ior projects intead of mdtest project bcecause latter was merged
   into former. See:
   https://github.com/MDTEST-LANL/mdtest/blob/master/README.md

2. Purge mpich package and then install it again. This is a vital step
   that's needed to build ior project on Ubuntu 22.04.

Fixes: https://tracker.ceph.com/issues/61574
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2023-09-21 18:15:16 +05:30
Adam King
0c8bd683b5
Merge pull request #52863 from batrick/i62326
pybind/mgr/cephadm/upgrade: stop disabling FSMap sanity checks

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-21 08:14:54 -04:00
Ronen Friedman
631899a971 osd/scrub: scheduler: removing unused code
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-09-21 05:11:06 -05:00
Ronen Friedman
27e151414b osd/scrub: correct placement for some scheduler-related methods
Moving some member functions to their corresponding files.
Including ScrubQueue::dump_scrubs()
as it was moved in a previous commit,
and some ScrubJob code.

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2023-09-21 05:11:05 -05:00
Yingxin
9f12b959b5
Merge pull request #53501 from zhscn/wip-lba-backref-node-size
crimson/os/seastore: create page aligned bufferptr in copy ctor of CachedExtent

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-09-21 17:20:28 +08:00
Nizamudeen A
b5bf9d70cb
Merge pull request #52150 from paulreece42/wip-grafana-quorum-fix
monitoring: grafana mons out of quorum should be count - sum

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-09-21 12:36:21 +05:30
Venky Shankar
dd33f1026e Merge PR #53028 into main
* refs/pull/53028/head:
	Update MDSDaemon.cc
	Update MDSRank.cc - Logoutput: Fix personal pronoun "I" to uppercase

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-21 06:11:54 +05:30
Venky Shankar
4859fef855 Merge PR #53176 into main
* refs/pull/53176/head:
	doc: add note for removing (automatic) partitioning policy

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2023-09-21 06:03:42 +05:30
Adam King
d6b8162d89
Merge pull request #53467 from phlogistonjohn/jjm-cephadm-move-get_data_dir
cephadm: move get data dir function to daemonidentity method

Reviewed-by: Adam King <adking@redhat.com>
2023-09-20 14:20:09 -04:00
Adam King
d5555ce34c
Merge pull request #53415 from rkachach/fix_issue_62814
cephadm: fix cephadm binary mount when --shared_ceph_folder is used

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-09-20 14:19:02 -04:00
Adam King
58d331f618
Merge pull request #53298 from phlogistonjohn/jjm-logging-2
cephadm: enhance logging behavior

Reviewed-by: Adam King <adking@redhat.com>
2023-09-20 14:17:03 -04:00
Adam King
c579ff27f7
Merge pull request #52251 from rkachach/fix_issue_61856
mgr/cephadm: Adding sort-by support for ceph orch ps

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-09-20 14:14:23 -04:00
Ilya Dryomov
65a7a43bba
Merge pull request #52982 from batrick/backport-cp-simplify
script/ceph-backport: perform cherry-pick in single command

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-09-20 19:58:40 +02:00
Patrick Donnelly
bf3051f458
Merge PR #53145 into main
* refs/pull/53145/head:
	mds: log message when exiting due to asok command

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-09-20 08:57:07 -04:00