Commit Graph

140241 Commits

Author SHA1 Message Date
Ilya Dryomov
e64830eb8e qa/suites/rbd: disable POOL_APP_NOT_ENABLED health check
Commit 990806e635 ("mon, qa: issue pool application warning even
if pool is empty") made it impossible to create a pool without raising
a (bogus) health alert.  See [1] for details.

[1] https://lists.ceph.io/hyperkitty/list/dev@ceph.io/thread/ZTDYC5HN677RR26EB4P6PORN6L2IFH4R/

Fixes: https://tracker.ceph.com/issues/62711
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2023-09-21 23:36:07 +02:00
Casey Bodley
e554b28b9e
Merge pull request #53448 from cbodley/wip-62378
rgw/crypt: don't deref null manifest_bl

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-09-21 22:15:37 +01:00
Casey Bodley
70973ad678
Merge pull request #53045 from smanjara/wip-shilpa-revert-51772
rgw/multisite: fixes assertion failure during realm reload

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-09-21 20:59:59 +01:00
zdover23
773799febb
Merge pull request #53493 from zdover23/wip-doc-2023-09-18-architecture-7-of-x
doc/architecture: "Edit HA Auth" (one of several)

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-09-22 03:41:21 +10:00
Casey Bodley
044b507077
Merge pull request #53505 from cbodley/wip-62771
rgw/sal: get_placement_target_names() returns void

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2023-09-21 18:30:07 +01:00
Yuval Lifshitz
94ac81981f
Merge pull request #52392 from yuvalif/wip-yuval-trace-name
rgw: rename request traces and change for tags

reviewed-by: cbodley
2023-09-21 20:12:01 +03:00
Patrick Donnelly
ab3e5ba744
Merge PR #50503 into main
* refs/pull/50503/head:
	mon: do not change pending if strategy is unchanged
	mon/MonmapMonitor: do not propose on error in prepare_update
	mon/MonmapMonitor: wait for commit before reply
	mon: use wait_for_commit to reply
	mon: add context list for commit wait
	mon: remove unused method
	test/mon: add commit benchmark script
	mon/MonClient: provide config to target specific rank

Reviewed-by: Laura Flores <lflores@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
2023-09-21 11:51:31 -04:00
Zac Dover
78804e1aad doc/architecture: "Edit HA Auth" (one of several)
Edit "High Availability Authentication" in doc/architecture.rst.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>
Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-22 00:10:12 +10:00
Adam King
0c8bd683b5
Merge pull request #52863 from batrick/i62326
pybind/mgr/cephadm/upgrade: stop disabling FSMap sanity checks

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-21 08:14:54 -04:00
Yingxin
9f12b959b5
Merge pull request #53501 from zhscn/wip-lba-backref-node-size
crimson/os/seastore: create page aligned bufferptr in copy ctor of CachedExtent

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-09-21 17:20:28 +08:00
Nizamudeen A
b5bf9d70cb
Merge pull request #52150 from paulreece42/wip-grafana-quorum-fix
monitoring: grafana mons out of quorum should be count - sum

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-09-21 12:36:21 +05:30
Venky Shankar
dd33f1026e Merge PR #53028 into main
* refs/pull/53028/head:
	Update MDSDaemon.cc
	Update MDSRank.cc - Logoutput: Fix personal pronoun "I" to uppercase

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-21 06:11:54 +05:30
Venky Shankar
4859fef855 Merge PR #53176 into main
* refs/pull/53176/head:
	doc: add note for removing (automatic) partitioning policy

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Milind Changire <mchangir@redhat.com>
2023-09-21 06:03:42 +05:30
Adam King
d6b8162d89
Merge pull request #53467 from phlogistonjohn/jjm-cephadm-move-get_data_dir
cephadm: move get data dir function to daemonidentity method

Reviewed-by: Adam King <adking@redhat.com>
2023-09-20 14:20:09 -04:00
Adam King
d5555ce34c
Merge pull request #53415 from rkachach/fix_issue_62814
cephadm: fix cephadm binary mount when --shared_ceph_folder is used

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-09-20 14:19:02 -04:00
Adam King
58d331f618
Merge pull request #53298 from phlogistonjohn/jjm-logging-2
cephadm: enhance logging behavior

Reviewed-by: Adam King <adking@redhat.com>
2023-09-20 14:17:03 -04:00
Adam King
c579ff27f7
Merge pull request #52251 from rkachach/fix_issue_61856
mgr/cephadm: Adding sort-by support for ceph orch ps

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-09-20 14:14:23 -04:00
Ilya Dryomov
65a7a43bba
Merge pull request #52982 from batrick/backport-cp-simplify
script/ceph-backport: perform cherry-pick in single command

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-09-20 19:58:40 +02:00
Patrick Donnelly
bf3051f458
Merge PR #53145 into main
* refs/pull/53145/head:
	mds: log message when exiting due to asok command

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-09-20 08:57:07 -04:00
Patrick Donnelly
0737936248
Merge PR #53149 into main
* refs/pull/53149/head:
	qa: lengthen shutdown timeout for thrashed MDS

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
2023-09-20 08:31:17 -04:00
Venky Shankar
20d027eb9d doc: add note for removing (automatic) partitioning policy
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2023-09-20 15:49:19 +05:30
Guillaume Abrioux
ed2bd84014
Merge pull request #53309 from guits/bz2203397
ceph-volume: fix mpath device support
2023-09-20 09:32:49 +02:00
Zhang Song
07577e3bc1 crimson/os/seastore: create page aligned bufferptr in copy ctor of CachedExtent
Signed-off-by: Zhang Song <zhangsong02@qianxin.com>
2023-09-20 11:38:24 +08:00
John Mulligan
abaeed1a20 doc/cephadm: document new cephadm logging destination settings
Add docs for setting the binary's log destination at cephadm bootstrap
or on a running cluster.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-19 16:17:24 -04:00
John Mulligan
d5e67783b7 doc/cephadm: clarify what cephadm component writes to the cluster log channel
Clarify that the cephadm orchestrator module, a part of the ceph mgr,
logs to the cluster log channel. This prepares for adding a specific
section to cover logging for the cephadm "binary".

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-19 16:17:24 -04:00
John Mulligan
4d5502c7b4 cephadm: remember log destination used during bootstrap
Store the log destination(s) specified on the CLI for cephadm bootstrap
as the manager configuration, unless the configuration key is explicitly
set by the input config.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-19 16:17:24 -04:00
John Mulligan
f550ca9850 mgr/cephadm: add a module option for controlling cephadm log dest
Now that cephadm has multiple possible persistent logging destinations
we need a way to choose which one to use when the command is started by
the mgr. Add the option 'cephadm_log_destination' which can take one
of 'file', 'syslog', or 'file,syslog'. If left unset (empty string)
then the behavior is equivalent to 'file' and that is the same as
previous cephadm versions.

Fixes: https://tracker.ceph.com/issues/62233

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-19 16:17:24 -04:00
John Mulligan
bb7225f4c4 cephadm: add cli option to enable logging to syslog
Add the --log-dest option to cephadm. The --log-dest option can be
specified 0, 1 or more times. If unspecified, cephadm will log to
the default location, the log file. If specified one ore more times,
each instance will enable the named logging destination.
Example:

```
cephadm boostrap

cephadm --log-dest=syslog bootstrap

cephadm --log-dest=file bootstrap

cephadm --log-dest=syslog --log-dest=file bootstrap
```

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-19 16:17:24 -04:00
John Mulligan
81dedb100b cephadm: add support for logging to syslog/journal
Add support to logging.py for persistent logging to syslog and thus to
journald. This is accomplished by switching logging handlers depending
on the log_dest attribute of the context. Setting this value is left
for a future patch.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-19 16:17:16 -04:00
John Mulligan
8707879408 cephadm: move colored output support into logging.py
Rewrite cephadm's colored output support such that it abstracts away
the colorization into extra logging metadata. The new code will not
unconditionally put control characters into the log files. It will
only print the control chars if the stderr is a tty.
In theory this is probably more future proof as well, but it's only
got two callers so it is hard to say how useful it'll be.

Signed-off-by: John Mulligan <jmulligan@redhat.com>
2023-09-19 16:16:55 -04:00
Casey Bodley
04d9ea6daf rgw/crypt: don't deref null manifest_bl
with dbstore, the manifest_bl pointer was null; check for null before
dereferencing for read_manifest_parts()

Fixes: https://tracker.ceph.com/issues/62378

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-09-19 14:59:19 -04:00
Kamoltat (Junior) Sirivadhna
24d95fda23
Merge pull request #51921 from kamoltat/wip-ksirivad-fix-54136
pybind/mgr/pg_autoscaler: Use bytes_used for actual_raw_used
Reviewed-by: Kamoltat Sirivadhna <ksirivad@redhat.com>
2023-09-19 14:12:35 -04:00
Ilya Dryomov
523831912b
Merge pull request #53532 from zdover23/wip-doc-2023-09-19-man-ceph-monstore-tool
doc/man: s/kvstore-tool/monstore-tool/

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2023-09-19 16:35:18 +02:00
Zac Dover
231afc8313 doc/man: s/kvstore-tool/monstore-tool/
s/kvstore-tool/monstore-tool/ in accordance with Ilya's remark here:
https://github.com/ceph/ceph/pull/53450#discussion_r1329804085

Signed-off-by: Zac Dover <zac.dover@proton.me>
2023-09-19 23:12:34 +10:00
Nizamudeen A
e068b2aabd
Merge pull request #53411 from rhcs-dashboard/align-charts
mgr/dashboard: align charts of landing page

Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-09-19 18:08:29 +05:30
Guillaume Abrioux
28a12f8ef7 ceph-volume: fix mpath device support
commit [1] broke mpath devices support in `disk.is_device()`

[1] 4fc6bc394d

Fixes: https://tracker.ceph.com/issues/62722
Signed-off-by: Guillaume Abrioux <gabrioux@ibm.com>
2023-09-19 14:25:00 +02:00
Yingxin
080bb4ffba
Merge pull request #53230 from myoungwon/fix-cbj-overflow-bug
crimson/os/seastore/cbj: fix a potential overflow bug on segment_seq

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
2023-09-19 16:03:34 +08:00
Milind Changire
096e82c19b
Merge PR #52631 into main
* refs/pull/52631/head:
	mds: add debug logs to monitor ceph.dir.subvolume management
	mds: dump subvolume flag for inode

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-19 13:21:09 +05:30
Milind Changire
29eb1ca580
Merge PR #52892 into main
* refs/pull/52892/head:
	qa: add test to validate periodic checks by async threads
	mgr/volumes: periodically check for async work

Reviewed-by: Kotresh Hiremath Ravishankar <khiremat@redhat.com>
2023-09-19 12:53:29 +05:30
Milind Changire
7f0df59ac2
Merge PR #52755 into main
* refs/pull/52755/head:
	mds: adjust pre_segments_size for MDLog when trimming segments for standby-replay

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jos Collin <jcollin@redhat.com>
2023-09-19 12:52:48 +05:30
Milind Changire
a94089bde2
Merge PR #52692 into main
* refs/pull/52692/head:
	qa/tasks/cephfs: reset the client_inject_fixed_oldest_tid after test

Reviewed-by: Dhairya Parmar <dparmar@redhat.com>
Reviewed-by: Neeraj Pratap Singh <neesingh@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-19 12:51:52 +05:30
zdover23
132cab7162
Merge pull request #53518 from likid0/patch-2
doc/dev: Fix typos in cephfs-mirroring.rst and  deduplication.rst

Reviewed-by: Zac Dover <zac.dover@proton.me>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-09-19 09:04:02 +10:00
Daniel Parkes
06358e8d17 doc/dev: Fix typos in files cephfs-mirroring.rst and deduplication.rst
Typo Error in Doc cephfs-mirroring.rst , replace RAODS with RADOS
Typo Error in Doc deduplication.rst , replace RAODS with RADOS

Signed-off-by: Daniel Parkes <dparkes@redhat.com>
2023-09-19 00:39:40 +02:00
Casey Bodley
d8b0a9112c
Merge pull request #53502 from dang/wip-dang-cls-test
RGW - Fix cls test build on new gcc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-09-18 23:01:31 +01:00
Daniel Gryniewicz
38f11f28b0
Merge pull request #53508 from dang/wip-dang-posix-cache
RGW - Add wait backoff to posix bucket cache test

Reviewed-by Matt Benjamin <mbenjamin@redhat.com>
2023-09-18 14:36:58 -04:00
Daniel Gryniewicz
c7d2c740b0 RGW - Add wait backoff to posix bucket cache test
The CI appears to be really slow, and even a second of wait for inotify
sometimes fails.  Add an exponential backoff wait of up to ~25 seconds
to hopefully make the test pass reliably.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2023-09-18 11:47:54 -04:00
Casey Bodley
3ad17ed3b2 rgw/sal: get_placement_target_names() returns void
the function returned an integer error code, but two callers were
incorrectly testing the return value as a boolean

the function just returns placement ids that are in-memory, so none of
the drivers have a failure case; change the return value to void

Fixes: https://tracker.ceph.com/issues/62771

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-09-18 11:15:04 -04:00
Casey Bodley
9b46b9b0a0
Merge pull request #53478 from EdwardVitor/cuiming_chinamobile
auth:rectify a cmake compilation warning

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-09-18 14:46:55 +01:00
Daniel Gryniewicz
8372e80d52 RGW - Fix cls test build on new gcc
The new encoder types broke building the cls test on newer gcc (13+) due
to undefined encoder/decoder.  Add the file that defines those to the
test.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2023-09-18 09:04:43 -04:00
Patrick Donnelly
6c993ee3bb
Merge PR #53175 into main
* refs/pull/53175/head:
	qa: increase the http postBuffer size and disable sslVerify

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2023-09-18 08:37:16 -04:00