Commit Graph

135945 Commits

Author SHA1 Message Date
Zac Dover
f04001deb3 doc/install: link to "cephadm installing ceph"
Link to "Installing Ceph" in the cephadm documentation instead of (as
was the case before this commit) to the cephadm overview page. Anyone
who clicks on the "cephadm" link in the context of the
doc/install/index.rst page is more likely to expect installation
instructions than to expect an explanation of what cephadm is.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-19 11:50:17 +10:00
J. Eric Ivancich
ece58aaaae
Merge pull request #49734 from linuxkidd/wip-rgw-gap-orphan-tool-error-checks
rgw/rgw-orphan-list: refactor and add more checks to the tool

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2023-01-18 15:30:21 -05:00
Michael J. Kidd
c951c3e3bd rgw/rgw-orphan-list: refactor / add error checking
standardize log output
add check that supplied pool[s] exist on the cluster
add return code checks for all commands that can affect output
add check for empty intermediate files
add usage output, including a -h command line option
add command line option to specify temporary directory to use
  ( instead of /tmp )
require command line supplied pools to be encased in double quotes "
  when multiple pools are provided
add warning for indexless buckets
move major segments to separate functions

Signed-off-by: Michael J. Kidd <linuxkidd@gmail.com>
2023-01-18 13:36:56 -05:00
Casey Bodley
02948ff7c6
Merge pull request #48632 from adamemerson/wip-57562
rgw: Fix race condition on FIFO client on new head creation

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Krunal Chheda <kchheda3@bloomberg.net>
Reviewed-by: Shilpa Jagannath <smanjara@redhat.com>
2023-01-18 10:41:31 -05:00
Lucian Petrut
2b014e159f qa: add windows run-tests.ps1
We have a few Python rbd-wnbd tests that are invoked explicitly
by the ceph-build scripts [1].

There are a few issues with that:

* it's a separate repo that has to be updated whenever we add new
  tests
* new tests that reside in the ceph repo will not be executed by
  the PR check
* some tests may be missing in case of older branches

For this reason, we're adding a new script as part of the Ceph
repo that will take care of invoking the Windows rbd-wnbd tests.

The ceph-build script has already been updated accordingly [2].

[1] https://github.com/ceph/ceph-build/blob/main/scripts/ceph-windows/run_tests#L73-L80
[2] https://github.com/ceph/ceph-build/pull/2094

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
Co-Authored-By: Ionut Balutoiu <ibalutoiu@cloudbasesolutions.com>
2023-01-18 15:32:50 +02:00
Pere Diaz Bou
d22737542a
Merge pull request #47794 from rhcs-dashboard/auth-add
mgr/dashboard: create authx users

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-01-18 10:06:29 +01:00
Aashish Sharma
7caccc3600
Merge pull request #49765 from rhcs-dashboard/fix-bucket-encryption-checkbox
mgr/dashboard: fix bucket encryption checkbox


Reviewed-by: Nizamudeen A <nia@redhat.com>
2023-01-18 10:29:31 +05:30
J. Eric Ivancich
933a42f9af
Merge pull request #48729 from ivancich/wip-flight-select-add-flight
rgw: initial commit adding Arrow Flight functionality

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-01-17 18:22:54 -05:00
J. Eric Ivancich
6d88d66e90
Merge pull request #48509 from jliebl-git/jliebl-ldap-fix
rgw: LDAP fix resource leak with wrong credentials

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-01-17 17:57:08 -05:00
J. Eric Ivancich
c9480473a0
Merge pull request #49636 from liangmingyuanneo/wip-read-olh-log
rgw: remove guard_reshard in bucket_index_read_olh_log

 Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-01-17 17:54:54 -05:00
J. Eric Ivancich
079601c212
Merge pull request #49463 from ivancich/wip-log-follow-bi-list
rgw: add logging to radosgw-admin bi list

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2023-01-17 17:52:49 -05:00
J. Eric Ivancich
98d0fd94e8
Merge pull request #49648 from ivancich/wip-fix-fp-error
rgw: fix FP error when calculating enteries per bi shard

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2023-01-17 17:51:38 -05:00
Laura Flores
c190aa9c82
Merge pull request #49181 from ljflores/wip-envlibrados-rocksdb-fix
qa/workunits/rados: skip running envlibrados rocksdb tests on ubuntu
2023-01-17 16:32:20 -06:00
Laura Flores
acc8c7e2ef qa/workunits/rados: skip running envlibrados rocksdb tests on ubuntu
This test passes on centos and rhel, but fails on ubuntu from an
invalid pointer. Since the envlibrados rocksdb tests are experimental
and don't have any actual users, we can just run them on rhel and
centos.

At the moment, the actual bug is not fully understood, but it was
decided that fixing it is low priority, and removing the test from
problematic distros is okay for the time being. This commit
is considered a workaround to the actual issue.

Related tracker: https://tracker.ceph.com/issues/57632
Signed-off-by: Laura Flores <lflores@redhat.com>
2023-01-17 11:38:19 -06:00
Aashish Sharma
aea92059f4 mgr/dashboard: fix bucket encryption checkbox
Fixes: https://tracker.ceph.com/issues/58474
The encryption checkbox in the bucket creation form remains disabled after setting the vault authentication method as agent.

Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2023-01-17 22:21:55 +05:30
Casey Bodley
ca762e628e rgw: fetch_remote_obj() adds x-amz-replication-status=REPLICA
implements the easy part of amazon's x-amz-replication-status feature:

https://docs.aws.amazon.com/AmazonS3/latest/userguide/replication-status.html#replication-status-overview

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2023-01-17 11:43:26 -05:00
Pere Diaz Bou
10f17bd9eb mgr/dashboard: create authx users
Signed-off-by: Pere Diaz Bou <pdiazbou@redhat.com>
Signed-off-by: Nizamudeen A <nia@redhat.com>
Co-authored-by: Nizamudeen A <nia@redhat.com>
2023-01-17 15:11:27 +01:00
Casey Bodley
728e8ac088
Merge pull request #49533 from mkogan1/wip-fips-openssl3
rgw: under fips & openssl 3.x allow md5 iusage in select rgw ops

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2023-01-17 08:12:54 -05:00
Yingxin
21e481482f
Merge pull request #49710 from cyx1231st/wip-seastore-cleanup-overwrite
crimson/os/seastore/object_data_handler: cleanup the overwrite path

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2023-01-17 16:29:24 +08:00
Yingxin
5734740ece
Merge pull request #49743 from xxhdx1985126/wip-omap-fixes
crimson/os/seastore/omap_manager: minor bugs fixes

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-01-17 16:28:43 +08:00
Avan Thakkar
17d1ecc914 mgr/prometheus: export zero valued pg state metrics
Fixes: https://tracker.ceph.com/issues/58471
Signed-off-by: Avan Thakkar <athakkar@redhat.com>

As per the Prometheus documentation, omitting zero metrics is not a best practice. The metric value for all PG_STATES should be initialized to zero.
2023-01-16 22:35:04 +05:30
Redouane Kachach
cb076017b1
mgr/cephadm: fix prometheus haproxy/ingress deps update
Fixes: https://tracker.ceph.com/issues/58001

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2023-01-16 09:40:37 +01:00
Lucian Petrut
0bf85c7be7 qa: add test_rbd_wnbd resize test
We're adding a test for the newly introduced live resize feature.
It will simply extend/shrink the image, wait for the new size to
be picked up and then run FIO tests to validate the resized image.

While at it, we're fixing two unrelated linter warnings:

  E275 missing whitespace after keyword

Signed-off-by: Lucian Petrut <lpetrut@cloudbasesolutions.com>
2023-01-16 10:12:12 +02:00
Xuehan Xu
120a187566 test/crimson/seastore/test_omap_manager: keep test_omap_mappings consistent with "rm_key_range" config
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2023-01-16 14:36:33 +08:00
Xuehan Xu
7c9a301837 crimson/os/seastore/omap_manager: fix a capture-by-reference related issue
Variables that are not guaranteed to be available as long as the continuations
live shouldn't be captured by reference

Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2023-01-16 14:36:33 +08:00
zdover23
6d583d25c5
Merge pull request #49725 from anthonyeleven/56521
doc/releases: Clarify Quincy CephFS MDS upgrade process

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2023-01-16 13:50:17 +10:00
Anthony D'Atri
680e534540
Merge pull request #49747 from zdover23/wip-doc-2023-01-16-luks-versions
doc/ceph-volume: update LUKS docs
2023-01-15 22:04:59 -05:00
Yingxin Cheng
b78668eec8 crimson/os/seastore: add FIXME to consider pending extent with absolute paddr
During object data overwrite.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-01-16 10:55:09 +08:00
Yingxin Cheng
14cab7365c crimson/os/seastore/object_data_handler: cleanup the overwrite path
* implement factory and type for extent_to_write_t.
* refactor overwrite_plan_t with explicit size calculations and
  defined operations.
* cleanup the overwrite path accordingly.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2023-01-16 10:55:01 +08:00
zdover23
d28f96359b
Merge pull request #49716 from zdover23/wip-doc-2023-01-12-rbd-iscsi-initiator-linux-prompts
doc/rbd: refine iscsi-initiator-linux.rbd

Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2023-01-16 11:32:02 +10:00
Zac Dover
27974c1d8a doc/ceph-volume: update LUKS docs
Remove references that claim that Ceph uses only LUKS version 1.

https://tracker.ceph.com/issues/58354

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-16 07:46:49 +10:00
colemitchell
cf8ec284f5
Merge pull request #49745 from zdover23/wip-doc-2023-01-15-start-documenting-ceph-escaping-bold-characters-within-words
doc/start: add RST escape character rules for bold

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2023-01-15 14:54:28 -05:00
Zac Dover
26b8e9cb93 doc/rbd: format iscsi-initiator-linux.rbd better
Add prompts and clean up the lists in doc/rbd/iscsi-initiator-linux.rbd.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-16 05:39:54 +10:00
Zac Dover
84524c2646 doc/start: add RST escape character rules for bold
Explain how to escape the bold notation (**) within words in RST.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-16 05:38:07 +10:00
colemitchell
6fec0c82d7
Merge pull request #49736 from zdover23/wip-doc-2023-01-14-dev-basic-workflow-git-commands
doc/dev: add git branch management commands

Reviewed-by: Cole Mitchell <cole.mitchell@gmail.com>
2023-01-13 16:47:52 -05:00
Zac Dover
f1c0c3ec3d doc/dev: add git branch management commands
Add git branch deleting and search commands to the "Basic Workflow" page
of the Developer Guide.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2023-01-14 07:26:18 +10:00
Adam King
cbe35e6dd4
Merge pull request #48496 from adk3798/apply-spec-parsing
cephadm: only pull host info from applied spec, don't try to parse yaml

Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-01-13 14:00:27 -05:00
Adam King
e6b4ef793a
Merge pull request #49024 from rkachach/fix_issue_58067
mgr/cephadm: fixing mgr port shown in ceph orch ps

Reviewed-by: Adam King <adking@redhat.com>
2023-01-13 12:29:58 -05:00
Patrick Donnelly
af04d224b0
Merge PR #49731 into main
* refs/pull/49731/head:
	tools/cephfs: fix traceback from missing envvar

Reviewed-by: Milind Changire <mchangir@redhat.com>
2023-01-13 12:28:05 -05:00
Adam King
d6982cc5b9
Merge pull request #48617 from adk3798/upgrade-status-help
mgr/orchestrator: fix upgrade status help message

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-01-13 12:25:54 -05:00
Adam King
f56a034cff
Merge pull request #48384 from jmolmo/Rook_PDFetcher
mgr/rook: Device inventory

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Travis Nielsen <tnielsen@redhat.com>
2023-01-13 12:23:10 -05:00
Adam King
2b8e7a6155
Merge pull request #48592 from adk3798/offline-upgrade
mgr/cephadm: improve offline host handling, mostly around upgrade

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-01-13 12:01:41 -05:00
Adam King
06206df4ea
Merge pull request #48574 from adk3798/debug-log-spam
mgr/cephadm: make logging refresh metadata to debug logs configurable

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-01-13 11:59:26 -05:00
Adam King
f7a5a3b49b
Merge pull request #47383 from rhcs-dashboard/ceph-exporter-cephadm-changes
exporter: cephadm changes

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-01-13 11:54:01 -05:00
Adam King
afdc8d3bec
Merge pull request #49389 from adk3798/git-archive-fix
qa/tasks/cephadm.py: fix pulling cephadm from git.ceph.com

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2023-01-13 10:31:21 -05:00
Nizamudeen A
6a7742f5df
Merge pull request #49726 from rhcs-dashboard/cephadm-e2e-fixes
mgr/dashboard: cephadm dashboard e2e fixes 

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2023-01-13 20:31:11 +05:30
Soumya Koduri
230a6e0c0e rgw: Resolve sync stuck in previous gen
In case if any data log entries are missing for the older
generations, the sync server may not mark those shards as done
and can get stuck in that old gen for ever.

To avoid that, whenever a future gen entry is read, write the undone (shard,gen)
entry to error repo so that it can be processed and marked as done
and hence sync can progress eventually.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2023-01-13 09:49:56 -05:00
Adam King
1366e8f276
Merge pull request #49635 from rkachach/fix_issue_58378
mgr/mgr_util: fixing some tox issues

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2023-01-13 09:47:33 -05:00
Shilpa Jagannath
fb92311b3e rgw/multisite: return error from RGWLastCallerWinsCR() to track marker update failures
Signed-off-by: Shilpa Jagannath <smanjara@redhat.com>
2023-01-13 09:46:44 -05:00
Adam C. Emerson
dc4685f693 rgw: Check for lost lease more often
Flush the marker tracker and abort if we don't still have it.

Resolves: rhbz#2129718
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2023-01-13 09:19:53 -05:00