Commit Graph

131363 Commits

Author SHA1 Message Date
myoungwon oh
8c5ebd3a70 seastore/cbjournal: use cur_segment_seq to track the sequence of written records
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:48:18 +09:00
myoungwon oh
1c7942c87e seastore: use config_t instead of parameter in make_transaction_manager
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:47:27 +09:00
myoungwon oh
bdc1c1490f seastore: make journal_seq_t.cmp compatible with blk_paddr_t
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:35:04 +09:00
myoungwon oh
8b255efb4c seastore: add disable_trim parameter to segment_cleaner for cbjournal testing
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:34:52 +09:00
myoungwon oh
8d0a6ebc79 seastore: add add_record_relative to blk_paddr to handle adjust_addrs_from_base correctly
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:33:20 +09:00
myoungwon oh
2b923b0c79 seastore: fix maybe_relarive_to in paddr_t to handle the both addrs transparently
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:33:12 +09:00
myoungwon oh
eabd4868dc seastore: add maybe_relative_to in blk_paddr_t
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:33:06 +09:00
myoungwon oh
0e48ccc897 seastore: replace set_*_off with add_offset to handle transparently
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:32:55 +09:00
myoungwon oh
410e29d188 seastore: fix add_relative to work corretly in case of blk addr
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:32:46 +09:00
myoungwon oh
af1f1e2bec seastore/cbjournal: remove last_committed_record_base
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:31:51 +09:00
myoungwon oh
b8cf506f54 seastore: add more explanation regarding how CBJournal works
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:31:44 +09:00
myoungwon oh
316b6f3859 seastore: recover header's variable correctly without storing it
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:31:39 +09:00
myoungwon oh
3fcda5353f seastore: read records until find invalid entry and recover variables
To do not loss last_committed_record and written_to at shutdown,
this commit update the most recent value correctly during replay.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:31:33 +09:00
myoungwon oh
8a8c89d940 seastore: rename *_super to *_header and use it as helper functions
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:31:28 +09:00
myoungwon oh
26f06396d9 seastore: move value initialization to the default constructor
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:31:22 +09:00
myoungwon oh
dfbe73e127 seastore: use const in mkfs()
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:31:16 +09:00
myoungwon oh
84175d6060 seastore: enable cbjournal when running unittest_transaction_manager
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:31:04 +09:00
myoungwon oh
ede5d5092a test: add unit tests for CircularBoundedJournal
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:29:31 +09:00
myoungwon oh
76d52a96c3 seatore: add CircularBoundedJournal
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-05-19 09:29:25 +09:00
Casey Bodley
5dabc21d94
Merge pull request #46151 from cbodley/wip-rgw-derr-config-store
rgw: remove cerr config_store from rgw_common.cc

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-05-18 16:48:38 -04:00
Casey Bodley
2656e8f0d8
Merge pull request #46148 from smanjara/wip-smanjara-metadata-sync-fix
rgw multisite: complete fix for metadata sync issue

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-05-18 16:47:23 -04:00
Casey Bodley
c20201dd80
Merge pull request #46141 from sumedhak27/rgw_rest_bucket/support_max-size_attr
rgw_rest_bucket: Support max-size attr for SetBucketQuota REST API

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-05-18 16:45:39 -04:00
Casey Bodley
0b7ab95c81
Merge pull request #46232 from cbodley/wip-qa-rgw-sse
qa/rgw: use 'with-sse-s3' override for s3tests

Reviewed-by: Ali Maredia <amaredia@redhat.com>
2022-05-18 16:44:28 -04:00
Casey Bodley
705501396d
Merge pull request #46152 from cbodley/wip-55548
radosgw-admin: don't crash on --placement-id without --storage-class

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2022-05-18 16:43:57 -04:00
David Galloway
d7c5dc0dd3 doc: 16.2.9 Release notes
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-05-18 16:16:56 -04:00
David Galloway
c9e216c1ab
Merge pull request #46056 from ceph/wip-yuriw-release-16.2.8-master
doc: 16.2.8 Release Notes
2022-05-18 16:13:44 -04:00
Daniel Gryniewicz
1d3419f5f2
Merge pull request #46167 from dang/wip-dang-nosuchtagset
RGW - Fix NoSuchTagSet error

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2022-05-18 14:34:32 -04:00
David Galloway
ae2e93f5f1 qa: Pull from quay.io not docker.io
We are pushing to quay.io now due to docker.io rate limiting.

Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-05-18 14:22:52 -04:00
Adam King
38ebba8eda
Merge pull request #44013 from adk3798/use-old-addr
mgr/cephadm: re-use old ip when re-adding hosts if necessary

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-05-18 14:01:00 -04:00
Adam King
87342078f4
Merge pull request #46088 from pcuzner/cephadm_mpath_support
cephadm: Add support for mpath devices to gather-facts

Reviewed-by: Adam King <adking@redhat.com>
2022-05-18 13:59:43 -04:00
Josh Durgin
ca02fd34c8
Merge pull request #46315 from zdover23/wip-doc-2022-05-18-intro-3-to-three
doc/start: s/3/three/ in intro.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-05-18 10:30:12 -07:00
Adam King
77c135f103
Merge pull request #46306 from rkachach/fix_issue_55638
mgr/cephadm: stripping out / from the end of the url

Reviewed-by: Adam King <adking@redhat.com>
2022-05-18 11:51:30 -04:00
Rishabh Dave
59273966f1 qa/vstart_runner: store FSID in LocalContext instances
1. Method cluster() in ceph.py creates a dictionary "ctx.ceph", attaches
   a namespace to ctx.ceph[cluster_name], create an attribute "fsid" and
   stores Ceph cluster's FSID in it.

2. The method kernel_mount.KernelMount._get_debug_dir() uses that "fsid"
   attribute to get Ceph cluster's FSID. (The exact that does that is
   "fsid = self.ctx.ceph[cluster_name].fsid").

3. Test test_readahead.TestReadahead.test_flush() crashes with
   vstart_runner.py because that test eventually calls _get_debug_dir()
   and "ctx" in case of vstart_runner.py doesn't hold "ceph" dictionary
   or anything similar.

Adding a dictionary, similar to the one added in ceph.py, to
vstart_runner.LocalContext's instances will fix this issue.

Fixes: https://tracker.ceph.com/issues/55694
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2022-05-18 19:44:34 +05:30
Adam King
a1e7026aa7
Merge pull request #46291 from adk3798/move-active-mgr
mgr/cephadm: force fail over when we want to remove active mgr

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-05-18 09:19:30 -04:00
Adam King
989dc12d45
Merge pull request #46303 from rkachach/fix_issue_55641
mgr/cephadm: do not use sudo for root user

Reviewed-by: Adam King <adking@redhat.com>
2022-05-18 09:05:12 -04:00
Zac Dover
28efcec2d6 doc/start: s/3/three/ in intro.rst
I'm changing "3" to "three" for two reasons:

1. It's correct.
2. This allows me to test backports into Octopus, Pacific, and Quincy.
   I am particularly interested to see what happens when I attempt
   the backport into Octopus, because backports into Octopus have
   failed. This will provide me with another unit of data.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-05-18 20:36:53 +10:00
Redouane Kachach
c5e4aa6085
mgr/cephadm: adding support to copy ceph conf to per fsid config location
Fixes: https://tracker.ceph.com/issues/55685

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-05-18 10:52:47 +02:00
Adam King
948dd1bb13
Merge pull request #46163 from rkachach/fix_issue_55556
mgr/cephadm: fixing ipv6 handling during bootstrap

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2022-05-17 17:47:25 -04:00
Adam King
3daac6f598
Merge pull request #46202 from rkachach/fix_issue_51257
mgr/cephadm: fixing ipv6/128 and ipv4/32 subnets handling

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: John Mulligan <jmulligan@redhat.com>
2022-05-17 17:45:20 -04:00
Adam King
e01758e75b
Merge pull request #46207 from rkachach/fix_issue_55555
mgr/cephadm: fixing yaml parsing during bootstrap

Reviewed-by: Adam King <adking@redhat.com>
2022-05-17 17:44:11 -04:00
Adam King
15648422de
Merge pull request #46218 from votdev/issue_55595_prometheus_external_url
cephadm: prometheus: The generatorURL in alerts is only using hostname

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-05-17 17:15:44 -04:00
Adam King
63aab1c2ad
Merge pull request #46222 from adk3798/dont-use-non-cluster-cached-conns
mgr/cephadm: don't use cached conns for hosts not in cluster

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-05-17 17:13:49 -04:00
Adam King
028aa5c5d3
Merge pull request #46245 from adk3798/revert-call-changes
cephadm: Revert "mgr/cephadm: fixing call method timeout handling"

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-05-17 17:13:01 -04:00
Adam King
6c02f6a05c
Merge pull request #46264 from adk3798/adopt-custom-name-osd
cephadm: fix adoption of osds from custom name clusters

Reviewed-by: Redouane Kachach <rkachach@redhat.com>
2022-05-17 17:11:59 -04:00
zdover23
e055fa5367
Merge pull request #46305 from zdover23/wip-doc-2022-05-17-basic-workflow-integration-tests
doc/dev: refine basic-workflow.rst integ. test

Reviewed-by: Anthony D'Atri <anthony.datri@gmail.com>
2022-05-18 05:04:51 +10:00
Zac Dover
63c6041068 doc/dev: refine basic-workflow.rst integ. test
This is one in a set of PRs meant to keep the Basic
Workflow in the Developer guide current. It refines
the English in the "Integration Tests AKA ceph-qa-suite"
section of "Basic Workflow".

Several other small updates like this are expected. I
intend to avoid refining half of the page in one commit,
as I did last month when I refined the first half of the
basic workflow.

Co-authored-by: Anthony D'Atri <anthony.datri@gmail.com>

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2022-05-18 04:08:05 +10:00
Redouane Kachach
17032f6be2
mgr/cephadm: stripping out / from the end of the url
Fixes: https://tracker.ceph.com/issues/55638

Signed-off-by: Redouane Kachach <rkachach@redhat.com>
2022-05-17 17:27:06 +02:00
Soumya Koduri
f846f6ff02 rgw/qa: Add separate task for cloudtier tests
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2022-05-17 20:54:58 +05:30
Soumya Koduri
d0ac12dc38 rgw/qa: enable s3-tests related to cloud-transition feature
Added a new test-suite to configure cloudtier storage class and run related s3-tests.

Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2022-05-17 20:54:58 +05:30
Samuel Just
a8bcb71026
Merge pull request #46298 from cyx1231st/wip-seastore-add-metrics
crimson/os/seastore: add and fix metrics to reveal internal activities

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
2022-05-17 07:55:48 -07:00