Commit Graph

119283 Commits

Author SHA1 Message Date
Zac Dover
cce1fc800d doc/dev: rewrite "getting binaries" section
This rewrites the "Getting Binaries" section
of the "Workflow" section of the "Tests:
Integration Tests" section of the Developer Guide.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-02-10 06:46:48 +10:00
Jeff Layton
615b3df1ab
Merge pull request #38955 from varshar16/wip-doc-update-nfs-ganesha-dynamic
doc/cephfs/nfs: Add rook pod restart note, export and log block example
2021-02-03 07:45:38 -05:00
pcuzner
faa93b751d
Merge pull request #38911 from pcuzner/add-cluster-network-to-bootstrap
cephadm: Add cluster network to bootstrap
2021-02-03 21:53:54 +13:00
Samuel Just
ac9e308c3a
Merge pull request #39239 from athanatos/sjust/wip-49114
crimson/os/seastore: fix staged-fltree build problems

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-02-02 19:11:41 -08:00
Samuel Just
ad1cc8875b crimson/.../staged-fltree: propogate eagain in node, value
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-02 16:58:54 -08:00
Samuel Just
83a8d5d98e crimson/.../staged-fltree: fix tree_cursor_t::(trim|extend)_value
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-02 16:58:28 -08:00
Sage Weil
cced65aab7 Merge PR #39206 into master
* refs/pull/39206/head:
	mgr/MetricTypes: condition encoding on feature bits

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-02-02 17:47:52 -05:00
Samuel Just
b6d9806477
Merge pull request #38924 from cyx1231st/wip-seastar-onode-tree-onode_t
crimson/onode-staged-tree: implement an extensive Value framework

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-02 13:05:39 -08:00
Ilya Dryomov
fab4c2a9ea
Merge pull request #39209 from idryomov/wip-unbreak-rbd-task
qa/tasks/rbd: fix regressions introduced with rbd encryption support

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-02-02 18:16:56 +01:00
Sage Weil
e74df78368 Merge PR #39212 into master
* refs/pull/39212/head:
	cpatch: python 3.6 -> 3.8
	cpatch: new default base image

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-02 11:49:07 -05:00
zdover23
42d3352f30
Merge pull request #39207 from zdover23/wip-doc-removing-workbench-docs
doc/dev: remove workbench sections

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-03 02:14:24 +10:00
Kefu Chai
085723b4b8
Merge pull request #39227 from tchaikov/wip-48825
mgr/zabbix: format ceph.[{#POOL},percent_used as float

Reviewed-by: Wido den Hollander <wido@widodh.nl>
2021-02-03 00:11:41 +08:00
Kefu Chai
5329cb4839
Merge pull request #39225 from tchaikov/wip-crimson-seastore-dec-ref
crimson/os/seastore: don't use variadic template for dec_ref()

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-02-03 00:06:03 +08:00
Igor Fedotov
07f136a2f7
Merge pull request #38050 from ifed01/wip-ifed-fsck-spanning-blob
os/bluestore: detect and fix "zombie" spanning blobs using fsck.

Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-02-02 18:09:08 +03:00
Varsha Rao
01db81e2bc doc/cephfs/nfs: Add rook pod restart note, export and log block example
Fixes: https://tracker.ceph.com/issues/48914
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-02-02 20:07:43 +05:30
Kefu Chai
c8e5a051a0 mgr/zabbix: format ceph.[{#POOL},percent_used as float
also, multiply it with 100, as we are using 1.0 for 100% here.

for more details regarding the mapping from value_type to its values.
see
https://www.zabbix.com/documentation/4.0/manual/api/reference/item/object

Fixes: https://tracker.ceph.com/issues/48825
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-02 21:39:57 +08:00
Igor Fedotov
18d120dc2c os/bluestore: detect and fix "zombie" spanning blobs using fsck.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2021-02-02 15:49:31 +03:00
Kefu Chai
f256086bd2 crimson/os/seastore: don't use variadic template for dec_ref()
simpler this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-02 20:09:48 +08:00
Igor Fedotov
f6b18055ab
Merge pull request #39041 from ifed01/wip-ifed-fix-48966
os/bluestore: fix a bug causing unexpected Onode's unpinned state.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-02 14:10:01 +03:00
Jan Fajerski
e332eae077 Merge PR #38869 into master
* refs/pull/38869/head:
	ceph-volume: Fix usage of is_lv

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2021-02-02 10:46:35 +01:00
Kefu Chai
11dc14e1bf
Merge pull request #38975 from athanatos/sjust/wip-seastore-pipelines
seastore: update to support pipelined write operations

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-02 17:40:37 +08:00
Igor Fedotov
ea0fc57ef5 os/bluestore: fix a bug causing unexpected Onode's unpinned state.
There could be a race for Onodes put() and get() methods:

put()(pinned, nref=3)
  int n = --nref; (nref = 2)
  if (n == 2) {
    ..
    std::lock_guard l(ocs->lock);
    ...
    pinned = pinned && nref > 2; (= false)
    ...                                     get()
    if (r) {                                ++nref; (=3)
      n = --nref; (nref = 2)                return;
    }
    ...
    return

As a result nref = 2, pinned = false which is wrong

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2021-02-02 12:25:00 +03:00
Kefu Chai
391cd0cd46
Merge pull request #39205 from rzarzynski/wip-crimson-configurable-alien-threads-num
crimson: make the number of alien threads configurable.

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2021-02-02 14:04:59 +08:00
Paul Cuzner
804f34e475 cephadm:updates following bootstrap code clean up
Patch to align to new(ish) bootstrap code changes

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 15:42:00 +13:00
Paul Cuzner
af00a33322 cephadm: updated doc text
The phrase "recommended"  has been removed.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 14:22:43 +13:00
Paul Cuzner
bbe4fd83c5 cephadm: unit test updates for cluster-network handling
Tests updated to handle comma separated subnet lists

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 14:22:43 +13:00
Paul Cuzner
abd9287db0 cephadm: updated handling of cluster_network parameter
Parameter now supports a comma separated list of subnets and
detects the ipv4 or ipv6 setting on the cluster network to enable
osds to bind correctly.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 14:22:43 +13:00
Paul Cuzner
509f171a08 cephadm: install doc updated to include cluster-network parameter
Install guide updated to include a description of the --cluster-network
parameter. The text also links to the complete definition for cluster-network
on the rados/configuration/network-config-ref page.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 14:22:43 +13:00
Paul Cuzner
3f352c8af4 cephadm: unit test updates for new subnet function
Adds tests to validate the check_subnet function will work as
expected with various inputs

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 14:22:42 +13:00
Paul Cuzner
c391ccb97f cephadm: Add cluster network parameter to bootstrap cmd
Adds a --cluster-network parameter to the bootstrap cmd to
set the internal cluster network.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 14:22:42 +13:00
Josh Durgin
caa58fce7a
Merge pull request #38956 from zdover23/2021_Jan_19_release_notes_grammar
doc/PendingReleaseNotes: grammar and wording

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-01 15:31:48 -08:00
Sage Weil
fafdb1e47d Merge PR #39149 into master
* refs/pull/39149/head:
	qa/workunits/cephtool/test.sh: tolerate some settling for osd info vs dump test

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-01 16:25:01 -06:00
Sage Weil
7a1ce980d6 cpatch: python 3.6 -> 3.8
Signed-off-by: Sage Weil <sage@newdream.net>
2021-02-01 15:52:14 -06:00
Sage Weil
6df56bb04e cpatch: new default base image
Signed-off-by: Sage Weil <sage@newdream.net>
2021-02-01 15:52:14 -06:00
Samuel Just
a27b03940f crimson/os/seastore/segment_cleaner: tolerate mark_space_used on closed segment
A journal segment can be closed while outstanding writes on that
segment have not yet updated metadata.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 13:29:22 -08:00
Samuel Just
dfb1adaed6 crimson/os/seastore/journal: tolerate journal rolls during commit
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 13:29:22 -08:00
Samuel Just
41ae1c497b crimson/os/seastore: add basic pipeline phases to TransactionManager
We need to ensure that the metadata preperation and completions happen
in order.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 13:29:19 -08:00
Samuel Just
ad14ecedb6 crimson/common/operation: add OrderedConcurrentPhase
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
86348b48b3 src/crimson/common: decouple handle from stage
We're going to introduce stages with other properties.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
260c7c4af9 crimson/os/seastore: fix find_hole
We actually need to propogate eagain errors now, fix to use do_until.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
bcf4c89adf crimson/os/seastore: annotate all assert_all instances
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
568a332fba store-nbd: support concurrent operations
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
e43e5eadc5 crimson/os/seastore: validate node immediately prior to adding pin
Mostly, operating on an invalid extent is harmless by construction --
it'll be caught by the read set check in submit_transaction.  However,
prior to adding an extent to the lba pin set, we need to check that it's
really still live, which we can do by checking that it and its immediate
parent are still valid.  Mutating the target extent would have
invalidated it, and replacing the target extent would necessarily have
involved a mutation to the parent, which would have invalidated it.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
d244530f92 crimson/os/seastore: expand error type for reads to include eagain
There are cases where reads may detect an invalid cached extent and require
the user to restart the transaction.

As a side effect, clean up errorators to assert cases where construction
is invalid (invalid refcounts, enoent or invarg on node read, etc).  In
such cases, we may eventually want to introduce an internal_error error
type, but asserting is fine for now as we do not expect users to handle
these cases.

Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
ae9d15f670 crimson/common/errorator: add extend_ertr helper for merging errorators
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
ef24a8cb2d crimson/os/seastore/cache: put root in t.mutated_extents and avoid special behavior
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
d3e5937c08 crimson/common/operation.h: permit moving Handle objects
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
ccbc728ca9 test/crimson/seastore/test_transaction_manager: add tests for concurrent IO
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:36 -08:00
Samuel Just
c7eb6e4002 crimson/os/seastore/cached_extent: add asserts for debugging
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:16 -08:00
Ernesto Puerta
27c32caa19
Merge pull request #36518 from yongseokoh/fix-dashboard
mgr/dashboard: Fix missing root path of each session for CephFS

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2021-02-01 21:46:44 +01:00