Zac Dover
cce1fc800d
doc/dev: rewrite "getting binaries" section
...
This rewrites the "Getting Binaries" section
of the "Workflow" section of the "Tests:
Integration Tests" section of the Developer Guide.
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-02-10 06:46:48 +10:00
Jeff Layton
615b3df1ab
Merge pull request #38955 from varshar16/wip-doc-update-nfs-ganesha-dynamic
...
doc/cephfs/nfs: Add rook pod restart note, export and log block example
2021-02-03 07:45:38 -05:00
pcuzner
faa93b751d
Merge pull request #38911 from pcuzner/add-cluster-network-to-bootstrap
...
cephadm: Add cluster network to bootstrap
2021-02-03 21:53:54 +13:00
Samuel Just
ac9e308c3a
Merge pull request #39239 from athanatos/sjust/wip-49114
...
crimson/os/seastore: fix staged-fltree build problems
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-02-02 19:11:41 -08:00
Samuel Just
ad1cc8875b
crimson/.../staged-fltree: propogate eagain in node, value
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-02 16:58:54 -08:00
Samuel Just
83a8d5d98e
crimson/.../staged-fltree: fix tree_cursor_t::(trim|extend)_value
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-02 16:58:28 -08:00
Sage Weil
cced65aab7
Merge PR #39206 into master
...
* refs/pull/39206/head:
mgr/MetricTypes: condition encoding on feature bits
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-02-02 17:47:52 -05:00
Samuel Just
b6d9806477
Merge pull request #38924 from cyx1231st/wip-seastar-onode-tree-onode_t
...
crimson/onode-staged-tree: implement an extensive Value framework
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-02 13:05:39 -08:00
Ilya Dryomov
fab4c2a9ea
Merge pull request #39209 from idryomov/wip-unbreak-rbd-task
...
qa/tasks/rbd: fix regressions introduced with rbd encryption support
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-02-02 18:16:56 +01:00
Sage Weil
e74df78368
Merge PR #39212 into master
...
* refs/pull/39212/head:
cpatch: python 3.6 -> 3.8
cpatch: new default base image
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-02 11:49:07 -05:00
zdover23
42d3352f30
Merge pull request #39207 from zdover23/wip-doc-removing-workbench-docs
...
doc/dev: remove workbench sections
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-03 02:14:24 +10:00
Kefu Chai
085723b4b8
Merge pull request #39227 from tchaikov/wip-48825
...
mgr/zabbix: format ceph.[{#POOL},percent_used as float
Reviewed-by: Wido den Hollander <wido@widodh.nl>
2021-02-03 00:11:41 +08:00
Kefu Chai
5329cb4839
Merge pull request #39225 from tchaikov/wip-crimson-seastore-dec-ref
...
crimson/os/seastore: don't use variadic template for dec_ref()
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-02-03 00:06:03 +08:00
Igor Fedotov
07f136a2f7
Merge pull request #38050 from ifed01/wip-ifed-fsck-spanning-blob
...
os/bluestore: detect and fix "zombie" spanning blobs using fsck.
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-02-02 18:09:08 +03:00
Varsha Rao
01db81e2bc
doc/cephfs/nfs: Add rook pod restart note, export and log block example
...
Fixes: https://tracker.ceph.com/issues/48914
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-02-02 20:07:43 +05:30
Kefu Chai
c8e5a051a0
mgr/zabbix: format ceph.[{#POOL},percent_used as float
...
also, multiply it with 100, as we are using 1.0 for 100% here.
for more details regarding the mapping from value_type to its values.
see
https://www.zabbix.com/documentation/4.0/manual/api/reference/item/object
Fixes: https://tracker.ceph.com/issues/48825
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-02 21:39:57 +08:00
Igor Fedotov
18d120dc2c
os/bluestore: detect and fix "zombie" spanning blobs using fsck.
...
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2021-02-02 15:49:31 +03:00
Kefu Chai
f256086bd2
crimson/os/seastore: don't use variadic template for dec_ref()
...
simpler this way
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-02-02 20:09:48 +08:00
Igor Fedotov
f6b18055ab
Merge pull request #39041 from ifed01/wip-ifed-fix-48966
...
os/bluestore: fix a bug causing unexpected Onode's unpinned state.
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-02 14:10:01 +03:00
Jan Fajerski
e332eae077
Merge PR #38869 into master
...
* refs/pull/38869/head:
ceph-volume: Fix usage of is_lv
Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2021-02-02 10:46:35 +01:00
Kefu Chai
11dc14e1bf
Merge pull request #38975 from athanatos/sjust/wip-seastore-pipelines
...
seastore: update to support pipelined write operations
Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-02-02 17:40:37 +08:00
Igor Fedotov
ea0fc57ef5
os/bluestore: fix a bug causing unexpected Onode's unpinned state.
...
There could be a race for Onodes put() and get() methods:
put()(pinned, nref=3)
int n = --nref; (nref = 2)
if (n == 2) {
..
std::lock_guard l(ocs->lock);
...
pinned = pinned && nref > 2; (= false)
... get()
if (r) { ++nref; (=3)
n = --nref; (nref = 2) return;
}
...
return
As a result nref = 2, pinned = false which is wrong
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2021-02-02 12:25:00 +03:00
Kefu Chai
391cd0cd46
Merge pull request #39205 from rzarzynski/wip-crimson-configurable-alien-threads-num
...
crimson: make the number of alien threads configurable.
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Mark Nelson <mnelson@redhat.com>
2021-02-02 14:04:59 +08:00
Paul Cuzner
804f34e475
cephadm:updates following bootstrap code clean up
...
Patch to align to new(ish) bootstrap code changes
Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 15:42:00 +13:00
Paul Cuzner
af00a33322
cephadm: updated doc text
...
The phrase "recommended" has been removed.
Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 14:22:43 +13:00
Paul Cuzner
bbe4fd83c5
cephadm: unit test updates for cluster-network handling
...
Tests updated to handle comma separated subnet lists
Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 14:22:43 +13:00
Paul Cuzner
abd9287db0
cephadm: updated handling of cluster_network parameter
...
Parameter now supports a comma separated list of subnets and
detects the ipv4 or ipv6 setting on the cluster network to enable
osds to bind correctly.
Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 14:22:43 +13:00
Paul Cuzner
509f171a08
cephadm: install doc updated to include cluster-network parameter
...
Install guide updated to include a description of the --cluster-network
parameter. The text also links to the complete definition for cluster-network
on the rados/configuration/network-config-ref page.
Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 14:22:43 +13:00
Paul Cuzner
3f352c8af4
cephadm: unit test updates for new subnet function
...
Adds tests to validate the check_subnet function will work as
expected with various inputs
Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 14:22:42 +13:00
Paul Cuzner
c391ccb97f
cephadm: Add cluster network parameter to bootstrap cmd
...
Adds a --cluster-network parameter to the bootstrap cmd to
set the internal cluster network.
Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2021-02-02 14:22:42 +13:00
Josh Durgin
caa58fce7a
Merge pull request #38956 from zdover23/2021_Jan_19_release_notes_grammar
...
doc/PendingReleaseNotes: grammar and wording
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-01 15:31:48 -08:00
Sage Weil
fafdb1e47d
Merge PR #39149 into master
...
* refs/pull/39149/head:
qa/workunits/cephtool/test.sh: tolerate some settling for osd info vs dump test
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-02-01 16:25:01 -06:00
Sage Weil
7a1ce980d6
cpatch: python 3.6 -> 3.8
...
Signed-off-by: Sage Weil <sage@newdream.net>
2021-02-01 15:52:14 -06:00
Sage Weil
6df56bb04e
cpatch: new default base image
...
Signed-off-by: Sage Weil <sage@newdream.net>
2021-02-01 15:52:14 -06:00
Samuel Just
a27b03940f
crimson/os/seastore/segment_cleaner: tolerate mark_space_used on closed segment
...
A journal segment can be closed while outstanding writes on that
segment have not yet updated metadata.
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 13:29:22 -08:00
Samuel Just
dfb1adaed6
crimson/os/seastore/journal: tolerate journal rolls during commit
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 13:29:22 -08:00
Samuel Just
41ae1c497b
crimson/os/seastore: add basic pipeline phases to TransactionManager
...
We need to ensure that the metadata preperation and completions happen
in order.
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 13:29:19 -08:00
Samuel Just
ad14ecedb6
crimson/common/operation: add OrderedConcurrentPhase
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
86348b48b3
src/crimson/common: decouple handle from stage
...
We're going to introduce stages with other properties.
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
260c7c4af9
crimson/os/seastore: fix find_hole
...
We actually need to propogate eagain errors now, fix to use do_until.
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
bcf4c89adf
crimson/os/seastore: annotate all assert_all instances
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
568a332fba
store-nbd: support concurrent operations
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
e43e5eadc5
crimson/os/seastore: validate node immediately prior to adding pin
...
Mostly, operating on an invalid extent is harmless by construction --
it'll be caught by the read set check in submit_transaction. However,
prior to adding an extent to the lba pin set, we need to check that it's
really still live, which we can do by checking that it and its immediate
parent are still valid. Mutating the target extent would have
invalidated it, and replacing the target extent would necessarily have
involved a mutation to the parent, which would have invalidated it.
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
d244530f92
crimson/os/seastore: expand error type for reads to include eagain
...
There are cases where reads may detect an invalid cached extent and require
the user to restart the transaction.
As a side effect, clean up errorators to assert cases where construction
is invalid (invalid refcounts, enoent or invarg on node read, etc). In
such cases, we may eventually want to introduce an internal_error error
type, but asserting is fine for now as we do not expect users to handle
these cases.
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
ae9d15f670
crimson/common/errorator: add extend_ertr helper for merging errorators
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
ef24a8cb2d
crimson/os/seastore/cache: put root in t.mutated_extents and avoid special behavior
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
d3e5937c08
crimson/common/operation.h: permit moving Handle objects
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:39 -08:00
Samuel Just
ccbc728ca9
test/crimson/seastore/test_transaction_manager: add tests for concurrent IO
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:36 -08:00
Samuel Just
c7eb6e4002
crimson/os/seastore/cached_extent: add asserts for debugging
...
Signed-off-by: Samuel Just <sjust@redhat.com>
2021-02-01 12:48:16 -08:00
Ernesto Puerta
27c32caa19
Merge pull request #36518 from yongseokoh/fix-dashboard
...
mgr/dashboard: Fix missing root path of each session for CephFS
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2021-02-01 21:46:44 +01:00