Commit Graph

117871 Commits

Author SHA1 Message Date
Kefu Chai
2f1f16ed86 admin/doc-requirements.txt: require breathe >= 4.20
to be compatible with Sphinx 3.2
see https://github.com/michaeljones/breathe/tree/v4.20.0#change-log

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-14 16:26:49 +08:00
Kefu Chai
684785d958
Merge pull request #38545 from tchaikov/wip-crimson-test-errorator
test/crimson: add a test to verify that errorator does not copy

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-13 19:26:40 +08:00
Kefu Chai
953efae652 test/crimson: add a test to verify that errorator does not copy
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-13 11:32:48 +08:00
Kefu Chai
ccaaad1d12 test/crimson: move member variable into test
so the test is more self-contained.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-13 11:32:48 +08:00
Kefu Chai
39ba718e30 test/crimson: s/do_until_test_t/errorator_test_t/
so we can reuse this test suite for more errorator related tests.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-13 11:32:31 +08:00
Kefu Chai
8bbe2e088a
Merge pull request #38554 from tchaikov/wip-admin-build-doc
admin/build-doc: consolidate the build deps into admin/doc-requirements.txt

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-12 22:24:52 +08:00
Sebastian Wagner
cd97c73089
Merge pull request #38547 from varshar16/wip-kubejacker-updates
script/kubejacker: Add python_common library and misc updates

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-12-12 12:55:50 +01:00
Kefu Chai
140f6c5c28 admin/build-doc: drop comments for building dummy C bindings
we don't build dummy C bindings since
2235c2db0e

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-12 16:49:21 +08:00
Kefu Chai
703ba9e7cb admin/build-doc: revert "upgrade pip setuptools first"
per Radoslow Zarzynski, the build failure was due to missing Python.h
for the python version he was using on the system.

This reverts commit bc73204812.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-12 16:29:20 +08:00
Kefu Chai
5cb9d54587 admin/build-doc: stop passing --use-feature=2020-resolver to pip
to silence the warning of

WARNING: --use-feature=2020-resolver no longer has any effect, since it is now the default dependency resolver in pip. This will become an error in pip 21.0.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-12 16:28:56 +08:00
Kefu Chai
6fb4aff5ad admin/build-doc: consolidate the build deps into admin/doc-pybind.txt
since all the python bindings are required for building the doc, extract
them into admin/doc-pybind.txt.

because the pybind python extensions require Cython python module to build,
we have to move them  into another requirement file, and install them after
Cython is installed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-12 16:27:20 +08:00
Kefu Chai
ebdaaf88fd
Merge pull request #37433 from aclamk/wip-rocksdb-better-options
kv/RocksDBStore: Added ability to set compound options

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2020-12-12 12:36:54 +08:00
Kefu Chai
ea9c14c322
Merge pull request #38020 from mdw-at-linuxbox/teuth-fix-x509-san
qa/tasks/openssl_keys.py: add subjectAltName to certificates

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-12 12:18:16 +08:00
Kefu Chai
30487c755c
Merge pull request #38282 from vosdev/ceph-pool-alert
mgr/prometheus: Fix 'pool filling up' with >50% usage

Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
2020-12-12 12:10:44 +08:00
Kefu Chai
b501d8516b
Merge pull request #38290 from athanatos/sjust/wip-transaction-manager-nbd
crimson/seastore: add journaling checksumming and nbd based simple perf tester

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-12 11:48:41 +08:00
Patrick Donnelly
cd62a8494b
Merge PR #38322 into master
* refs/pull/38322/head:
	test_cephfs_shell: add tests for ls command

Reviewed-by: Rishabh Dave <ridave@redhat.com>
2020-12-11 18:59:42 -08:00
Samuel Just
60e1d2ca92 crimson/os/seastore/journal: fix typo in comment
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 18:18:19 -08:00
Samuel Just
a99882edcb crimson/os/seastore/segment_manager: allocate page aligned in read helper
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 18:18:19 -08:00
Samuel Just
e358d24d5f crimson/os/seastore/cached_extent: always allocate page aligned
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 18:18:19 -08:00
Samuel Just
321c138ef0 crimson/os/seastore/journal: remove now unused scan_segment
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 18:18:19 -08:00
Samuel Just
5f4da5cefc crimson/os/seastore: rework jorunal::scan_extents to use scan_valid_records
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 18:18:19 -08:00
Samuel Just
b922fa8905 crimson/os/seastore/journal: replace scan_segment with scan_valid_records in replay_segment
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 18:18:19 -08:00
Samuel Just
68c17a0252 crimson/os/seastore/journal: add scan_valid_records
scan_valid_records validates record checksums and uses last_comitted
to avoid checking data crcs except on the final few records.  Will
replace scan_segment in a few patches.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 18:18:16 -08:00
Kefu Chai
b507eb2488
Merge pull request #38444 from tchaikov/wip-msgr-string-view
msg/async: drop unused member variable

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-12 08:17:02 +08:00
Sebastian Wagner
acde2ff575
Merge pull request #38439 from adk3798/iscsi-stuff
mgr/cephadm: improve iscsi dashboard config

Reviewed-by: Guillaume Abrioux <gabrioux@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-12-12 01:09:14 +01:00
Sebastian Wagner
755e66aa61
Merge pull request #38533 from sebastian-philipp/cephadm-mypy-no-untyped
mgr/cephadm: disallow_untyped_defs=True

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-12-12 01:07:12 +01:00
Kefu Chai
db3516d8f8
Merge pull request #38544 from tchaikov/wip-build-doc-auto-build
admin/build-doc: add livehtml target

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-12 08:05:24 +08:00
Samuel Just
ac08cfa188 crimson/os/seastore/journal: try_decode* pass bl as const &
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
d63ace5628 crimson/os/seastore/journal: validate header crc on read
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
59ff3f9735 crimson/os/seastore/lba_manager/btree/btree_range_pin: remove obsolete assert
In the event that the only two children of the root are merged, they
as well as the old root will be retired meaning that check_parent
will find no parent.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
6cd52cb0e6 crimson/os/seastore/journal: maintain committed_to on each record
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
2ed559fdb1 crimson/os/seastore/journal: use specified size types for header
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
56b9313fd7 crimson/os/seastore/journal: fix debugging lines
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
46e8a8db14 crimson/os/seastore/journal: add data and metadata checksums
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
1c3df6f1c7 crimson/os/seastore/.../lba_btree_node: collapse root on merge if down to one element
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
6f744a5549 crimson/os/seastore/.../lba_btree_node_impl: fix merge_entry return values
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
060fd035a5 crimson/os/seastore/journal: check segment nonce in scan_segment
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
f2402dc916 crimson/os/seastore/journal: factor out read_segment_header
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
36cc47e69c crimson/os/seastore/journal: propogate segment headers with replay segments
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
2674d338e2 crimson/os/seastore/journal: record segment/record nonces based on seastore_id
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
bd49b956ad include/uuid: make bytes() return const *
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
cdd2b53a96 crimson/os/seastore/segment_manager: add seastore_meta_t with uuid
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
72a0667330 include/uuid: convert to denc
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
574474048b crimson/os/seastore/segment_manger/ephemeral: add final annotations
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
975d6e501c crimson/os/seastore: use unqualified en/decode for denc types
Otherwise, if definitions from encoding.h are in scope the templated
denc one won't be considered.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
dbd9e32adc crimson/os/seastore/journal: fix error returns in replay
SegmentManager is allowed to return an enoent if the segment isn't
readable.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
9628f34018 crimson/os/seastore/.../ephemeral: introduce pauses for testing
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
d7bb905a93 crimson/os/seastore/journal: send aligned buffer in initialize_segment
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
73e74914b5 crimson/tools/: add really simple nbd driver for TransactionManager
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
pcuzner
6513ee6233
Merge pull request #38413 from pcuzner/fix-yaml-error
orchestrator: validate osd yaml
2020-12-12 09:00:12 +13:00