Commit Graph

117886 Commits

Author SHA1 Message Date
Samuel Just
f2402dc916 crimson/os/seastore/journal: factor out read_segment_header
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
36cc47e69c crimson/os/seastore/journal: propogate segment headers with replay segments
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
2674d338e2 crimson/os/seastore/journal: record segment/record nonces based on seastore_id
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
bd49b956ad include/uuid: make bytes() return const *
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
cdd2b53a96 crimson/os/seastore/segment_manager: add seastore_meta_t with uuid
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
72a0667330 include/uuid: convert to denc
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
574474048b crimson/os/seastore/segment_manger/ephemeral: add final annotations
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
975d6e501c crimson/os/seastore: use unqualified en/decode for denc types
Otherwise, if definitions from encoding.h are in scope the templated
denc one won't be considered.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
dbd9e32adc crimson/os/seastore/journal: fix error returns in replay
SegmentManager is allowed to return an enoent if the segment isn't
readable.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
9628f34018 crimson/os/seastore/.../ephemeral: introduce pauses for testing
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
d7bb905a93 crimson/os/seastore/journal: send aligned buffer in initialize_segment
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
73e74914b5 crimson/tools/: add really simple nbd driver for TransactionManager
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
pcuzner
6513ee6233
Merge pull request #38413 from pcuzner/fix-yaml-error
orchestrator: validate osd yaml
2020-12-12 09:00:12 +13:00
Ali Maredia
786461204f rgw: add request time into beast log instead of current time
Change time format on the line that prints a
summary of the request in apache common log format
to match the format suggested by apache and encapsulate
apache time formatting in stream output operator.

For more information visit:
https://httpd.apache.org/docs/current/logs.html#common

Signed-off-by: Ali Maredia <amaredia@redhat.com>
Co-authored-by: Casey Bodley <cbodley@redhat.com>
2020-12-11 14:14:15 -05:00
Varsha Rao
c453493280 doc/dev/kubernetes: Add minikube tips and misc updates
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-11 23:23:28 +05:30
Varsha Rao
e126c94366 script/kubejacker: Add python_common library
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-11 23:21:58 +05:30
Patrick Donnelly
0c663e7d4e
Merge PR #38511 into master
* refs/pull/38511/head:
	qa/tasks/cephfs/nfs: Check if host ip is in cluster info output

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-11 09:47:35 -08:00
Kefu Chai
bc73204812 admin/build-doc: upgrade pip setuptools first
on certain distros, buggy pip and setuptools are used, so we need to
upgrade them first.

see also: googleapis/google-cloud-python#2990 and pypa/setuptools#885

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-12 00:23:32 +08:00
Ernesto Puerta
6a40305be4
Merge pull request #38519 from rhcs-dashboard/fix-47727-master
mgr/dashboard: RGW User Form is validating disabled fields

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-12-11 17:14:50 +01:00
Ernesto Puerta
5d548160e8
Merge pull request #38125 from rhcs-dashboard/improve-CRUSH-info-columns
mgr/dashboard: Replace Replica size and Erasure code profile with a single column

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-12-11 17:08:35 +01:00
Mykola Golub
cbbfd1c426
Merge pull request #38494 from dillaman/wip-45694
librbd: fix sporadic failures in TestMigration.StressLive

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-11 17:40:12 +02:00
Kefu Chai
286c6b437f
Merge pull request #38515 from tchaikov/wip-script-run-cbt
script/run-cbt.sh: drop bashism

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-11 22:34:53 +08:00
Kefu Chai
34f74e8a37 admin/build-doc: add livehtml target
it is time-consuming to rebuild the python bindings every time we
rebuild the document, it'd be ideal if we could just build document.

in this change, in addition to "html" and "doc", "livehtml" argument is
now supported by build-doc script, so one can just use

./build-doc livehtml

to build and start a web server. whenever a change in doc/ is detected,
the document is rebuilt. for more details, see
https://pypi.org/project/sphinx-autobuild/

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-11 22:30:56 +08:00
Jason Dillaman
1baba64e21 librbd/deep_copy: added new migrating flag to object copy
The migration operation and the copyup state machine will set
this flag when attempting to perform a deep-copy due to a
live-migration.

This flag will prevent a possible race condition between the
start of the object deep-copy when migration was enabled and
the writing portion of the deep-copy when migration might
have completed via external means.

Fixes: https://tracker.ceph.com/issues/45694
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 08:03:07 -05:00
Jason Dillaman
e79f6b1c15 librbd/deep_copy: added bitwise flag parameter to object copy
This initial version subsumes the original "flatten" boolean flag.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 08:02:39 -05:00
Varsha Rao
c139d0da44 script/kubejacker: Add podman push example for plain HTTP registry
If the image is pushed to a plain HTTP registry then tls-verify needs to be set
to false. This patch adds an example for it.

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-11 18:32:34 +05:30
Kefu Chai
864d7ffc2a
Merge pull request #38486 from Rjerk/fix-mds-conf-typo
doc: fix a couple of typos

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-11 20:46:24 +08:00
Kefu Chai
df77e51a6f
Merge pull request #38542 from SMIL-Infra/wip-doc-conf-typo
doc: Fixes a typo in mon_dns_srv_name.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 20:41:54 +08:00
Mykola Golub
6283c7739b
Merge pull request #38517 from dillaman/wip-48525
rbd-mirror: bad state and crashes in snapshot-based mirroring

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-11 12:13:41 +02:00
Mykola Golub
d518bb2588
Merge pull request #38492 from dillaman/wip-librbd-io-tweaks
librbd: minor fix to IO shut-down and increased IO logging

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-11 12:12:04 +02:00
胡玮文
4dd26d651f doc: Fixes a typo in mon_dns_srv_name.
Signed-off-by: 胡玮文 <huww98@outlook.com>
2020-12-11 17:16:21 +08:00
Kefu Chai
4d6d1465ea
Merge pull request #38480 from yician1000/fix_48488
mgr/restful: fix TypeError occurring in _gather_osds()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 16:08:31 +08:00
Kefu Chai
6e28e6f41b
Merge pull request #38384 from bk201/wip-48406
mgr/dashboard: fix test_dashboard_e2e.sh errors

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-12-11 16:07:03 +08:00
Kefu Chai
8453857907
Merge pull request #37785 from lxbsz/conf1
common/config: do not expand the pid for socket admin

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 16:04:51 +08:00
Kefu Chai
53a54dcd24
Merge pull request #38417 from changchengx/osdmap
osd/OSDMonitor: correct duplicated output info

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-11 16:04:00 +08:00
Kefu Chai
208247268f
Merge pull request #38453 from b-ranto/wip-crash-serial
mgr/crash: Serialize command handling

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-12-11 16:00:35 +08:00
Kefu Chai
3f1aa66ee2
Merge pull request #38501 from tchaikov/wip-cmake-crimson-test
test/crimson: do not link against crimson-{os,common}

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-11 15:52:22 +08:00
Kefu Chai
7a5100fd17
Merge pull request #38516 from tchaikov/wip-cmake-rocksdb
cmake: stop rebuilding rocksdb everytime

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-12-11 12:47:51 +08:00
Paul Cuzner
a8690f1b50 orchestrator: drop redundant try/except
YAML is validated up front, so the additional try/except
clause is not needed.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2020-12-11 17:25:08 +13:00
Josh Durgin
7f1f5673c7
Merge pull request #35314 from zdover23/wip-doc-elasticsearch-7-warning
doc/radosgw: Note that ElasticSearch 7 doesn't work. Just 6 and lower.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-12-10 18:54:51 -08:00
Kefu Chai
79177997a5
Merge pull request #38523 from tchaikov/wip-gcc-toolset-9
install-deps.sh: do not use gcc-toolset-9 from copr

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-12-11 10:41:53 +08:00
Kefu Chai
39605e6bdc
Merge pull request #38157 from sebastian-philipp/labeler-orchestrator
github/labeler: Add some more to cephadm, add orchestrator

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 08:59:09 +08:00
Jason Dillaman
c95cf1eb78
Merge pull request #38408 from trociny/wip-rbd-group-snap-create2
librbd: extend group snap create API to support flags

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-12-10 18:06:50 -05:00
Jason Dillaman
3a30490eab
Merge pull request #38518 from trociny/wip-rbd-test-memleak
test/librbd: fix memory leak in TestLibRBD.ConcurentOperations

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-12-10 18:06:24 -05:00
Sebastian Wagner
84a110744c
Merge pull request #38490 from sebastian-philipp/mypy-0.790
src,qa,dashboard: Upgrade to mypy 0.790

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-12-10 22:41:47 +01:00
Harish Munjulur
ddb5a03b47
Merge pull request #38075 from joke-lee/s3-auth-date-fix
rgw: fix RequestTimeTooSkewed when Date contain RFC-822/ISO 8601 standard timezone
2020-12-10 11:49:37 -08:00
Harish Munjulur
482599e24e
Merge pull request #37926 from BryceCao/wip-catch-non-int-exception
rgw : catch non int exception
2020-12-10 11:48:47 -08:00
Kefu Chai
b32c6f1d1a
Merge pull request #37909 from alexandrsushko/prometheus-pg-laggy-46142
mgr: Fix for dashboard/prometheus failure due to laggy pg state

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
2020-12-10 23:53:48 +08:00
J. Eric Ivancich
30dc6f971b
Merge pull request #38131 from linuxbox2/wip-lc-ix
rgwlc: correctly dimension lc shard index vector

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-12-10 10:06:40 -05:00
Sebastian Wagner
a823ee6b1f mgr/cephadm: disallow_untyped_defs=True
simplifies mypy.ini

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-12-10 15:53:00 +01:00