Commit Graph

118032 Commits

Author SHA1 Message Date
Samuel Just
2ed559fdb1 crimson/os/seastore/journal: use specified size types for header
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
56b9313fd7 crimson/os/seastore/journal: fix debugging lines
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
46e8a8db14 crimson/os/seastore/journal: add data and metadata checksums
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
1c3df6f1c7 crimson/os/seastore/.../lba_btree_node: collapse root on merge if down to one element
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
6f744a5549 crimson/os/seastore/.../lba_btree_node_impl: fix merge_entry return values
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
060fd035a5 crimson/os/seastore/journal: check segment nonce in scan_segment
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
f2402dc916 crimson/os/seastore/journal: factor out read_segment_header
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
36cc47e69c crimson/os/seastore/journal: propogate segment headers with replay segments
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
2674d338e2 crimson/os/seastore/journal: record segment/record nonces based on seastore_id
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
bd49b956ad include/uuid: make bytes() return const *
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
cdd2b53a96 crimson/os/seastore/segment_manager: add seastore_meta_t with uuid
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
72a0667330 include/uuid: convert to denc
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
574474048b crimson/os/seastore/segment_manger/ephemeral: add final annotations
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
975d6e501c crimson/os/seastore: use unqualified en/decode for denc types
Otherwise, if definitions from encoding.h are in scope the templated
denc one won't be considered.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
dbd9e32adc crimson/os/seastore/journal: fix error returns in replay
SegmentManager is allowed to return an enoent if the segment isn't
readable.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
9628f34018 crimson/os/seastore/.../ephemeral: introduce pauses for testing
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
d7bb905a93 crimson/os/seastore/journal: send aligned buffer in initialize_segment
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
73e74914b5 crimson/tools/: add really simple nbd driver for TransactionManager
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
pcuzner
6513ee6233
Merge pull request #38413 from pcuzner/fix-yaml-error
orchestrator: validate osd yaml
2020-12-12 09:00:12 +13:00
Ali Maredia
786461204f rgw: add request time into beast log instead of current time
Change time format on the line that prints a
summary of the request in apache common log format
to match the format suggested by apache and encapsulate
apache time formatting in stream output operator.

For more information visit:
https://httpd.apache.org/docs/current/logs.html#common

Signed-off-by: Ali Maredia <amaredia@redhat.com>
Co-authored-by: Casey Bodley <cbodley@redhat.com>
2020-12-11 14:14:15 -05:00
Jason Dillaman
abab5f143b librbd/object_map: don't assert if a snapshot doesn't exist
When compute a fast-diff, if an snapshot no longer exists or fails
to load, ignore the error as long as it wasn't the start or end
snapshot.

Fixes: https://tracker.ceph.com/issues/48526
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 13:16:06 -05:00
Varsha Rao
c453493280 doc/dev/kubernetes: Add minikube tips and misc updates
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-11 23:23:28 +05:30
Varsha Rao
e126c94366 script/kubejacker: Add python_common library
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-11 23:21:58 +05:30
Patrick Donnelly
0c663e7d4e
Merge PR #38511 into master
* refs/pull/38511/head:
	qa/tasks/cephfs/nfs: Check if host ip is in cluster info output

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-11 09:47:35 -08:00
Kefu Chai
bc73204812 admin/build-doc: upgrade pip setuptools first
on certain distros, buggy pip and setuptools are used, so we need to
upgrade them first.

see also: googleapis/google-cloud-python#2990 and pypa/setuptools#885

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-12 00:23:32 +08:00
Ernesto Puerta
6a40305be4
Merge pull request #38519 from rhcs-dashboard/fix-47727-master
mgr/dashboard: RGW User Form is validating disabled fields

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-12-11 17:14:50 +01:00
Ernesto Puerta
5d548160e8
Merge pull request #38125 from rhcs-dashboard/improve-CRUSH-info-columns
mgr/dashboard: Replace Replica size and Erasure code profile with a single column

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-12-11 17:08:35 +01:00
Jason Dillaman
a888bff8d0 librbd/mirror: tweak which snapshot is unlinked when at capacity
The rbd-mirror daemon will attempt to sync from the last synced
snapshot to the next mirror snapshot. When the limit is at 3, this
currently can result in a situation where an in-use sync snapshot is
deleted. Instead of unlinking the second oldest snapshot, always
unlink the third oldest.

Fixes: https://tracker.ceph.com/issues/48553
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 10:41:34 -05:00
Jason Dillaman
529d3c9a07 librbd/mirror: ignore non-fatal errors when unlinking the snapshot
Notifications can fail if a client crashes or if we race with the
removal of the image. Either case should be ignored.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 10:41:34 -05:00
Jason Dillaman
11165b1de3 librbd/mirror: increase debug logging of snapshot state machines
Try to keep debug level 20 for IO state machines so that setting the
debug level to something lower should show the manipulation of
the mirror snapshots.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 10:41:34 -05:00
Mykola Golub
cbbfd1c426
Merge pull request #38494 from dillaman/wip-45694
librbd: fix sporadic failures in TestMigration.StressLive

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-11 17:40:12 +02:00
Nizamudeen A
aaedab9135 mgr/dashboard: Making the edges of not rounded button rounded
Fixes: https://tracker.ceph.com/issues/48563
Signed-off-by: Nizamudeen A <nia@redhat.com>
2020-12-11 20:27:12 +05:30
Kefu Chai
286c6b437f
Merge pull request #38515 from tchaikov/wip-script-run-cbt
script/run-cbt.sh: drop bashism

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-11 22:34:53 +08:00
Kefu Chai
34f74e8a37 admin/build-doc: add livehtml target
it is time-consuming to rebuild the python bindings every time we
rebuild the document, it'd be ideal if we could just build document.

in this change, in addition to "html" and "doc", "livehtml" argument is
now supported by build-doc script, so one can just use

./build-doc livehtml

to build and start a web server. whenever a change in doc/ is detected,
the document is rebuilt. for more details, see
https://pypi.org/project/sphinx-autobuild/

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-11 22:30:56 +08:00
Aashish Sharma
13900cf6ae mgr/dashboard: new generic HTTP error page component
Added a generic Error component for HTTP Errors such as 404,403,501

Fixes:https://tracker.ceph.com/issues/39128
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2020-12-11 19:19:38 +05:30
Jason Dillaman
1baba64e21 librbd/deep_copy: added new migrating flag to object copy
The migration operation and the copyup state machine will set
this flag when attempting to perform a deep-copy due to a
live-migration.

This flag will prevent a possible race condition between the
start of the object deep-copy when migration was enabled and
the writing portion of the deep-copy when migration might
have completed via external means.

Fixes: https://tracker.ceph.com/issues/45694
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 08:03:07 -05:00
Jason Dillaman
e79f6b1c15 librbd/deep_copy: added bitwise flag parameter to object copy
This initial version subsumes the original "flatten" boolean flag.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 08:02:39 -05:00
Varsha Rao
c139d0da44 script/kubejacker: Add podman push example for plain HTTP registry
If the image is pushed to a plain HTTP registry then tls-verify needs to be set
to false. This patch adds an example for it.

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-11 18:32:34 +05:30
Kefu Chai
864d7ffc2a
Merge pull request #38486 from Rjerk/fix-mds-conf-typo
doc: fix a couple of typos

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-11 20:46:24 +08:00
Kefu Chai
df77e51a6f
Merge pull request #38542 from SMIL-Infra/wip-doc-conf-typo
doc: Fixes a typo in mon_dns_srv_name.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 20:41:54 +08:00
Mykola Golub
6283c7739b
Merge pull request #38517 from dillaman/wip-48525
rbd-mirror: bad state and crashes in snapshot-based mirroring

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-11 12:13:41 +02:00
Mykola Golub
d518bb2588
Merge pull request #38492 from dillaman/wip-librbd-io-tweaks
librbd: minor fix to IO shut-down and increased IO logging

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-11 12:12:04 +02:00
Deepika Upadhyay
85ca7b36a0 jaeger: make tracing default turned off, until teuthology integration
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 10:08:09 +00:00
Deepika Upadhyay
1e6e1f907e debian/control: use yaml-dev >= 0.6
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 10:08:09 +00:00
Deepika Upadhyay
4b8c92a920 osd: refactor missing spaces
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 10:08:09 +00:00
Deepika Upadhyay
01997e76fe core: tracing basic i/o path for OSD
* add tracing header files { common/tracer.{h/cc} }

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 10:07:58 +00:00
胡玮文
4dd26d651f doc: Fixes a typo in mon_dns_srv_name.
Signed-off-by: 胡玮文 <huww98@outlook.com>
2020-12-11 17:16:21 +08:00
Deepika Upadhyay
3c5abab7ea ceph.spec.in: refactor s/Cephs/Ceph
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 08:35:22 +00:00
Kefu Chai
4d6d1465ea
Merge pull request #38480 from yician1000/fix_48488
mgr/restful: fix TypeError occurring in _gather_osds()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 16:08:31 +08:00
Kefu Chai
6e28e6f41b
Merge pull request #38384 from bk201/wip-48406
mgr/dashboard: fix test_dashboard_e2e.sh errors

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-12-11 16:07:03 +08:00