Commit Graph

118012 Commits

Author SHA1 Message Date
Samuel Just
dbd9e32adc crimson/os/seastore/journal: fix error returns in replay
SegmentManager is allowed to return an enoent if the segment isn't
readable.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
9628f34018 crimson/os/seastore/.../ephemeral: introduce pauses for testing
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
d7bb905a93 crimson/os/seastore/journal: send aligned buffer in initialize_segment
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
Samuel Just
73e74914b5 crimson/tools/: add really simple nbd driver for TransactionManager
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-12-11 13:31:39 -08:00
pcuzner
6513ee6233
Merge pull request #38413 from pcuzner/fix-yaml-error
orchestrator: validate osd yaml
2020-12-12 09:00:12 +13:00
Ali Maredia
786461204f rgw: add request time into beast log instead of current time
Change time format on the line that prints a
summary of the request in apache common log format
to match the format suggested by apache and encapsulate
apache time formatting in stream output operator.

For more information visit:
https://httpd.apache.org/docs/current/logs.html#common

Signed-off-by: Ali Maredia <amaredia@redhat.com>
Co-authored-by: Casey Bodley <cbodley@redhat.com>
2020-12-11 14:14:15 -05:00
Jason Dillaman
abab5f143b librbd/object_map: don't assert if a snapshot doesn't exist
When compute a fast-diff, if an snapshot no longer exists or fails
to load, ignore the error as long as it wasn't the start or end
snapshot.

Fixes: https://tracker.ceph.com/issues/48526
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 13:16:06 -05:00
Varsha Rao
c453493280 doc/dev/kubernetes: Add minikube tips and misc updates
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-11 23:23:28 +05:30
Varsha Rao
e126c94366 script/kubejacker: Add python_common library
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-11 23:21:58 +05:30
Patrick Donnelly
0c663e7d4e
Merge PR #38511 into master
* refs/pull/38511/head:
	qa/tasks/cephfs/nfs: Check if host ip is in cluster info output

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-11 09:47:35 -08:00
Kefu Chai
bc73204812 admin/build-doc: upgrade pip setuptools first
on certain distros, buggy pip and setuptools are used, so we need to
upgrade them first.

see also: googleapis/google-cloud-python#2990 and pypa/setuptools#885

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-12 00:23:32 +08:00
Ernesto Puerta
6a40305be4
Merge pull request #38519 from rhcs-dashboard/fix-47727-master
mgr/dashboard: RGW User Form is validating disabled fields

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-12-11 17:14:50 +01:00
Ernesto Puerta
5d548160e8
Merge pull request #38125 from rhcs-dashboard/improve-CRUSH-info-columns
mgr/dashboard: Replace Replica size and Erasure code profile with a single column

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-12-11 17:08:35 +01:00
Jason Dillaman
a888bff8d0 librbd/mirror: tweak which snapshot is unlinked when at capacity
The rbd-mirror daemon will attempt to sync from the last synced
snapshot to the next mirror snapshot. When the limit is at 3, this
currently can result in a situation where an in-use sync snapshot is
deleted. Instead of unlinking the second oldest snapshot, always
unlink the third oldest.

Fixes: https://tracker.ceph.com/issues/48553
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 10:41:34 -05:00
Jason Dillaman
529d3c9a07 librbd/mirror: ignore non-fatal errors when unlinking the snapshot
Notifications can fail if a client crashes or if we race with the
removal of the image. Either case should be ignored.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 10:41:34 -05:00
Jason Dillaman
11165b1de3 librbd/mirror: increase debug logging of snapshot state machines
Try to keep debug level 20 for IO state machines so that setting the
debug level to something lower should show the manipulation of
the mirror snapshots.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 10:41:34 -05:00
Mykola Golub
cbbfd1c426
Merge pull request #38494 from dillaman/wip-45694
librbd: fix sporadic failures in TestMigration.StressLive

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-11 17:40:12 +02:00
Nizamudeen A
aaedab9135 mgr/dashboard: Making the edges of not rounded button rounded
Fixes: https://tracker.ceph.com/issues/48563
Signed-off-by: Nizamudeen A <nia@redhat.com>
2020-12-11 20:27:12 +05:30
Kefu Chai
286c6b437f
Merge pull request #38515 from tchaikov/wip-script-run-cbt
script/run-cbt.sh: drop bashism

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-11 22:34:53 +08:00
Kefu Chai
34f74e8a37 admin/build-doc: add livehtml target
it is time-consuming to rebuild the python bindings every time we
rebuild the document, it'd be ideal if we could just build document.

in this change, in addition to "html" and "doc", "livehtml" argument is
now supported by build-doc script, so one can just use

./build-doc livehtml

to build and start a web server. whenever a change in doc/ is detected,
the document is rebuilt. for more details, see
https://pypi.org/project/sphinx-autobuild/

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-11 22:30:56 +08:00
Aashish Sharma
13900cf6ae mgr/dashboard: new generic HTTP error page component
Added a generic Error component for HTTP Errors such as 404,403,501

Fixes:https://tracker.ceph.com/issues/39128
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2020-12-11 19:19:38 +05:30
Jason Dillaman
1baba64e21 librbd/deep_copy: added new migrating flag to object copy
The migration operation and the copyup state machine will set
this flag when attempting to perform a deep-copy due to a
live-migration.

This flag will prevent a possible race condition between the
start of the object deep-copy when migration was enabled and
the writing portion of the deep-copy when migration might
have completed via external means.

Fixes: https://tracker.ceph.com/issues/45694
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 08:03:07 -05:00
Jason Dillaman
e79f6b1c15 librbd/deep_copy: added bitwise flag parameter to object copy
This initial version subsumes the original "flatten" boolean flag.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 08:02:39 -05:00
Varsha Rao
c139d0da44 script/kubejacker: Add podman push example for plain HTTP registry
If the image is pushed to a plain HTTP registry then tls-verify needs to be set
to false. This patch adds an example for it.

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-11 18:32:34 +05:30
Kefu Chai
864d7ffc2a
Merge pull request #38486 from Rjerk/fix-mds-conf-typo
doc: fix a couple of typos

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-11 20:46:24 +08:00
Kefu Chai
df77e51a6f
Merge pull request #38542 from SMIL-Infra/wip-doc-conf-typo
doc: Fixes a typo in mon_dns_srv_name.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 20:41:54 +08:00
Mykola Golub
6283c7739b
Merge pull request #38517 from dillaman/wip-48525
rbd-mirror: bad state and crashes in snapshot-based mirroring

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-11 12:13:41 +02:00
Mykola Golub
d518bb2588
Merge pull request #38492 from dillaman/wip-librbd-io-tweaks
librbd: minor fix to IO shut-down and increased IO logging

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-11 12:12:04 +02:00
Deepika Upadhyay
85ca7b36a0 jaeger: make tracing default turned off, until teuthology integration
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 10:08:09 +00:00
Deepika Upadhyay
1e6e1f907e debian/control: use yaml-dev >= 0.6
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 10:08:09 +00:00
Deepika Upadhyay
4b8c92a920 osd: refactor missing spaces
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 10:08:09 +00:00
Deepika Upadhyay
01997e76fe core: tracing basic i/o path for OSD
* add tracing header files { common/tracer.{h/cc} }

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 10:07:58 +00:00
胡玮文
4dd26d651f doc: Fixes a typo in mon_dns_srv_name.
Signed-off-by: 胡玮文 <huww98@outlook.com>
2020-12-11 17:16:21 +08:00
Deepika Upadhyay
3c5abab7ea ceph.spec.in: refactor s/Cephs/Ceph
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 08:35:22 +00:00
Kefu Chai
4d6d1465ea
Merge pull request #38480 from yician1000/fix_48488
mgr/restful: fix TypeError occurring in _gather_osds()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 16:08:31 +08:00
Kefu Chai
6e28e6f41b
Merge pull request #38384 from bk201/wip-48406
mgr/dashboard: fix test_dashboard_e2e.sh errors

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-12-11 16:07:03 +08:00
Kefu Chai
8453857907
Merge pull request #37785 from lxbsz/conf1
common/config: do not expand the pid for socket admin

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 16:04:51 +08:00
Kefu Chai
53a54dcd24
Merge pull request #38417 from changchengx/osdmap
osd/OSDMonitor: correct duplicated output info

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-11 16:04:00 +08:00
Kefu Chai
208247268f
Merge pull request #38453 from b-ranto/wip-crash-serial
mgr/crash: Serialize command handling

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-12-11 16:00:35 +08:00
Deepika Upadhyay
4b69d3a184 jaeger, build/op: add jaeger and it's dependencies as submodules
* This commit introduces Jaegertracing library as package libjaeger,
  pickwhich would be consumed by other ceph pacakges such as ceph-common0

* adds the following dependencies, which would be build from source
  using ExternalProjectHelper.cmake +IncludeJaeger.cmake +
  Build<package>.cmake scripts:

  jaegertracing: v0.6.0 [added as a submodule]
  opentracing: v1.6.0 [added as a submodule]
  thrift: 0.13.0 [added as a submodule]
  yaml-cpp: 0.6.0
  json(optional)

* updates Boost to be installed instead of being build only, because
  jaegertracing them during their build process.

* ceph.spec.in: introduces a default enabled jaeger packaging option,
  which could be disabled using --without-jaeger flag during rpmbuild

* note: libjaeger package if enabled will be a dependency on ceph-common, ceph-mon, rgw_common and transitively will be a dependency for modules that have them as  a dependency.

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 07:55:46 +00:00
Kefu Chai
3f1aa66ee2
Merge pull request #38501 from tchaikov/wip-cmake-crimson-test
test/crimson: do not link against crimson-{os,common}

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-11 15:52:22 +08:00
Kefu Chai
7a5100fd17
Merge pull request #38516 from tchaikov/wip-cmake-rocksdb
cmake: stop rebuilding rocksdb everytime

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-12-11 12:47:51 +08:00
Paul Cuzner
a8690f1b50 orchestrator: drop redundant try/except
YAML is validated up front, so the additional try/except
clause is not needed.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2020-12-11 17:25:08 +13:00
Kotresh HR
aa4beb3d99
tasks/cephfs/test_volume_client: Add tests for authorize/deauthorize
1. Add testcase for authorizing auth_id which is not added by
   ceph_volume_client
2. Add testcase to test 'allow_existing_id' option
3. Add testcase for deauthorizing auth_id which has got it's caps
   updated out of band

Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-12-10 19:51:58 -08:00
Kotresh HR
77b42496e2
pybind/ceph_volume_client: Optionally authorize existing auth-ids
Optionally allow authorizing auth-ids not created by ceph_volume_client
via the option 'allow_existing_id'. This can help existing deployers
of manila to disallow/allow authorization of pre-created auth IDs
via a manila driver config that sets 'allow_existing_id' to False/True.

Fixes: https://tracker.ceph.com/issues/48555
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-12-10 19:51:55 -08:00
Kotresh HR
47100e528e
pybind/ceph_volume_client: Preserve existing caps while authorize/deauthorize auth-id
Authorize/Deauthorize used to overwrite the caps of auth-id which would
end up deleting existing caps. This patch fixes the same by retaining
the existing caps by appending or deleting the new caps as needed.

Fixes: https://tracker.ceph.com/issues/48555
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-12-10 19:51:52 -08:00
Ramana Raja
3a85d2d040
pybind/ceph_volume_client: Disallow authorize auth_id
This patch disallow the ceph_volume_client to authorize the auth_id
which is not created by ceph_volume_client. Those auth_ids could be
created by other means for other use cases which should not be modified
by ceph_volume_client.

Fixes: https://tracker.ceph.com/issues/48555
Signed-off-by: Ramana Raja <rraja@redhat.com>
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-12-10 19:51:50 -08:00
Josh Durgin
7f1f5673c7
Merge pull request #35314 from zdover23/wip-doc-elasticsearch-7-warning
doc/radosgw: Note that ElasticSearch 7 doesn't work. Just 6 and lower.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-12-10 18:54:51 -08:00
Kefu Chai
79177997a5
Merge pull request #38523 from tchaikov/wip-gcc-toolset-9
install-deps.sh: do not use gcc-toolset-9 from copr

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-12-11 10:41:53 +08:00
Kefu Chai
39605e6bdc
Merge pull request #38157 from sebastian-philipp/labeler-orchestrator
github/labeler: Add some more to cephadm, add orchestrator

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 08:59:09 +08:00