Commit Graph

117996 Commits

Author SHA1 Message Date
Mykola Golub
cbbfd1c426
Merge pull request #38494 from dillaman/wip-45694
librbd: fix sporadic failures in TestMigration.StressLive

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-11 17:40:12 +02:00
Nizamudeen A
aaedab9135 mgr/dashboard: Making the edges of not rounded button rounded
Fixes: https://tracker.ceph.com/issues/48563
Signed-off-by: Nizamudeen A <nia@redhat.com>
2020-12-11 20:27:12 +05:30
Kefu Chai
286c6b437f
Merge pull request #38515 from tchaikov/wip-script-run-cbt
script/run-cbt.sh: drop bashism

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-11 22:34:53 +08:00
Kefu Chai
34f74e8a37 admin/build-doc: add livehtml target
it is time-consuming to rebuild the python bindings every time we
rebuild the document, it'd be ideal if we could just build document.

in this change, in addition to "html" and "doc", "livehtml" argument is
now supported by build-doc script, so one can just use

./build-doc livehtml

to build and start a web server. whenever a change in doc/ is detected,
the document is rebuilt. for more details, see
https://pypi.org/project/sphinx-autobuild/

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-12-11 22:30:56 +08:00
Aashish Sharma
13900cf6ae mgr/dashboard: new generic HTTP error page component
Added a generic Error component for HTTP Errors such as 404,403,501

Fixes:https://tracker.ceph.com/issues/39128
Signed-off-by: Aashish Sharma <aasharma@redhat.com>
2020-12-11 19:19:38 +05:30
Jason Dillaman
1baba64e21 librbd/deep_copy: added new migrating flag to object copy
The migration operation and the copyup state machine will set
this flag when attempting to perform a deep-copy due to a
live-migration.

This flag will prevent a possible race condition between the
start of the object deep-copy when migration was enabled and
the writing portion of the deep-copy when migration might
have completed via external means.

Fixes: https://tracker.ceph.com/issues/45694
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 08:03:07 -05:00
Jason Dillaman
e79f6b1c15 librbd/deep_copy: added bitwise flag parameter to object copy
This initial version subsumes the original "flatten" boolean flag.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-11 08:02:39 -05:00
Varsha Rao
c139d0da44 script/kubejacker: Add podman push example for plain HTTP registry
If the image is pushed to a plain HTTP registry then tls-verify needs to be set
to false. This patch adds an example for it.

Signed-off-by: Varsha Rao <varao@redhat.com>
2020-12-11 18:32:34 +05:30
Kefu Chai
864d7ffc2a
Merge pull request #38486 from Rjerk/fix-mds-conf-typo
doc: fix a couple of typos

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-11 20:46:24 +08:00
Kefu Chai
df77e51a6f
Merge pull request #38542 from SMIL-Infra/wip-doc-conf-typo
doc: Fixes a typo in mon_dns_srv_name.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 20:41:54 +08:00
Mykola Golub
6283c7739b
Merge pull request #38517 from dillaman/wip-48525
rbd-mirror: bad state and crashes in snapshot-based mirroring

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-11 12:13:41 +02:00
Mykola Golub
d518bb2588
Merge pull request #38492 from dillaman/wip-librbd-io-tweaks
librbd: minor fix to IO shut-down and increased IO logging

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-12-11 12:12:04 +02:00
Deepika Upadhyay
85ca7b36a0 jaeger: make tracing default turned off, until teuthology integration
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 10:08:09 +00:00
Deepika Upadhyay
1e6e1f907e debian/control: use yaml-dev >= 0.6
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 10:08:09 +00:00
Deepika Upadhyay
4b8c92a920 osd: refactor missing spaces
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 10:08:09 +00:00
Deepika Upadhyay
01997e76fe core: tracing basic i/o path for OSD
* add tracing header files { common/tracer.{h/cc} }

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 10:07:58 +00:00
胡玮文
4dd26d651f doc: Fixes a typo in mon_dns_srv_name.
Signed-off-by: 胡玮文 <huww98@outlook.com>
2020-12-11 17:16:21 +08:00
Deepika Upadhyay
3c5abab7ea ceph.spec.in: refactor s/Cephs/Ceph
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 08:35:22 +00:00
Kefu Chai
4d6d1465ea
Merge pull request #38480 from yician1000/fix_48488
mgr/restful: fix TypeError occurring in _gather_osds()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 16:08:31 +08:00
Kefu Chai
6e28e6f41b
Merge pull request #38384 from bk201/wip-48406
mgr/dashboard: fix test_dashboard_e2e.sh errors

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-12-11 16:07:03 +08:00
Kefu Chai
8453857907
Merge pull request #37785 from lxbsz/conf1
common/config: do not expand the pid for socket admin

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 16:04:51 +08:00
Kefu Chai
53a54dcd24
Merge pull request #38417 from changchengx/osdmap
osd/OSDMonitor: correct duplicated output info

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-11 16:04:00 +08:00
Kefu Chai
208247268f
Merge pull request #38453 from b-ranto/wip-crash-serial
mgr/crash: Serialize command handling

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-12-11 16:00:35 +08:00
Deepika Upadhyay
4b69d3a184 jaeger, build/op: add jaeger and it's dependencies as submodules
* This commit introduces Jaegertracing library as package libjaeger,
  pickwhich would be consumed by other ceph pacakges such as ceph-common0

* adds the following dependencies, which would be build from source
  using ExternalProjectHelper.cmake +IncludeJaeger.cmake +
  Build<package>.cmake scripts:

  jaegertracing: v0.6.0 [added as a submodule]
  opentracing: v1.6.0 [added as a submodule]
  thrift: 0.13.0 [added as a submodule]
  yaml-cpp: 0.6.0
  json(optional)

* updates Boost to be installed instead of being build only, because
  jaegertracing them during their build process.

* ceph.spec.in: introduces a default enabled jaeger packaging option,
  which could be disabled using --without-jaeger flag during rpmbuild

* note: libjaeger package if enabled will be a dependency on ceph-common, ceph-mon, rgw_common and transitively will be a dependency for modules that have them as  a dependency.

Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-12-11 07:55:46 +00:00
Kefu Chai
3f1aa66ee2
Merge pull request #38501 from tchaikov/wip-cmake-crimson-test
test/crimson: do not link against crimson-{os,common}

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-11 15:52:22 +08:00
Kefu Chai
7a5100fd17
Merge pull request #38516 from tchaikov/wip-cmake-rocksdb
cmake: stop rebuilding rocksdb everytime

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-12-11 12:47:51 +08:00
Paul Cuzner
a8690f1b50 orchestrator: drop redundant try/except
YAML is validated up front, so the additional try/except
clause is not needed.

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2020-12-11 17:25:08 +13:00
Kotresh HR
aa4beb3d99
tasks/cephfs/test_volume_client: Add tests for authorize/deauthorize
1. Add testcase for authorizing auth_id which is not added by
   ceph_volume_client
2. Add testcase to test 'allow_existing_id' option
3. Add testcase for deauthorizing auth_id which has got it's caps
   updated out of band

Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-12-10 19:51:58 -08:00
Kotresh HR
77b42496e2
pybind/ceph_volume_client: Optionally authorize existing auth-ids
Optionally allow authorizing auth-ids not created by ceph_volume_client
via the option 'allow_existing_id'. This can help existing deployers
of manila to disallow/allow authorization of pre-created auth IDs
via a manila driver config that sets 'allow_existing_id' to False/True.

Fixes: https://tracker.ceph.com/issues/48555
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-12-10 19:51:55 -08:00
Kotresh HR
47100e528e
pybind/ceph_volume_client: Preserve existing caps while authorize/deauthorize auth-id
Authorize/Deauthorize used to overwrite the caps of auth-id which would
end up deleting existing caps. This patch fixes the same by retaining
the existing caps by appending or deleting the new caps as needed.

Fixes: https://tracker.ceph.com/issues/48555
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-12-10 19:51:52 -08:00
Ramana Raja
3a85d2d040
pybind/ceph_volume_client: Disallow authorize auth_id
This patch disallow the ceph_volume_client to authorize the auth_id
which is not created by ceph_volume_client. Those auth_ids could be
created by other means for other use cases which should not be modified
by ceph_volume_client.

Fixes: https://tracker.ceph.com/issues/48555
Signed-off-by: Ramana Raja <rraja@redhat.com>
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2020-12-10 19:51:50 -08:00
Josh Durgin
7f1f5673c7
Merge pull request #35314 from zdover23/wip-doc-elasticsearch-7-warning
doc/radosgw: Note that ElasticSearch 7 doesn't work. Just 6 and lower.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-12-10 18:54:51 -08:00
Kefu Chai
79177997a5
Merge pull request #38523 from tchaikov/wip-gcc-toolset-9
install-deps.sh: do not use gcc-toolset-9 from copr

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-12-11 10:41:53 +08:00
Kefu Chai
39605e6bdc
Merge pull request #38157 from sebastian-philipp/labeler-orchestrator
github/labeler: Add some more to cephadm, add orchestrator

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-11 08:59:09 +08:00
Jason Dillaman
c95cf1eb78
Merge pull request #38408 from trociny/wip-rbd-group-snap-create2
librbd: extend group snap create API to support flags

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-12-10 18:06:50 -05:00
Jason Dillaman
3a30490eab
Merge pull request #38518 from trociny/wip-rbd-test-memleak
test/librbd: fix memory leak in TestLibRBD.ConcurentOperations

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-12-10 18:06:24 -05:00
Sebastian Wagner
84a110744c
Merge pull request #38490 from sebastian-philipp/mypy-0.790
src,qa,dashboard: Upgrade to mypy 0.790

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2020-12-10 22:41:47 +01:00
Harish Munjulur
ddb5a03b47
Merge pull request #38075 from joke-lee/s3-auth-date-fix
rgw: fix RequestTimeTooSkewed when Date contain RFC-822/ISO 8601 standard timezone
2020-12-10 11:49:37 -08:00
Harish Munjulur
482599e24e
Merge pull request #37926 from BryceCao/wip-catch-non-int-exception
rgw : catch non int exception
2020-12-10 11:48:47 -08:00
Volker Theile
3cfe054d42 mgr/dashboard: The /rgw/status endpoint does not check for running service
Fixes: https://tracker.ceph.com/issues/48542

Signed-off-by: Volker Theile <vtheile@suse.com>
2020-12-10 17:09:46 +01:00
Kefu Chai
b32c6f1d1a
Merge pull request #37909 from alexandrsushko/prometheus-pg-laggy-46142
mgr: Fix for dashboard/prometheus failure due to laggy pg state

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
2020-12-10 23:53:48 +08:00
J. Eric Ivancich
30dc6f971b
Merge pull request #38131 from linuxbox2/wip-lc-ix
rgwlc: correctly dimension lc shard index vector

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-12-10 10:06:40 -05:00
Sebastian Wagner
a823ee6b1f mgr/cephadm: disallow_untyped_defs=True
simplifies mypy.ini

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-12-10 15:53:00 +01:00
Ronen Friedman
0ac87ebb97 osd: restoring a log message required by osd-scrub-test.sh
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2020-12-10 16:52:11 +02:00
Sebastian Wagner
0e0bd9b0d7 github/labeler: Add some more to cephadm, add orchestrator
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-12-10 15:41:34 +01:00
Kefu Chai
cbaa18e85a
Merge pull request #38524 from tchaikov/wip-crimson-qa-rbd
qa/suites: add crimson-rados/rbd test suites

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-12-10 22:18:39 +08:00
Sebastian Wagner
521b52c4d0
Merge pull request #38470 from sebastian-philipp/cephadm-command-unit-verbose
cephadm: command_unit: call systemctl with verbose=True

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-12-10 15:14:19 +01:00
Sebastian Wagner
56db4fbed8
Merge pull request #38009 from ideepika/wip-48058-cephadm
qa/tasks/cephadm: update_info_yam() only if ctx.archive is valid

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-12-10 15:13:42 +01:00
Jason Dillaman
6f4e3b0dd1
Merge pull request #36551 from CongMinYin/immutable_object_cache_throttle
tools: add throttle mechanism to immutable object cache

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-12-10 09:07:16 -05:00
Jason Dillaman
78f8abce2d rbd-mirror: do not attempt to unlink from more recent snapshots
The snapshot-based mirroring replayer should only attempt to unlink
from any snapshots that are older than the end remote snapshot id to
prevent the remote side from incorrectly deleted the snapshot.

Fixes: https://tracker.ceph.com/issues/48527
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-12-10 08:34:09 -05:00