RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-01-20 10:01:45 +00:00
Code Issues Packages Projects Releases Wiki Activity
126,362 Commits 216 Branches 394 Tags 1.8 GiB
dde92124b5
Commit Graph

126362 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kefu Chai
dde92124b5 admin/doc-requirements: use funcparserlib from github 
funcparserlib is pulled in as a dependency by blockdiag. the latest version of
funcparserlib available on pypi is v0.3.6 which is not compatible with
Python3.8.

in this change, funcparserlib is installed from github instead to
address the build failure like:

  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/41855/lib/python3.8/site-packages/sphinxcontrib/seqdiag.py", line 26, in <module>
    import seqdiag.utils.rst.nodes
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/41855/lib/python3.8/site-packages/seqdiag/utils/rst/nodes.py", line 16, in <module>
    from blockdiag.utils.rst import nodes
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/41855/lib/python3.8/site-packages/blockdiag/utils/rst/nodes.py", line 21, in <module>
    import blockdiag.builder
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/41855/lib/python3.8/site-packages/blockdiag/builder.py", line 16, in <module>
    from blockdiag import parser
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/41855/lib/python3.8/site-packages/blockdiag/parser.py", line 43, in <module>
    from funcparserlib.parser import (a, finished, forward_decl, many, maybe, skip,
  File "/home/docs/checkouts/readthedocs.org/user_builds/ceph/envs/41855/lib/python3.8/site-packages/funcparserlib/parser.py", line 123
    except NoParseError, e:
                       ^
SyntaxError: invalid syntax

once https://github.com/vlasovskikh/funcparserlib/issues/65 is
addressed, we should drop this change.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
 2021-09-06 22:30:03 +08:00
Kefu Chai
2d6e192d1d
Merge pull request #43034 from rubenk/fix-unmapped-bytes-help-text 
common/PriorityCache: fix help text for unmapped_bytes metric

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
 2021-09-06 22:10:20 +08:00
Ilya Dryomov
1daa5c2356
Merge pull request #43047 from idryomov/wip-rbd-mirror-peer-profile-doc 
doc: adjust client.rbd-mirror-peer mon cap and add details about site names

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
 2021-09-06 10:07:41 +02:00
Yuval Lifshitz
37fd5f486f
Merge pull request #42840 from TRYTOBE8TME/wip-rgw-kafka-timeout 
Wip rgw kafka timeout
 2021-09-05 10:58:10 +03:00
Yuval Lifshitz
c77bfac565
Merge pull request #42875 from pleiadesian/feature-lua 
examples: add elasticsearch and prometheus examples
 2021-09-05 10:57:15 +03:00
Kefu Chai
81d52a2d65
Merge pull request #42870 from ktdreyer/cmake-thread-libs-init 
cmake: link Threads::Threads instead of CMAKE_THREAD_LIBS_INIT

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
 2021-09-04 22:02:19 +08:00
Kefu Chai
91f3816999
Merge pull request #42960 from wjwithagen/wjw-fix-cephfs-lock 
tools/cephfs_mirror: fix lock declaratie/locking

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Kefu Chai <tchaikov@gmail.com>
 2021-09-04 10:47:50 +08:00
Kefu Chai
74ee3e63da
Merge pull request #42962 from tchaikov/wip-cmake-ppc 
arch,cmake: compile ppc.c on all powerpc machines

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
 2021-09-04 10:46:28 +08:00
Kefu Chai
8157266b01
Merge pull request #43043 from tchaikov/crimson/os/cleanup 
crimson/os: use structured binding in loop

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
 2021-09-04 06:57:33 +08:00
Ilya Dryomov
b367672082 doc: adjust client.rbd-mirror-peer mon cap 
On top of "profile rbd" permissions, "profile rbd-mirror-peer" also
allows getting rbd/mirror and setting rbd/mirror/peer/* config keys.
This is what "rbd mirror pool peer bootstrap create" does.

Fixes: https://tracker.ceph.com/issues/50970
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
 2021-09-03 18:17:47 +02:00
Ilya Dryomov
1fe44830b6 doc: add some details about rbd-mirror site names 
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
 2021-09-03 18:17:47 +02:00
Josh Durgin
5164919d14
Merge pull request #43035 from zdover23/wip-doc-2021-09-03-rados-bootstrap-options 
doc: rados/ceph-conf.rst bootstrap options

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
 2021-09-03 08:27:49 -07:00
Patrick Donnelly
f46276562c Merge PR #43012 into master 
* refs/pull/43012/head:
	script: ceph-debug-docker.sh deals with the centos-repos -> centos-linux-repos transition.

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
 2021-09-03 11:20:52 -04:00
Sebastian Wagner
b88bd99066
Merge pull request #43040 from sebastian-philipp/qa-deadsymlinks 
qa/tox.ini: check for dead symlinks

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@newdream.net>
 2021-09-03 17:17:03 +02:00
J. Eric Ivancich
5b324a1397
Merge pull request #42836 from ivancich/wip-fix-bi-test-error 
rgw: fix bucket index list test error

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2021-09-03 11:09:28 -04:00
Kefu Chai
39ad45ce63 crimson/os: use structured binding in loop 
also avoid using `map[key] = val` for setting an item in map, as, if
he key does not exist in map, `map[key]` would have to create a value
using its default ctor, and then call the `operator=(bufferlist&&)` to
set it.

Signed-off-by: Kefu Chai <tchaikov@gmail.com>
 2021-09-03 22:52:12 +08:00
Patrick Donnelly
8d1bd26d83 Merge PR #43032 into master 
* refs/pull/43032/head:
	backport-create-issue: set backport priority

Reviewed-by: Nathan Cutler <ncutler@suse.com>
 2021-09-03 10:27:31 -04:00
Sebastian Wagner
4e7c9c3a4c
Merge pull request #43039 from sebastian-philipp/rm-kubic 
qa/distros: Remove stale kubic distros

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
 2021-09-03 11:44:44 +02:00
Sebastian Wagner
5313da14b9
Merge pull request #43021 from sebastian-philipp/rhel_8.3_container_tools_rhel8.yaml 
qa/distros/podman: Add rhel_8.3_container_tools_rhel8.yaml

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2021-09-03 11:44:19 +02:00
Sebastian Wagner
c6779fdf13
qa/tox.ini: check for dead symlinks 
IMO the amount of symlinks we have to manually maintain
is tedious and error prone. Any ideas on improving thing?

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
 2021-09-03 11:38:04 +02:00
Sebastian Wagner
65e2cc0840
qa/distros: Remove stale kubic distros 
Cause they're broken

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
 2021-09-03 10:13:54 +02:00
Sebastian Wagner
0293580b50
qa/distros/podman: Add rhel_8.rhel_8.4_container_tools_3.0.yaml 
mainly for the cephfs suite

Signed-off-by: Sebastian Wagner <sewagner@redhat.com>
 2021-09-03 10:04:45 +02:00
Sebastian Wagner
bb9240ef7b
Merge pull request #43030 from dsavineau/cephadm_fix_prometheus_spelling 
cephadm: fix prometheus namespace spelling

Reviewed-by: Sage Weil <sage@newdream.net>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
 2021-09-03 09:37:04 +02:00
Sage Weil
9cb2f444fd Merge PR #42873 into master 
* refs/pull/42873/head:
	qa/tasks/rook: add OSD creation to Rook QA

Reviewed-by: Sage Weil <sage@redhat.com>
 2021-09-02 17:11:51 -04:00
Samuel Just
57b09dbaa7
Merge pull request #43018 from cyx1231st/wip-seastore-onode-tree-alloc-hint 
crimson/onode-staged-tree: improve laddr hints during allocation

Reviewed-by: Samuel Just <sjust@redhat.com>
 2021-09-02 12:34:08 -07:00
Zac Dover
d156638b5a doc: rados/ceph-conf.rst bootstrap options 
This is the editorial syntax and elegance PR for the "Bootstrap Options"
section in the "Configuring Ceph" chapter of the RADOS Guide.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
 2021-09-03 05:22:38 +10:00
Ruben Kerkhof
cb0d30af90 common/PriorityCache: fix help text for unmapped_bytes metric 
Signed-off-by: Ruben Kerkhof <ruben@42on.com>
 2021-09-02 21:01:14 +02:00
Samuel Just
7cadc9e538
Merge pull request #43031 from rzarzynski/wip-crimson-watch-reconnect 
crimson/osd: fix Watch::connect() behaviour on reconnect.

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
 2021-09-02 11:34:07 -07:00
Samuel Just
e8c78046c5
Merge pull request #43033 from markhpc/wip-cyanstore-moreops 
src/crimson: Add various missing ops to cyanstore

Reviewed-by: Samuel Just <sjust@redhat.com>
 2021-09-02 11:30:40 -07:00
Cory Snyder
0afbf207c3 backport-create-issue: set backport priority 
Set backport issue priority based upon the priority of the original issue.

Fixes: https://tracker.ceph.com/issues/52387
Signed-off-by: Cory Snyder <csnyder@iland.com>
 2021-09-02 11:23:31 -04:00
Radoslaw Zarzynski
97ff102cc6 crimson/osd: fix Watch::connect() behaviour on reconnect. 
It's perfectly legal for a client to reconnect to particular `Watch`
using different socket / `Connection` than original one. This shall
include proper handling of the watch timer which is currently broken
as, when reconnecting, we don't cancel the timer. This leaded to the
following crash at Sepia:

```
rzarzynski@teuthology:/home/teuthworker/archive/rzarzynski-2021-09-02_07:44:51-rados-master-distro-basic-smithi/6372357$ less ./remote/smithi183/log/ceph-osd.4.log.gz
...
DEBUG 2021-09-02 08:10:45,462 [shard 0] osd - client_request(id=12, detail=m=[osd_op(client.5087.0:93 7.1e 7:7c7084bd:::repobj:head {watch reconnect cookie 94478891024832 gen 1} snapc 0={} ondisk+write+know
n_if_redirected e40) v8]): got obc lock
...
DEBUG 2021-09-02 08:10:45,462 [shard 0] osd - do_op_watch
INFO  2021-09-02 08:10:45,462 [shard 0] osd - found existing watch by client.5087
DEBUG 2021-09-02 08:10:45,462 [shard 0] osd - do_op_watch_subop_watch
INFO  2021-09-02 08:10:45,462 [shard 0] osd - found existing watch watch(cookie 94478891024832 30s 172.21.15.150:0/3544196211) by client.5087
...
INFO  2021-09-02 08:10:45,462 [shard 0] osd - op_effect: found existing watcher: 94478891024832,client.5087
ceph-osd: /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-7406-g9d30203c/rpm/el8/BUILD/ceph-
17.0.0-7406-g9d30203c/src/seastar/include/seastar/core/timer.hh:95: void seastar::timer<Clock>::arm_state(seastar::timer<Clock>::time_point, std::optional<typename Clock::duration>) [with Clock = seastar::l
owres_clock; seastar::timer<Clock>::time_point = std::chrono::time_point<seastar::lowres_clock, std::chrono::duration<long int, std::ratio<1, 1000> > >; typename Clock::duration = std::chrono::duration<long
 int, std::ratio<1, 1000> >]: Assertion `!_armed' failed.
Aborting on shard 0.
Backtrace:
 0# 0x000055CC052CF0B6 in ceph-osd
 1# FatalSignal::signaled(int, siginfo_t const&) in ceph-osd
 2# FatalSignal::install_oneshot_signal_handler<6>()::{lambda(int, siginfo_t*, void*)#1}::_FUN(int, siginfo_t*, void*) in ceph-osd
 3# 0x00007FA58349FB20 in /lib64/libpthread.so.0
 4# gsignal in /lib64/libc.so.6
 5# abort in /lib64/libc.so.6
 6# 0x00007FA581A98C89 in /lib64/libc.so.6
 7# 0x00007FA581AA6A76 in /lib64/libc.so.6
 8# 0x000055CC0BEEE9DD in ceph-osd
 9# crimson::osd::Watch::connect(seastar::shared_ptr<crimson::net::Connection>, bool) in ceph-osd
10# 0x000055CC00B1D246 in ceph-osd
11# 0x000055CBFFEF01AE in ceph-osd
...
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
 2021-09-02 15:20:37 +00:00
Mark Nelson
b214f42d1f src/crimson: Add various missing ops to cyanstore 
Signed-off-by: Mark Nelson <mnelson@redhat.com>
 2021-09-02 14:47:00 +00:00
Deepika Upadhyay
27faeaf129
Merge pull request #43015 from ktdreyer/build-doc-venv 
admin/build-doc: use venv module again

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2021-09-02 20:11:01 +05:30
Dimitri Savineau
25e9673957 cephadm: fix prometheus namespace spelling 
Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>
 2021-09-02 10:28:35 -04:00
Kefu Chai
370c1e6087
Merge pull request #42994 from ceph/wip-crimson-monmap-more-srcs 
monmap, crimson: add support for mon_host_override

Reviewed-by: Kefu Chai <tchaikov@gmail.com>
 2021-09-02 21:51:06 +08:00
Matt Benjamin
e1cbd1bf61
Merge pull request #39849 from pritha-srivastava/wip-rgw-sts-principal-tags 
rgw/sts: adding code for aws:RequestTags as part
 2021-09-02 07:39:49 -04:00
Sebastian Wagner
b4cb9b6d6c
Merge pull request #42982 from adk3798/async-mock-py3-8 
mgr/cephadm: don't fail unit tests if can't import AsyncMock

Reviewed-by: Michael Fritch <mfritch@suse.com>
Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
 2021-09-02 12:04:01 +02:00
Igor Fedotov
88ecaf6e4c
Merge pull request #42830 from ifed01/wip-ifed-fix-bluefs-replay-crc 
os/bluestore: accept undecodable multi-block bluefs transactions on log

Reviewed-by: Sage Weil <sweil@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
 2021-09-02 12:40:27 +03:00
Yingxin Cheng
372bc45810 crimson/onode-staged-tree: add logs for hint 
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
 2021-09-02 12:42:27 +08:00
Yingxin Cheng
bcd9773430 crimson/onode-staged-tree: implement hint based on the splitting node 
Instead of the hint from the inserting key.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
 2021-09-02 12:39:27 +08:00
Yingxin Cheng
2c48d25d19 crimson/onode-staged-tree: implement hint in NodeImpl::rebuild_extent() 
Get the hint from its first key when rebuilding a node extent.

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
 2021-09-02 11:05:18 +08:00
Yingxin
c49a6362e2
Merge pull request #43016 from athanatos/sjust/wip-fix-build 
crimson/os/seastore/lba_manager/btree/lba_btree: fix FTBFS on gcc 9

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
 2021-09-02 09:19:29 +08:00
Samuel Just
d8ce06fc04 crimson/os/seastore/lba_manager/btree/lba_btree: fix FTBFS on gcc 9 
gcc-9 doesn't seem to consider interator nothrow move constructible with
the default move constructor implementation yielding the following build
failure:

m/el8/BUILD/ceph-17.0.0-7373-gfc349212/src/seastar/include/seastar/core/future.hh:584:58: error: static assertion failed: Types must be no-throw move constructible
  584 |     static_assert(std::is_nothrow_move_constructible<T>::value,

Signed-off-by: Samuel Just <sjust@redhat.com>
 2021-09-01 14:44:14 -07:00
Ken Dreyer
9b539494e6 admin/build-doc: use venv module again 
Commit 690ca1c562 accidentally
re-introduced virtualenv. Switch back to the venv module in stdlib.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
 2021-09-01 17:40:35 -04:00
zdover23
f51c0c737e
Merge pull request #42942 from zdover23/wip-doc-mgr-progress 
doc/mgr: add progress module documentation

Reviewed-by: Neha Ojha <nojha@redhat.com>
 2021-09-02 02:17:22 +10:00
Joseph Sawaya
4b6de11169 qa/tasks/rook: add OSD creation to Rook QA 
This commit adds OSD creation to the Rook QA tasks. The Rook task will
explicitly wait for the mgr to start and the CLI to work (instead of
implicitly doing so while waiting for 'ceph osd dump' to work).
Then it will do `ceph orch apply osd --all-available-devices` to create
OSDs on the rest of the PVs.

Signed-off-by: Joseph Sawaya <jsawaya@redhat.com>
 2021-09-01 11:27:40 -04:00
Radoslaw Zarzynski
c19648bba2 script: ceph-debug-docker.sh deals with the centos-repos -> centos-linux-repos transition. 
See: https://gist.github.com/rzarzynski/19f11e2180faeb82c42d1787b7e0e8dd.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
 2021-09-01 16:39:45 +02:00
Daniel Gryniewicz
9c213a0d08
Merge pull request #42948 from llamerada-jp/fix-radosgw-admin-document 
rgw: fix document

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
 2021-09-01 08:40:04 -04:00
Michael Fritch
20d305bc75 mgr/cephadm: run coroutines in a new event loop 
`asyncio.run` does not exist until python37 or later

Signed-off-by: Michael Fritch <mfritch@suse.com>
 2021-09-01 08:17:08 -04:00
Kalpesh Pandya
9c1e5d5c52 qa/tasks: Addition of new code for session tags in STS 
Signed-off-by: Kalpesh Pandya <kapandya@redhat.com>
 2021-09-01 17:09:54 +05:30