Commit Graph

115043 Commits

Author SHA1 Message Date
Mykola Golub
dc9ee9ba0b rbd-nbd: return quiesce hook exit code
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-09-11 14:51:51 +01:00
Mykola Golub
41727ab01c rbd-nbd: fix potential race when waiting unqiesce
There was a window between issuing quiesce_complete and checking
the quiesce variable unset by the unqiesce callback, when the lock
was not holding. If during that window the unquiesce following the
next quiesce callbacks were called we would miss unquiesce event.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-09-11 14:51:51 +01:00
Jason Dillaman
251ccb8d95
Merge pull request #36825 from trociny/wip-47068
librbd: task finisher should distinguish quiesce tasks with different ID

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-09-11 09:25:57 -04:00
Sebastian Wagner
f972becdf8
Merge pull request #37094 from adk3798/iscsi-m
cephadm: remove z option from iSCSI dev and configfs mount

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-09-11 14:09:52 +02:00
Kefu Chai
bcd01b9195
Merge pull request #37084 from tchaikov/wip-crimson-fmt
crimson/osd: fix fmt::format() errors and cleanups

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-09-11 19:37:12 +08:00
Kefu Chai
5172e0f6a3
Merge pull request #37099 from tchaikov/wip-crimson-cause-sv
crimson/osd: pass the the cause by string_view

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-09-11 18:55:04 +08:00
Sridhar Seshasayee
af1ab10251
Merge pull request #37031 from sseshasa/wip-pgpush-recovery-class
osd: Introduce new PGOpQueueable class for recovery push/reply messages.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2020-09-11 15:06:04 +05:30
Kefu Chai
2910f973a7
Merge pull request #36745 from ifed01/wip-ifed-bluefs-remove-obsolete
os/bluestore: get rid of obsolete stuff in bluefs.

Reviewed-by: Adam Kupczyk <akucpzyk@redhat.com>
2020-09-11 17:13:25 +08:00
Sebastian Wagner
49d36740a0
Merge pull request #36822 from sebastian-philipp/cephadm-container-init
cephadm: Add --container-init
2020-09-11 11:12:21 +02:00
Kefu Chai
75bbdeb0c3
Merge pull request #36211 from kshtsk/wip-remote-write-file
qa/tasks: use remote write file

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-09-11 17:11:10 +08:00
Kefu Chai
7b5fce3521
Merge pull request #37029 from tchaikov/wip-pybind-finer-grainer-test
test/pybind: split aio_test into smaller pieces

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-09-11 17:10:43 +08:00
Kefu Chai
71f9a8de14
Merge pull request #32169 from zjcmszh/cmpext_op
pybind: add aio_cmpext()

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-09-11 17:09:47 +08:00
Kefu Chai
3fb7f3118e
Merge pull request #37036 from changchengx/unused_var
common: remove data_dir_option in func global_init

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-09-11 17:06:44 +08:00
Kefu Chai
23e963bb1a crimson/osd: pass the the cause by string_view
in future, string_view can be used almost every where string can be
used. in this change, `const char*` is instead passed to the constructor
of system_error, as we can ensure that the string_view instances are
always constructed from a `const char*` ended with `\0`.

we need this change for two reasons:

* better performance
* prefer for the world where string_view rules.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-11 16:59:55 +08:00
Adam King
351b92acda cephadm: remove z option from iSCSI dev and configfs mount
selinux complains if you try to deploy iSCSI with the z option
on the /dev and /sys/kernel/config mounts

Signed-off-by: Adam King <adking@redhat.com>
2020-09-10 20:45:28 -04:00
Sebastian Wagner
3713645324
Merge pull request #36935 from mgfritch/cephadm-ceph-service
mgr/cephadm: introduce `CephService` class

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-09-11 00:13:10 +02:00
zdover23
b22cf6da57
Merge pull request #37070 from zdover23/wip-doc-3-hacking-into-docs
doc/dev: add HACKING.rst to Dev Guide

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-09-11 08:04:24 +10:00
Casey Bodley
4ac040bfe9
Merge pull request #37089 from cbodley/wip-cmake-osd-fifo
cmake: add cls_fifo as a dependency of osd

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Soumya Koduri <skoduri@redhat.com>
Reviewed-by: Ali Maredia <amaredia@redhat.com>
2020-09-10 14:52:27 -04:00
Sebastian Wagner
8c47db39b8
Merge pull request #36980 from adk3798/fix-iscsi
cephadm: fix iSCSI unit.run file

Reviewed-by: Matthew Oliver <moliver@suse.com>
Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-09-10 20:02:03 +02:00
Neha Ojha
9e81f39733
Merge pull request #36747 from varshar16/wip-doc-update-about-priority-check
doc/developer_guide: Update about '--force-priority' flag

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Kyr Shatskyy <kyrylo.shatskyy@suse.de>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-09-10 10:29:29 -07:00
Casey Bodley
12c145f22b
Merge pull request #36313 from changchengx/fix_warning
rgw: fix vector index warning

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-09-10 12:59:05 -04:00
Casey Bodley
9fbb31d6be cmake: add cls_fifo as a dependency of osd
otherwise cls_fifo is not built by 'make vstart'

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-09-10 12:45:54 -04:00
Kefu Chai
4ae71a068f
Merge pull request #37075 from tchaikov/wip-doc-dev
doc/dev: fix broken link and fix the codeblocks' formatting

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-09-10 23:29:30 +08:00
Zac Dover
5760cff6e3 doc/dev: add HACKING.rst to Dev Guide
This commit exposes HACKING.rst through the
docs website. Formerly, HACKING.rst was just
a file that existed at /src/pybind/mgr/dashboard/
HACKING.rst. This commit also updates README.rst
to point to the new location of HACKING.rst.

Fixes: https://tracker.ceph.com/issues/47230
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2020-09-11 01:00:48 +10:00
Sebastian Wagner
57ba572964
Merge pull request #37071 from votdev/cleanup_servicespec_code
cephadm: Remove assignment to member variable in ServiceSpecs

Reviewed-by: Joshua Schmid <jschmid@suse.de>
2020-09-10 16:08:08 +02:00
Sebastian Wagner
e79a7c8c74 Merge PR #37046 into master
* refs/pull/37046/head:
	cephadm: unit.run: create /var/run/ceph/$FSID before doing anything else

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-09-10 16:03:48 +02:00
Sebastian Wagner
0fd4c1e068
Merge pull request #36766 from jmolmo/cephadm_log
cephadm: log to file
2020-09-10 15:44:17 +02:00
Kefu Chai
d008326706 common/dout: escape formatting string for crimson
crimson uses seastar logging facility for logging. and the latter uses
fmt::format(). currently, we collect the log message into a string and
pass it to log(fmt,...) as "fmt", but seastar/core/sstring.hh defines
the operator<<(ostream&, const vector<T>&) which is a better match than
our the operator<<(ostream&, const vector<T, Allocator>&). and seastar's
operator<<(ostream&, const vector<T>&) uses "{" and "}" to mark the
begin and end of a vector when printing it. and "{}" is also used by
libfmt to enclose its replacement fields. see
https://fmt.dev/latest/syntax.html. so when a vector is printed using
logging facility in crimson, libfmt chokes when trying to parse it as a
format string. so we have some options, like:

- disable seastar's operator<< implementation
- escape the "{}" when writing the vector to the output stream
- print the message as the args, and use "{}" as the fmt.

the 3rd one is the most straightforward, and probably more performant.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 21:21:39 +08:00
Kefu Chai
69260a60b7 crimson/osd: use structured binding in loop
use alias for accessing the elements for better readability

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 21:21:39 +08:00
Kefu Chai
be840c59da crimson/osd: fix fmt::format() error
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 21:21:39 +08:00
Kefu Chai
e7ed50a718 crimson/osd: optimize the fast path of get_recovery_read()
no need to enqueue if the lock can be acquired without waiting for it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 21:21:39 +08:00
Kefu Chai
a838ccca8f common/config_proxy: add missing space
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 21:21:39 +08:00
Daniel Gryniewicz
0c37322ddb
Merge pull request #36798 from dang/wip-dang-zipper-8
Wip dang zipper 8

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-09-10 08:29:00 -04:00
Jan Fajerski
4ade3e84ad
Merge pull request #37039 from jan--f/c-v-no-fstrings
ceph-volume: avoid format strings for now
2020-09-10 13:34:44 +02:00
Kefu Chai
576528d08a
Merge pull request #36855 from yaarith/fix-devid-split
mgr/telemetry: fix device id splitting when anonymizing serial

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-09-10 15:51:20 +08:00
Jan Fajerski
5baeff5ca5 ceph-volume: avoid format strings for now
Fixes: https://tracker.ceph.com/issues/47354

Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2020-09-10 09:50:55 +02:00
Kefu Chai
d2ba22a2d1
Merge pull request #37005 from tchaikov/wip-buffer-hyprcombine
common/buffer: check for null before deref

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-09-10 15:49:55 +08:00
Kefu Chai
c80d5d47b3 doc/dev: reformat the sample for tree structure of a test suite
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 15:13:02 +08:00
Kefu Chai
3569244a50 doc/dev: use appropriate directive for code blocks
* use "code-block:: yaml" for qa suite samples
* use "prompt:: bash $" for shell commands using a non-root user

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 15:13:02 +08:00
Kefu Chai
c77382ac0e doc/dev: update supported distros of ceph
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 15:13:02 +08:00
Kefu Chai
549952edef doc/dev: drop unused label
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 15:13:02 +08:00
Kefu Chai
b17dcc1fc7 doc/dev: fix broken link
otherwise "make check" would be a link pointing to
https://wiki.sepia.ceph.com/doku.php

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 15:13:02 +08:00
Ilya Dryomov
a1f8589679
Merge pull request #37050 from idryomov/wip-krbd-namespace-symlinks
rbd: include RADOS namespace in krbd symlinks

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-09-10 08:04:10 +02:00
Kefu Chai
0f2e67a616
Merge pull request #37073 from tchaikov/wip-crimson-test-config
test/crimson: fix racing in testing

Reviewed-by: Samuel Just <sjust@redhat.com>
2020-09-10 13:43:13 +08:00
Josh Durgin
ce33c21054
Merge pull request #36961 from jdurgin/wip-auth-perf
mon/AuthMonitor: speed up caps updates

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-09-09 22:12:52 -07:00
Kefu Chai
864364547f cmake: add unittest_seastar_config as a ceph test
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 11:53:43 +08:00
Kefu Chai
fe0f662a93 test/crimson: fix racing in testing
before this change, unittest_seastar_config set the specified option to
the shard id in parallel and expects that the values of the option are
consistent across all shards after setting the value on all shards. but
sharded::invoke_on_all() is executed in parallel, and so does
ConfigProxy::do_change(), so there are actually "n x n" continuations
racing each other. the order of the continuations storing the setting
cannot be determined. so we cannot expected that the last batch of
continuations hitting shareds store the same value.

in this change, only a single `conf.set_val()` call is performed with
a known value. and this value is checked with the values stored on all
shards.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 11:53:43 +08:00
Kefu Chai
457fe7202f test/crimson: use seastar::make_ready_future()
instead of seastar::now(). as seastar::now() was moved into
seastar/util/laster.hh.

this change is a leftover of aa28b51f3c

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-10 11:53:43 +08:00
Kefu Chai
e5b9b08cc4
Merge pull request #36962 from tchaikov/wip-qa-py3-cleanup
qa: py3 cleanups

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-09-10 09:39:20 +08:00
Casey Bodley
d03a1cec24
Merge pull request #37054 from cbodley/wip-47306
rgw: ObjectCache::put() clears stale objv

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Mark Kogan <mkogan@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-09-09 17:11:43 -04:00