Commit Graph

106051 Commits

Author SHA1 Message Date
Kefu Chai
d063674c80
Merge pull request #32494 from ronen-fr/clang_3
crimson: fix lambda captures of non-variables

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-07 20:45:40 +08:00
Kefu Chai
8988a07e2d
Merge pull request #32499 from sebastian-philipp/orchestrator-cli-mon-update-count-only
mgr/orchestrator_cli: _update_mons require host spec only

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-07 18:52:26 +08:00
Ronen Friedman
24694e2a06 crimson: fix lambda captures of non-variables
One cannot just capture a structured binding "non-variable".
(From the C++ standard, $8.4.5.2:
"If a lambda-expression [...] captures a structured binding (explicitly or implicitly),
the program is ill-formed.")

Co-authored-by: Kefu Chai <kchai@redhat.com>
Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2020-01-07 12:39:42 +02:00
Ilya Dryomov
39fdbe1b81
Merge pull request #32376 from idryomov/wip-krbd-fsx-object-map
qa/suites/krbd: fsx with object-map and fast-diff

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-01-07 11:32:26 +01:00
Kefu Chai
0150ac9daa
Merge pull request #32518 from tchaikov/wip-orchestrator-service-action-tests
qa/tasks/mgr/test_orchestrator_cli: fix service action tests

Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-07 17:44:10 +08:00
Sebastian Wagner
a41b68ee0b mgr/rook: Add some more type annotations
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-01-07 09:44:29 +01:00
Sebastian Wagner
ce2010c4e3 mgr/orchestrator_cli: _update_mons require host spec only
* `mgr/cephadm` requres a host spec right now
* `mgr/rook` only supports `spec.count` right now

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-01-07 09:44:29 +01:00
Kefu Chai
e78b992a04
Merge pull request #32496 from majianpeng/osd-remove-unused-func2
osd/OSD: remove unused func enqueue_peering_evt_front

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-07 16:40:16 +08:00
Kefu Chai
4788de2370
Merge pull request #32484 from bzed/bluefs-use-uint64_t-for-len
os/bluestore/Blue(FS|Store): uint64_t alloc_size

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-07 16:38:04 +08:00
Kefu Chai
e18dcbb232
Merge pull request #32473 from sseshasa/fix-mon-autotune-update
mon/OSDMonitor: Don't update mon cache settings if rocksdb is not used

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-07 16:32:41 +08:00
Kefu Chai
726b0de68f
Merge pull request #28921 from rzarzynski/wip-msgr-drop-0c
msg/async: drop zero_copy_read() & co from ConnectedSocket.

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-07 16:31:49 +08:00
Kefu Chai
f4f1bb44d5
Merge pull request #32112 from hjwsm1989/wip-42706
test/librados: don't release handler if set_pg_num failed

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-07 16:30:37 +08:00
Kefu Chai
ccfaf40491
Merge pull request #32428 from tchaikov/wip-qa-mgr-mon-update
qa/tasks/mgr/test_orchestrator_cli: fix "mon update" test

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2020-01-07 16:29:34 +08:00
Kefu Chai
b59cc672a0
Merge pull request #31929 from majianpeng/msg-async-bugfix
msg/async: update refcount and perf counter properly

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-07 16:28:30 +08:00
Kefu Chai
4c98b3224e qa/tasks/mgr/test_orchestrator_cli: fix service action tests
in b77f0c74a5, "reload"
service[-instance] action was dropped. so replace "reload" with
"restart" in the related tests.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-07 16:00:04 +08:00
Ilya Dryomov
53066d09ab
Merge pull request #32358 from idryomov/wip-krbd-py3-fixup
qa: krbd_exclusive_option.sh: fixup for json.tool ordering change

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-01-06 21:54:43 +01:00
Patrick Donnelly
47d8515975
Merge PR #32498 into master
* refs/pull/32498/head:
	doc: mounting CephFS subdirectory and Persistent Mounts cleanup

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-06 12:42:05 -08:00
Patrick Donnelly
e389d9016c
Merge PR #32480 into master
* refs/pull/32480/head:
	qa: use -D_GNU_SOURCE when compiling fsync-tester.c
	qa: add comment about fsync-tester distribution

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 12:34:37 -08:00
Patrick Donnelly
78bd2a83ed
Merge PR #29995 into master
* refs/pull/29995/head:
	mds: add config to require forward to auth MDS

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-06 12:31:57 -08:00
Patrick Donnelly
87755902ad
Merge PR #31494 into master
* refs/pull/31494/head:
	qa: force creation of fs with EC default data pool
	qa: add tests for adding EC data pools
	mon/MDSMonitor: warn when creating fs with default EC data pool

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-06 12:30:59 -08:00
Patrick Donnelly
7fde99ac06
Merge PR #32015 into master
* refs/pull/32015/head:
	doc/cephfs/standby: document mds_join_fs
	mgr/cephadm: map mds daemons to a particular fs
	mon/MDSMonitor: respect mfs fscid preference
	mon/MDSMonitor: assign standbys to their preferred fscid
	mds/FSMap: track preferred fscid for standby daemons
	mds: add mds_join_fs option; pass via MMDSBeacon

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-06 12:29:50 -08:00
Patrick Donnelly
a804561795
Merge PR #32268 into master
* refs/pull/32268/head:
	mds: only enable batch getattr/lookup for non-snap request.
	mds: pin dentry when attaching batch lookup to it

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-06 12:28:20 -08:00
Patrick Donnelly
a9a77bf1f9
Merge PR #32307 into master
* refs/pull/32307/head:
	mon: print FSMap if standbys exist

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-06 12:27:31 -08:00
Patrick Donnelly
f714c4bd3e
Merge PR #32308 into master
* refs/pull/32308/head:
	mon/MDSMonitor: cleanup check_subs

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 12:26:58 -08:00
Patrick Donnelly
c755740376
Merge PR #32467 into master
* refs/pull/32467/head:
	qa: fix various py3 cephfs qa bugs

Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 12:25:34 -08:00
Patrick Donnelly
0997d24ddd
Merge PR #32164 into master
* refs/pull/32164/head:
	mount.ceph: give a hint message when no mds is up or cluster is laggy

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2020-01-06 12:19:01 -08:00
Patrick Donnelly
02b3883dd0
Merge PR #32363 into master
* refs/pull/32363/head:
	qa: add .qa link

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-06 12:18:12 -08:00
Kefu Chai
13acfe0491
Merge pull request #32426 from tchaikov/wip-qa-test_envlibrados_for_rocksdb.sh
qa: enable CRB repo for RHEL8

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-07 01:46:14 +08:00
Kefu Chai
f05696ebeb qa: enable CRB repo for RHEL8
instead of enabling PowerTools repo, we need to enable CodeReady Builder
repo for RHEL8

also, since we are moving to RHEL8, there is no need to install cmake3
specifically for CentOS. CentOS 8 comes with cmake3.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-06 23:41:23 +08:00
Jan Fajerski
69df8573bf
Merge pull request #32242 from rishabh-d-dave/cv-methods-for-lvm-opt-S
ceph-volume: add methods to pass filters to pvs, vgs and lvs commands
2020-01-06 15:53:52 +01:00
Ilya Dryomov
b2b7610d1a qa: krbd_exclusive_option.sh: fixup for json.tool ordering change
In Python 3.5 json.tool was changed to produce unsorted output and
--sort-keys option was added to compensate.  This wasn't caught by
4fe245cc2f ("qa: update krbd tests for python3") because it raced
with 50933b863a ("qa: krbd_exclusive_option.sh: update for recent
kernel changes").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-01-06 15:12:25 +01:00
Rishabh Dave
a4f2fcefb8 ceph-volume: add methods to pass filters to pvs, vgs and lvs commands
Filters can be passed to these commands by using option '-S'.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-06 19:27:42 +05:30
Ilya Dryomov
cff2e49ff0 qa/suites/krbd: fsx with object-map and fast-diff
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-01-06 14:52:52 +01:00
Ilya Dryomov
848eb11468 test/librbd/fsx: don't disable features for krbd
rbd_default_features is set in krbd suite, no need to hard-code this in
fsx (especially now when object-map, fast-diff and deep-flatten are all
supported).

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-01-06 14:52:52 +01:00
Jos Collin
1033d5b373
doc: mounting CephFS subdirectory and Persistent Mounts cleanup
Fixes: https://tracker.ceph.com/issues/37746
Signed-off-by: Jos Collin <jcollin@redhat.com>
2020-01-06 18:33:26 +05:30
Jianpeng Ma
234beadff4 osd/OSD: remove unused func enqueue_peering_evt_front
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2020-01-06 16:42:19 +08:00
Kefu Chai
fd0cbcfee4
Merge pull request #32485 from tchaikov/wip-clang
common,crimson: fixes to compile with clang and libc++

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-01-06 14:43:13 +08:00
Kefu Chai
dba2b80897
Merge pull request #31728 from luis-henrix/copy-from-notrunc
osd: add a 'copy-from2' operation that includes truncate_{seq,size} parameters

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-01-06 10:07:45 +08:00
Kefu Chai
3535e24181
Merge pull request #32488 from ronen-fr/clang_3
crimson: CLANG-related fixes to errorator.h

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 10:00:14 +08:00
Kefu Chai
ccc59a64c2
Merge pull request #32490 from rzarzynski/wip-crimson-missing_err_include
crimson: add missing include in common/errorator.h

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 09:57:46 +08:00
Radoslaw Zarzynski
9c51035545 crimson: add missing include in common/errorator.h
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-01-05 22:17:10 +01:00
Ronen Friedman
f81054d5ce crimson: fix non-standard C++ constructs in errorator.h
Fixing use patterns accepted by gcc, but frowned upon by Clang:

Put noexcept specifier after attributes specifiers (as
per the C++ standard $11.3.5)

Limit the use of a not-completely-defined class names to
within function bodies, per the standard ("A class is considered
a completely-defined object type (or complete type) at the
closing } of the class-specifier.
Within the class member-specification, the class is regarded as
complete within function bodies, default arguments, noexcept-specifiers,
and default member initializers (including such things in nested classes).
Otherwise it is regarded as incomplete within its own class member-specification.")

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2020-01-05 19:50:52 +02:00
Radoslaw Zarzynski
12aafcd769 crimson: fix FTBFS on Clang induced by errorator.
Reported-by Ronen Friedman <rfriedma@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-01-05 18:00:37 +02:00
Kefu Chai
598c37296c common: add missing #include
clang++-9.0.1 and libc++ require them to build

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-05 22:53:48 +08:00
Kefu Chai
eb24936cfc crimson: do not use auto in param list of function prototype
src/crimson/net/Socket.cc:114:57: error: 'auto' not allowed in function
prototype
static inline seastar::future<> close_and_handle_errors(auto& out) {
                                                        ^~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-05 22:27:03 +08:00
Kefu Chai
ba0fc1fef3 crimson: do not capture unused variables
to silence warnings like

src/crimson/net/Socket.cc:93:41: warning: lambda capture 'this' is not
used [-Wunused-lambda-capture]
    return in.read_exactly(bytes).then([this](auto buf) {
                                        ^~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-05 22:27:03 +08:00
Bernd Zeimetz
e56f2967be os/bluestore/Blue(FS|Store): uint64_t alloc_size
Compiling on Debian's 32bit architectures failed with

<<PKGBUILDDIR>>/src/os/bluestore/BlueStore.cc:5539:37: error: no matching function for call to ‘p2align(size_t&, uint64_t&)’
 5539 |     total += p2align(len, alloc_size);
      |                                     ^
In file included from /<<PKGBUILDDIR>>/src/include/denc.h:42,
                 from /<<PKGBUILDDIR>>/src/include/encoding.h:40,
                 from /<<PKGBUILDDIR>>/src/include/compact_map.h:16,
                 from /<<PKGBUILDDIR>>/src/include/mempool.h:32,
                 from /<<PKGBUILDDIR>>/src/os/bluestore/BlueStore.h:36,
                 from /<<PKGBUILDDIR>>/src/os/bluestore/BlueStore.cc:25:
/<<PKGBUILDDIR>>/src/include/intarith.h:57:20: note: candidate: ‘template<class T> constexpr T p2align(T, T)’
   57 | constexpr inline T p2align(T x, T align) {
      |                    ^~~~~~~
/<<PKGBUILDDIR>>/src/include/intarith.h:57:20: note:   template argument deduction/substitution failed:
/<<PKGBUILDDIR>>/src/os/bluestore/BlueStore.cc:5539:37: note:   deduced conflicting types for parameter ‘T’ (‘unsigned int’ and ‘long long unsigned int’)
 5539 |     total += p2align(len, alloc_size);

As far as I understand it the available_freespace should at least be
able to return the same number as alloc_size, so we should use uint64_t
instead of size_t here, similar to
10a953afc8

Fixes: https://tracker.ceph.com/issues/43451
Signed-off-by: Bernd Zeimetz <bernd@bzed.de>
2020-01-05 14:40:15 +01:00
Kefu Chai
acd4de57c4
Merge pull request #32474 from kalebskeithley/fedora32
do_cmake.sh: fedora-32 (rawhide) build with python-3.8

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-04 23:17:56 +08:00
Kefu Chai
f8cab0eed2
Merge pull request #32481 from tchaikov/wip=admin-build-doc-python3
admin/build-doc: always install python3-* for build deps

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-01-04 22:16:16 +08:00
Kefu Chai
b87781c120 admin/build-doc: always install python3-* for build deps
since we've dropped the support of python36-*, i.e. python packages
provided by EPEL7 before RHEL7/CentOS7 included python3. as before the
inclusion of python3 as supported python3, python packages are named
python36-*. and they don't provide python3-*. so we had to install
python36-* explicitly. now that we are able to use the python3-*
packages, we can just install python3-*.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-04 17:05:06 +08:00