Commit Graph

106031 Commits

Author SHA1 Message Date
David Zafman
621acf8ce7 osdmaptool: Add --upmap-active to simulate active upmap balancing
Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-06 21:35:19 -08:00
David Zafman
184e9d1ae3 doc: Add upmap options to osdmaptool man page and give example
Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-06 21:35:19 -08:00
David Zafman
e42a6ccb18 tools: osdmaptool document non-upmap options that were missing
Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-06 21:35:19 -08:00
David Zafman
8e46bbbf36 test: Fix test case for pool based balancing instead of rule batched
Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-06 21:35:19 -08:00
David Zafman
a92f48773e Revert "tools: osdmaptool sync with balancer module behavior"
This was the rules batching version of osdmaptool

This reverts commit f165d4ca39.

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-06 21:35:19 -08:00
David Zafman
7a1d6872c7 Partially revert "mgr/balancer: balance pools with same crush_rule in batch"
This partially reverts commit 3a730d751d

Fixes: https://tracker.ceph.com/issues/43307

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-01-06 21:35:19 -08:00
Ilya Dryomov
53066d09ab
Merge pull request #32358 from idryomov/wip-krbd-py3-fixup
qa: krbd_exclusive_option.sh: fixup for json.tool ordering change

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-01-06 21:54:43 +01:00
Patrick Donnelly
47d8515975
Merge PR #32498 into master
* refs/pull/32498/head:
	doc: mounting CephFS subdirectory and Persistent Mounts cleanup

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-06 12:42:05 -08:00
Patrick Donnelly
e389d9016c
Merge PR #32480 into master
* refs/pull/32480/head:
	qa: use -D_GNU_SOURCE when compiling fsync-tester.c
	qa: add comment about fsync-tester distribution

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 12:34:37 -08:00
Patrick Donnelly
78bd2a83ed
Merge PR #29995 into master
* refs/pull/29995/head:
	mds: add config to require forward to auth MDS

Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-06 12:31:57 -08:00
Patrick Donnelly
87755902ad
Merge PR #31494 into master
* refs/pull/31494/head:
	qa: force creation of fs with EC default data pool
	qa: add tests for adding EC data pools
	mon/MDSMonitor: warn when creating fs with default EC data pool

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-06 12:30:59 -08:00
Patrick Donnelly
7fde99ac06
Merge PR #32015 into master
* refs/pull/32015/head:
	doc/cephfs/standby: document mds_join_fs
	mgr/cephadm: map mds daemons to a particular fs
	mon/MDSMonitor: respect mfs fscid preference
	mon/MDSMonitor: assign standbys to their preferred fscid
	mds/FSMap: track preferred fscid for standby daemons
	mds: add mds_join_fs option; pass via MMDSBeacon

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-06 12:29:50 -08:00
Patrick Donnelly
a804561795
Merge PR #32268 into master
* refs/pull/32268/head:
	mds: only enable batch getattr/lookup for non-snap request.
	mds: pin dentry when attaching batch lookup to it

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-06 12:28:20 -08:00
Patrick Donnelly
a9a77bf1f9
Merge PR #32307 into master
* refs/pull/32307/head:
	mon: print FSMap if standbys exist

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-06 12:27:31 -08:00
Patrick Donnelly
f714c4bd3e
Merge PR #32308 into master
* refs/pull/32308/head:
	mon/MDSMonitor: cleanup check_subs

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 12:26:58 -08:00
Patrick Donnelly
c755740376
Merge PR #32467 into master
* refs/pull/32467/head:
	qa: fix various py3 cephfs qa bugs

Reviewed-by: Thomas Bechtold <tbechtold@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 12:25:34 -08:00
Patrick Donnelly
0997d24ddd
Merge PR #32164 into master
* refs/pull/32164/head:
	mount.ceph: give a hint message when no mds is up or cluster is laggy

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2020-01-06 12:19:01 -08:00
Patrick Donnelly
02b3883dd0
Merge PR #32363 into master
* refs/pull/32363/head:
	qa: add .qa link

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-06 12:18:12 -08:00
Kefu Chai
13acfe0491
Merge pull request #32426 from tchaikov/wip-qa-test_envlibrados_for_rocksdb.sh
qa: enable CRB repo for RHEL8

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-07 01:46:14 +08:00
Kefu Chai
f05696ebeb qa: enable CRB repo for RHEL8
instead of enabling PowerTools repo, we need to enable CodeReady Builder
repo for RHEL8

also, since we are moving to RHEL8, there is no need to install cmake3
specifically for CentOS. CentOS 8 comes with cmake3.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-06 23:41:23 +08:00
Jan Fajerski
69df8573bf
Merge pull request #32242 from rishabh-d-dave/cv-methods-for-lvm-opt-S
ceph-volume: add methods to pass filters to pvs, vgs and lvs commands
2020-01-06 15:53:52 +01:00
Ilya Dryomov
b2b7610d1a qa: krbd_exclusive_option.sh: fixup for json.tool ordering change
In Python 3.5 json.tool was changed to produce unsorted output and
--sort-keys option was added to compensate.  This wasn't caught by
4fe245cc2f2d ("qa: update krbd tests for python3") because it raced
with 50933b863a1d ("qa: krbd_exclusive_option.sh: update for recent
kernel changes").

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2020-01-06 15:12:25 +01:00
Rishabh Dave
a4f2fcefb8 ceph-volume: add methods to pass filters to pvs, vgs and lvs commands
Filters can be passed to these commands by using option '-S'.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-01-06 19:27:42 +05:30
Jos Collin
1033d5b373
doc: mounting CephFS subdirectory and Persistent Mounts cleanup
Fixes: https://tracker.ceph.com/issues/37746
Signed-off-by: Jos Collin <jcollin@redhat.com>
2020-01-06 18:33:26 +05:30
Kefu Chai
fd0cbcfee4
Merge pull request #32485 from tchaikov/wip-clang
common,crimson: fixes to compile with clang and libc++

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-01-06 14:43:13 +08:00
Kefu Chai
dba2b80897
Merge pull request #31728 from luis-henrix/copy-from-notrunc
osd: add a 'copy-from2' operation that includes truncate_{seq,size} parameters

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Ilya Dryomov <idryomov@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2020-01-06 10:07:45 +08:00
Kefu Chai
3535e24181
Merge pull request #32488 from ronen-fr/clang_3
crimson: CLANG-related fixes to errorator.h

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 10:00:14 +08:00
Kefu Chai
ccc59a64c2
Merge pull request #32490 from rzarzynski/wip-crimson-missing_err_include
crimson: add missing include in common/errorator.h

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-06 09:57:46 +08:00
Radoslaw Zarzynski
9c51035545 crimson: add missing include in common/errorator.h
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-01-05 22:17:10 +01:00
Ronen Friedman
f81054d5ce crimson: fix non-standard C++ constructs in errorator.h
Fixing use patterns accepted by gcc, but frowned upon by Clang:

Put noexcept specifier after attributes specifiers (as
per the C++ standard $11.3.5)

Limit the use of a not-completely-defined class names to
within function bodies, per the standard ("A class is considered
a completely-defined object type (or complete type) at the
closing } of the class-specifier.
Within the class member-specification, the class is regarded as
complete within function bodies, default arguments, noexcept-specifiers,
and default member initializers (including such things in nested classes).
Otherwise it is regarded as incomplete within its own class member-specification.")

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2020-01-05 19:50:52 +02:00
Radoslaw Zarzynski
12aafcd769 crimson: fix FTBFS on Clang induced by errorator.
Reported-by Ronen Friedman <rfriedma@redhat.com>
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-01-05 18:00:37 +02:00
Kefu Chai
598c37296c common: add missing #include
clang++-9.0.1 and libc++ require them to build

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-05 22:53:48 +08:00
Kefu Chai
eb24936cfc crimson: do not use auto in param list of function prototype
src/crimson/net/Socket.cc:114:57: error: 'auto' not allowed in function
prototype
static inline seastar::future<> close_and_handle_errors(auto& out) {
                                                        ^~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-05 22:27:03 +08:00
Kefu Chai
ba0fc1fef3 crimson: do not capture unused variables
to silence warnings like

src/crimson/net/Socket.cc:93:41: warning: lambda capture 'this' is not
used [-Wunused-lambda-capture]
    return in.read_exactly(bytes).then([this](auto buf) {
                                        ^~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-05 22:27:03 +08:00
Kefu Chai
acd4de57c4
Merge pull request #32474 from kalebskeithley/fedora32
do_cmake.sh: fedora-32 (rawhide) build with python-3.8

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-01-04 23:17:56 +08:00
Kefu Chai
f8cab0eed2
Merge pull request #32481 from tchaikov/wip=admin-build-doc-python3
admin/build-doc: always install python3-* for build deps

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2020-01-04 22:16:16 +08:00
Kefu Chai
b87781c120 admin/build-doc: always install python3-* for build deps
since we've dropped the support of python36-*, i.e. python packages
provided by EPEL7 before RHEL7/CentOS7 included python3. as before the
inclusion of python3 as supported python3, python packages are named
python36-*. and they don't provide python3-*. so we had to install
python36-* explicitly. now that we are able to use the python3-*
packages, we can just install python3-*.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-04 17:05:06 +08:00
Patrick Donnelly
6ea2730ea6
qa: fix various py3 cephfs qa bugs
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-03 16:42:13 -08:00
Patrick Donnelly
6ea7c5ce49
qa: use -D_GNU_SOURCE when compiling fsync-tester.c
Otherwise loff_t is unavailable for some distributions.

Fixes: https://tracker.ceph.com/issues/43460
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-03 15:45:52 -08:00
Patrick Donnelly
95013b0346
qa: add comment about fsync-tester distribution
I was initially confused why this would not be included in the QA suite.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-03 15:45:29 -08:00
Neha Ojha
bd24ccf90d
Merge pull request #32451 from rs-fabrica/doc_rados_operations_crush-map-edits
doc/rados/operations/crush-map-edits: recompile and set instructions

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-03 15:20:33 -08:00
Patrick Donnelly
dacdb85e81
Merge PR #32442 into master
* refs/pull/32442/head:
	doc/developer: fix dev mailing list address

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-03 14:43:22 -08:00
Willem Jan Withagen
867fb0cfb0 doc/developer: fix dev mailing list address
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2020-01-03 17:52:20 +01:00
Kaleb S. KEITHLEY
5c80bb8f78 do_cmake.sh: fedora-32 (rawhide) build with python-3.8
Fedora-32 now has python-3.8.

Fedora-29 is EOL. All non-EOL versions of Fedora have python-3.7, except
Fedora-32

(Unclear to me why PYBUILD="3" isn't used, like Ubuntu and FreeBSD. That
would eliminate breakage when pyhon versions change in Rawhide.)

Signed-off-by: Kaleb S. KEITHLEY <kkeithle@redhat.com>
2020-01-03 08:34:37 -05:00
Patrick Donnelly
aafef601f8
Merge PR #32457 into master
* refs/pull/32457/head:
	doc: fix Getting Started with CephFS

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-02 18:26:03 -08:00
Casey Bodley
d21598b816
Merge pull request #31309 from matthewoliver/rgw_swift_auth_note
doc: Add a RGW swift auth note

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-02 15:59:36 -05:00
Casey Bodley
d48e6f57dd
Merge pull request #31432 from zhangsw/rgw-cleanup-cls-reshard-const
rgw:cleanup the "magic string" usage in cls_rgw_client.cc

Reviewed-by: Yuval Lifshitz <yuvalif@yahoo.com>
2020-01-02 15:33:02 -05:00
Casey Bodley
1787b7c880
Merge pull request #31429 from zhangsw/rgw-cleanup-cls-guard-bucket-resharding
rgw: correct some error log about reshard in cls_rgw.cc.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-02 10:56:54 -05:00
Yuval Lifshitz
c46ea53a55
Merge pull request #31404 from zhangsw/rgw-cleanup-deletelc
rgw:cleanup:remove un-used class member in RGWDeleteLC
2020-01-02 17:56:27 +02:00
Casey Bodley
8e41c4b97f
Merge pull request #31345 from zhangsw/rgw-cleanup-rgw-admin-check-instance
rgw:cleanup:remove un-used create_new_bucket_instance in rgw_admin.cc

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-02 10:51:23 -05:00