Commit Graph

106768 Commits

Author SHA1 Message Date
Casey Bodley
e736ae8179
Merge pull request #30861 from IlsooByun/rgw_lc_missing
rgw: do not miss the 1000th element of every iteration during lifecycle processing

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-01-23 16:32:45 -05:00
Sage Weil
a41f2594d5 mon/ConfigMonitor: put global/ keys in global section
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 14:14:09 -06:00
Kefu Chai
68a52faccb
Merge pull request #32797 from tchaikov/wip-seastar-and-errorator
seastar,crimson: pickup change to pin socket to fixed core

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-01-24 02:31:59 +08:00
Ali Maredia
f1216df227
Merge pull request #29703 from baixueyu/wip-quota
rgw:  when you abort a multipart upload request, the quota may be not updated
2020-01-23 13:13:17 -05:00
Ali Maredia
3b2e50108c
Merge pull request #28622 from IlsooByun/master
rgw: incorrect return value when processing CORS headers
2020-01-23 13:12:25 -05:00
Ali Maredia
a8ba1a5a26
Merge pull request #29733 from baixueyu/wip-reload-coredump
rgw: maybe coredump when reload operator happened
2020-01-23 13:11:39 -05:00
Mykola Golub
6171c26a94 doc: document "mode" param for "rbd mirror image enable" command
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-01-23 18:10:19 +00:00
Ali Maredia
4a7f8cfb89
Merge pull request #29795 from xxcs/xxcs03
rgw: fix one part of the bulk delete(RGWDeleteMultiObj_ObjStore_S3) fails but no error messages
2020-01-23 12:56:20 -05:00
Ali Maredia
3fdd1ce157
Merge pull request #30913 from ofriedma/wip-ofriedma-lc-logs
rgw: Add more details to the LC delete and transit log
2020-01-23 12:55:22 -05:00
Sage Weil
2e1c9c9409 Merge PR #32787 into master
* refs/pull/32787/head:
	qa/tasks/cephadm: work around .git suffix on ceph_repo
	qa/tasks/cephadm: learn to pull cephadm from github

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2020-01-23 11:25:56 -06:00
Sage Weil
66797ef199 common/options: bluestore 64k min_alloc_size for HDD
Until we understand the performance regression and allocator behavior,
go back to 64k.  This will continue to have a high space overhead for
small objects and EC, but will preserve the current performance levels
for all workloads.

This partially reverts 0ec75c99dd

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 11:24:36 -06:00
Sage Weil
2ff06d75f8 mgr/cephadm: health alert for stray hosts and/or services
Fixes: https://tracker.ceph.com/issues/43714
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 11:13:40 -06:00
Lenz Grimmer
554fbc0443
mgr/dashboard: Add column filtering feature to cd-table (#32568)
mgr/dashboard: Add column filtering feature to cd-table

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-01-23 16:36:44 +00:00
Michael Fritch
457c75dfda
cephadm: require fsid if name contains a daemon id
$ cephadm shell --name mon.123
INFO:cephadm:Found fsids []
Traceback (most recent call last):
  File "./cephadm", line 2805, in <module>
    r = args.func()
  File "./cephadm", line 646, in _infer_fsid
    return func()
  File "./cephadm", line 1992, in command_shell
    no_config=True if args.config else False)
  File "./cephadm", line 1009, in get_container_mounts
    data_dir = get_data_dir(fsid, daemon_type, daemon_id)
  File "./cephadm", line 670, in get_data_dir
    return os.path.join(args.data_dir, fsid, '%s.%s' % (t, n))
  File "/usr/lib64/python3.7/posixpath.py", line 94, in join
    genericpath._check_arg_types('join', a, *p)
  File "/usr/lib64/python3.7/genericpath.py", line 149, in _check_arg_types
    (funcname, s.__class__.__name__)) from None
TypeError: join() argument must be str or bytes, not 'NoneType'

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-23 08:17:19 -07:00
Michael Fritch
f46be311e4
cephadm: infer the fsid by name
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-23 08:17:19 -07:00
Samuel Just
b5f42f5f95
Merge pull request #32387 from athanatos/sjust/wip-glibcxx-assertions
Enable _GLIBCXX_ASSERTIONS and fix unittest problems

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-23 07:15:28 -08:00
Sage Weil
1ebe7950ed qa/tasks/cephadm: work around .git suffix on ceph_repo
githubusercontent.com doesn't like the .git suffix

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 08:25:34 -06:00
Sage Weil
3e7d1981d4 Merge PR #32794 into master
* refs/pull/32794/head:
	cephadm: normalize image_id in 'pull' output too
	cephadm: fix image_id normalization
	cephadm: pull: remove newline from ceph_version
	mgr/cephadm: base upgrade check on return code, not stderr
	mgr/cephadm: fix ok-to-stop
	mgr/cephadm: some upgrade debug output
	mgr/cephadm: remove dup check
	mgr/cephadm: only need_upgrade_self if image_id doesn't match
	mgr/cephadm: safe to restart mgr and other non-mon/osd/mds daemons

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-01-23 08:12:49 -06:00
Ali Maredia
1a950cd5ec
Merge pull request #32791 from liewegas/fix-rgw-website
qa/suites/rgw/website: run test on ubuntu
2020-01-23 09:01:28 -05:00
Nathan Cutler
a9490c07d0
Merge pull request #32276 from smithfarm/wip-drop-repo-access-doc
doc/cleanup: drop repo-access.rst

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-01-23 14:17:26 +01:00
Varsha Rao
952f1edbf8 pybind: Add test for listxattr
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-23 18:32:44 +05:30
Varsha Rao
5b33fefcde pybind: Add listxattr
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-23 18:32:44 +05:30
Daniel Gryniewicz
a660d38924
Merge pull request #32269 from liuchang0812/issue-43199-lockdep-in-coroutines-manager
rgw: get elastic search info in start_sync, avoid creating new coroutines manager
2020-01-23 07:56:35 -05:00
Daniel Gryniewicz
2cf63eac22
Merge pull request #32290 from jiahuizeng/es-valid
rgw: relax es zone validity check
2020-01-23 07:55:51 -05:00
Daniel Gryniewicz
64cb813818
Merge pull request #32458 from ofriedma/wip-ofriedma-fix-trans-noncurr
cls/rgw: when object is versioned and lc transition it, the object is becoming non-current
2020-01-23 07:54:43 -05:00
Daniel Gryniewicz
77abca2697
Merge pull request #32180 from yehudasa/wip-43255
rgw: use bucket creation time from bucket instance info
2020-01-23 07:53:34 -05:00
Ulrich Weigand
c58fc258a2 cmake: Improve test for 16-byte atomic support on IBM Z
Commit d1b9d14324 added a check for
16-byte atomics without library support on IBM Z.  Unfortunately
it turns out this test only works correctly when the test case
is built without optimization.  (This is normally true, but it
may not be the case when passing explicit CXXFLAGS to cmake.)

The underlying reason is that GCC may choose to use either an
inline implementation of the 16-byte atomics or library calls,
depending on whether or not it is able to prove the atomic
variable is properly aligned.  At -O0 it is never able to prove
that, but at higher optimization levels it depends on the complexity
of the expression (in particular, whether GCC can track down the
definition of the underlying object).

As the test case uses a very simple expression, it may happen that
this test can be built without requiring library support, but some
of the "real" uses of atomics in Ceph code cannot.   This defeats
the whole purpose of the test at configure time.

Fixed by making the access pattern in the test more complex, so
that the test fails even at high optimization levels.

Fixes: https://tracker.ceph.com/issues/43747

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
2020-01-23 13:13:58 +01:00
Tiago Melo
78b335b76d mgr/dashboard: Add required symbol directly in the text element
This prevents the symbol from breaking from the last word of the label,
if the width gets too small.

This will also remove the need to add an extra span just to show the symbol.

Fixes: https://tracker.ceph.com/issues/40751

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-01-23 10:41:37 -01:00
Tiago Melo
07c7fff489 mgr/dashboard: Use custom classes for form label and inputs
With this change we are able to configura the col sizes of labels and inputs in
one single place.

Also increased the col size in smaller screens to be able to display longer
labels.

This was not applied in some situations where the col size was different than
usual.

Fixes: https://tracker.ceph.com/issues/40751

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-01-23 10:41:36 -01:00
Abhishek L
323d055651
Merge pull request #32736 from capri1989/credits-script
src/script/credits.sh - switch to bash

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2020-01-23 11:44:28 +01:00
Alfonso Martínez
e5fa448229 ceph.spec.in: fix 'make check' deps for centos8
When running 'FOR_MAKE_CHECK=1 ./install-deps.sh' in CentOS 8
these dependencies were not being installed.
Missing dependencies are provided by
https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2020-01-23 11:16:27 +01:00
Volker Theile
4d8dbe5c6e mgr/dashboard: Unit test does not do the mentioned thing
The unit test AccessControlTest::test_load_v2() is testing a v1 database instead of a v2.

Fixes: https://tracker.ceph.com/issues/43760
Signed-off-by: Volker Theile <vtheile@suse.com>
2020-01-23 10:25:53 +01:00
Stephan Müller
34976bae14 mgr: Add get_rates_from_data to mgr_util.py
The function calculates the difference between the values
in a time series list.

The previous location of it was in the dashboard, that's why the
function has doc tests. In order to be able to test them as part of the
manager utilities a bit of tox magic was added.

Fixes: https://tracker.ceph.com/issues/40365
Signed-off-by: Stephan Müller <smueller@suse.com>
2020-01-23 10:04:57 +01:00
Kefu Chai
5a132172dd crimson/common/errorator: construct future<> with a future_state_base
this change is made to adapt
89e801b373

* always use the helpers from `futurize` instead of using
  `::seastar::make_exception_future()` directly. as
  `make_exception_future(future_state_base&& state)` is located in
  `seastar::internal` namespace
* add `noexcept` specifier in both constructors. to match with the
  helpers of `make_exception_future2()` which dispatch the call to
  different constructor variants.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-23 15:52:33 +08:00
Kefu Chai
6857348f64 seastar: pickup change to pin socket to fixed core
and clang / GCC-10 related fixes

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-23 15:52:27 +08:00
Neha Ojha
f205d38c2c
Merge pull request #32373 from zdover23/wip-doc-pg-formats-update-dec-2019
doc: update list of formats for --format flag for "ceph pg dump"

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-01-22 19:10:00 -08:00
Neha Ojha
9f96f9bdc5
Merge pull request #32790 from neha-ojha/wip-pglog-defaults
doc/rados: update osd_min_pg_log_entries and add osd_max_pg_log_entries

Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-22 19:03:48 -08:00
Samuel Just
181d991e53 rgw_kms: fix concat_url for empty url case
Can't call back() on an empty string.  Causes unittest_rgw_kms
to fail when compiled with _GLIBCXX_ASSERTIONS.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-01-22 16:03:14 -08:00
Samuel Just
9c89b16a8c fastbmap_allocator_impl: avoid std::vector[] for oob index
This was relatively harmless as the pointer won't actually be
dereferenced, but it runs afoul of std::vector's bounds checks with
_GLIBCXX_ASSERTIONS enabled.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-01-22 16:03:14 -08:00
Samuel Just
d2b4cd2820 unittest_random: min > max triggers a glibc assert
Signed-off-by: Samuel Just <sjust@redhat.com>
2020-01-22 16:03:14 -08:00
Samuel Just
385215f284 src/CMakeLists.txt: enable _GLIBCXX_ASSERTIONS in debug builds
We already enable this by default in our rpm builds.  Adding it here as
well increases the odds we'll catch things with make check and local
testing.

Signed-off-by: Samuel Just <sjust@redhat.com>
2020-01-22 16:03:06 -08:00
Sage Weil
f0049916a1 cephadm: normalize image_id in 'pull' output too
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-22 16:46:17 -06:00
Sage Weil
3806c5e7f2 cephadm: fix image_id normalization
Remove sha256: prefix from id (hash), not name.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-22 16:46:05 -06:00
Patrick Donnelly
5d8e1d0949
Merge PR #32741 into master
* refs/pull/32741/head:
	qa/cephfs: make filelock_interrupt.py work with python3

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-01-22 14:41:40 -08:00
Sage Weil
04d1f378e5 cephadm: pull: remove newline from ceph_version
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-22 16:39:57 -06:00
Sage Weil
7244b7cef1 mgr/cephadm: base upgrade check on return code, not stderr
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-22 16:37:51 -06:00
Sage Weil
702e0c2e4d mgr/cephadm: fix ok-to-stop
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-22 16:33:03 -06:00
Sage Weil
1412177f8f mgr/cephadm: some upgrade debug output
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-22 16:31:01 -06:00
Sage Weil
1deae2492f mgr/cephadm: remove dup check
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-22 16:27:42 -06:00
Sage Weil
c360205961 mgr/cephadm: only need_upgrade_self if image_id doesn't match
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-22 16:25:09 -06:00