Commit Graph

107005 Commits

Author SHA1 Message Date
Sage Weil
044e9247bb qa/suites/upgrade/mimic-x: finish at octopus
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 17:13:09 -06:00
Sage Weil
2182e79744 qa/suites/upgrade/nautilus-x: disable TOO_FEW_PGS warning
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 17:13:09 -06:00
Sage Weil
777f239df9 qa/tasks/ceph: set mon_health_to_clog=false via mon config
This actually works better on new versions.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 17:12:56 -06:00
Sage Weil
223d5d4f9f qa/suites/upgrade/mimic-x: disable TOO_FEW_PGS warning
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 17:12:34 -06:00
Sage Weil
3ca1fa3643 Merge PR #32616 into master
* refs/pull/32616/head:
	cephadm: annotate call()
	cephadm: podman inspect: image field was called `ImageID`:

Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-23 16:40:59 -06:00
Sage Weil
84b679ffe7 Merge PR #32795 into master
* refs/pull/32795/head:
	cephadm: require fsid if name contains a daemon id
	cephadm: infer the fsid by name

Reviewed-by: Sebastian Wagner <swagner@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2020-01-23 16:17:39 -06:00
Casey Bodley
19d06094ab
Merge pull request #31155 from zhangsw/fix-rgw-reshard-process
rgw: one log shard fails shouldn't block other shards process when reshard buckets

Reviewed-by: Mark Kogan <mkogan@redhat.com>
2020-01-23 16:35:13 -05:00
Casey Bodley
2507a09b48
Merge pull request #31103 from zhangsw/fix-rgw-reshard-cleanindex
rgw: clean index and remove bucket instance info when setting resharding status fails

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-23 16:34:12 -05:00
Casey Bodley
e19788d1fb
Merge pull request #30920 from GaryHyg/wip-quota-bug
RGW: Set appropriate bucket quota value (when quota value is less than 0)

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-23 16:33:46 -05:00
Casey Bodley
86750660fc
Merge pull request #30880 from jiahuizeng/radosgw
rgw: support radosgw-admin zone/zonegroup placement get command

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-23 16:33:20 -05:00
Casey Bodley
e736ae8179
Merge pull request #30861 from IlsooByun/rgw_lc_missing
rgw: do not miss the 1000th element of every iteration during lifecycle processing

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2020-01-23 16:32:45 -05:00
Sage Weil
a41f2594d5 mon/ConfigMonitor: put global/ keys in global section
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 14:14:09 -06:00
Sage Weil
b575e40f23 mgr/cephadm: fetch keyring in _create_daemon()
This simplifies life for the callers, especially service_action
reconfig and redeploy.

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 13:45:17 -06:00
Mykola Golub
da46798ab3 librbd: don't call refresh from mirror::GetInfoRequest state machine
Fixes: https://tracker.ceph.com/issues/43589
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-01-23 19:13:25 +00:00
Kefu Chai
68a52faccb
Merge pull request #32797 from tchaikov/wip-seastar-and-errorator
seastar,crimson: pickup change to pin socket to fixed core

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2020-01-24 02:31:59 +08:00
Ali Maredia
f1216df227
Merge pull request #29703 from baixueyu/wip-quota
rgw:  when you abort a multipart upload request, the quota may be not updated
2020-01-23 13:13:17 -05:00
Ali Maredia
3b2e50108c
Merge pull request #28622 from IlsooByun/master
rgw: incorrect return value when processing CORS headers
2020-01-23 13:12:25 -05:00
Ali Maredia
a8ba1a5a26
Merge pull request #29733 from baixueyu/wip-reload-coredump
rgw: maybe coredump when reload operator happened
2020-01-23 13:11:39 -05:00
Mykola Golub
6171c26a94 doc: document "mode" param for "rbd mirror image enable" command
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-01-23 18:10:19 +00:00
Ali Maredia
4a7f8cfb89
Merge pull request #29795 from xxcs/xxcs03
rgw: fix one part of the bulk delete(RGWDeleteMultiObj_ObjStore_S3) fails but no error messages
2020-01-23 12:56:20 -05:00
Ali Maredia
3fdd1ce157
Merge pull request #30913 from ofriedma/wip-ofriedma-lc-logs
rgw: Add more details to the LC delete and transit log
2020-01-23 12:55:22 -05:00
Sage Weil
2e1c9c9409 Merge PR #32787 into master
* refs/pull/32787/head:
	qa/tasks/cephadm: work around .git suffix on ceph_repo
	qa/tasks/cephadm: learn to pull cephadm from github

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2020-01-23 11:25:56 -06:00
Sage Weil
66797ef199 common/options: bluestore 64k min_alloc_size for HDD
Until we understand the performance regression and allocator behavior,
go back to 64k.  This will continue to have a high space overhead for
small objects and EC, but will preserve the current performance levels
for all workloads.

This partially reverts 0ec75c99dd

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 11:24:36 -06:00
Sage Weil
2ff06d75f8 mgr/cephadm: health alert for stray hosts and/or services
Fixes: https://tracker.ceph.com/issues/43714
Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 11:13:40 -06:00
Lenz Grimmer
554fbc0443
mgr/dashboard: Add column filtering feature to cd-table (#32568)
mgr/dashboard: Add column filtering feature to cd-table

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2020-01-23 16:36:44 +00:00
Igor Fedotov
06fe987527 os/bluestore: unconditionally repair legacy statfs
To be inline with per-pool omaps let's repair legacy statfs no matter
what's the value (true or false) is set to 'bluestore_fsck_error_on_no_per_pool_omap'
parameter. I.e. repair will bring per-pool  statfs even when legacy statfs are considered as warning.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-01-23 18:57:04 +03:00
Igor Fedotov
2605c375d5 tools/ceph-[objectstore|bluestore]-tool: fix reporting on repaired warnings
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-01-23 18:57:03 +03:00
Igor Fedotov
f16629980d os/bluestore: limit error/warning lines shown during fsck.
Some 'expected' fsck falures (e.g. legacy omap records from previous
releases in Octopus) might produce tons of corresponding error/warning log lines.
This is a simple and rough workaround which limits number of printed lines by a
predefined value of 100.
Curretly applied to omap-related errors only.

Known flaw is that limit is applied on per-task basis hence multi-threaded quick-fix will
prooduce up to 100 * <number of fix task> lines instead of 100 which is a bit confusing.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-01-23 18:57:00 +03:00
Michael Fritch
457c75dfda
cephadm: require fsid if name contains a daemon id
$ cephadm shell --name mon.123
INFO:cephadm:Found fsids []
Traceback (most recent call last):
  File "./cephadm", line 2805, in <module>
    r = args.func()
  File "./cephadm", line 646, in _infer_fsid
    return func()
  File "./cephadm", line 1992, in command_shell
    no_config=True if args.config else False)
  File "./cephadm", line 1009, in get_container_mounts
    data_dir = get_data_dir(fsid, daemon_type, daemon_id)
  File "./cephadm", line 670, in get_data_dir
    return os.path.join(args.data_dir, fsid, '%s.%s' % (t, n))
  File "/usr/lib64/python3.7/posixpath.py", line 94, in join
    genericpath._check_arg_types('join', a, *p)
  File "/usr/lib64/python3.7/genericpath.py", line 149, in _check_arg_types
    (funcname, s.__class__.__name__)) from None
TypeError: join() argument must be str or bytes, not 'NoneType'

Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-23 08:17:19 -07:00
Michael Fritch
f46be311e4
cephadm: infer the fsid by name
Signed-off-by: Michael Fritch <mfritch@suse.com>
2020-01-23 08:17:19 -07:00
Samuel Just
b5f42f5f95
Merge pull request #32387 from athanatos/sjust/wip-glibcxx-assertions
Enable _GLIBCXX_ASSERTIONS and fix unittest problems

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-01-23 07:15:28 -08:00
Sage Weil
1ebe7950ed qa/tasks/cephadm: work around .git suffix on ceph_repo
githubusercontent.com doesn't like the .git suffix

Signed-off-by: Sage Weil <sage@redhat.com>
2020-01-23 08:25:34 -06:00
Sage Weil
3e7d1981d4 Merge PR #32794 into master
* refs/pull/32794/head:
	cephadm: normalize image_id in 'pull' output too
	cephadm: fix image_id normalization
	cephadm: pull: remove newline from ceph_version
	mgr/cephadm: base upgrade check on return code, not stderr
	mgr/cephadm: fix ok-to-stop
	mgr/cephadm: some upgrade debug output
	mgr/cephadm: remove dup check
	mgr/cephadm: only need_upgrade_self if image_id doesn't match
	mgr/cephadm: safe to restart mgr and other non-mon/osd/mds daemons

Reviewed-by: Michael Fritch <mfritch@suse.com>
2020-01-23 08:12:49 -06:00
Ali Maredia
1a950cd5ec
Merge pull request #32791 from liewegas/fix-rgw-website
qa/suites/rgw/website: run test on ubuntu
2020-01-23 09:01:28 -05:00
Nathan Cutler
a9490c07d0
Merge pull request #32276 from smithfarm/wip-drop-repo-access-doc
doc/cleanup: drop repo-access.rst

Reviewed-by: Zac Dover <zac.dover@gmail.com>
2020-01-23 14:17:26 +01:00
Varsha Rao
952f1edbf8 pybind: Add test for listxattr
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-23 18:32:44 +05:30
Varsha Rao
5b33fefcde pybind: Add listxattr
Signed-off-by: Varsha Rao <varao@redhat.com>
2020-01-23 18:32:44 +05:30
Daniel Gryniewicz
a660d38924
Merge pull request #32269 from liuchang0812/issue-43199-lockdep-in-coroutines-manager
rgw: get elastic search info in start_sync, avoid creating new coroutines manager
2020-01-23 07:56:35 -05:00
Daniel Gryniewicz
2cf63eac22
Merge pull request #32290 from jiahuizeng/es-valid
rgw: relax es zone validity check
2020-01-23 07:55:51 -05:00
Daniel Gryniewicz
64cb813818
Merge pull request #32458 from ofriedma/wip-ofriedma-fix-trans-noncurr
cls/rgw: when object is versioned and lc transition it, the object is becoming non-current
2020-01-23 07:54:43 -05:00
Daniel Gryniewicz
77abca2697
Merge pull request #32180 from yehudasa/wip-43255
rgw: use bucket creation time from bucket instance info
2020-01-23 07:53:34 -05:00
Kefu Chai
a471ad2a6a mgr: better error handling when reading option
this also silences the warning of

src/mgr/BaseMgrModule.cc:402:9: warning: unused variable 'r' [-Wunused-variable]
     int r = g_conf().get_val(string(what), &value);
         ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-23 20:18:28 +08:00
Ulrich Weigand
c58fc258a2 cmake: Improve test for 16-byte atomic support on IBM Z
Commit d1b9d14324 added a check for
16-byte atomics without library support on IBM Z.  Unfortunately
it turns out this test only works correctly when the test case
is built without optimization.  (This is normally true, but it
may not be the case when passing explicit CXXFLAGS to cmake.)

The underlying reason is that GCC may choose to use either an
inline implementation of the 16-byte atomics or library calls,
depending on whether or not it is able to prove the atomic
variable is properly aligned.  At -O0 it is never able to prove
that, but at higher optimization levels it depends on the complexity
of the expression (in particular, whether GCC can track down the
definition of the underlying object).

As the test case uses a very simple expression, it may happen that
this test can be built without requiring library support, but some
of the "real" uses of atomics in Ceph code cannot.   This defeats
the whole purpose of the test at configure time.

Fixed by making the access pattern in the test more complex, so
that the test fails even at high optimization levels.

Fixes: https://tracker.ceph.com/issues/43747

Signed-off-by: Ulrich Weigand <ulrich.weigand@de.ibm.com>
2020-01-23 13:13:58 +01:00
Tiago Melo
78b335b76d mgr/dashboard: Add required symbol directly in the text element
This prevents the symbol from breaking from the last word of the label,
if the width gets too small.

This will also remove the need to add an extra span just to show the symbol.

Fixes: https://tracker.ceph.com/issues/40751

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-01-23 10:41:37 -01:00
Tiago Melo
07c7fff489 mgr/dashboard: Use custom classes for form label and inputs
With this change we are able to configura the col sizes of labels and inputs in
one single place.

Also increased the col size in smaller screens to be able to display longer
labels.

This was not applied in some situations where the col size was different than
usual.

Fixes: https://tracker.ceph.com/issues/40751

Signed-off-by: Tiago Melo <tmelo@suse.com>
2020-01-23 10:41:36 -01:00
Abhishek L
323d055651
Merge pull request #32736 from capri1989/credits-script
src/script/credits.sh - switch to bash

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
2020-01-23 11:44:28 +01:00
Alfonso Martínez
e5fa448229 ceph.spec.in: fix 'make check' deps for centos8
When running 'FOR_MAKE_CHECK=1 ./install-deps.sh' in CentOS 8
these dependencies were not being installed.
Missing dependencies are provided by
https://copr.fedorainfracloud.org/coprs/ktdreyer/ceph-el8/

Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2020-01-23 11:16:27 +01:00
Volker Theile
4d8dbe5c6e mgr/dashboard: Unit test does not do the mentioned thing
The unit test AccessControlTest::test_load_v2() is testing a v1 database instead of a v2.

Fixes: https://tracker.ceph.com/issues/43760
Signed-off-by: Volker Theile <vtheile@suse.com>
2020-01-23 10:25:53 +01:00
Stephan Müller
34976bae14 mgr: Add get_rates_from_data to mgr_util.py
The function calculates the difference between the values
in a time series list.

The previous location of it was in the dashboard, that's why the
function has doc tests. In order to be able to test them as part of the
manager utilities a bit of tox magic was added.

Fixes: https://tracker.ceph.com/issues/40365
Signed-off-by: Stephan Müller <smueller@suse.com>
2020-01-23 10:04:57 +01:00
Kefu Chai
5a132172dd crimson/common/errorator: construct future<> with a future_state_base
this change is made to adapt
89e801b373

* always use the helpers from `futurize` instead of using
  `::seastar::make_exception_future()` directly. as
  `make_exception_future(future_state_base&& state)` is located in
  `seastar::internal` namespace
* add `noexcept` specifier in both constructors. to match with the
  helpers of `make_exception_future2()` which dispatch the call to
  different constructor variants.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-01-23 15:52:33 +08:00