Commit Graph

110772 Commits

Author SHA1 Message Date
Sebastian Wagner
b2a545aa43
Merge pull request #34612 from zdover23/wip-doc-tshooting-ssh-errors-44905
doc/cephadm: Add troubleshooting guidance for ssh connection failures. [cephadm]

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-21 15:22:15 +02:00
Casey Bodley
20a1accd54
Merge pull request #34661 from wjwithagen/wjw-fix-rgw_bucket_sync_cache.h
rgw: remove noexcept from function definition

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-04-21 08:21:43 -04:00
Casey Bodley
3cefd0561f
Merge pull request #34614 from theanalyst/rgw/reshard-num-check
rgw: reshard: skip stale bucket id entries from reshard queue

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2020-04-21 07:59:55 -04:00
Willem Jan Withagen
5f0d5fcf46 rgw: remove noexcept from function definition
Clang complains:
src/rgw/rgw_bucket_sync_cache.h:88:3: error: exception specification of explicitly defaulted copy co
nstructor does not match the calculated one
  Handle(const Handle&) noexcept = default;
  ^
1 error generated.

And a reference that I found for this:
    https://github.com/mapnik/mapnik/issues/3274
Suggesting that the noexcept is inherited from the first definition.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2020-04-21 11:41:23 +00:00
Yuval Lifshitz
a13aeafe30 rgw/doc: clarify topic creation format
also, fix some typos, and 'push-endpoint' parameter

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2020-04-21 14:08:28 +03:00
Yan, Zheng
a7eadaf28b qa/cephfs: add test case for fragmenting stray dirs
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-04-21 12:38:59 +08:00
Kefu Chai
713ef3c7e7
Merge pull request #34605 from tchaikov/wip-45113
qa/suites/*/rados_cls_all.yaml: load all classes

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-04-21 09:23:39 +08:00
Simon Gao
2822787229 mds: automatically fragment stray dirs
Signed-off-by: Simon Gao <simon29rock@gmail.com>
2020-04-21 08:46:31 +08:00
Josh Durgin
18734afab0
Merge pull request #34655 from ceph/wip-yuriw-remove-wip-master
qa/tests: removed tests 'client-upgrade-octopus-pacific'

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-20 16:37:32 -07:00
Yuri Weinstein
16abadc59e qa/tests: removed tests 'client-upgrade-octopus-pacific'
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-04-20 15:59:19 -07:00
Josh Durgin
285fbac34c
Merge pull request #34651 from ceph/wip-yuriw-crontab-master
qa/tests: fixed typo

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-04-20 15:32:11 -07:00
Jason Dillaman
b0c3ca63c2 librbd: pass bit-flags to image::CreateRequest
The current boolean for skip enable mirror will be able to be changed to
a tri-state to force enable mirror (in addition to the current auto-enable
if in pool-mode).

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-04-20 18:18:49 -04:00
Yuri Weinstein
5e7391f231 qa/tests: fixed typo
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-04-20 13:57:10 -07:00
Yuri Weinstein
4b0237eb96
Merge pull request #34649 from ceph/wip-yuriw-crontab-master
qa/tests: added new clients upgrade tests `client-upgrade-octopus-pacific`
2020-04-20 13:45:41 -07:00
Yuri Weinstein
540842d27e qa/tests: added new clients upgrade tests
`client-upgrade-octopus-pacific` for future 'pacific' release

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-04-20 12:44:39 -07:00
Yuri Weinstein
6cd199602d
Merge pull request #34642 from ceph/wip-yuriw-octopus-client-upgrade-octopus-pacific
qa/tests: initial checkin for clients upgrades tests for future relea…
2020-04-20 12:35:32 -07:00
Bryan Stillwell
caf74d533b compressor: Set the Zstd default compression level to 1
The default compression level of 5 for Zstandard is too high for the majority
of use cases since it requires too many CPU cycles.  This patch switches the
default to 1.

Fixes: https://tracker.ceph.com/issues/44724

Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2020-04-20 13:27:09 -06:00
Bryan Stillwell
82699067b8 compressor: Add a config option to specify Zstd compression level
Add a new configuration item called 'compressor_zstd_level' so that the
Zstandard compression level can be tuned to the workload on a cluster.

Fixes: https://tracker.ceph.com/issues/43377

Signed-off-by: Bryan Stillwell <bstillwell@godaddy.com>
2020-04-20 13:26:54 -06:00
Casey Bodley
6a64fe3e1a rgw: use target bucket layout for reshard
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-04-20 15:23:14 -04:00
Neha Ojha
4f82ebf41b qa/standalone/scrub/osd-scrub-repair.sh: fix race in TEST_auto_repair_bluestore_failed
We need to flush_pg_stats before checking for active+clean.

Fixed: https://tracker.ceph.com/issues/45075
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-04-20 18:29:51 +00:00
Yuri Weinstein
158518fdcf qa/tests: initial checkin for clients upgrades tests for future release of pacific
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2020-04-20 10:58:57 -07:00
Jason Dillaman
73e3f537ef
Merge pull request #34608 from trociny/wip-journal-append-stripe-width
cls/journal: use EC pool stripe width for padding appends

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-04-20 13:27:35 -04:00
Kefu Chai
0a183082e5 mgr: drop python2 support
just stop checking for `PY_MAJOR_VERSION`, since we've moved to python3.
no need to be python2 compatible.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-20 23:39:20 +08:00
Casey Bodley
58a773b59c qa/rgw: allow 'ceph' user to read vault token
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2020-04-20 11:36:51 -04:00
Sebastian Wagner
67a29846f8 mgr/orch: upgrade: better input validation
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-20 15:45:02 +02:00
Kefu Chai
94e39db4e8
Merge pull request #34636 from tchaikov/wip-vstart-runner-py3
qa/tasks/vstart_runner,doc: be compatible with python3

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2020-04-20 21:23:43 +08:00
Dimitri Savineau
252d4b3044 cephadm: fix adopt prometheus command
Create the target directory before copy the prometheus configuration.

Closes: https://tracker.ceph.com/issues/45120

Signed-off-by: Dimitri Savineau <dsavinea@redhat.com>
2020-04-20 08:42:25 -04:00
Kefu Chai
c5bd318de6 qa/tasks/cephfs/fuse_mount.py: by python3 compatible
pass `StringIO()` to capture stdout whose value will be interpreted as a
string later on

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-20 19:55:09 +08:00
Zac Dover
c4765afb81 Add troubleshooting guidance for ssh connection failures.
For more thorough information about this commit, see:
https://tracker.ceph.com/issues/44905

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Update doc/cephadm/troubleshooting.rst

Co-Authored-By: Michael Fritch <mfritch@suse.com>

ibid

Signed-off-by: Zac Dover <zac.dover@gmail.com>

Update doc/cephadm/troubleshooting.rst

Co-Authored-By: Sebastian Wagner <sebastian@spawnhost.de>

Update doc/cephadm/troubleshooting.rst

Co-Authored-By: Sebastian Wagner <sebastian@spawnhost.de>

Added mgfritch's suggestion regarding checking to see if the public key
is listed in the authorized_keys file.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2020-04-20 21:48:22 +10:00
Kefu Chai
d54f3ea43e pybind/mgr/dashboard/run-backend-api-tests.sh: use python3 by default
since vstart_runner.py is now py3, let's use python3 by default

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-20 19:41:09 +08:00
Kefu Chai
bedea85019 qa/tasks/vstart_runner.py: be python3 compatible
differentiate `str` and `bytes` instances, and drop python2 support from
vstart_runner.py, as we've moved to python3 already

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-20 19:41:09 +08:00
Igor Fedotov
0f639740a3 qa/objectstore: test hybrid allocator instead of avl one.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-20 14:33:14 +03:00
Igor Fedotov
c6b2413e8e os/bluestore: fix unittest_bluefs.mkfs_mount_duplicate_gift
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2020-04-20 14:06:48 +03:00
Xiubo Li
3441261346 qa/volume_client: switch to use python3
Currently for the ceph_volume_client in pybind only the python3 is
support.

Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-20 07:05:03 -04:00
Xiubo Li
0ed507dfd4 qa/volume_client: fix TestVolumeClient failing under new py3 runtime
The pybind now has dropped the WITH_PYTHON2 option, and for now only
py3 supported.

Fixes: https://tracker.ceph.com/issues/45103
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-20 07:04:52 -04:00
Kefu Chai
a2d1eaeb3f qa/suites/*/rados_cls_all.yaml: load all classes
the intention to add the whitelist was to test "sdk" class, but if we
add new classes to the list, and add tests exercising them, the tests
fail if we fail to update these `rados_cls_all.yaml` accordingly.

so in this change, the list is now '*' which allows OSD to load all
classes found in the specified directory

Fixes: https://tracker.ceph.com/issues/45113
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-20 18:58:35 +08:00
Kefu Chai
c6e48ef0f0 doc/dev/developer_guide: use python3 to launch vstart_runner.py
as vstart_runner.py is compatible with python3, and so is the tests
under `qa/` directory.

and use `pip` to install teuthology, simpler this way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-04-20 18:31:37 +08:00
Yan, Zheng
f558dff017 mds: make MDCache::scan_stray_dir() handle dir fragmentation
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-04-20 18:11:18 +08:00
Yan, Zheng
9a308ed4a4 mds: don't add null dentry to frozen stray dir
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-04-20 18:11:18 +08:00
Yan, Zheng
72dab35bd0 mds: auth pin stray dir when purging stray inode
After stray inode gets added to purge queue, mds deletes stray dentry.
MDS needs to make sure stray dir is not being fragmented.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-04-20 18:11:15 +08:00
Yan, Zheng
02e15a20d9 ceph: allow 'dirfrag split' asok command to operate on stray dirs
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-04-20 18:06:26 +08:00
Kefu Chai
36ddb9ed3b
Merge pull request #34432 from optimistyzy/47_upstream
os/bluestore/NVMEDevice.cc: use slist for tracking mempool

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-04-20 14:51:33 +08:00
Ziye Yang
30858a9534 NVMEDevice: Remove the performance counter
Compared with other approach (KernelDevice, iouring), it does not
have such feature, so remove it to simplify the code and improve
the performance. Because, each thread will call the logger and calculate
the time, it is very time consuming. And the upper layer in bluestore has
the feature to track each I/O task.

And it is not readable if we add ifdef configure to enable this feature,
so in my mind that I suggest removing this latency track. And the
latency benefit demonstrated by SPDK is already approved, so we do not
need to tracking every I/O time when invoking SPDK driver.

Signed-off-by: Ziye Yang <ziye.yang@intel.com>
2020-04-21 00:25:08 +08:00
Ziye Yang
bb55f2c2a3 NVMEDevice.cc: Remove the data_buf_mempool
Use the linked list is enough.

Signed-off-by: Ziye Yang <ziye.yang@intel.com>
2020-04-21 00:24:38 +08:00
Yuan Lu
bee4e6f66c librbd: add aio_flush test case
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-20 14:04:05 +08:00
Yuan Lu
03f08687bb librbd: add aio_flush
Signed-off-by: Peterson, Scott <scott.d.peterson@intel.com>
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
Signed-off-by: Lu, Yuan <yuan.y.lu@intel.com>
Signed-off-by: Chamarthy, Mahati <mahati.chamarthy@intel.com>
2020-04-20 14:03:45 +08:00
Mykola Golub
5e540f1191
Merge pull request #34615 from dillaman/wip-45072
rbd-mirror: image replayer stop might race with instance replayer shut down

Reviewed-by: Mykola Golub <mgolub@suse.com>
2020-04-19 10:57:49 +03:00
Xiubo Li
cb0a600acf ceph-fuse: link to libfuse3 if fuse3 is installed
Fixes: https://tracker.ceph.com/issues/44891
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-18 05:57:29 -04:00
Xiubo Li
32a45b624b rbd-fuse: remove FUSE_CAP_BIG_WRITES when linking to libfuse3
The big-writes is enabled as default from 3.0.

Fixes: https://tracker.ceph.com/issues/44891
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-18 05:50:27 -04:00
Xiubo Li
d5999a9ac4 rbd-fuse: switch to use utimens instead
The utime is deprecated.

Fixes: https://tracker.ceph.com/issues/44891
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-04-18 05:50:22 -04:00