Commit Graph

122514 Commits

Author SHA1 Message Date
Kefu Chai
8e85261b80 test/crimson/seastore: do not put braces around scalar initializer
this change silences the warning from clang like:

src/test/crimson/seastore/onode_tree/test_value.h:152:12: warning: braces around scalar initializer [-Wbraced-scalar-init]
     return {static_cast<value_size_t>(size - sizeof(value_header_t))};
            ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-28 20:54:22 +08:00
Kefu Chai
bdc5b14743 crimson/os/seastore: do not reference non-template with template
this change addresses the build failure with clang:

src/crimson/os/seastore/onode_manager/staged-fltree/node_extent_accessor.h:352:29: error: 'encode_split' following the 'template' keyword does not refer to a template
    test_recorder->template encode_split(split_at, read().p_start());
                   ~~~~~~~~ ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-28 20:54:22 +08:00
Kefu Chai
e69e3dae03 crimson/os/seastore: do not capture label using &
structured binding does not define variables. unlike GCC, Clang does
not allow this. this change address following build failures with clang:

../src/crimson/os/seastore/omap_manager/btree/omap_btree_node_impl.cc:210:24:
note: 'result' declared here
      auto &[complete, result] = ret;
                       ^
../src/crimson/os/seastore/omap_manager/btree/omap_btree_node_impl.cc:214:6:
error: reference to local binding 'complete' declared in enclosing
lambda expression
            complete = biter == eiter;
            ^

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-28 20:54:22 +08:00
Kefu Chai
f7294bca9d
Merge pull request #41046 from rzarzynski/wip-crimson-monc-auth_reply
crimson/monc: fix use-after-free around Connection::do_auth_single().

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-28 02:02:32 +08:00
Ernesto Puerta
df945af52d
Merge pull request #40936 from rhcs-dashboard/support-ingress-service-creation-UI
mgr/dashboard: fix HAProxy (now called ingress)

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-04-27 19:05:04 +02:00
Ernesto Puerta
95c52c978c
Merge pull request #40426 from rhcs-dashboard/host-maintenance-followups
mgr/dashboard: Host Maintenance Follow ups

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-04-27 19:03:09 +02:00
Radoslaw Zarzynski
1a3b54ac5e crimson/monc: fix use-after-free around Connection::do_auth_single().
This bug caused following failure in teuthology testing [1]:

```
WARN  2021-04-23 07:08:29,449 [shard 0] osd - ms_handle_reset
WARN  2021-04-23 07:08:29,449 [shard 0] monc - active conn reset v2:172.21.15.100:3300/0
INFO  2021-04-23 07:08:29,449 [shard 0] monc - reopen_session to mon.-1
INFO  2021-04-23 07:08:29,449 [shard 0] monc - close
INFO  2021-04-23 07:08:29,449 [shard 0] monc - connecting to mon.0
...
ERROR 2021-04-23 07:08:29,450 [shard 0] none - /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-3454-gddedc2e1/rpm/el8/BUILD/ceph-17.0.0-3454-gddedc2e1/src/crimson/mon/MonClient.cc:228 : In function 'crimson::mon::Connection::do_auth_single(crimson::mon::Connection::request_t)::<lambda(Ref<MAuthReply>)>', ceph_assert(%s)
closed
```

[1]: http://pulpito.front.sepia.ceph.com/rzarzynski-2021-04-22_00:20:19-rados-master-distro-basic-smithi/6063316/

The root cause is in freeing the `active_con` in `Client::reopen_session()`
while there still could be the second, ongoing part of `do_auth_single()`.
This fix rectifies the issue by switching `std::unique_ptr` to `seastar::shared_ptr`
and extending the life-time with the help of `seastar::enable_shared_from_this<T>`.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-27 14:40:50 +00:00
Patrick Donnelly
eb0fdad52c
Merge PR #40810 into master
* refs/pull/40810/head:
	test: tests for *at() libcephfs APIs
	test: cleanup files/dirs before finishing test
	client: non-at APIs call at-APIs with CEPHFS_AT_FDCWD as file descriptor
	libcephfs: introduce basic *at() calls
	client: remove redundant caps_issued_mask() call in Client::fstatx()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-27 07:40:15 -07:00
Radoslaw Zarzynski
180ab53eeb crimson/monc: assert Connection::handle_auth_reply() is truly provided with a msg.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-27 13:26:04 +00:00
Radoslaw Zarzynski
a34dda1213 crimson/monc: rename Connection::reply to auth_reply.
Easier to distinguish from local variables with the same name
we have a few in `MonClient.cc`.

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-27 13:26:04 +00:00
Venky Shankar
9dcf6f7c8c
Merge pull request #40157 from leseb/do-not-fail-when-nosnap
mgr/pybind/snap_schedule: do not fail when no fs snapshots are available

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-04-27 18:51:57 +05:30
Nizamudeen A
23bdf201c4 mgr/dashboard: Host Maintenance Follow ups
Added the ability to create a host in maintenance mode

Fixes: https://tracker.ceph.com/issues/49998
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-04-27 16:11:20 +05:30
Ilya Dryomov
74202456e1
Merge pull request #41035 from ktdreyer/rbd-cache-err-spelling
librbd: fix spelling in immutable-object-cache conn error

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-27 11:37:33 +02:00
Ernesto Puerta
efda297428
Merge pull request #41037 from tchaikov/wip-npm-audit
mgr/dashboard: upgrade package-lock.json

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
2021-04-27 11:00:30 +02:00
Venky Shankar
8343471a0f
Merge pull request #40933 from vshankar/wip-50266
cephfs-mirror: sanitize `daemons status` JSON

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-04-27 12:22:37 +05:30
Kefu Chai
f0e1a16898
Merge pull request #41013 from tchaikov/wip-doc-mds-confval
doc/cephfs/mds-config-ref: render options using confval directive 

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-27 13:20:44 +08:00
Kefu Chai
5b7128bdf2
Merge pull request #41022 from tchaikov/wip-cmake-findpmem
cmake/modules/Findpmem: always set pmem_VERSION_STRING

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-04-27 13:19:32 +08:00
Kefu Chai
98afc9e0a2 mgr/dashboard: upgrade package-lock.json
diminish "npm run fix:audit" divergences

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-27 05:04:07 +00:00
Kefu Chai
7b5ab38ea4
Merge pull request #41010 from rzarzynski/wip-crimson-backtrace-fix-assert
crimson/common: fix broken assertion on FatalSignal setup.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-27 08:44:04 +08:00
Ken Dreyer
3041937fb5 librbd: fix spelling in immutable-object-cache conn error
Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2021-04-26 15:01:41 -06:00
zdover23
c6d1d0e031
Merge pull request #41030 from zdover23/wip-doc-adding-one-word-to-cephadm-nfs-2021-Apr-26
doc/cephadm: add a single word

Reviewed-by: Sage Weil <sweil@redhat.com>
2021-04-27 03:41:03 +10:00
Guillaume Abrioux
08223119b9
Merge pull request #38368 from rishabh-d-dave/cv-list-by-osd-id
ceph-volume: allow listing devices by OSD ID
2021-04-26 17:25:48 +02:00
Avan Thakkar
21318e8fa9 mgr/dashboard: fix HAProxy (now called ingress)
Fixes: https://tracker.ceph.com/issues/50319
Signed-off-by: Avan Thakkar <athakkar@redhat.com>

Support from Dashboard UI to create Ingress service type.
2021-04-26 20:21:26 +05:30
zdover23
d526c9c390
Merge pull request #40992 from zdover23/wip-doc-cephadm-osd-advanced-adding-a-word-2021-apr-22
doc/cephadm: adding "device" to a sentence

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-04-27 00:34:26 +10:00
Zac Dover
3af9fe3fd8 doc/cephadm: add a single word
s/If the nfs-ganesha doesn't/If the
nfs-ganesha pool doesn't/

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-04-27 00:32:21 +10:00
Kefu Chai
a1753f56bb
Merge pull request #40724 from rhcs-dashboard/upgrade-caniuse-lite
mgr/dashboard: upgrade Browserslist: caniuse-lite

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-26 22:26:58 +08:00
zdover23
284472939b
Merge pull request #41029 from zdover23/wip-doc-cephadm-nfs-service-corrections-2021-Apr-26
doc/cephadm: rewrite "nfs.rst"

Reviewed-by: Sage Weil <sweil@redhat.com>
2021-04-27 00:12:17 +10:00
Casey Bodley
a46f84d32e
Merge pull request #40594 from mkogan1/wip-rgw-multipart-complete
rgw: return OK on consecutive complete-multipart reqs

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-04-26 10:03:44 -04:00
Venky Shankar
b88228e936 test: tests for *at() libcephfs APIs
Fixes: http://tracker.ceph.com/issues/50298
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-04-26 09:14:27 -04:00
Venky Shankar
3ad4521187 test: cleanup files/dirs before finishing test
Other tests might use the same file names and expect libcephfs
calls to succeed.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-04-26 09:14:27 -04:00
Venky Shankar
8e8c4041ef client: non-at APIs call at-APIs with CEPHFS_AT_FDCWD as file descriptor
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-04-26 09:14:27 -04:00
Venky Shankar
3831aa12f3 libcephfs: introduce basic *at() calls
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-04-26 09:14:27 -04:00
Venky Shankar
52c672350f client: remove redundant caps_issued_mask() call in Client::fstatx()
No need to include this check since _getattr() checks this anyway.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-04-26 09:14:27 -04:00
Zac Dover
36426d6df5 doc/cephadm: rewrite "nfs.rst"
This PR makes a few (very small) stylistic
corrections, mostly typographical, to the text.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-04-26 23:04:04 +10:00
Kefu Chai
5249e5fe03 doc/dev/osd_internals/mclock_wpq_cmp_study: fix a typo
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 21:01:44 +08:00
Kefu Chai
19ccf3655f doc/cephfs/mds-config-ref: render options using confval directive
less repeating, better maintanability this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 21:01:44 +08:00
Kefu Chai
ecb8e5e9c7 doc/rados/operations/pools: define pool settings using "describe"
better readability and more structured this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 21:01:44 +08:00
Kefu Chai
4e27388ba7 doc/rados/configuration: reference options using :confval:
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 21:01:44 +08:00
Kefu Chai
ad85af2ef8 cmake/modules/Findpmem: always set pmem_VERSION_STRING
before this change, `pmem_VERSION_STRING` is not set if it is not able
to fulfill the specified version requirement. the intention was to check
if the version is able to satisfy the requirement. but actually, passing
an empty `pmem_VERSION_STRING` to `find_package_handle_standard_args()`
as the option of `VERSION_VAR` does not fail this check. on the
contrary, it prints

-- Found pmem: pmem_pmemobj_INCLUDE_DIR;pmem_pmem_INCLUDE_DIR (Required
is at least version "1.17")

if we requires pmem 1.17, while the found version is, for instance,
1.10.

if the required version is 1.7, and the found version is 1.10, the
output from cmake is:

-- Found pmem: pmem_pmemobj_INCLUDE_DIR;pmem_pmem_INCLUDE_DIR (found
suitable version "1.10", minimum required is "1.7")

in this change, the version spec is not specified when calling
`pkg_check_modules()`. so, `PKG_${component}_VERSION` is always set.
and we can always delegate the version checking to
`find_package_handle_standard_args()`. please note, we use the lower
version returned by pkg-config if multiple components are required and
both pkg-config settings return their versions.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 16:38:09 +08:00
Kefu Chai
ecb8d2cae2 ceph.spec.in: do not build with system pmdk by default
we need to use libpmem 1.10 in #40493.

without enabling the module stream offering libpmem 1.9.2, we can only
have access to libpmem 1.6.1. and fedora 33 only has libpmem 1.9
packaged. the same applies to openSUSE Tumbleweed and openSUSE Leap. so
let's stop using libpmem packaged by distro by default, until these
distros include libpmem 1.10.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 16:38:09 +08:00
Ernesto Puerta
813933f81e
Merge pull request #39929 from ceph/dependabot/npm_and_yarn/src/pybind/mgr/dashboard/frontend/elliptic-6.5.4
build(deps): bump elliptic from 6.5.3 to 6.5.4 in /src/pybind/mgr/dashboard/frontend

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-26 10:08:45 +02:00
Sébastien Han
bf115b49b9 mgr/pybind/snap_schedule: return valid json for 'status' command
The status should return a valid list, prior to this path the code was
only appending json blob next to each other resulting in an invalid
json. Now the blobs will be enclosed properly so a valid list is
returned.

Signed-off-by: Sébastien Han <seb@redhat.com>
2021-04-26 08:57:31 +02:00
Sébastien Han
74a7cdda6b mgr/pybind/snap_schedule: do not fail when no fs snapshot schedules are available
When listing for available snapshot schedules, we should not an error in case
there is none. We should just return 0 with an empty dict.

Fixes: https://tracker.ceph.com/issues/49837
Signed-off-by: Sébastien Han <seb@redhat.com>
2021-04-26 08:57:28 +02:00
Kefu Chai
55c02a81cf
Merge pull request #41015 from inspur-wyq/patch-doc
doc/radosgw/role.rst: fix typos

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-25 21:25:38 +08:00
Kefu Chai
b5cae0d744
Merge pull request #39605 from inspur-wyq/patch-1
doc/radosgw/cloud-sync-module: fix typos

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-25 20:15:47 +08:00
wangyunqing
066c065508 doc/radosgw/role.rst: fix typos
Signed-off-by: wangyunqing <wangyunqing@inspur.com>
2021-04-25 09:15:12 +00:00
Kefu Chai
d5b5a7fb6c
Merge pull request #41011 from tchaikov/wip-cephadm-test
mgr/cephadm: s/_hosts_with_daemon_inventory/_schedulable_hosts/

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
2021-04-25 10:06:21 +08:00
Kefu Chai
782fc0e7ca mgr/cephadm: s/_hosts_with_daemon_inventory/_schedulable_hosts/
`_hosts_with_daemon_inventory` was renamed to `_schedulable_hosts`
in f260c48f72 which was merged before
eebb842d04 got merged, hence the
regression.

this change just updates the test with the new method name.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-24 15:40:03 +08:00
Radoslaw Zarzynski
4ba84b85bb crimson/common: fix broken assertion on FatalSignal setup.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-24 07:14:28 +00:00
Kefu Chai
5dccba839b
Merge pull request #34109 from CongMinYin/optimizing-bluestore-lock
os/bluestore: Optimizing the lock of bluestore writing process

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-24 13:58:38 +08:00