Commit Graph

122490 Commits

Author SHA1 Message Date
Venky Shankar
8343471a0f
Merge pull request #40933 from vshankar/wip-50266
cephfs-mirror: sanitize `daemons status` JSON

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-04-27 12:22:37 +05:30
Kefu Chai
f0e1a16898
Merge pull request #41013 from tchaikov/wip-doc-mds-confval
doc/cephfs/mds-config-ref: render options using confval directive 

Reviewed-by: Sridhar Seshasayee <sseshasa@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-27 13:20:44 +08:00
Kefu Chai
5b7128bdf2
Merge pull request #41022 from tchaikov/wip-cmake-findpmem
cmake/modules/Findpmem: always set pmem_VERSION_STRING

Reviewed-by: Yingxin Cheng <yingxin.cheng@intel.com>
2021-04-27 13:19:32 +08:00
Kefu Chai
7b5ab38ea4
Merge pull request #41010 from rzarzynski/wip-crimson-backtrace-fix-assert
crimson/common: fix broken assertion on FatalSignal setup.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-27 08:44:04 +08:00
zdover23
c6d1d0e031
Merge pull request #41030 from zdover23/wip-doc-adding-one-word-to-cephadm-nfs-2021-Apr-26
doc/cephadm: add a single word

Reviewed-by: Sage Weil <sweil@redhat.com>
2021-04-27 03:41:03 +10:00
Guillaume Abrioux
08223119b9
Merge pull request #38368 from rishabh-d-dave/cv-list-by-osd-id
ceph-volume: allow listing devices by OSD ID
2021-04-26 17:25:48 +02:00
zdover23
d526c9c390
Merge pull request #40992 from zdover23/wip-doc-cephadm-osd-advanced-adding-a-word-2021-apr-22
doc/cephadm: adding "device" to a sentence

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-04-27 00:34:26 +10:00
Zac Dover
3af9fe3fd8 doc/cephadm: add a single word
s/If the nfs-ganesha doesn't/If the
nfs-ganesha pool doesn't/

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-04-27 00:32:21 +10:00
Kefu Chai
a1753f56bb
Merge pull request #40724 from rhcs-dashboard/upgrade-caniuse-lite
mgr/dashboard: upgrade Browserslist: caniuse-lite

Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-26 22:26:58 +08:00
zdover23
284472939b
Merge pull request #41029 from zdover23/wip-doc-cephadm-nfs-service-corrections-2021-Apr-26
doc/cephadm: rewrite "nfs.rst"

Reviewed-by: Sage Weil <sweil@redhat.com>
2021-04-27 00:12:17 +10:00
Casey Bodley
a46f84d32e
Merge pull request #40594 from mkogan1/wip-rgw-multipart-complete
rgw: return OK on consecutive complete-multipart reqs

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-04-26 10:03:44 -04:00
Zac Dover
36426d6df5 doc/cephadm: rewrite "nfs.rst"
This PR makes a few (very small) stylistic
corrections, mostly typographical, to the text.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-04-26 23:04:04 +10:00
Kefu Chai
5249e5fe03 doc/dev/osd_internals/mclock_wpq_cmp_study: fix a typo
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 21:01:44 +08:00
Kefu Chai
19ccf3655f doc/cephfs/mds-config-ref: render options using confval directive
less repeating, better maintanability this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 21:01:44 +08:00
Kefu Chai
ecb8e5e9c7 doc/rados/operations/pools: define pool settings using "describe"
better readability and more structured this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 21:01:44 +08:00
Kefu Chai
4e27388ba7 doc/rados/configuration: reference options using :confval:
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 21:01:44 +08:00
Kefu Chai
ad85af2ef8 cmake/modules/Findpmem: always set pmem_VERSION_STRING
before this change, `pmem_VERSION_STRING` is not set if it is not able
to fulfill the specified version requirement. the intention was to check
if the version is able to satisfy the requirement. but actually, passing
an empty `pmem_VERSION_STRING` to `find_package_handle_standard_args()`
as the option of `VERSION_VAR` does not fail this check. on the
contrary, it prints

-- Found pmem: pmem_pmemobj_INCLUDE_DIR;pmem_pmem_INCLUDE_DIR (Required
is at least version "1.17")

if we requires pmem 1.17, while the found version is, for instance,
1.10.

if the required version is 1.7, and the found version is 1.10, the
output from cmake is:

-- Found pmem: pmem_pmemobj_INCLUDE_DIR;pmem_pmem_INCLUDE_DIR (found
suitable version "1.10", minimum required is "1.7")

in this change, the version spec is not specified when calling
`pkg_check_modules()`. so, `PKG_${component}_VERSION` is always set.
and we can always delegate the version checking to
`find_package_handle_standard_args()`. please note, we use the lower
version returned by pkg-config if multiple components are required and
both pkg-config settings return their versions.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 16:38:09 +08:00
Kefu Chai
ecb8d2cae2 ceph.spec.in: do not build with system pmdk by default
we need to use libpmem 1.10 in #40493.

without enabling the module stream offering libpmem 1.9.2, we can only
have access to libpmem 1.6.1. and fedora 33 only has libpmem 1.9
packaged. the same applies to openSUSE Tumbleweed and openSUSE Leap. so
let's stop using libpmem packaged by distro by default, until these
distros include libpmem 1.10.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-26 16:38:09 +08:00
Ernesto Puerta
813933f81e
Merge pull request #39929 from ceph/dependabot/npm_and_yarn/src/pybind/mgr/dashboard/frontend/elliptic-6.5.4
build(deps): bump elliptic from 6.5.3 to 6.5.4 in /src/pybind/mgr/dashboard/frontend

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-26 10:08:45 +02:00
Kefu Chai
55c02a81cf
Merge pull request #41015 from inspur-wyq/patch-doc
doc/radosgw/role.rst: fix typos

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-25 21:25:38 +08:00
Kefu Chai
b5cae0d744
Merge pull request #39605 from inspur-wyq/patch-1
doc/radosgw/cloud-sync-module: fix typos

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-25 20:15:47 +08:00
wangyunqing
066c065508 doc/radosgw/role.rst: fix typos
Signed-off-by: wangyunqing <wangyunqing@inspur.com>
2021-04-25 09:15:12 +00:00
Kefu Chai
d5b5a7fb6c
Merge pull request #41011 from tchaikov/wip-cephadm-test
mgr/cephadm: s/_hosts_with_daemon_inventory/_schedulable_hosts/

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Adam King <adking@redhat.com>
2021-04-25 10:06:21 +08:00
Kefu Chai
782fc0e7ca mgr/cephadm: s/_hosts_with_daemon_inventory/_schedulable_hosts/
`_hosts_with_daemon_inventory` was renamed to `_schedulable_hosts`
in f260c48f72 which was merged before
eebb842d04 got merged, hence the
regression.

this change just updates the test with the new method name.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-04-24 15:40:03 +08:00
Radoslaw Zarzynski
4ba84b85bb crimson/common: fix broken assertion on FatalSignal setup.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-24 07:14:28 +00:00
Kefu Chai
5dccba839b
Merge pull request #34109 from CongMinYin/optimizing-bluestore-lock
os/bluestore: Optimizing the lock of bluestore writing process

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-24 13:58:38 +08:00
Kefu Chai
9598175a58
Merge pull request #40863 from adk3798/maint-fix
mgr/cephadm: don't remove daemons on hosts in maintenance or offline mode

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2021-04-24 13:54:07 +08:00
Kefu Chai
9827ee5d5e
Merge pull request #38641 from agayev/zoned-cleaner
os/bluestore: Some more plumbing for zone cleaning (WIP)

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2021-04-24 13:53:50 +08:00
Kefu Chai
b30d0b8ab5
Merge pull request #40978 from idryomov/wip-reset-authenticate-err
mon/MonClient: reset authenticate_err in _reopen_session()

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2021-04-24 13:51:17 +08:00
Yuri Weinstein
2771cb0887
Merge pull request #41006 from yuriw/wip-yuriw-simlinks-master
qa/tests: changed simlink to upgrade/parallel only

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-04-23 09:49:07 -07:00
Neha Ojha
edcf29b934
Merge pull request #40994 from neha-ojha/wip-50388
qa/suites/upgrade/pacific-x/rgw-multisite: fix install version

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-04-23 09:36:06 -07:00
Yuri Weinstein
b6c84d5621 qa/tests: changed simlink to upgrade/parallel only
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-04-23 08:20:01 -07:00
Kefu Chai
8656e56d6f
Merge pull request #40986 from rhcs-dashboard/50484-update-run-api-tests
mgr/dashboard: set required env. variables in run-backend-api-tests.sh

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-23 20:14:32 +08:00
Kefu Chai
9cd823a81c
Merge pull request #40664 from xxhdx1985126/wip-seastar-missing-apis
crimson/os/seastore: add set/get attrs and write/read meta methods for seastore

Reviewed-by: Chunmei Liu <chunmei.liu@intel.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-23 14:31:16 +08:00
Kefu Chai
d1fdae6d73
Merge pull request #40991 from rzarzynski/wip-crimson-backtrace-si_addr
crimson/common: print the address that caused the fault on SIGSEGV.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-23 12:57:16 +08:00
Xuehan Xu
e403e0e3e8 crimson/os/seastore: limit the max size of objects' ns and oid
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-04-23 11:33:00 +08:00
Xuehan Xu
e936bcdfc3 test/crimson/seastore: add set/get attrs test
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-04-23 11:33:00 +08:00
Xuehan Xu
f85c424842 test/crimson/seastore: add write/read_meta tests
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-04-23 11:33:00 +08:00
Xuehan Xu
85a180a765 crimson/os/seastore: add write/read_meta methods for seastore
Signed-off-by: Xuehan Xu <xxhdx1985126@gmail.com>
2021-04-23 11:32:57 +08:00
Neha Ojha
839ce6de15 qa/suites/upgrade/pacific-x/rgw-multisite: fix install version
Before:

2021-04-22T06:20:58.260 INFO:teuthology.task.install:Ceph rpm upgrade from
16.2.1-103.gb54cefd0.el8 to 16.2.1-103.gb54cefd0

After:

2021-04-22T21:08:16.565 INFO:teuthology.task.install:Ceph rpm upgrade from
16.2.1-105.g540c2494.el8 to 17.0.0-3515.ga5b16446

Fixes: https://tracker.ceph.com/issues/50388
Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-04-22 22:33:28 +00:00
Zac Dover
72445fb724 doc/cephadm: adding "device" to a sentence
This tiny PR fixes an issue that I thought
I had squashed into PR#40914: a missing
word, "device", which was caught by Josh
Durgin during review.

Alas. I had not then caught it.

Here then it is, corrected at last.

Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-04-23 03:36:59 +10:00
Mark Kogan
324c377849 rgw: return OK on consecutive complete-multipart reqs
Fixes: https://tracker.ceph.com/issues/50141

Signed-off-by: Mark Kogan <mkogan@redhat.com>

fixup! rgw: return OK on consecutive complete-multipart reqs
2021-04-22 20:33:38 +03:00
Radoslaw Zarzynski
324661c684 crimson/common: print the address that caused the fault on SIGSEGV.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-22 16:49:08 +00:00
Patrick Donnelly
a4d3377ff4
Merge PR #40526 into master
* refs/pull/40526/head:
	spec: add nfs to spec file
	mgr/nfs: Don't enable nfs module by default
	mgr/nfs: check for invalid chars in cluster id
	mgr/nfs: Use CLICommand wrapper
	mgr/nfs: reorg nfs files
	mgr/nfs: Check if transport or protocol are list instance
	mgr/nfs: reorg cluster class and common helper methods
	mgr/nfs: move common export helper methods to ExportMgr class
	mgr/nfs: move validate methods into new ValidateExport class
	mgr/nfs: add custom exception module
	mgr/nfs: create new module for export utils
	mgr/nfs: rename fs dir to export
	mgr/volumes/nfs: Move nfs code out of volumes plugin

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-22 09:20:59 -07:00
Ilya Dryomov
8c9de31c98 mon/MonClient: reset authenticate_err in _reopen_session()
Otherwise, if "mon host" list has at least one unqualified IP address
without a port and both msgr1 and msgr2 are turned on, there is a race
affecting MonClient::authenticate().

For backwards compatibility reasons such an address is expanded into
two entries, each being treated as a separate monitor.  For example,
"mon host = 1.2.3.4" generates the following initial monmap:

  0: v1:1.2.3.4:6789/0
  1: v2:1.2.3.4:3300/0

See MonMap::_add_ambiguous_addr() for details.

Then, the following can happen:

1. we connect to both endpoints and attempt to authenticate
2. authenticate() sets authenticate_err to 1 and sleeps on auth_cond
3. msgr1 authenticates first (i.e. it gets the final MAuth message
   before msgr2 gets the monmap)
4. active_con is set to msgr1 connection, msgr2 connection is closed
   as redundant
5. _finish_auth() sets authenticate_err to 0 and signals auth_cond,
   but before either the monmap is received or authenticate() wakes
   up, msgr1 connection is closed due to a network hiccup
6. ms_handle_reset() calls _reopen_session() which clears active_con
   and again connects to both endpoints and attempts to authenticate
7. authenticate() wakes up, sees that there is no active_con and goes
   back to sleep, but this time with authenticate_err == 0
8. msgr2 authenticates first but doesn't call _finish_auth() because
   it is called only if authenticate_err == 1
9. active_con is set to msgr2 connection, msgr1 connection is closed
   as redundant
10. authenticate() hangs on auth_cond until timeout defaulting to 5
    minutes

The discrepancy between msgr1 and msgr2 plays a key role.  For msgr1,
authentication is considered to be complete as soon as the final MAuth
message is received -- the monmap is not waited for.  For msgr2,
authentication is considered to be complete only after the monmap is
received.

Avoid the race by setting authenticate_err to 1 in _reopen_session(),
so that _finish_auth() is called on/after every authentication attempt
instead of just the first one.

Fixes: https://tracker.ceph.com/issues/50477
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-22 18:16:09 +02:00
Radoslaw Zarzynski
7ed8dbddc9 crimson/common: fix the messed labels for backtrace printing.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-22 15:57:24 +00:00
Radoslaw Zarzynski
ea628dbac1 crimson/common: rename print_with_backtrace in fatal_signal.cc.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-22 15:53:26 +00:00
Ernesto Puerta
cc24e0acd1
Merge pull request #40940 from rhcs-dashboard/50440-fix-nfs-duplicated-rows
mgr/dashboard: fix duplicated rows when creating NFS export.

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Varsha Rao <varao@redhat.com>
2021-04-22 17:27:55 +02:00
Radoslaw Zarzynski
0608ab8874 crimson/common: drop a non-existing method from the FatalSignal's declaration.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-04-22 15:19:10 +00:00
Alfonso Martínez
f0ded7b006 mgr/dashboard: set required env. variables in run-backend-api-tests.sh
Fixes: https://tracker.ceph.com/issues/50484
Signed-off-by: Alfonso Martínez <almartin@redhat.com>
2021-04-22 17:02:27 +02:00