Commit Graph

118333 Commits

Author SHA1 Message Date
Patrick Donnelly
cdabf0d507
.github: add MDSMonitor to cephfs label
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-06 10:59:41 -08:00
Kefu Chai
1897b8cf57
Merge pull request #38714 from tchaikov/wip-better-vstart
vstart: format the customized options in ceph.conf

Reviewed-by: luo rixin <luorixin@huawei.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-06 22:53:34 +08:00
Patrick Donnelly
06fff9aa82
Merge PR #38769 into master
* refs/pull/38769/head:
	doc/cephfs: add data pool-MDS instructions link

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-01-06 06:50:24 -08:00
Zac Dover
725d294218 doc/cephfs: add data pool-MDS instructions link
- This commit adds a link to the "Create a Ceph
File System" page. The link that it adds is to the
"Adding a data pool to the MDS" subsection of the
file layouts page.
- s/mds/file system/

Fixes: https://tracker.ceph.com/issues/48531
Signed-off-by: Zac Dover <zac.dover@gmail.com>
2021-01-06 15:52:24 +10:00
Kefu Chai
485ddccc35
Merge pull request #38713 from tchaikov/wip-ceph-annotations
ceph.in: return bytes as outbuf in error path, add type annotations

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-01-06 11:34:09 +08:00
Neha Ojha
6398ca5ab3
Merge pull request #38777 from neha-ojha/wip-cephadm-rbd
qa: allow the cephadm task to create an RBD pool and add workload to use it

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2021-01-05 16:31:37 -08:00
Neha Ojha
fcff116216 qa/suites/upgrade/octopus-x: add rados_loadgenbig workload
Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-01-05 21:36:04 +00:00
Neha Ojha
276a4fb8b0 qa/tasks/cephadm.py: create RBD pool
The ceph task already does this and a bunch of tests rely on this pool
being already present. Can be disabled by setting create_rbd_pool to False.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2021-01-05 21:32:41 +00:00
Patrick Donnelly
edd6d3ddcd
Merge PR #38742 into master
* refs/pull/38742/head:
	doc/cephfs/nfs: Add more details about path and pseudo path
	doc/cephfs/nfs: Add note about how to fetch port details with rook
	doc/cephfs/nfs: Add warning note about management of dashboard created exports

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-01-05 08:38:41 -08:00
Jason Dillaman
20141ed67b
Merge pull request #38735 from changchengx/pwl_load_existing_cache
librbd/cache/pwl: correct update previous_sync_point_entry

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-05 09:33:49 -05:00
Jason Dillaman
6b40dddb27
Merge pull request #38520 from lixiaoy1/wip-doc-pwl
doc: add RBD persistent write-back cache

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-05 09:12:20 -05:00
lixiaoy1
948e1e82e2 doc: add RBD persistent write-back cache
Signed-off-by: Li, Xiaoyan <xiaoyan.li@intel.com>
2021-01-05 09:37:30 -05:00
Varsha Rao
948ea79fb0 doc/cephfs/nfs: Add more details about path and pseudo path
Fixes: https://tracker.ceph.com/issues/48731
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-01-05 18:04:34 +05:30
Varsha Rao
e626e54b72 doc/cephfs/nfs: Add note about how to fetch port details with rook
Fixes: https://tracker.ceph.com/issues/48731
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-01-05 18:04:34 +05:30
Varsha Rao
8ccb57069a doc/cephfs/nfs: Add warning note about management of dashboard created exports
Fixes: https://tracker.ceph.com/issues/48731
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-01-05 18:04:34 +05:30
Jan Fajerski
2fa311a462 Merge PR #32776 into master
* refs/pull/32776/head:
	win32*.sh: fetch WNBD dependency
	win32*.sh: bump win32 boost dependency
	cmake: skip osd, Lua and neorados on Windows
	win32*.sh: improve lib handling
	win32*.sh: update openssl location
	win32*.sh: cleanup dependency build dir when targetting Windows
	win32*.sh: Strip binaries individually
	win32*.sh: Cleanup zip archive creation
	cmake,win32*.sh: Add OS=(ubuntu|suse) flag, for distro settings
	win32*.sh: Use nproc for CPU count when targeting win32
	test: Include compat.h to find uid_t/gid_t/gidlist when cross compiling
	win32*.sh: improve win32 dependency check
	win32*.sh: isolate network operations when building win32 dependencies
	cmake: drop Python dependency when targeting Windows
	win32*.sh: cleanup Windows build script
	win32*.sh: fix patch command
	win32*.sh: update Windows build scripts and readme

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-05 12:50:37 +01:00
Kefu Chai
02178b04d6
Merge pull request #38699 from rosinL/boost-paralllel
do_cmake: add a default value to BOOST_J

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-05 19:06:57 +08:00
zdover23
94e7c6f95a
Merge pull request #38745 from zdover23/wip-doc-jan-2021-dev-guide-basic-workflow-reorg
doc/dev: restructure basic-workflow.rst

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-01-05 18:34:19 +10:00
Kefu Chai
62bac2989d
Merge pull request #38749 from tchaikov/wip-cmake-check-nasm
cmake: only display the result of checking nasm once

Reviewed-by: Changcheng Liu <changcheng.liu@aliyun.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-01-05 10:32:48 +08:00
Patrick Donnelly
dc3bd41d42
Merge PR #38703 into master
* refs/pull/38703/head:
	test: move snap delete operation to non-root directory
	client: optionally check client permission on rmsnap()

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-04 09:49:00 -08:00
Kefu Chai
ab7cdde56b
Merge pull request #38758 from tchaikov/wip-crimson-cleanup
crimson/os: do not let omap_get_values() return input_output_error

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2021-01-05 01:39:14 +08:00
Kefu Chai
dd9f4a9345
Merge pull request #38757 from rosinL/wip-remove-unused-options
common/options: remove ununsed options

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-04 23:32:18 +08:00
Kefu Chai
889a6b451c crimson/os: do not let omap_get_values() return input_output_error
BlueStore only returns 0 or -ENOENT. so no need to handle the cases
where the return value is neither of them.

but Seastore might return EIO, so keep the interface unchanged.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-04 23:28:15 +08:00
ofriedma
6b9b228861
Merge pull request #38616 from ofriedma/wip-ofriedma-dist-cache
rgw: distribute cache for exclusive put
2021-01-04 17:11:37 +02:00
Kefu Chai
d39c1794a5
Merge pull request #38663 from tchaikov/wip-crimson-recovery-cleanups
crimson/osd: fixes and cleanups

Reviewed-by: Xuehan Xu <xxhdx1985126@gmail.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2021-01-04 22:54:10 +08:00
luo rixin
a5f9ca1571 common/options: remove ununsed options
Signed-off-by: luo rixin <luorixin@huawei.com>
2021-01-04 20:40:54 +08:00
Kefu Chai
a51f8f2612
Merge pull request #38676 from ronen-fr/wip-48690
qa/standalone/scrub/osd-scrub-snaps.sh: fix Python print syntax

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-04 19:04:45 +08:00
Nathan Cutler
ea851e71fd
Merge pull request #38603 from smithfarm/wip-48604
rpm: require smartmontools on SUSE

Reviewed-by: Volker Theile <vtheile@suse.com>
2021-01-04 10:58:54 +01:00
Kefu Chai
362ccec7a6 vstart: format the customized options in ceph.conf
better formatted in ceph.conf, no extra spaces and tabs anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-04 15:02:00 +08:00
Kefu Chai
d72c9205dc cmake: only display the result of checking nasm once
if nasm is able to emit AVX512 instructions, we can assume that it's
able to generate AVX2 instructions as well. so no need to print "Found
nasm" multiple times.

and by chaining mutual exclusive branches with "elseif", we can have
better readability.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-04 01:34:46 +08:00
Kefu Chai
de78439775 cmake: drop duplicated variable
not_arch_x32 replicates ${_support_x64}. and a variable starts with
"not" is just difficult to parse. so drop it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-04 01:34:46 +08:00
Mykola Golub
5fbae26e9e
Merge pull request #38694 from dillaman/wip-migration-import
librbd/migration: tweaks and initial set of documentation

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-01-03 11:07:20 +02:00
Jason Dillaman
c2bf642ecf doc/rbd: incorporate external data source support for live-migration
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-01-02 09:26:54 -05:00
Jason Dillaman
7044a9d6ff librbd/migration: fixed missing return statements on stream error path
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-01-02 09:26:54 -05:00
Jason Dillaman
0c51b58f67 librbd/migration: optionally pull S3 keys from MON config store
This allows the S3 keys to be better protected since the MON can
be configured to restrict access to keys by user and the results
can be encrypted in transit.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-01-02 09:26:54 -05:00
Jason Dillaman
9eb47021b8 librbd: helper utility to retrieve config from the MON config store
A special "config://" URI prefix can be used to denote configuration
settings that should be (securely) pulled from the MON config store.
This will be first used in a follow-up commit to support storing
the S3 access and secret keys in the MON config store.

This "config://" syntax is already in-use by RGW and ceph-iscsi for
pulling secrets when deployed via cephadm.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-01-02 09:26:54 -05:00
Jason Dillaman
d22ca3d978 librbd/migration: require snapshot when importing from native source
Since we cannot mark the source image read-only when running in import-only
migration mode, we should require the user to provide a snapshot to ensure
that data cannot change while the migration is running.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2021-01-02 09:26:53 -05:00
Kefu Chai
df2d50925e ceph.in: remove unused indent
no need to put `if True`. it was used when removing unused variables.
but it'd be better to have less indent for better readability.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:46 +08:00
Kefu Chai
3d777c93ee ceph.in: do not apply rados.cstr() to a bytes
since the parameter is already a bytes instance, there is no need to encode it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:46 +08:00
Kefu Chai
f99bd29363 pybind/rados: correct annotation of {mon,pg,osd}_command
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:46 +08:00
Kefu Chai
5b651e6142 pybind/ceph_argparse: no need to import print()
we are already in a python3 world.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:45 +08:00
Kefu Chai
b90791e2c2 pybind/ceph_argparse: PEP8 related cleanups
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:45 +08:00
Kefu Chai
ea18b69e36 ceph.in: return bytes as outbuf in error path
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:45 +08:00
Kefu Chai
9220af325f ceph.in,ceph_argparse: add type annotations
Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-01 20:37:45 +08:00
Kefu Chai
d2d1c23a51
Merge pull request #30027 from majianpeng/optimize-mutex-contention
os/bluestore: optimize mutex contention

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2021-01-01 12:12:43 +08:00
Kefu Chai
bd0553730b
Merge pull request #36088 from rhcs-dashboard/fix-45822-master
mgr/dashboard:minimize console log traces of Ceph backend API test

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-01-01 12:10:25 +08:00
Kefu Chai
a6e87d3142
Merge pull request #38651 from ifed01/wip-ifed-new-omap-naming
os/bluestore: introduce new "per-pg" naming scheme for omap

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-01-01 12:06:39 +08:00
Kefu Chai
7ddcbcc970
Merge pull request #38680 from ifed01/wip-ifed-rocksdb-options-annex
os/bluestore: introduce bluestore_rocksdb_options_annex config parame…

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-01-01 12:01:55 +08:00
Jason Dillaman
73f6326272
Merge pull request #38738 from ronen-fr/wip-ronenf-rawformat
librbd/migration: removing an unused capture

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2020-12-31 08:00:37 -05:00
Kefu Chai
85d686ce77
Merge pull request #38709 from wuhongsong/aios_be_truncated
blk: add upper bound of bluestore_deferred_batch_ops* options

Reviewed-by: Kefu Chai <kchai@redhat.com>
2020-12-31 19:41:37 +08:00