Commit Graph

122672 Commits

Author SHA1 Message Date
Patrick Donnelly
d65632289c
Merge PR #40903 into master
* refs/pull/40903/head:
	test: add test case for MDS privated inos accessing
	mds: make the lost+found dir accessible from clients
	mds: move the inos 1,2 and 3 macros to ceph_fs.h

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-03 17:37:34 -07:00
Patrick Donnelly
878d38bcfe
Merge PR #40882 into master
* refs/pull/40882/head:
	client: Fix executeable access check for the root user

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-05-03 17:35:24 -07:00
Patrick Donnelly
35dabfe69f
Merge PR #41120 into master
* refs/pull/41120/head:
	doc/_ext: ignore desc if it is unavailable
	doc/_ext: check "default" for None
	doc/_ext: print 0B if option value is 0
	doc/cephfs: render options using confval directive

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-03 14:51:55 -07:00
Casey Bodley
afaed75012
Merge pull request #41102 from soumyakoduri/set_acl_fix
rgw/acl: set_acl shouldn't overwrite bucket attrs

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2021-05-03 14:27:58 -04:00
Ilya Dryomov
5f12e85d91
Merge pull request #41093 from idryomov/wip-rbd-pwl-ssd-boundary
librbd/cache/pwl/ssd/WriteLog: don't crash on split log entries

Reviewed-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
2021-05-03 15:27:18 +02:00
Sage Weil
94acfd5ada Merge PR #41105 into master
* refs/pull/41105/head:
	qa/workunits/cephadm/test_cephadm: test zap-osds
	cephadm: add --zap-osds argument to rm_cluster
	cephadm: implement zap-osds --fsid ... command

Reviewed-by: Juan Miguel Olmo <jolmomar@redhat.com>
2021-05-03 08:28:15 -04:00
Ilya Dryomov
155ee28d98 librbd/cache/pwl/ssd/WriteLog: don't crash on split log entries
write_log_entries() will split a log entry at the end of the log, the
remainder is written to the beginning at DATA_RING_BUFFER_OFFSET.  On
the read side aio_read_data_block() doesn't handle this case and just
crashes.  Unless the workload in use is <= 4K, the image is rendered
unusable sooner or later.

Fixes: https://tracker.ceph.com/issues/50589
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-05-03 14:05:58 +02:00
Ilya Dryomov
7f17f21857
Merge pull request #41068 from idryomov/wip-rbd-pwl-ssd-capacity
librbd/cache/pwl/ssd/WriteLog: decrement m_bytes_allocated when retiring

Reviewed-by: Mahati Chamarthy <mahati.chamarthy@intel.com>
2021-05-03 14:00:48 +02:00
Ilya Dryomov
c804989a32
Merge pull request #41042 from tchaikov/wip-rbd-cls-sparse-size
librbd: 32-bit and libc++ portability fixups

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2021-05-02 23:31:06 +02:00
Soumya Koduri
f61227e472 rgw/acl: set_acl shouldn't overwrite bucket attrs
Signed-off-by: Soumya Koduri <skoduri@redhat.com>
2021-05-02 22:49:55 +05:30
Kefu Chai
659d01dcb5 doc/_ext: ignore desc if it is unavailable
there is chance that we don't have desc, desc_long or fmt_desc, in that
case, we should just skip desc before checking its length. so, just use
'if desc' which is able to check for None or empty string.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 19:57:29 +08:00
Kefu Chai
ab7cb630ae doc/_ext: check "default" for None
default could be None and we don't reference the default value using
`opt.default`, so this variable is always defined. to avoid printing
a None default value, check for a None value. see
https://jinja.palletsprojects.com/en/2.11.x/templates/#none

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 18:17:02 +08:00
Kefu Chai
d1aacf555e doc/_ext: print 0B if option value is 0
before this change, the rendered Default is "0Ei" if the default size is 0,
would be more readable if it is "0B" or "0".

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 17:50:38 +08:00
Kefu Chai
79e8c4f9e8 doc/cephfs: render options using confval directive
less repeating, better maintainability this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-02 17:48:31 +08:00
Mykola Golub
f0bd648992
Merge pull request #41085 from idryomov/wip-rbd-nuke-source-spec-file
rbd: --source-spec-file should be --source-spec-path

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-05-02 12:11:10 +03:00
Kefu Chai
5093c6f36e
Merge pull request #41116 from tchaikov/wip-in_addr_t
common/pick_address: define in_addr_t if it is not defined

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-05-02 08:09:03 +08:00
Kefu Chai
7e6a653dea
Merge pull request #41117 from tchaikov/wip-doc-cephfs-conf
doc/cephfs/mds-config-ref: remove duplicated confval

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-01 23:34:11 +08:00
Kefu Chai
a06f8edeca common/pick_address: define in_addr_t if it is not defined
neither mingw not not have in_addr_t defined, see
https://docs.microsoft.com/en-us/windows/win32/api/winsock2/ns-winsock2-in_addr,
so define it if it is not defined.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-01 23:30:53 +08:00
Kefu Chai
92ca8bbe38 doc/cephfs/mds-config-ref: remove duplicated confval
this change addresses the warning of:

/home/jenkins-build/build/workspace/ceph-pr-docs/doc/cephfs/mds-config-ref.rst:2: WARNING: duplicate confval_option description of mds_cache_memory_limit, other instance in cephfs/cache-configuration
/home/jenkins-build/build/workspace/ceph-pr-docs/doc/cephfs/mds-config-ref.rst:2: WARNING: duplicate confval_option description of mds_cache_reservation, other instance in cephfs/cache-configuration

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-05-01 23:05:37 +08:00
Kefu Chai
960b6e034d
Merge pull request #41043 from ifed01/wip-ifed-fix-use-ratio
osd: compute OSD's space usage ratio via raw space utilization

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-05-01 12:59:41 +08:00
Patrick Donnelly
b9c7d52987
Merge PR #41012 into master
* refs/pull/41012/head:
	doc/cephfs/cache-config: use config item macros

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-30 21:03:17 -07:00
Kefu Chai
2fb01d3f62
Merge pull request #40961 from tchaikov/wip-50456
common/pick_address: filter out loopback addresses

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-05-01 09:11:30 +08:00
Kefu Chai
8ba7087585
Merge pull request #41071 from tchaikov/wip-cmake-disable-vta
cmake: disable "variable tracking" when building rados python binding

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-05-01 09:09:05 +08:00
Patrick Donnelly
325bebc021
Merge PR #41091 into master
* refs/pull/41091/head:
	doc/cephfs/nfs: add section about ganesha logs
	doc/cephfs/nfs: Replace volume/nfs with nfs
	doc/cephfs/nfs: add note about export management with volume/nfs interface only

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-30 17:15:55 -07:00
Sridhar Seshasayee
0ad2b2c8ee
Merge pull request #41004 from sseshasa/wip-mclock-max-backfill-misc-fix
osd: Override recovery, backfill and sleep related config options during OSD and mclock scheduler initialization.

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sunny Kumar <sunkumar@redhat.com>
2021-04-30 22:58:21 +05:30
Sage Weil
4b4f4ad7bf qa/workunits/cephadm/test_cephadm: test zap-osds
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-30 10:16:16 -04:00
Sage Weil
14c95b54fb cephadm: add --zap-osds argument to rm_cluster
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-30 10:13:55 -04:00
Sage Weil
a6a20bafc4 cephadm: implement zap-osds --fsid ... command
Signed-off-by: Sage Weil <sage@newdream.net>
2021-04-30 10:13:55 -04:00
Daniel Gryniewicz
6110c687a6
Merge pull request #40967 from dang/wip-dang-zipper-user
RGW Zipper consistent load/store APIs for User
2021-04-30 10:03:58 -04:00
Kefu Chai
29a613bfe2
Merge pull request #40946 from ifed01/wip-ifed-dump-pool-statfs
osd: admin cmd to dump pools statfs for a specific OSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-04-30 19:43:18 +08:00
Kefu Chai
fee3028abc
Merge pull request #41014 from smithfarm/wip-mempool-cacheline-49781
qa: verify the benefits of mempool cacheline optimization

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-04-30 19:36:17 +08:00
Samuel Just
964acc6dd9
Merge pull request #40998 from cyx1231st/wip-seastore-onode-tree-delete
crimson/onode-staged-tree: implement/validate features to erase values from tree

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-04-29 23:22:42 -07:00
Varsha Rao
6ff3c1da87 doc/cephfs/nfs: add section about ganesha logs
Fixes: https://tracker.ceph.com/issues/50008
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-04-30 11:16:48 +05:30
Varsha Rao
ff11cdb4bc doc/cephfs/nfs: Replace volume/nfs with nfs
Recently, nfs related code was moved out of volumes plugin[1]. So using the
name volume/nfs for the interface is not appropriate.

[1] https://github.com/ceph/ceph/pull/40526

Signed-off-by: Varsha Rao <varao@redhat.com>
2021-04-30 11:09:23 +05:30
Varsha Rao
923e689e08 doc/cephfs/nfs: add note about export management with volume/nfs interface only
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-04-30 11:09:23 +05:30
Loïc Dachary
7fe0ac7c11 qa: verify the benefits of mempool cacheline optimization
There already is a test to verify the mempool sharding works, in the sense that
it uses at least half of the variables available to count the number of
allocated objects and their total size. This new test verifies that, with
sharding, object counting is at least twice faster than without sharding. It
also collects cacheline contention data with the perf c2c tool. The manual
analysis of this data shows the optimization gain is indeed related to cacheline
contention.

Fixes: https://tracker.ceph.com/issues/49896

Signed-off-by: Loïc Dachary <loic@dachary.org>
2021-04-30 12:11:13 +08:00
Ilya Dryomov
2a974fd0c1 librbd/cache/pwl: include head and tail pointers in STATS
While at it, reduce the number of calls to operator<< and drop
the trailing comma.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-29 22:09:16 +02:00
Ilya Dryomov
626a995cf6 librbd/cache/pwl: bump "Waiting for allocation" and "Retiring" dout level
Bump "Waiting for allocation" to 5.

"Retiring" is at 20 for rwl and 1 for ssd.  Bump the latter to 20 as
well.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-29 22:09:16 +02:00
Ilya Dryomov
27dd7f85ae librbd/cache/pwl: use m_bytes_allocated_cap for both rwl and ssd
Follow rwl mode and use AbstractWriteLog::m_bytes_allocated_cap
instead of m_log_pool_ring_buffer_size specific to ssd.  This fixes
"bytes available" calculation in STATS output.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-29 22:09:16 +02:00
Ilya Dryomov
e2bbf4167f librbd/cache/pwl/ssd/WriteLog: decrement m_bytes_allocated when retiring
Currently if ssd cache is filled to capacity, all future I/O hangs
indefinitely because even though the cache eventually becomes clean
and retires enough entries to get back under RETIRE_HIGH_WATER, this
isn't communicated to AbstractWriteLog::check_allocation().

Fixes: https://tracker.ceph.com/issues/50560
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-29 22:09:16 +02:00
Ilya Dryomov
5b89c47ec5 librbd/cache/pwl/ssd/WriteLog: fix free()/delete mismatch
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-29 22:09:16 +02:00
Ilya Dryomov
a40676c513 librbd/cache/pwl/ssd/WriteLog: fix indentation
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-29 22:09:16 +02:00
zdover23
462c121653
Merge pull request #40502 from zdover23/wip-doc-podman-version-octopus-note-2021-30-Mar
doc/cephadm: add podman version note to install

Reviewed-by: Sebastian Wagner <sewagner@redhat.com>
2021-04-30 05:53:58 +10:00
Ernesto Puerta
381685f17f
Merge pull request #40072 from wornet-mwo/dashboard--grafana-hostname-corrections
mgr/dashboard: Fixed name clash when hostname similar to another

Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: p-se <NOT@FOUND>
2021-04-29 19:40:57 +02:00
Daniel Gryniewicz
f330b50f7a RGW Zipper - Permenant User storage API
The load/store/remove APIs for User are needed, so make them consistent
and permenant.

Signed-off-by: Daniel Gryniewicz <dang@redhat.com>
2021-04-29 12:56:35 -04:00
Kefu Chai
9e3aa76f4a
Merge pull request #41040 from tchaikov/wip-doc-mds-conf
doc/cephfs/mds-config-ref: render options using confval directive

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-30 00:33:41 +08:00
Ilya Dryomov
d12e7f458b rbd: --source-spec-file should be --source-spec-path
It was renamed during development, get rid of the leftovers.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-04-29 18:10:54 +02:00
Mark Kogan
48ce5bb6c3
Merge pull request #41028 from mkogan1/wip-rgw-tracker-50467
rgw: fix segfault related to explicit object manifest handling
2021-04-29 18:48:54 +03:00
Ernesto Puerta
b0c0815e9d
Merge pull request #41083 from rhcs-dashboard/fix-50580-master
mgr/dashboard: OSDs placement text is unreadable

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2021-04-29 17:42:38 +02:00
Kefu Chai
a64b623537
Merge pull request #41082 from tchaikov/wip-50558
os/bluestore: Revert" Optimizing the lock of bluestore writing process"

Reviewed-by: Mark Nelson <mnelson@redhat.com>
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2021-04-29 22:59:02 +08:00