Commit Graph

118457 Commits

Author SHA1 Message Date
Venky Shankar
d5062c60f6 spec, deb: package cephfs-top utility
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-01-11 06:15:53 -05:00
Venky Shankar
4867fc1cd1 cephfs-top: top(1) like utility for Ceph Filesystem
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-01-11 06:15:53 -05:00
Venky Shankar
74309430b4 mgr/stats: include kernel version (for kclients) in perf stats command output
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-01-11 06:15:53 -05:00
Venky Shankar
9a862d0cda mgr/stats: include version with perf stats output
So that `fstop` infers the version of mgr/stats to parse the
JSON command output.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-01-11 06:15:53 -05:00
Sebastian Wagner
2cd46a141c
Merge pull request #38804 from sebastian-philipp/cephadm-silence-evict-container
cephadm: silence "Failed to evict container" log msg

Reviewed-by: Adam King <adking@redhat.com>
2021-01-11 12:03:29 +01:00
Sebastian Wagner
8d80817c74
Merge pull request #38615 from adk3798/haproxy-stuff
mgr/cephadm: HA for RGW endpoints

Reviewed-by: Daniel-Pivonka <dpivonka@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-01-11 12:02:25 +01:00
Kefu Chai
340a437626
Merge pull request #38543 from zjcmszh/cmpext_op
pybind/rados: add WriteOp::cmpext() and ReadOp::cmpext()

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-11 18:26:45 +08:00
Gregory Farnum
6e67a985b2
Merge pull request #38531 from gregsfortytwo/wip-stretch-updates
More stretch updates for overly-aggressive safety checks that broke clients

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-01-10 22:06:22 -08:00
Kefu Chai
3d4ba3d924
Merge pull request #38701 from rosinL/fix-memory-over-use
commom/buffer: use small page aligned when bufferlist prealloc memory

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-10 19:58:03 +08:00
Kefu Chai
dbd54dacc3
Merge pull request #38747 from tchaikov/wip-scrub-event
osd/scrub_machine: pass an instance of event to post_event()

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
2021-01-10 19:52:00 +08:00
Jason Dillaman
d3fa8889ff
Merge pull request #38796 from MahatiC/wip-ssd-read
librbd/cache: Implement aio_read operation

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-09 16:52:20 -05:00
Kefu Chai
0da007a2f8
Merge pull request #38272 from vbashkirtsev/master
test/test_arch.cc: search "pni" in CPU flags also when detecting SSE3

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-10 00:25:06 +08:00
Vladimir Bashkirtsev
b9516966ec test/test_arch.cc: search "pni" in CPU flags also when detecting SSE3
as sometimes a SSE-3 CPU reports "pni" (Prescott New Instructions) in /proc/cpuinfo.

Signed-off-by: Vladimir Bashkirtsev <vladimir@bashkirtsev.com>
2021-01-09 14:36:55 +10:30
Vladimir Bashkirtsev
50564a60ce do_cmake.sh: do not perform 'git submodule update' if building from tarball
Signed-off-by: Vladimir Bashkirtsev <vladimir@bashkirtsev.com>
2021-01-09 14:36:55 +10:30
Kefu Chai
b5fd5b505f
Merge pull request #38753 from Rethan/style-ceph-df-output
mon/PGMap: align to same side when output ceph df / ceph df detail

Reviewed-by: Kefu Chai <kchai@redhat.com>
2021-01-09 12:06:47 +08:00
Patrick Donnelly
52ef68c681
Merge PR #38775 into master
* refs/pull/38775/head:
	qa: remove ceph file systems on completion

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
2021-01-08 19:06:58 -08:00
Patrick Donnelly
0a3e6b4459
Merge PR #38791 into master
* refs/pull/38791/head:
	mon/MDSMonitor: add missing frozen checks

Reviewed-by: Jos Collin <jcollin@redhat.com>
2021-01-08 15:17:47 -08:00
Patrick Donnelly
7c5c9df288
Merge PR #38778 into master
* refs/pull/38778/head:
	mds: don't use dentry_key_t in C_IO_Dir_Commit_Ops

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-01-08 15:17:10 -08:00
Patrick Donnelly
88800299e2
Merge PR #38773 into master
* refs/pull/38773/head:
	mds: avoid spurious sleeps

Reviewed-by: Xiubo Li <xiubli@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Sidharth Anupkrishnan <sanupkri@redhat.com>
2021-01-08 15:15:54 -08:00
Patrick Donnelly
fe724349da
Merge PR #38698 into master
* refs/pull/38698/head:
	client: fix the cache size check
	client: add more detail info for the _put_inode debug log
	client: skip putting inodes if map is empty

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-08 15:14:10 -08:00
Patrick Donnelly
4b976e70a4
Merge PR #38683 into master
* refs/pull/38683/head:
	mds: add scrub perf counters support

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-08 15:13:22 -08:00
Patrick Donnelly
d03064d930
Merge PR #38642 into master
* refs/pull/38642/head:
	rpm/deb/cmake: install mount.fuse.ceph man page

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-08 15:12:42 -08:00
Greg Farnum
dd63a3e21f osd: osdmap: do not assert target_v when encoding in stretch mode
Again, this was an overly-strict safety check. It passed testing against
(even old) userspace clients, but the kernel clients don't have all the
same feature bits and so when encoding for them, we see lower target_v values
and assert out erroneously.

As before, monitors and OSDs that actually need to interpret this data
are gated on cluster entry, so we don't need this safety check here.

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2021-01-08 22:17:07 +00:00
Daniel-Pivonka
a398fc239f cephadm: HA for RGW endpoints
Cephadm deploying keepalived and HAproxy for providing High availability for RGW endpoints

Fixes: https://tracker.ceph.com/issues/45116

Signed-off-by: Daniel-Pivonka <dpivonka@redhat.com>
Signed-off-by: Adam King <adking@redhat.com>
Signed-off-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2021-01-08 17:00:51 -05:00
Casey Bodley
66cafc8312
Merge pull request #37882 from cbodley/wip-rgw-data-sync-notification-fix
rgw: data sync: fix obligation check

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2021-01-08 15:16:23 -05:00
Ernesto Puerta
ad5f10edba
Merge pull request #38720 from bk201/wip-48717
mgr/dashboard: fix Reads/Writes ratio of Clients IOPS donut chart

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2021-01-08 21:09:46 +01:00
Patrick Donnelly
37f7bba5c0
Merge PR #38776 into master
* refs/pull/38776/head:
	qa: get pool holding file data from file layout

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2021-01-08 11:27:08 -08:00
Patrick Donnelly
b9c35d9d22
Merge PR #38664 into master
* refs/pull/38664/head:
	qa: bump scrub timeout
	qa: move cephfs_ec_profile under cephfs
	qa: do not use ec pools for default data pool
	qa: skip check-counters for light workloads
	qa: remove empty multimds suite
	qa: merge multimds:verify with fs:verify
	qa: merge multimds:thrash to fs:thrash
	qa: remove dead multimds:basic
	qa: move functional multimds tests to fs:functional
	qa: migrate multimds workloads to fs:workloads
	qa: only run valgrind on cephfs daemons
	qa: stop testing filestore on cephfs suites
	qa: load data pools before deleting fs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Tested-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-08 11:25:23 -08:00
Patrick Donnelly
ea61b6a10f
Merge PR #38693 into master
* refs/pull/38693/head:
	qa: execute scrubs only on rank 0
	client: print debug information about resolved MDS
	qa: let Client::resolve_mds lookup the rank

Reviewed-by: Xiubo Li <xiubli@redhat.com>
2021-01-08 10:47:07 -08:00
Patrick Donnelly
abe7c86337
qa: remove ceph file systems on completion
So that we can avoid MDS replacement warnings.

Fixes: https://tracker.ceph.com/issues/48757
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-08 10:44:53 -08:00
Patrick Donnelly
71c7315ef2
Merge PR #38510 into master
* refs/pull/38510/head:
	PendingReleaseNotes: Update about volume/nfs cluster id changes
	mgr/volumes/nfs: remove 'ganesha-' prefix from cluster id

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-08 10:39:38 -08:00
Harish Munjulur
7267300640
Merge pull request #38537 from IlsooByun/fix_ret_invalid_err
rgw: return error when trying to copy encrypted object without key
2021-01-08 09:25:35 -08:00
Harish Munjulur
ecf006ee0e
Merge pull request #38283 from dvanders/dvanders_throttle
rgw: add an outstanding_requests perf counter
2021-01-08 09:24:42 -08:00
Harish Munjulur
52c44aa00d
Merge pull request #38242 from theanalyst/rgw/reset-stats-1-fix
rgw: cls/user: set from_index for reset stats calls
2021-01-08 09:23:46 -08:00
Jason Dillaman
6b6abfac56
Merge pull request #38725 from CongMinYin/immutable-obejct-cache-doc
doc/rbd: Immutable object cache doc

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2021-01-08 09:24:21 -05:00
Sebastian Wagner
9432027961
Merge pull request #38667 from pcuzner/fix-cephadm-stdout
cephadm: make host add failure message more friendly
2021-01-08 15:23:31 +01:00
Sebastian Wagner
a084037efa
Merge pull request #37920 from votdev/issue_48068_timezone
cephadm: Various properties like 'last_refresh' do not contain timezone 

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-01-08 15:21:45 +01:00
Kefu Chai
fdb26d2c10
Merge pull request #38807 from tchaikov/wip-mon-cmd-doc
doc: build mon_command_api.rst using a homebrew extension

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2021-01-08 20:35:28 +08:00
zhangjiao
22248362f7 pybind/rados: add test_cmpext_op()
Signed-off-by: Zhang Jiao <zhangjiao_yewu@cmss.chinamobile.com>
2021-01-08 17:53:10 +08:00
zhangjiao
12004686b9 pybind/rados: add ReadOp::cmpext()
Signed-off-by: Zhang Jiao <zhangjiao_yewu@cmss.chinamobile.com>
2021-01-08 16:54:43 +08:00
zhangjiao
3258c610a6 pybind/rados:add WriteOp::cmpext()
Signed-off-by: Zhang Jiao <zhangjiao_yewu@cmss.chinamobile.com>
2021-01-08 16:51:31 +08:00
Varsha Rao
ef3660bb96 PendingReleaseNotes: Update about volume/nfs cluster id changes
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-01-08 12:38:57 +05:30
Varsha Rao
24b70c5186 mgr/volumes/nfs: remove 'ganesha-' prefix from cluster id
Orchestrator defines service name as "<service_type>.<service_id>". The ganesha
common config object name in orchestrator is "conf-<service_name>". Volume's
nfs plugin deploys nfs-ganesha clusters with 'ganesha' prefixed to cluster id
and common config object.  It can cause unecessary issues in rook and cephadm.
So let's remove the prefix.

Fixes: https://tracker.ceph.com/issues/48514
Signed-off-by: Varsha Rao <varao@redhat.com>
2021-01-08 12:35:53 +05:30
Kefu Chai
1a16fc9d39
Merge pull request #38754 from tchaikov/wip-confutil-string-view
common/ConfUtils: pass string_view instead of string

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-01-08 14:00:06 +08:00
Kefu Chai
ef281f6b55 doc/_ext: accept params separated with ", "
"mon enable_stretch_mode" command's arg descriptors are delimited with
", ", so we should ignore empty kv when split the params with ",".

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-08 11:35:42 +08:00
Kefu Chai
202b805aaf doc: build mon_command_api.rst using a homebrew extension
so we can build the command doc using ReadTheDoc infra, without adding
the generated rst file to the source repo.

before this change, all the commands are ordered alphabetically. after
this change, command docs are generated by two directives, and are
ordered separately. we could restructure the directives and merge them.

but let's leave it for a future change if this is important.

for more details on writing sphinx directives, see
https://www.sphinx-doc.org/en/master/extdev/markupapi.html and
https://docutils.sourceforge.io/docs/howto/rst-directives.html

Signed-off-by: Kefu Chai <kchai@redhat.com>
2021-01-08 11:35:42 +08:00
Patrick Donnelly
f7617cf4d7
qa: bump scrub timeout
To avoid timeouts for large workloads.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-07 12:55:25 -08:00
Patrick Donnelly
488f10c62f
qa: move cephfs_ec_profile under cephfs
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-07 12:55:25 -08:00
Patrick Donnelly
faa30050c1
qa: do not use ec pools for default data pool
This configuration unnecessarily slows down backtrace writes and bloats
the used disk space.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-07 12:55:25 -08:00
Patrick Donnelly
4a45b9eb3e
qa: skip check-counters for light workloads
None of these are likely to generate exports.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-01-07 12:55:25 -08:00