Commit Graph

460 Commits

Author SHA1 Message Date
Patrick Donnelly
0376ce721a
doc: add documentation for new multifs feature
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-12-15 06:46:49 -08:00
Matt Benjamin
146a8e5543
Merge pull request #38171 from yuvalif/wip-yuval-fix-46296
rgw/notification: support GetTopicAttributes API
2020-12-02 07:42:03 -05:00
Yuval Lifshitz
3906884aa6 rgw/notification: support GetTopicAttributes API
fixes: https://tracker.ceph.com/issues/46296

Signed-off-by: Yuval Lifshitz <ylifshit@redhat.com>
2020-11-25 11:23:52 +02:00
Xiubo Li
73a48dfe8e global: reexpand the conf meta in all the child processes
Especially for the tools or the daemons whose config options need
to expand the '$pid', they will be always expanded with the parent
processes. We need to reexpand them in child processes just after
the fork is done.

Fixes: https://tracker.ceph.com/issues/48240
Signed-off-by: Xiubo Li <xiubli@redhat.com>
2020-11-23 14:07:07 +08:00
Josh Durgin
c2b9152eac
Merge pull request #37488 from kamoltat/wip-mgr-progress-turn-off-option
mgr/progress: progress module on/off option

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2020-11-17 13:37:30 -08:00
Yan, Zheng
11a199707d Update Release notes for multimds scrub
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-11-17 13:12:11 +08:00
Kamoltat
993bb02b30 mgr/progress: introduce turn off/on feature
progress module can be turned off/on by using
the commands: 'progress off' and 'progress on'

As well as refractoring teuthology test suite
to prevent future bugs that can possibly occur

fixes: https://tracker.ceph.com/issues/47238

Signed-off-by: kamoltat <ksirivad@redhat.com>
2020-11-16 03:46:42 +00:00
Neha Ojha
4a6f53afe6
Merge pull request #37902 from pdvian/wip-clog-health-detail
mon: Log "ceph health detail" periodically in cluster log

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-11-12 15:02:52 -08:00
Prashant D
f45712c190 mon: Log "ceph health detail" periodically in cluster log
change mon_health_to_clog_interval from 1_hr -> 10_min to
log health summary or detail more frequently.

Fixes: https://tracker.ceph.com/issues/48042

Signed-off-by: Prashant Dhange <pdhange@redhat.com>
2020-11-11 19:08:51 -05:00
David Zafman
9e469f5b31 doc: Apply suggestions from code review
Co-authored-by: Neha Ojha <nehaojha88@gmail.com>
Co-authored-by: Josh Durgin <jdurgin@redhat.com>

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-11-11 15:31:26 -08:00
David Zafman
93373746f5 osd test: Delay reporting until mon_warn_older_version_delay has passed
Move release notes description to 16.0.0 and update
Update documentation

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-11-11 15:10:11 -08:00
David Zafman
8b435668b0 Update Release notes
Signed-off-by: David Zafman <dzafman@redhat.com>
2020-11-11 15:10:11 -08:00
David Zafman
d3cc647583 osd: Eliminate day of weeek 7 and hour 24
Add test case for permitted hours to make sure scrub doesn't start
Remove permitted hours in extended sleep test

Fixes: https://tracker.ceph.com/issues/48077

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-11-09 22:47:00 +00:00
Patrick Donnelly
5c9f77cb65
Merge PR #36457 into master
* refs/pull/36457/head:
	qa/tasks/cephfs: fix fs authorize cmd args
	mds: add root_squash mode in MDS auth caps
	vstart_runner: add write_file and sudo_write_file

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-08 13:23:34 -07:00
Jan Fajerski
485f0d797e PendingReleaseNotes: add note about batch refactor
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2020-10-07 13:12:14 +02:00
Ramana Raja
e1c5220780 mds: add root_squash mode in MDS auth caps
Implement a root_squash mode in MDS auth caps to deny operations for
clients with uid=0 or gid=0 that need write access. It's mainly to
prevent operations such as accidental `sudo rm -rf /path`.

The root squash mode can be enforced in one of the following ways in
the MDS caps,
  'allow rw root_squash'
  (across file systems)
          or
  'allow rw fsname=a root_squash'
  (on a file system)
          or
  'allow rw fsname=a path=/vol/group/subvol00 root_squash'
  (on a file system path)

Fixes: https://tracker.ceph.com/issues/42451
Signed-off-by: Ramana Raja <rraja@redhat.com>
2020-09-25 14:34:35 +05:30
Yan, Zheng
b7101f1bc7 mds: remove snap past parents compat code
snap format change was introduced in Mimic release. It's long enough to
remove compat code.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-09-21 16:24:30 +08:00
Patrick Donnelly
7eceaf45de
Merge PR #37202 into master
* refs/pull/37202/head:
	mon: allow overriding the initial mon_host

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-09-18 18:54:57 -07:00
Patrick Donnelly
ed3782e60a
mon: allow overriding the initial mon_host
This overrides what the CephContext believes to be the current quorum of
monitors (retrieved from other instances of the MonClient), introduced
by [1]. Tests need to be able to target a specific monitor for
exercising forwarding and other things.

[1] 731e2db9fb
Fixes: https://tracker.ceph.com/issues/47180
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-09-16 18:34:23 -07:00
David Zafman
bb5058074d doc: Add doc and PendingRealeaseNotes
Add help about new list_unfound fields in troubleshooting-pg.rst
Add info in PendingReleaseNotes

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-09-16 16:40:10 -07:00
Rishabh Dave
f93c4c7188 src/mds: allow passing fs names and path in same cap
Allow passing path along with fs names and capspec while creating an MDS
cap. The new syntax looks as follows -

allow rw fsname=<fsname> path=<path>

To provide caps for multiple file systems, pass the same phrase multiple
times separated by commas -

allow rw fsname=<fsname1> path=<path1>, allow rw fsname=<fsname2>
path=<path2>, ...

This commit also makes sure that the old syntax 'allow rw path=<path>'
is supported for backwards compatibility. The old syntax would imply
'allow rw fsname=* path=<path>' and would grant read-write permission for
all FSs containing the path <path>.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-09-10 17:10:51 +05:30
Douglas Fuller
811e48d6ff mon/MDSMonitor: add mon auth caps for CephFS names
Add a 'fsname' clause to mon auth caps to restrict a client's view
of the FSMap. Example:

mon 'allow rw fsname=cephfs2'

This would restrict the client's view of the FSMap to the MDSMap for
cephfs2. Any MDS allocated to a different filesystem will be invisible.
Global standby daemons are always visible. To allow multiple CephFSs,
add multiple caps:

mon 'allow rw fsname=cephfs2, allow rw fsname=cephfs2'

Fixes: http://tracker.ceph.com/issues/15070
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-09-10 17:10:51 +05:30
Adam C. Emerson
ae5660fbb6 rgw: Remove date from REST log trim/list
Also only accept one marker.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2020-09-08 22:09:40 -04:00
Adam C. Emerson
26f5b2f58e rgw: Remove some TimeLog options from radosgw-admin
Remove date-oriented trim/list functionality from MDLOG, DataLog, and
Sync-Error-Log.

Don't provide start/end markers. Support only a start marker for list
and an end marker for trim.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2020-09-08 22:09:40 -04:00
Kefu Chai
968df0cae6
Merge pull request #36775 from tchaikov/wip-spdk
spdk: pick up spdk v20.07

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-09-03 11:03:02 +08:00
Kefu Chai
08e8a178ed PendingReleaseNotes: mention bdev_nvme_retry_count was dropped
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-01 10:05:11 +08:00
Vikhyat Umrao
9ffbffbe6c mon/PGMap: add pg count for pools in the ceph df command
Fixes: https://tracker.ceph.com/issues/46663

Signed-off-by: Vikhyat Umrao <vikhyat@redhat.com>
2020-08-28 02:57:59 -07:00
Sage Weil
dfd01d7653 blacklist -> blocklist
Signed-off-by: Sage Weil <sage@newdream.net>
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-08-24 19:53:08 +00:00
Patrick Donnelly
02813988a6
Merge PR #36394 into master
* refs/pull/36394/head:
	qa: add method run ceph cluster command with better interface
	cephfs: allow only "good" characters

Reviewed-by: Varsha Rao <varao@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-24 11:33:03 -07:00
Kefu Chai
ec73fea99e
Merge pull request #36680 from tchaikov/wip-mgr-disk-predict
pybind/mgr/diskprediction_cloud: remove mgr-diskprediction-cloud

Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-By: Zac Dover <zac.dover@gmail.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-08-21 09:46:54 +08:00
Rishabh Dave
4022e2ba7d cephfs: allow only "good" characters
Allow only [A-Za-z0-9-_.] characters for FS, volume, subvolume and
subvolume group names and add test for the same.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-08-20 15:34:02 +05:30
Kefu Chai
2644766d0f pybind/mgr/diskprediction_cloud: remove mgr-diskprediction-cloud
the service offered by https://www.diskprophet.com is not accessible
anymore. before we have a replacement of it, let's drop
mgr-diskprediction-cloud. and remove its packaging.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-19 11:08:38 +08:00
Kefu Chai
c0802c98c4 alpine: remove stale Alpine build recipe
alpine build recipe is stale and does not work with the latest Ceph,
also the APKBUILD for Ceph can be found at alphine's aports repo, see
https://gitlab.alpinelinux.org/alpine/aports/-/tree/master/community/ceph.

so instead keeping a stale version, let's drop it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-18 14:23:50 +08:00
David Zafman
33749cc3c3 osd: Cancel in-progress scrubs (not user requested)
This change adds new scrubber.req_scrub to track user
requested scrubs, deep_scrub or repair.

Fixes: https://tracker.ceph.com/issues/46275

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-07-24 11:41:20 -07:00
Wido den Hollander
93e4c56ecc osd: Add config option to compact OSD's object store on start
By setting this configuration option an OSD will compact it's
store's OMAP on start.

This way admin's can trigger an offline compaction by setting this
configuration value to 'true' and then restarting the OSD.

This is easier than using tools like 'ceph-kvstore-tool' with requires
more manual work on the CLI and might be more difficult for users.

Signed-off-by: Wido den Hollander <wido@42on.com>
2020-07-16 17:55:36 +08:00
Patrick Donnelly
4ec68680bd
Merge PR #33827 into master
* refs/pull/33827/head:
	mon: add 'ceph fs required_client_feature <fs_name> add/rm' command

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-08 17:06:16 -07:00
Yan, Zheng
c4a335d7c6 mon: add 'ceph fs required_client_feature <fs_name> add/rm' command
Fixes: https://tracker.ceph.com/issues/43817
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-07-07 09:05:56 +08:00
Josh Durgin
124ffa4663
Merge pull request #35751 from smithfarm/wip-radosgw-admin-orphans
doc: PendingReleaseNotes: fix deprecated radosgw-admin commands

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2020-07-01 07:59:34 -07:00
Patrick Donnelly
6cd10c591a
doc: add documentation for new ephemeral pinning feature
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-06-24 15:43:32 -07:00
Nathan Cutler
5b59c7f55b doc: PendingReleaseNotes: fix deprecated radosgw-admin commands
Instead of repeating the same command thrice, three different commands
were intended.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-06-24 21:01:00 +02:00
David Zafman
661996d434 mgr: Warn when too many reads are repaired on an OSD
Include test case
Configurable by setting mon_osd_warn_num_repaired (default 10)
Ignore new health warning with random eio injection test

Fixes: https://tracker.ceph.com/issues/41564

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-06-16 17:45:27 -07:00
Nathan Cutler
473a185ef9
Merge pull request #35129 from smithfarm/wip-fix-PendingReleaseNotes-headings
doc/releases/octopus.rst: move still-pending release notes to official v15.2.0 release notes

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2020-05-25 10:41:30 +02:00
Jason Dillaman
9ec1e4ec50 librbd: moved parent image cache to its own plugin
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-05-21 14:50:33 -04:00
Nathan Cutler
838c3ce5bf PendingReleaseNotes: drop mention of CVE fix
CVEs fixed before the first stable Pacific release need not be mentioned
explicitly in the release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-21 13:57:56 +02:00
Nathan Cutler
06db0a7d34 PendingReleaseNotes: add missing ">= 16.0.0" heading
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 16:06:03 +02:00
Nathan Cutler
5dfb1c2439 doc/releases/octopus: add "default bucket index shards" release note
The RGW "default number of bucket index shards for new buckets was raised from
1 to 11" release note was added to PendingReleaseNotes by
1ec77ec7ba13da68d7919176b3675513ed7d7c21 but it did not find its way into the
official v15.2.0 release notes until now.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 16:02:31 +02:00
Nathan Cutler
c66ae41ec5 doc/releases/octopus: add "BlockPublicAccess" release note
The RGW BlockPublicAccess release note was added to PendingReleaseNotes
by df384ea95f88196a9723877a5aa9041ef25b5f29 but it did not find its way
into the official v15.2.0 release notes until now.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 15:59:42 +02:00
Nathan Cutler
af06190066 doc/releases/octopus: add "rgw bucket granularity" release note
The RGW bucket granularity release note was added to PendingReleaseNotes
by 50f13fd54b709bd0b8ad25e818fc61e2c55828fd but it never found its way
into the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 15:58:32 +02:00
Nathan Cutler
b580142213 doc/releases/octopus: enforce mds_join_fs cluster affinity
The "enforce mds_join_fs cluster affinity" release note was
added to PendingReleaseNotes by 3fac3b1236c4918e9640e38fe7f5f59efc0a23b9
but it never made its way into the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 15:50:53 +02:00
Nathan Cutler
ba3c1b3d6b doc/releases/octopus: osd_calc_pg_upmaps_max_stddev removal
The release note about osd_calc_pg_upmaps_max_stddev removal
was added to PendingReleaseNotes by
65d03bae8b4f50cc3cbaa50640eaeab4cabd711f but never found its
way into the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 15:48:51 +02:00