Commit Graph

447 Commits

Author SHA1 Message Date
Patrick Donnelly
5c9f77cb65
Merge PR #36457 into master
* refs/pull/36457/head:
	qa/tasks/cephfs: fix fs authorize cmd args
	mds: add root_squash mode in MDS auth caps
	vstart_runner: add write_file and sudo_write_file

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-10-08 13:23:34 -07:00
Jan Fajerski
485f0d797e PendingReleaseNotes: add note about batch refactor
Signed-off-by: Jan Fajerski <jfajerski@suse.com>
2020-10-07 13:12:14 +02:00
Ramana Raja
e1c5220780 mds: add root_squash mode in MDS auth caps
Implement a root_squash mode in MDS auth caps to deny operations for
clients with uid=0 or gid=0 that need write access. It's mainly to
prevent operations such as accidental `sudo rm -rf /path`.

The root squash mode can be enforced in one of the following ways in
the MDS caps,
  'allow rw root_squash'
  (across file systems)
          or
  'allow rw fsname=a root_squash'
  (on a file system)
          or
  'allow rw fsname=a path=/vol/group/subvol00 root_squash'
  (on a file system path)

Fixes: https://tracker.ceph.com/issues/42451
Signed-off-by: Ramana Raja <rraja@redhat.com>
2020-09-25 14:34:35 +05:30
Yan, Zheng
b7101f1bc7 mds: remove snap past parents compat code
snap format change was introduced in Mimic release. It's long enough to
remove compat code.

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-09-21 16:24:30 +08:00
Patrick Donnelly
7eceaf45de
Merge PR #37202 into master
* refs/pull/37202/head:
	mon: allow overriding the initial mon_host

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-09-18 18:54:57 -07:00
Patrick Donnelly
ed3782e60a
mon: allow overriding the initial mon_host
This overrides what the CephContext believes to be the current quorum of
monitors (retrieved from other instances of the MonClient), introduced
by [1]. Tests need to be able to target a specific monitor for
exercising forwarding and other things.

[1] 731e2db9fb
Fixes: https://tracker.ceph.com/issues/47180
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-09-16 18:34:23 -07:00
David Zafman
bb5058074d doc: Add doc and PendingRealeaseNotes
Add help about new list_unfound fields in troubleshooting-pg.rst
Add info in PendingReleaseNotes

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-09-16 16:40:10 -07:00
Rishabh Dave
f93c4c7188 src/mds: allow passing fs names and path in same cap
Allow passing path along with fs names and capspec while creating an MDS
cap. The new syntax looks as follows -

allow rw fsname=<fsname> path=<path>

To provide caps for multiple file systems, pass the same phrase multiple
times separated by commas -

allow rw fsname=<fsname1> path=<path1>, allow rw fsname=<fsname2>
path=<path2>, ...

This commit also makes sure that the old syntax 'allow rw path=<path>'
is supported for backwards compatibility. The old syntax would imply
'allow rw fsname=* path=<path>' and would grant read-write permission for
all FSs containing the path <path>.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-09-10 17:10:51 +05:30
Douglas Fuller
811e48d6ff mon/MDSMonitor: add mon auth caps for CephFS names
Add a 'fsname' clause to mon auth caps to restrict a client's view
of the FSMap. Example:

mon 'allow rw fsname=cephfs2'

This would restrict the client's view of the FSMap to the MDSMap for
cephfs2. Any MDS allocated to a different filesystem will be invisible.
Global standby daemons are always visible. To allow multiple CephFSs,
add multiple caps:

mon 'allow rw fsname=cephfs2, allow rw fsname=cephfs2'

Fixes: http://tracker.ceph.com/issues/15070
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-09-10 17:10:51 +05:30
Adam C. Emerson
ae5660fbb6 rgw: Remove date from REST log trim/list
Also only accept one marker.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2020-09-08 22:09:40 -04:00
Adam C. Emerson
26f5b2f58e rgw: Remove some TimeLog options from radosgw-admin
Remove date-oriented trim/list functionality from MDLOG, DataLog, and
Sync-Error-Log.

Don't provide start/end markers. Support only a start marker for list
and an end marker for trim.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2020-09-08 22:09:40 -04:00
Kefu Chai
968df0cae6
Merge pull request #36775 from tchaikov/wip-spdk
spdk: pick up spdk v20.07

Reviewed-by: Neha Ojha <nojha@redhat.com>
2020-09-03 11:03:02 +08:00
Kefu Chai
08e8a178ed PendingReleaseNotes: mention bdev_nvme_retry_count was dropped
Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-09-01 10:05:11 +08:00
Vikhyat Umrao
9ffbffbe6c mon/PGMap: add pg count for pools in the ceph df command
Fixes: https://tracker.ceph.com/issues/46663

Signed-off-by: Vikhyat Umrao <vikhyat@redhat.com>
2020-08-28 02:57:59 -07:00
Sage Weil
dfd01d7653 blacklist -> blocklist
Signed-off-by: Sage Weil <sage@newdream.net>
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-08-24 19:53:08 +00:00
Patrick Donnelly
02813988a6
Merge PR #36394 into master
* refs/pull/36394/head:
	qa: add method run ceph cluster command with better interface
	cephfs: allow only "good" characters

Reviewed-by: Varsha Rao <varao@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-08-24 11:33:03 -07:00
Kefu Chai
ec73fea99e
Merge pull request #36680 from tchaikov/wip-mgr-disk-predict
pybind/mgr/diskprediction_cloud: remove mgr-diskprediction-cloud

Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-By: Zac Dover <zac.dover@gmail.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Laura Paduano <lpaduano@suse.com>
2020-08-21 09:46:54 +08:00
Rishabh Dave
4022e2ba7d cephfs: allow only "good" characters
Allow only [A-Za-z0-9-_.] characters for FS, volume, subvolume and
subvolume group names and add test for the same.

Signed-off-by: Rishabh Dave <ridave@redhat.com>
2020-08-20 15:34:02 +05:30
Kefu Chai
2644766d0f pybind/mgr/diskprediction_cloud: remove mgr-diskprediction-cloud
the service offered by https://www.diskprophet.com is not accessible
anymore. before we have a replacement of it, let's drop
mgr-diskprediction-cloud. and remove its packaging.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-19 11:08:38 +08:00
Kefu Chai
c0802c98c4 alpine: remove stale Alpine build recipe
alpine build recipe is stale and does not work with the latest Ceph,
also the APKBUILD for Ceph can be found at alphine's aports repo, see
https://gitlab.alpinelinux.org/alpine/aports/-/tree/master/community/ceph.

so instead keeping a stale version, let's drop it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2020-08-18 14:23:50 +08:00
David Zafman
33749cc3c3 osd: Cancel in-progress scrubs (not user requested)
This change adds new scrubber.req_scrub to track user
requested scrubs, deep_scrub or repair.

Fixes: https://tracker.ceph.com/issues/46275

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-07-24 11:41:20 -07:00
Wido den Hollander
93e4c56ecc osd: Add config option to compact OSD's object store on start
By setting this configuration option an OSD will compact it's
store's OMAP on start.

This way admin's can trigger an offline compaction by setting this
configuration value to 'true' and then restarting the OSD.

This is easier than using tools like 'ceph-kvstore-tool' with requires
more manual work on the CLI and might be more difficult for users.

Signed-off-by: Wido den Hollander <wido@42on.com>
2020-07-16 17:55:36 +08:00
Patrick Donnelly
4ec68680bd
Merge PR #33827 into master
* refs/pull/33827/head:
	mon: add 'ceph fs required_client_feature <fs_name> add/rm' command

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2020-07-08 17:06:16 -07:00
Yan, Zheng
c4a335d7c6 mon: add 'ceph fs required_client_feature <fs_name> add/rm' command
Fixes: https://tracker.ceph.com/issues/43817
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2020-07-07 09:05:56 +08:00
Josh Durgin
124ffa4663
Merge pull request #35751 from smithfarm/wip-radosgw-admin-orphans
doc: PendingReleaseNotes: fix deprecated radosgw-admin commands

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2020-07-01 07:59:34 -07:00
Patrick Donnelly
6cd10c591a
doc: add documentation for new ephemeral pinning feature
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2020-06-24 15:43:32 -07:00
Nathan Cutler
5b59c7f55b doc: PendingReleaseNotes: fix deprecated radosgw-admin commands
Instead of repeating the same command thrice, three different commands
were intended.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-06-24 21:01:00 +02:00
David Zafman
661996d434 mgr: Warn when too many reads are repaired on an OSD
Include test case
Configurable by setting mon_osd_warn_num_repaired (default 10)
Ignore new health warning with random eio injection test

Fixes: https://tracker.ceph.com/issues/41564

Signed-off-by: David Zafman <dzafman@redhat.com>
2020-06-16 17:45:27 -07:00
Nathan Cutler
473a185ef9
Merge pull request #35129 from smithfarm/wip-fix-PendingReleaseNotes-headings
doc/releases/octopus.rst: move still-pending release notes to official v15.2.0 release notes

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2020-05-25 10:41:30 +02:00
Jason Dillaman
9ec1e4ec50 librbd: moved parent image cache to its own plugin
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2020-05-21 14:50:33 -04:00
Nathan Cutler
838c3ce5bf PendingReleaseNotes: drop mention of CVE fix
CVEs fixed before the first stable Pacific release need not be mentioned
explicitly in the release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-21 13:57:56 +02:00
Nathan Cutler
06db0a7d34 PendingReleaseNotes: add missing ">= 16.0.0" heading
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 16:06:03 +02:00
Nathan Cutler
5dfb1c2439 doc/releases/octopus: add "default bucket index shards" release note
The RGW "default number of bucket index shards for new buckets was raised from
1 to 11" release note was added to PendingReleaseNotes by
1ec77ec7ba but it did not find its way into the
official v15.2.0 release notes until now.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 16:02:31 +02:00
Nathan Cutler
c66ae41ec5 doc/releases/octopus: add "BlockPublicAccess" release note
The RGW BlockPublicAccess release note was added to PendingReleaseNotes
by df384ea95f but it did not find its way
into the official v15.2.0 release notes until now.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 15:59:42 +02:00
Nathan Cutler
af06190066 doc/releases/octopus: add "rgw bucket granularity" release note
The RGW bucket granularity release note was added to PendingReleaseNotes
by 50f13fd54b but it never found its way
into the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 15:58:32 +02:00
Nathan Cutler
b580142213 doc/releases/octopus: enforce mds_join_fs cluster affinity
The "enforce mds_join_fs cluster affinity" release note was
added to PendingReleaseNotes by 3fac3b1236
but it never made its way into the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 15:50:53 +02:00
Nathan Cutler
ba3c1b3d6b doc/releases/octopus: osd_calc_pg_upmaps_max_stddev removal
The release note about osd_calc_pg_upmaps_max_stddev removal
was added to PendingReleaseNotes by
65d03bae8b but never found its
way into the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 15:48:51 +02:00
Nathan Cutler
1d13cfe721 doc/releases/octopus: add bucket notification JSON array
The release note about bucket notifications being encapsulated in a JSON
array was added to PendingReleaseNotes by
19832a0dae but it never found its way into
the actual v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 15:45:39 +02:00
Nathan Cutler
50e27bbc71 doc/releases/octopus.rst: add nvme self-classify release note
The release note about OSDs self-classifying themselves as "nvme" in
certain rare cases was added to PendingReleaseNotes by
1d0fd5603e but it never found its way into
the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 15:43:35 +02:00
Nathan Cutler
568b8a11ed doc/releases/octopus.rst: add "-o" behavior release note
The release note about restoring the original behavior of the rados
tool's "-o" option was added to PendingReleaseNotes by
d2b806070d but it never found its way into
the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 15:41:37 +02:00
Nathan Cutler
69fbfbc9ac doc/releases/octopus.rst: include MDS cache memory limit note
This note was added to PendingReleaseNotes by
0efa73f029 but never found its way into
the official v15.2.0 release notes.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2020-05-19 15:38:46 +02:00
Mykola Golub
5b6849e08e mgr/rbd_support: rename "rbd_trash_trash_purge_schedule" oid
to "rbd_trash_purge_schedule"

Fixes: https://tracker.ceph.com/issues/45589
Signed-off-by: Mykola Golub <mgolub@suse.com>
2020-05-18 20:59:31 +03:00
Josh Durgin
06f239fc35 PendingReleaseNotes: note about security fix
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2020-05-13 21:35:15 -07:00
J. Eric Ivancich
a813e08a3a PendingReleaseNotes: add missing quote character
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-11 15:18:08 -04:00
J. Eric Ivancich
fe253c9d5f PendingReleaseNotes: rgw-orphan-list and deprecated radosgw-admin orphans
Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2020-05-11 15:16:36 -04:00
Sebastian Wagner
a057467ede PendingReleaseNotes: Add Cephadm for >15.2.1
Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2020-04-29 11:04:59 +02:00
Neha Ojha
8f90e41d34 PendingReleaseNotes: add note about balancer being on by default
Signed-off-by: Neha Ojha <nojha@redhat.com>
2020-04-15 00:53:01 +00:00
zhengyin
e03a749b8f doc: add a note that states the behavior change for the clone operation
in the PendingReleaseNotes.

     Signed-off-by: Zheng Yin <zhengyin@cmss.chinamobile.com>
2020-03-31 20:57:44 +08:00
Deepika Upadhyay
21508bd9dd mon/OSDMonitor: add flag --yes-i-really-mean-it for setting pool size 1
Adds option `mon_allow_pool_size_one` which will be disabled by default
to ensure pools are not configured without replicas.
If the user still wants to use pool size 1, they will have to change the
value of `mon_allow_pool_size_one` to true and then have to pass flag
`--yes-i-really-mean-it` to cli command:

Example:
`ceph osd pool test set size 1 --yes-i-really-mean-it`

Fixes: https://tracker.ceph.com/issues/44025
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-03-09 23:27:36 +05:30
Deepika Upadhyay
677b50ec74 doc: change case from apis to APIs
use APIs instead of apis to be consistent throughout.

fixes: https://tracker.ceph.com/issues/44374
Signed-off-by: Deepika Upadhyay <dupadhya@redhat.com>
2020-03-03 14:52:45 +05:30