Commit Graph

243 Commits

Author SHA1 Message Date
Sage Weil
d7bca5d19f Merge PR #20512 into wip-sage-testing-20180407.022843
* refs/pull/20512/head:
	osd: osd_mon_report_interval_min -> osd_mon_report_interval, kill _max

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-04-06 21:29:32 -05:00
Gregory Farnum
6d2e4c9b7b
Merge pull request #19973 from liewegas/wip-peering-fast-dispatch
osd: fast dispatch of peering events and pg_map + osd sharded wq refactor

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-04-06 11:48:11 -07:00
Sage Weil
577737d007 osd: osd_mon_report_interval_min -> osd_mon_report_interval, kill _max
The _max isn't used.  Drop the _min suffix.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-06 11:00:14 -05:00
Sage Weil
68c505df24 PendingReleaseNotes: not pg_num adjustments during pool create
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-04 08:27:01 -05:00
Sage Weil
3ecfa258d1 PendingReleaseNotes: mons before osds to avoid force-recovery issue
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-04 08:27:00 -05:00
Yan, Zheng
5e79179d2b mds: PendingReleaseNotes and dev doc for open file table
Fixes: http://tracker.ceph.com/issues/23532
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2018-04-03 17:06:07 +08:00
Nathan Cutler
b71eb01705
Merge pull request #19439 from chardan/jfw-wip-14363-normalize-rm
rgw, mon: normalize delete/remove in admin console (cleanup 22444)

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2018-03-26 15:35:40 +02:00
Patrick Donnelly
c498abe2f0
Merge PR #20903 into master
* refs/pull/20903/head:
	PendingReleaseNotes: add note about upgrading MDS

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-03-17 11:30:23 -07:00
Patrick Donnelly
9c809d3c58
PendingReleaseNotes: add note about upgrading MDS
Fixes: https://tracker.ceph.com/issues/23172

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-03-17 11:27:07 -07:00
Sage Weil
6df18e6526 PendingReleaseNotes: dummy change
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-12 10:29:22 -05:00
Sage Weil
f8d4e5b5e9 common/config: rewrite (╯°□°)╯︵ ┻━┻
This is too complete a rewrite to reasonably break down into small steps,
and even if I could, it would be harder to review that way than to simply
review the new implementation.  The semantics of the old one were so weird
that it's harder to reason about the change in behavior than to simply
review the new behavior.

That's my story, at least, and I'm sticking to it!

So, here are the highlights:

 - $foo meta expansions are evaluated at get_val() time.  This means the
weird bool arguments to set_val specifying whether things were expanded
are removed (they didn't make any sense unless you were thinking about the
old implementation).
 - for every option, we track values from any inputs (config, mon,
   override).  At get_val() time, we pick the highest priority one.
 - diff() is rewritten to be simple and to show you all of the above.
 - internal interfaces are simplified, and in terms of Option::value_t
   whenever possible.
 - unit tests simplified somewhat based on the above.

Known issues:

 - legacy values get pushed out in select cases.  Notably if foo=$bar
   and bar is updated, we do not update $foo (there is no dependency
   tracking to do this efficiently).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:47 -06:00
Jesse Williamson
fa5398d31f rgw: normalize delete/remove in admin console
Normalizes "rm", deprecates any other (eg. "delete", del",
or "remove"). Provides backward compatibility with
existing commands, deprecates non-"rm".

http://tracker.ceph.com/issues/14363

Cleanup: http://tracker.ceph.com/issues/22444
Signed-off-by: Jesse Williamson <jwilliamson@suse.de>
2018-03-06 06:51:48 -08:00
Nathan Cutler
0dd34c81f2 doc: PendingReleaseNotes: deprecate/drop ceph-rest-api
References: http://tracker.ceph.com/issues/21264
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-03-05 22:01:51 +01:00
Abhishek Lekshmanan
1e491f6519 doc: release notes for 12.2.3
Also dropping the relevant changes from PendingReleaseNotes

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-02-21 19:34:59 +01:00
Gregory Farnum
240b688177
Merge pull request #20147 from smithfarm/wip-15904
tools: rados: make -f be --format for consistency with ceph tool

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-02-13 09:07:24 -08:00
Jason Dillaman
fe2fe0c46b librbd: clone request now handles clone v2
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-05 11:12:00 -05:00
Nathan Cutler
89385a2fb6 doc: mention rados -f change in PendingReleaseNotes
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-01-28 12:12:32 +01:00
Nathan Cutler
5ec2364421 doc: PendingReleaseNotes: python-ceph-compat deprecate/drop
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-01-26 07:42:18 +01:00
Kefu Chai
f5e7a8da11
Merge pull request #19899 from smithfarm/wip-rip-rcceph
build/ops: rpm: rip out rcceph script

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-22 16:36:23 +08:00
Nathan Cutler
2049155ea5 doc: mention rcceph drop in PendingReleaseNotes
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-01-15 11:24:05 +01:00
Mykola Golub
de97a3be48 rbd: adjusted "showmapped" JSON and XML formatted output
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-01-12 21:36:00 +02:00
Jason Dillaman
619b0c0244 rbd: adjusted "lock list" JSON and XML formatted output
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-01-12 11:31:07 -05:00
Sage Weil
fb3220ff3e ceph-crush-location: remove
This script is pointless.  It is equivalent to the built-in default
behavior, which makes it only useful as a sample for what a location
hook's output should be.  The documentation has been updated to provide
that.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-01-09 16:38:12 -06:00
Patrick Donnelly
f6e1a797d4
Revert "Merge PR #19369 into master"
This reverts commit 3189ba19a7, reversing
changes made to b7620de020.

Despite the change in json format being positive, the unfortunate side-effect
is that it broke upgrade testing (because the QA framework must handle the
transition of mdsmap["info"] to a list from object) and the ceph-mgr.

Fixes: http://tracker.ceph.com/issues/22527
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-01-04 09:42:37 -08:00
Patrick Donnelly
3189ba19a7
Merge PR #19369 into master
* refs/pull/19369/head:
	qa: update handling of fs status format
	PendingReleaseNotes: add note for format change
	mds/MDSMap : use arrary_section for mds stat

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
Reviewed-by: Xiaoxi Chen <xiaoxchen@ebay.com>
2017-12-21 20:21:18 -08:00
Patrick Donnelly
25d9473ebc
PendingReleaseNotes: add note for format change
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-20 20:32:10 -08:00
Patrick Donnelly
ee9d5f9a45
Merge PR #19440 into master
* refs/pull/19440/head:
	mds: update mds option descriptions
	mds: obsolete MDSMap option configs
	mds: organize Filesystem class def

Reviewed-by: John Spray <john.spray@redhat.com>
2017-12-15 11:07:58 -08:00
Patrick Donnelly
67ca6cd229
mds: obsolete MDSMap option configs
These configs were used for initialization but it is more appropriate to
require setting these file system attributes via `ceph fs set`. This is similar
to what was already done with max_mds. There are new variables added for `fs
set` where missing.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-13 18:30:52 -08:00
Sage Weil
4389b55435 Merge remote-tracking branch 'gh/mimic-dev1' 2017-12-11 22:27:35 -06:00
Patrick Donnelly
5b2b1d1446
client: quit on failed remount during dentry invalidate test
Fixes: http://tracker.ceph.com/issues/22269

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-12-04 16:10:27 -08:00
Sage Weil
c30faff877 PendingReleaseNotes: dummy commit
Just need a new to trigger a build on this branch.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-12-04 08:59:35 -06:00
Abhishek Lekshmanan
0c2bb1f041 doc: cleanup PendingReleaseNotes
drop sections already in previous releases, keeping only Mimic sections
and a new section header for items going post 12.2.2

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-11-30 19:27:45 +01:00
Jason Dillaman
3effd324db librbd: prevent overflow of discard API result code
Prevent discard/writesame lengths larger than 2GB.

Fixes: http://tracker.ceph.com/issues/21966
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-11-15 09:20:26 -05:00
Patrick Donnelly
cad798d132
PendingReleaseNotes: add obsoleted mds commands
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-10-01 17:32:12 -07:00
Sage Weil
dda1726bcb PendingReleaseNotes: note about upmap mapping change in luminous release notes
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-25 17:36:14 -04:00
Sage Weil
6767f841e5 Merge pull request #17427 from liewegas/wip-pg-num-limits
mon/OSDMonitor: implement cluster pg limit

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-09-19 12:57:10 -05:00
Abhishek Lekshmanan
aeddbc5201 doc: rgw: add a note for resharding in 12.2.1 docs
Since we're now enabling dynamic resharding, mention  this in release
notes

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-09-15 23:20:27 +02:00
Sage Weil
986b86fbeb mon: rename mon_pg_warn_max_per_osd -> mon_max_pg_per_osd
Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-14 16:00:31 -04:00
Sage Weil
3ea2e518d2 mon/OSDMonitor: prevent pg_num from exceeding mon_pg_warn_max_per_osd
Check total pg count for the cluster vs osd count and max pgs per osd
before allowing pool creation, pg_num change, or pool size change.

"in" OSDs are the ones we distribute data too, so this should be the right
count to use.  (Whether they happen to be up or down at the moment is
incidental.)

If the user really wants to create the pool, they can change the
configurable limit.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-09-14 12:10:13 -04:00
Patrick Donnelly
06c94de584
mds: support limiting cache by memory
This introduces two config parameters:

    mds_cache_memory_limit: Sets the soft maximum of the cache to the given
    byte count. (Like mds_cache_size, this doesn't actually limit the maximum
    size of the cache. It just dictates the steady-state size.)

    mds_cache_reservation: This replaces mds_health_cache_threshold everywhere
    except the Beacon heartbeat sent to the mons. The idea here is to specify a
    reservation of memory (5% by default) for operations and the MDS tries to
    always maintain that reservation. So, the MDS will recall caps from clients
    when it begins dipping into its reservation of memory.

mds_cache_size still limits the cache by Inode count but is now by-default 0
(i.e. unlimited). The new preferred way of specifying cache limits is by memory
size. The default is 1GB.

Fixes: http://tracker.ceph.com/issues/20594
Fixes: https://bugzilla.redhat.com/show_bug.cgi?id=1464976

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-09-12 20:02:41 -07:00
Abhishek Lekshmanan
74801fda1c doc: 12.2.0 major release announcements
Reordered the RC releases sections back to their respective components,
added a ceph-mon section, added links to documentation wherever
possible, and a few forgotten RGW announcements. Also cleared up the
PendingReleaseNotes upto this point

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-08-29 14:45:01 +02:00
Abhishek L
5a00b3905d Merge pull request #16782 from wjwithagen/wip-wjw-FreeBSD-Release
PendingReleaseNotes:Announce FreeBSD availability

Reviewed-By: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-By: Jason Dillaman <jdillaman@redhat.com>
2017-08-08 18:46:16 +02:00
Patrick Donnelly
41849fdcd1
doc: remove accidental additions to release notes
Presumably this was caused by a bad rebase.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2017-08-08 09:28:57 -07:00
Willem Jan Withagen
fcc2e134b9 PendingReleaseNotes:Announce FreeBSD availability
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2017-08-08 16:26:21 +02:00
Douglas Fuller
8f33e3bc2b PendingReleaseNotes: add note about df filtering
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2017-08-03 14:11:46 -04:00
Piotr Dałek
b57fb1eef1 PendingReleaseNotes: mention forced recovery
Mention forced recovery in release notes.

Signed-off-by: Piotr Dałek <piotr.dalek@corp.ovh.com>
2017-08-03 09:45:28 +02:00
Abhishek Lekshmanan
a80b99fd41 doc: 12.1.1 release notes add major changes
Also cleanup PendingReleasenotes to an empty file so that only newer
changes are tracked, adding the relevant section back to
RC1 where relevant. Moving all the RC1 announcements back to RC2, when
we go to 12.2.0 we'll collapse all of these back to the release
announcments

Signed-off-by: Abhishek Lekshmanan <alekshmanan@suse.com>
2017-08-02 17:41:13 +02:00
Sage Weil
e0bd667320 PendingReleaseNotes: note about put -> set
Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-26 14:13:22 -04:00
Jason Dillaman
6b44cb6034 PendingReleaseNotes: added blurb for new RBD cap profiles
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-07-21 14:30:38 -04:00
Sage Weil
7832c53375 mon/PGMap: remove skewed utilizatoin warning
This has a few problems:

1- It does not do it's analysis over CRUSH rule roots/classes, which
means that an innocent user of classes will see skewed usage (bc hdds are
more full than ssds, say)

2- It does not take degraded clusters into account, which means the warning
will appear when a fresh OSD is added.

See http://tracker.ceph.com/issues/20730

Signed-off-by: Sage Weil <sage@redhat.com>
2017-07-21 11:58:08 -04:00