Commit Graph

96995 Commits

Author SHA1 Message Date
Sage Weil
8827250d5a os/filestore: make note of EIO errors when we see them
This is imprecise, since we can't (easily) map an EIO back to a specific
part of the device, or even (easily) tell whether it was a read or write
error.  It's enough to mark a crash dump as an EIO event, though, and to
include the name of the (primary) filestore device.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-07 16:01:38 -05:00
Sage Weil
cef94b72b2 os/filestore: note devname for later use
This will generally happen early, before we see an EIO error and need it.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-07 16:01:38 -05:00
Sage Weil
e3464df47b global/signal_handler: avoid core dump on EIO
Generating a core dump is overkill if we hit an EIO error from the
hardware.  Exit with an error code instead.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-07 16:01:38 -05:00
Sage Weil
145333576c os/bluestore/KernelDevice: note EIO metadata on aio EIO
Note that we only do this if we're about to induce a crash.  If we can
pass EIO up the stack, it's up to the upper layer to handle it or trigger
its own crash if it can't.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-07 16:01:38 -05:00
Sage Weil
7f9df6158d global: add hook to annotate crash report with EIO information
If the global g_eio* fields are populated, include them in the crash
report, similar to how we populate assertion metadata.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-07 16:01:38 -05:00
Sage Weil
3c9db396ae Merge PR #27141 into master
* refs/pull/27141/head:
	mon/OSDMonitor: fix osd boot feature vs require_osd_release check
	include/ceph_features: retire 7 other old features
	include/ceph_features: retire ERASURE_CODE_PLUGINS_V2
	include/ceph_features: retire OSD_ERASURE_CODES
	include/ceph_features: update comment to align with N+2 upgrades
	include/ceph_features: adjust whitespace for retired and now usable features
	mon: remove check for jewel mons
	mds/FSMap: remove support for encoding jewel FSMap
	include/ceph_features: enable SERVER_OCTOPUS
	test/cli/osdmaptool/feature-set-unset-list: add octopus to output
	test/cli/osdmaptool/feature-set-unset-list: change unknown feature bit
	qa/releases/octopus.yaml: add octopus upgrade final step
	osd/OSDMap: octopus encoding features
	mon/OSDMonitor: add mon_debug_no_require_octopus
	mon/OSDMonitor: allow 'osd require-osd-release octopus'
	mon: add ondisk incompat octopus feature
	mon/mon_types: add mon feature for octopus
	include/ceph_features: SERVER_O -> SERVER_OCTOPUS

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-04-03 14:59:03 -05:00
Sage Weil
1e7629983f Merge PR #27291 into master
* refs/pull/27291/head:
	qa/suites/upgrade/nautilus-x-singleton: upgrade mgrs early
	qa/suites/upgrade/mimic-x-singleton: upgrade mgrs later
	qa/suites: add upgrade/nautilus-x-singleton and symlink from rados/upgrade
	qa/suites: move rados/upgrade/mimic-x-singleton to upgrade/ and symlink

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-03 14:07:27 -05:00
Sage Weil
d667228c2e Merge PR #27146 into master
* refs/pull/27146/head:
	mon/MonMap: add min_quorum_size() helper
	mon/MDSMonitor: add 'mds ok-to-stop' command
	mon: add 'mon ok-to-{stop,add-offline,rm}' commands

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-03 13:49:19 -05:00
Ricardo Marques
7f150021a1
Merge pull request #26572 from rhcs-dashboard/wip-37337-master
mgr/dashboard: unify button/URL actions naming

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-04-03 19:46:38 +01:00
J. Eric Ivancich
a33ae8c97a
Merge pull request #26183 from letterwuyu/wip-rgw-get-detail-user-info
rgw: Make rgw admin ops api get user info consistent with the command line
2019-04-03 12:36:23 -04:00
J. Eric Ivancich
00ec1eeccb
Merge pull request #26412 from theanalyst/rgw-orphan-fixes
rgw: orphan fixes
2019-04-03 12:34:20 -04:00
Sage Weil
54d0c2b19a Merge PR #27343 into master
* refs/pull/27343/head:
	mon/LogMonitor: add mon_cluster_log_to_file bool option

Reviewed-by: Sébastien Han <seb@redhat.com>
2019-04-03 09:22:19 -05:00
Ernesto Puerta
b8dc3b5c8a
mgr/dashboard: add wording section to hacking.rst
Fixes: http://tracker.ceph.com/issues/37337
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-04-03 16:09:36 +02:00
Ernesto Puerta
3346688394
mgr/dashboard: unify button/URL actions naming
- Mappings (actually an Enum) created for actions (buttons and other UI elements) and URLs: ActionLabels and URLVerbs.
  - An alternative would be to fix/improve the current i18n-polyfill, which only works with literal strings (not even with 'const enums' which become literals after Typescript transpiling).
  - Additionally having a predefined file with some strings to translate (actions, verbs, etc) could improve on the 1st of the 2-stage i18n process (as extraction tool has a lot of limitations).
- A corresponding ActionLabelsI18n service with translated labels (it's a service as I haven't found the way to either translate no-const strings (ngx-translate/AST parser failure) or get a static translator).
  - This services could/should be extended to cover all strings that are defined in static/globally scoped objects before any I18n provider has been initialized.
- Breadcrumbs are not translated (neither were they before this change). This part remains untackled: using 'proxy' static objects and performing live translation could deal with the issue.
- New URLBuilder service created (following a established pattern in the Java/.NET world) . This should avoid the need of messing with literal URLs and string composition/parsing, and while the front-end is not meant to be consumed by anyone, Angular does not provide any other way for the app to navigate between components, so the URLs are a de-facto interface contract. Unlike this approach is not flawless, it's easier to enforce, while issues coming from free-from strings are really hard to catch.
  - This could be further improved by using a router registry/dynamic routing. Most of the routes are trivial.
- As a side effect of these changes, routing module has been refactored and some routes moved to their specific modules (pool, rbd, rgw), via loadChildren and routes.forChild() magic. Now the above mentioned components are lazy-loaded/pre-loaded (it means right after the main code is loaded). This should also decrease the loading time (though probably this is not biggest time eater here).
  - As now modules can be loaded multiple times, not only from App module by means of lazy loading, but also from other ones (as PoolModule loads BlockModule to get QoS widgets in Pool windows), now lazy loaded modules include 2 NgModules (one with imports: RouterModule.forChild(routes), meant for lazy-loading, and another without routes).
- Caveat: Some parts might not be (fully) translated (NFS, iSCSI, mirroring), as there's been ongoing work on them and it's hard to keep up with the new code.
These changes will be a waste of time if the new code does not take benefit from/adheres to it, so I'm still figuring out how to spread this (nothing really fancy to demo). Maybe adding some checks/harnessing to enforce the new naming convention (ideas greatly welcome here).

Fixes: http://tracker.ceph.com/issues/37337
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-04-03 16:09:36 +02:00
Sage Weil
978ac6e2f8 mon/LogMonitor: add mon_cluster_log_to_file bool option
Allow cluster logging to a file to be disabled via a boolean.  Default
to true to avoid any change in behavior.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-03 07:18:50 -05:00
Kefu Chai
42f777e67d
Merge pull request #27280 from xiexingguo/wip-39039
mgr: more GIL fixes

Reviewed-by: Yan Jun <yan.jun8@zte.com.cn>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-03 18:53:55 +08:00
Ricardo Marques
f40c51a1af
Merge pull request #27245 from tspmelo/wip-nfs-typo
mgr/dashboard: Fix typo in NFS form

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-04-03 09:44:24 +01:00
Kefu Chai
dc5e9fbea8
Merge pull request #27333 from tchaikov/wip-rpm-devtoolsset-8-on-aarch64
rpm: enable devtoolset-8 on aarch64 also

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-04-03 13:29:33 +08:00
Kefu Chai
00f19923b4 install-deps,rpm: enable devtoolset-8 on aarch64 also
in 5ae3b06e, we left aarch64 with devtoolset-7, but aarch64 builders are
also suffering from http://tracker.ceph.com/issues/38892. so i installed
devtoolset-8 on all aarch64 builders manually from the rpm packages
downloaded from koji builder:

- https://cbs.centos.org/koji/buildinfo?buildID=24923
- https://cbs.centos.org/koji/buildinfo?buildID=24931

libasan5, libubsan1 are not installed.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-03 11:40:59 +08:00
Patrick Donnelly
73e0f9e72b
Merge PR #27328 into master
* refs/pull/27328/head:
	qa/tests: reduce number of jobs for `kcephfs`

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-04-02 18:28:09 -07:00
Kefu Chai
957f004fd7
Merge pull request #27310 from tchaikov/wip-crimson-cache-ss-oi
crimson/osd: cache object_info and snapset in PGBackend

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-04-03 09:24:05 +08:00
Kefu Chai
f746609ad5
Merge pull request #27307 from tchaikov/wip-crimson-osd-hb
crimson/osd: do not add whoami as hb peer and cleanups

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-04-03 09:14:37 +08:00
Yuri Weinstein
10d5a591fc qa/tests: reduce number of jobs for kcephfs
we need it on `master` as well
see https://github.com/ceph/ceph/pull/27165

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-04-02 16:34:29 -07:00
Sage Weil
cea39d2f01 qa/suites/upgrade/nautilus-x-singleton: upgrade mgrs early
The mgrmap may change when the mons upgrade, causing the mgr daemons to
respawn.  Restart mgr daemons before mons to avoid a mismatch between
the running version and the ondisk binary.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:41:15 -05:00
Sage Weil
2436eadcfd qa/suites/upgrade/mimic-x-singleton: upgrade mgrs later
The mgrmap may change when the mons upgrade, causing the mgr daemons to
respawn.  Delay the upgrade until later so that the ondisk binary does
not change out from underneath them.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:39:58 -05:00
Sage Weil
0adc99511f qa/suites: add upgrade/nautilus-x-singleton and symlink from rados/upgrade
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:35:25 -05:00
Sage Weil
7fbc0f6e2c qa/suites: move rados/upgrade/mimic-x-singleton to upgrade/ and symlink
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:33:38 -05:00
Sage Weil
d656ef08ae Merge PR #27316 into master
* refs/pull/27316/head:
	doc/rados/operations: document BLUEFS_SPILLOVER

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-04-02 16:24:52 -05:00
Sage Weil
1a689766a5 mon/OSDMonitor: fix osd boot feature vs require_osd_release check
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
43c688289c include/ceph_features: retire 7 other old features
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
b7c88c26ca include/ceph_features: retire ERASURE_CODE_PLUGINS_V2
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
b0ca1bace0 include/ceph_features: retire OSD_ERASURE_CODES
We can use this again in Q.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
135022a3d6 include/ceph_features: update comment to align with N+2 upgrades
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
47049407ad include/ceph_features: adjust whitespace for retired and now usable features
The blank line suggests that the feature is now reusable.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
953dce7402 mon: remove check for jewel mons
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
1678753092 mds/FSMap: remove support for encoding jewel FSMap
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
ce7e0b1bb1 include/ceph_features: enable SERVER_OCTOPUS
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
1d198c764f test/cli/osdmaptool/feature-set-unset-list: add octopus to output
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
62fb916d73 test/cli/osdmaptool/feature-set-unset-list: change unknown feature bit
Use something we won't consume anytime soon.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
871c2ebe53 qa/releases/octopus.yaml: add octopus upgrade final step
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
c9a95a887c osd/OSDMap: octopus encoding features
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
3760e8f918 mon/OSDMonitor: add mon_debug_no_require_octopus
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
Sage Weil
2806de1147 mon/OSDMonitor: allow 'osd require-osd-release octopus'
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 16:19:43 -05:00
J. Eric Ivancich
f3d6746782
Merge pull request #27223 from ivancich/wip-fix-resharding-issue
rgw: race condition between resharding and ops waiting on resharding

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-04-02 16:24:36 -04:00
Sage Weil
242ef7824d doc/rados/operations: document BLUEFS_SPILLOVER
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 11:13:31 -05:00
Tiago Melo
6c5ed44716 mgr/dashboard: Fix typo in NFS form
Fixes: http://tracker.ceph.com/issues/39067

Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-04-02 15:58:17 +00:00
Sage Weil
cc16d9c9cf Merge PR #27265 into master
* refs/pull/27265/head:
	valgrind.supp: add clauses for uninitialised gcm.Xi in OpenSSL.
	src/valgrind.supp: replace with the teuthology's whitelist.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-02 10:52:14 -05:00
Sage Weil
0da42c1b70 Merge PR #27313 into master
* refs/pull/27313/head:
	mon: quiet devname log noise

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-02 10:07:57 -05:00
Sebastian Wagner
f44b01d35a
Merge pull request #26966 from SUSE/wip-orchestrator-deepsea-fix-device-ls
mgr/deepsea: use ceph_volume output in get_inventory()

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-04-02 16:16:23 +02:00
Sage Weil
3221381d9f mon: quiet devname log noise
Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-02 08:49:01 -05:00