Commit Graph

86035 Commits

Author SHA1 Message Date
Kefu Chai
3d2e5449f1 test/librados: increase pgp_num along with pg_num
Fixes: http://tracker.ceph.com/issues/23763
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-24 10:16:12 +08:00
Kefu Chai
713ebcdd34
Merge pull request #21590 from sebastian-philipp/dashboard-fix-taskmanager-race
mgr/dashboard: Fix data race and use-before-assignment

Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-04-24 09:37:36 +08:00
Patrick Donnelly
19ff550c54
MDSMonitor: do not resize cluster when MDS is starting
Fixes: http://tracker.ceph.com/issues/23799

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-23 16:08:00 -07:00
Casey Bodley
c893dcaa43 dout: DoutPrefixProvider operates directly on stream
removes the need for stringstream in more complicated prefixes

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-04-23 18:08:25 -04:00
John Spray
b1e8d63bf7 mgr: handle commands sent to unavailable modules
There are some up-front checks in DaemonServer
but it shouldn't assume that its checks are
necessarily going to match the choices about
how ActivePyModules composes its ::modules member,
so let's have some extra checks to avoid
risk of crashing mgr on commands sent to
unhealthy/unloaded modules.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 17:32:36 -04:00
Sage Weil
a2636967f3
Merge pull request #20959 from LiumxNL/fix-pg-fake-down
pg: handle MNotifyRec event in down state

Reviewed-by: Sage Weil <sage@redhat.com>
2018-04-23 16:30:43 -05:00
John Spray
cf5ef59bcc mgr: execute modules even if can_run=false
We execute modules even if can_run=false, so that it is possible
to load them for running their selftest hooks.  However,
we already raise health messages about the fact that they're
enabled but can't run, so we don't want to also raise
health messages about whatever exceptions they raise
from serve()

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 17:30:41 -04:00
Kefu Chai
60e3a2404f qa/tasks/mgr: pass "--force" to "mgr module enable"
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-23 17:30:40 -04:00
Kefu Chai
67ac7496b7 debian: let ceph-mgr suggests python-influxdb
the influx plugin requires influxdb python module to function, but
influxdb mgr plugin is optional for users who don't use influxdb.
so it's marked "Suggests" at this moment before we use a more flexible
packaging scheme.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-04-23 17:30:40 -04:00
Sage Weil
f9cd5b1f0c
Merge pull request #21000 from ceph/evelu-23320
common: Improving message sent to user when getting signals

Reviewed-by: Sage Weil <sage@redhat.com>
2018-04-23 16:29:27 -05:00
Sage Weil
06a2cc5a2f
Merge pull request #20761 from liewegas/wip-service-unregister
mgr: allow service daemons to unregister from ServiceMap

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-23 16:27:50 -05:00
Danny Al-Gaaf
d45421d0e6 rados/objclass.h: fix build define CEPH_CLS_API in all cases
Fix for bug introduced with 096668ec5d:

In file included from src/objclass/objclass.h:13:0,
                 from src/cls/hello/cls_hello.cc:37:
src/include/rados/objclass.h:31:1: error: ‘CEPH_CLS_API’ does not name a
type; did you mean ‘CEPH_CAP_ANY’?
 CEPH_CLS_API void name##_cls_init()
 ^
/develop/ceph/source/ceph/src/include/rados/objclass.h:31:1: note: in
definition of macro ‘CLS_INIT’
 CEPH_CLS_API void name##_cls_init()
 ^~~~~~~~~~~~

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2018-04-23 23:14:25 +02:00
Jason Dillaman
2311eff622 qa/suites/rbd: thrash rbd-mirror daemon during tests
Fixes: http://tracker.ceph.com/issues/18753
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-04-23 16:02:59 -04:00
Sage Weil
f2942aa571 osd/ECBackend: wait for apply for luminous peers
Avoid completing a write until luminous peers also apply the change.
This is overkill, but works around a problem where completing our write
here allows the next read to start too early.  This is because the
PrimaryLogPG is handling the write-to-read ordering, but completing the
write releases the write lock in the PG.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-23 13:23:53 -05:00
Sage Weil
6a3c4e4652
Merge pull request #21442 from jcsp/wip-config
mgr: centralized setting/getting of mgr configs

Reviewed-by: Sage Weil <sage@redhat.com>
2018-04-23 11:02:21 -05:00
Casey Bodley
13160222fd rgw: add buffering filter to compression for fetch_remote_obj
fetch_remote_obj() only gets 16k blocks from libcurl, which leads to a
much worse compression ratio than the 4m blocks in normal PUT requests

Fixes: http://tracker.ceph.com/issues/23547

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-04-23 11:35:00 -04:00
Volker Theile
9a4d379705 mgr/dashboard: Fix bug in RBD form.
Signed-off-by: Volker Theile <vtheile@suse.com>
2018-04-23 17:13:31 +02:00
Sage Weil
7003d415db
Merge pull request #21580 from xiexingguo/wip-add-assert
osd/PGLog: assert out on performing overflowed log trimming

Reviewed-by: Sage Weil <sage@redhat.com>
2018-04-23 09:59:46 -05:00
Kefu Chai
f612f0f151
Merge pull request #21572 from tchaikov/wip-boost-1.67
cmake,make-dist: bump up boost version to 1.67

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2018-04-23 22:57:47 +08:00
Kefu Chai
2c41c2f160
Merge pull request #19985 from Liuchang0812/osd-pool-stats-in-mgr
mon, mgr: move "osd pool stats" command to mgr and mgr python module

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-23 22:52:22 +08:00
Kefu Chai
9a48ccb576
Merge pull request #21058 from trociny/wip-osd-empty-snapset
osd: don't crash on empty snapset

Reviewed-by: Sage Weil <sage@redhat.com>
2018-04-23 22:33:13 +08:00
Jason Dillaman
b28b2ee875 qa/tasks: thrasher for rbd-mirror daemon
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-04-23 10:22:50 -04:00
John Spray
8453c0edba doc: update config-key->config in mgr module docs
Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 10:14:31 -04:00
John Spray
5414b73800 doc: update mgr plugin guide
...for recent config changes.  Explain about MgrModule.OPTIONS,
and explain the new store/config distinction.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 10:14:31 -04:00
John Spray
4b3f026d07 qa: update mgr test for MgrModule.OPTIONS
Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 10:14:31 -04:00
John Spray
a5f71c59a5 mgr: add MgrModule.OPTIONS definitions to modules
They need these to do upgrades properly.  Where there
was an existing structure describing config, merge
these together to avoid having two lists of options.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 10:14:31 -04:00
Sage Weil
5b99b6f8d2
Merge pull request #21188 from guzhongyan/mgr-disable-fix
mon,mgr: improve 'mgr module disable' cmd

Reviewed-by: John Spray <john.spray@redhat.com>
2018-04-23 09:12:55 -05:00
Sage Weil
868a41e45a
Merge pull request #21597 from LenzGr/dashboard-releasenotes
PendingReleaseNotes: Added note about Dashboard v2, fixed typo
2018-04-23 09:01:15 -05:00
Volker Theile
379276ecee Address comments.
Signed-off-by: Volker Theile <vtheile@suse.com>
2018-04-23 15:45:28 +02:00
Volker Theile
1daa8b0ab3 mgr/dashboard: Add 'autofocus' directive
Signed-off-by: Volker Theile <vtheile@suse.com>
2018-04-23 15:45:28 +02:00
Sage Weil
25d754a9b0
Merge pull request #21581 from tchaikov/wip-objcls-sdk
objclass-sdk: expose __cls_init() to the world

Reviewed-by: Sage Weil <sage@redhat.com>
2018-04-23 08:28:14 -05:00
Volker Theile
9dbb2df402 mgr/dashboard: Load the datatable content after the component is initialized.
Signed-off-by: Volker Theile <vtheile@suse.com>
2018-04-23 13:36:40 +02:00
John Spray
6c8fba9758 mgr: load MgrModule.OPTIONS and use it in upgrade
Modules will now only migrate items from config-key
into config options if they appear in the module's
schema.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:32:12 -04:00
John Spray
bca1bb43c6 mgr: introduce MgrModule.OPTIONS field
Now is a good time to start requiring
modules to explicitly list their configuration
settings, so that we can do a proper job of
migrating configuration from old config-key style,
i.e. knowing what's a config setting and what's
a KV store item.

Throw an exception if a module tries to
access a setting outside their schema, so
that we have some confidence that the schema
is complete.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:47 -04:00
John Spray
c928983340 mgr: fix up a couple of double-lookups
Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:47 -04:00
John Spray
d4ed33c2e0 qa: test mgr live configuration updates
Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:47 -04:00
John Spray
98a3d0e04a vstart: use "config set" for mgr modules
...instead of pre-mimic config-key set.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:47 -04:00
John Spray
54e5cef234 mgr/restful: migrate to new get_store interface
Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:47 -04:00
John Spray
69f0a0966e mon: warn user doing "config key set mgr/..."
This is still completely legal, but isn't going
to have the effect they wanted if they were
trying to set a configuration option for a mgr module.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:46 -04:00
John Spray
dd7631c292 mgr: replace get_config_prefix with get_store_prefix
The _prefix variant was only used for data-ish things,
so we can just move it over to operate on store instead
of config, rather than having a _prefix variant for both.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:46 -04:00
John Spray
1d830df901 mgr: don't migrate config values that look like data
A quickie heuristic, but sufficient to avoid picking
up e.g. SSL certs and trying to cram them into
config values.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:46 -04:00
John Spray
f2b340a842 mon: grant mgr profile "config" commands
...and remove redundant config-key lines (these are applied
to mgr anyway in the next block, and mgr even has a broader
config-key permission in the line above).

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:46 -04:00
John Spray
6e447fd101 mgr: clean up ActivePyModules logging
This was running the prefix and message together.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:46 -04:00
John Spray
3bc9850e6f mgr: fix PyModuleConfig::set_config
Commands were slightly wrong.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:45 -04:00
John Spray
48c9071d63 mgr: remove dead update_perf_schema fn definition
Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:45 -04:00
John Spray
37484af0b8 mgr: rework kv store load path
The locking and blocking around this was a bit
tricky.  Do the simple thing, and pull the
load_store out to Mgr so that it can be safely
done as part of the background_init process (just drop
Mgr::lock across blocking actions).

Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:45 -04:00
John Spray
bd80cf9398 mgr: update python interface for store vs. config
Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:45 -04:00
John Spray
306e4854b5 mgr: separate out module_config and store_cache
Signed-off-by: John Spray <john.spray@redhat.com>
2018-04-23 07:29:45 -04:00
Rubab-Syed
3193d40d0d mgr: centralized setting/getting of mgr configs
Signed-off-by: Rubab Syed<rubab.syed21@gmail.com>
2018-04-23 07:29:44 -04:00
Lenz Grimmer
a2639b6072 PendingReleaseNotes: Added note about Dashboard v2, fixed typo
Added a bullet point about the new Ceph mgr dashboard, fixed typo in the
LZ4 compression bullet point.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2018-04-23 13:28:53 +02:00