Commit Graph

83824 Commits

Author SHA1 Message Date
Sage Weil
f999e8aa54 mon/ConfigMonitor: always send initial config, even if empty
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
c9f1fb841c common/ceph_context: count crypto/shutdown cycles
We need to allow crypto to be set up and torn down before a fork.  Count
the init/shutdown cycles to make that safe.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
4c7e382a47 common/ceph_context: whitespace
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
a524868161 mon: handle MGetConfig
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
e76a189732 vstart.sh: use mon config for many things
We also trim out some obsolete options while we're at it.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
936de8b3db mon: 'config set <who> <name> <value>'
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
2f9617d801 mon/ConfigMonitor: refresh mon configs too
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
3b0fc9537e mon/ConfigMap: some improvements
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
7ccd515f82 mon/ConfigMap: move option mask parsing into helper
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
d3dac3d280 mgr/DaemonServer: 'config show <who>'
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
d8450574cf mgr/MgrClient: report running config to mgr
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
e82f925eb3 mon/ConfigKeyService: add 'prefix' arg to 'config-key dump ...'
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
8bd1f8d338 vstart.sh: less config noise
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
bb4151ea0d common/options: remove obsolete 'crushtool' option
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
7940f66b64 mon/MonClient: subscribe to config, handle updates
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
38db0a289f mon/ConfigMonitor: add monitor service for distributing configs
Add 'config' subscribe option to get MConfigs on auth and when config is
updated.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
43a9d164d6 mon/ConfigMap: parsed cluster-wide config
Breaks down options by global, type, daemon, and can filter options by
crush location.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:48 -06:00
Sage Weil
081e52c7bf messages/MConfig: send config map
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:47 -06:00
Sage Weil
9647e50886 common/config: set_mon_vals()
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:47 -06:00
Sage Weil
37fe36fbe5 common/config: some cleanup; rm_val
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:47 -06:00
Sage Weil
d4cc161566 cleanup: src/.libs -> build/lib
Clean up remaining traces of automake's .libs.  This makes unittest_*
tests easier to run by hand (mostly).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:47 -06:00
Sage Weil
f8d4e5b5e9 common/config: rewrite (╯°□°)╯︵ ┻━┻
This is too complete a rewrite to reasonably break down into small steps,
and even if I could, it would be harder to review that way than to simply
review the new implementation.  The semantics of the old one were so weird
that it's harder to reason about the change in behavior than to simply
review the new behavior.

That's my story, at least, and I'm sticking to it!

So, here are the highlights:

 - $foo meta expansions are evaluated at get_val() time.  This means the
weird bool arguments to set_val specifying whether things were expanded
are removed (they didn't make any sense unless you were thinking about the
old implementation).
 - for every option, we track values from any inputs (config, mon,
   override).  At get_val() time, we pick the highest priority one.
 - diff() is rewritten to be simple and to show you all of the above.
 - internal interfaces are simplified, and in terms of Option::value_t
   whenever possible.
 - unit tests simplified somewhat based on the above.

Known issues:

 - legacy values get pushed out in select cases.  Notably if foo=$bar
   and bar is updated, we do not update $foo (there is no dependency
   tracking to do this efficiently).

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:47 -06:00
Sage Weil
55f902f267 common/config: whitespace
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:10 -06:00
Sage Weil
dfd07f3820 common/config: streamline get_val_generic
Lookup value first; avoid a schema lookup entirely.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:10 -06:00
Sage Weil
db655f800a common: refactor default config value handling
- pass an optional map<string,string> instead of an arg list
- remember default values in md_config_t
- some nicer helpers

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:10 -06:00
Sage Weil
955537776b os/bluestore: pass rocksdb options via map, not global config
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:10 -06:00
Sage Weil
33a333ebaa kv/KeyValueDB: pass kv_options map to ctor
This will let us avoid passing options via global config options.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:09 -06:00
Sage Weil
e6612ade1d common/config: make debug_* regular options
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:09 -06:00
Sage Weil
08eaca61be crush/CrushWrapper: get_full_location by name
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:09 -06:00
Sage Weil
4161e804d7 common/config: move parse_value() into Option
It is more reuable there.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:09 -06:00
Sage Weil
02e57753e5 common/config: new get_val() variant
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:09 -06:00
Sage Weil
da11800d30 common/config: record is_daemon
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:09 -06:00
Sage Weil
64a5332766 common/config: find_option
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:09 -06:00
Sage Weil
004357a03b common: don't pass alt_def_args if we don't use them
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:09 -06:00
Sage Weil
35caf2e106 common/options: convert bool safe to a flags field
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:09 -06:00
Sage Weil
c391f476af mon/ConfigKeyService: make STORE_PREFIX public
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:09 -06:00
Sage Weil
dd216198b5
Merge pull request #20681 from liewegas/wip-fork-vs-msgr
common,rbd-nbd: fix up prefork behavior vs AsyncMessenger singletons

Reviewed-by: Haomai Wang <haomai@xsky.com>
2018-03-06 14:43:05 -06:00
Nathan Cutler
233fe8338e
Merge pull request #17530 from smithfarm/wip-21264
tools: cleanup: rip out ceph-rest-api

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2018-03-06 15:22:20 +01:00
Sage Weil
f4bb81553c Merge PR #20688 into wip-sage-testing-20180306.131906
* refs/pull/20688/head:
	doc: Drop the output of pg query
	doc: Update Monitoring OSDs and PGs

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-03-06 07:19:46 -06:00
Sage Weil
2a978666fc githubmap: update contributors
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 07:19:45 -06:00
Alfredo Deza
83348aef08
Merge pull request #20718 from ceph/wip-rm23163
ceph-volume tests alleviate libvirt timeouts when reloading

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-03-06 08:04:46 -05:00
Kefu Chai
59195f12da
Merge pull request #20726 from b-ranto/wip-doc-upgrade
build-doc: Upgrade ceph python libraries

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-06 19:47:41 +08:00
Kefu Chai
23eb14de52
Merge pull request #20103 from openattic/wip-mgr-dashboard_v2
mgr/dashboard_v2: Initial submission of a web-based management UI (replacement for the existing dashboard)

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-06 19:08:57 +08:00
Kefu Chai
2e4f06ea54
Merge pull request #20659 from tchaikov/wip-msg/async/dpdk/launch-on-coreid
msg/async: execute on core specified by core_id not its index

Reviewed-by: shangfufei <shangfufei@inspur.com>
Reviewed-by: Haomai Wang <haomai@xsky.com>
2018-03-06 17:10:52 +08:00
Nathan Cutler
bebcdbeb76 tests: workunits: drop rest/test.py workunit
This workunit is only used by the two rest-api test cases that are also being removed.

Fixes: http://tracker.ceph.com/issues/21264
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-03-06 09:34:43 +01:00
Nathan Cutler
b69530e647 tests: rados suite: drop rest-api test cases
Fixes: http://tracker.ceph.com/issues/21264
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-03-06 06:58:59 +01:00
Gregory Farnum
017c846449
Merge pull request #20519 from gregsfortytwo/wip-22882-linger-locking
osdc/Objecter: take budgets across a LingerOp instead of on child Ops

Reviewed-by:  Jason Dillaman <dillaman@redhat.com>
2018-03-05 21:49:27 -08:00
Greg Farnum
aba55b5fb6 osdc: create and use take_linger_budget for prefetching watch/notify budgets
We don't actually take any budget, as we don't want to hit the
total op limits (especially on eg rbd-mirror), but this prevents
our per-message budgeting from causing a deadlock.

Fixes: http://tracker.ceph.com/issues/22882

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2018-03-05 21:45:42 -08:00
Gregory Farnum
7b9a715189
Merge pull request #20517 from gregsfortytwo/wip-22114-beacon-blocking-2
mon: mark OSD beacons and pg_create messages as no_reply

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2018-03-05 21:29:10 -08:00
Jos Collin
3d6a61efff
Merge pull request #20720 from ctrlaltdel/typo
doc: Fix typo s/applicatoin/application/

Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-03-06 09:22:19 +05:30