Commit Graph

94840 Commits

Author SHA1 Message Date
Yingxin Cheng
092944837e crimson/net: compatible mode of crimson-msgr
Added a compatible mode with master_sid to support single-core
dispatcher.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
2019-02-12 16:48:02 +08:00
Yingxin Cheng
cf92062e3f crimson/net: suppress info logs for frequent keepalive
The new unittest_seastar_messenger will print out the count of keepalive
attempts at the end of the execution.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
2019-02-12 16:48:02 +08:00
Yingxin Cheng
7ac5fb013b crimson/net: enable connections on all cores
Implement the sharded crimson-messenger:

* Sharded Messenger: provides shared-nothing Messenger for each shard,
  it's interfaces are symmetric to be called, any modifications will be
  applied to all shards.

* Sharded/non-sharded Dispatcher interface: allow connections to be
  dispatched, and related resources (such as Session) to be managed in
  its own shard or not.

* Sharded Connection: A connection only lives at one dedicated core
  during its lifecycle. It's sharded by its peer_IP in this PoC, because
  peer port and nonce are not available when a socket is accepted. While
  its interfaces are safe to be called from all shards.

* Replace `boost::intrusive_ptr` by seastar native smart ptrs for
  `Connection` and `SocketConnection`, because they need to be
  destructed from its original core.

* Unit test: establish multiple connections on both client and server
  sides, they runs concurrently and creates sessions that are also
  following shared-nothing design.

Signed-off-by: Yingxin Cheng <yingxincheng@gmail.com>
2019-02-12 16:47:53 +08:00
Kefu Chai
e01b99c358
Merge pull request #26255 from tchaikov/wip-crimson-hb
crimson/osd: add more heartbeat peers

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-12 10:57:40 +08:00
Sage Weil
0a1ac6418d Merge PR #26282 into master
* refs/pull/26282/head:
	mon: include progress events in 'ceph status' output
	mon/MgrStatMonitor: persist progress events
	mgr: send progress events to mon
	mgr/progress: revise message syntax a bit
	mgr/progress: report events into mgr
	mgr: allow progress events to be reported from modules
	mgr/progress: make persist period/interval configurable
	mgr/progress: prune completed events

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 17:26:19 -06:00
Sage Weil
059844f9b9 Merge PR #26336 into master
* refs/pull/26336/head:
	qa/tasks/keystone.py: no need for notcmalloc in example
	qa/suites/rgw/tempest/tasks/rgw_tempest: no need for notcmalloc

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2019-02-11 15:47:29 -06:00
Jason Dillaman
3b797011b9
Merge pull request #26322 from trociny/wip-mock-warning
test/librbd: fix 'Uninteresting mock function call' warning

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-02-11 12:23:02 -05:00
Kefu Chai
e1e3dc934c
Merge pull request #26318 from wjwithagen/wjw-fix-crush_weights.sh-sed
test: switch to GNU sed on FreeBSD

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-12 00:20:15 +08:00
Ilya Dryomov
400686efd9
Merge pull request #26339 from idryomov/wip-krbd-namespaces-test
qa: krbd namespaces test

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-02-11 16:00:32 +01:00
Lenz Grimmer
4431d6d60f
Merge pull request #26102 from rhcs-dashboard/wip-featuretoggles
mgr/dashboard: add Feature Toggles

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-02-11 15:58:57 +01:00
Lenz Grimmer
35d17efabe
Merge pull request #26360 from rhcs-dashboard/wip-38254-master
doc: mgr/orch: Fix remote_host doc reference

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
2019-02-11 14:16:59 +01:00
Ernesto Puerta
ec949ab71d
doc: mgr/orch: Fix remote_host doc reference
The type fix in the remote_host to remove_host has caused a Ceph docs
build failure.

Introduced-By: 05cfa6f
Fixes: http://tracker.ceph.com/issues/38254
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:55:47 +01:00
Nathan Cutler
8ea24dd9aa
Merge pull request #26268 from smithfarm/wip-opensuse-s390
rpm: do not exclude s390x build on openSUSE

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-11 12:53:09 +01:00
Ernesto Puerta
ae8e288769
doc: mgr/dashboard: feature-toggles: Fix config
Add '*.inc.rst' to the list of excluded patterns from sphinx-build. This
allows for using '*.inc.rst' as includes, and avoids duplicates. The
benefit of keeping the trailing '.rst' extension is that most IDEs use
that to render reStructured Text files.

Fixes: http://tracker.ceph.com/issues/37530
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:07:55 +01:00
Ernesto Puerta
c7ba1ba157
mgr/dashboard: feature-toggles: minor fixes
Fixes: http://tracker.ceph.com/issues/37530
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:07:55 +01:00
Ernesto Puerta
001c049ef2
mgr/dashboard: feature-toggles: Update Hacking
Fixes: http://tracker.ceph.com/issues/37530
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:07:55 +01:00
Ernesto Puerta
d15eb65808
mgr/dashboard: feature-toggles: Fix formatting
Fix front-end formatting as suggested by tspmelo

Fixes: http://tracker.ceph.com/issues/37530
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:07:55 +01:00
Ernesto Puerta
7b06daedfc
doc: mgr/dashboard: feature-toggles: Add doc
Fixes: http://tracker.ceph.com/issues/37530
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:07:55 +01:00
Ernesto Puerta
8f29ff5159
mgr/dashboard: feature-toggles: add py unit tests
Add python unit test for feature toggles plugin, and refactor other
files, and add a new type of function cache decorator based on LRU but
with a TTL.

Fixes: http://tracker.ceph.com/issues/37530
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2019-02-11 12:07:49 +01:00
Lenz Grimmer
3fb2d72601
Merge pull request #26115 from ricardoasmarques/iscsi-discovery-auth-api
mgr/dashboard: iSCSI discovery authentication API

Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-02-11 10:50:14 +01:00
Sebastian Wagner
ad7abc3995
Merge pull request #26314 from sebastian-philipp/orchestrator-host-mon-mgr
mgr/orchestrator: Add host mon mgr management to interface

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2019-02-11 09:52:53 +01:00
Sage Weil
b4fa47390d Merge PR #25977 into master
* refs/pull/25977/head:
	qa/suites: exclude new packages when installing old versions
	rpm: add dependency on python-kubernetes module to ceph-mgr-rook package
	rpm,deb: add rbd_support module to ceph-mgr
	packaging: split ceph-mgr diskprediction and rook plugins into own packages

Reviewed-by: Tim Serong <tserong@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-02-09 13:46:51 -06:00
Sage Weil
33582d2290 Merge PR #26327 into master
* refs/pull/26327/head:
	doc/dev/msgr2: bring up to date with new HELLO, different RECONNECT
	msg/async/ProtocolV2: separate IDENT into {CLIENT,SERVER}_IDENT

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-02-09 08:29:18 -06:00
Kefu Chai
ed98a198a4
Merge pull request #25082 from rzarzynski/wip-bl-less-atomic
common: optimize reference counting in bufferlist

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-02-09 21:32:23 +08:00
Patrick Donnelly
f9854b522f
Merge PR #26287 into master
* refs/pull/26287/head:
	doc: update doc on new recall config

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2019-02-08 19:38:37 -08:00
Sage Weil
d431821fb4 Merge PR #26248 into master
* refs/pull/26248/head:
	systemd: lock down privileges more

Reviewed-by: Sage Weil <sage@redhat.com>
2019-02-08 14:42:10 -06:00
Sage Weil
a2a39b0cab mon: include progress events in 'ceph status' output
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-08 13:50:27 -06:00
Sage Weil
db7f17db2c mon/MgrStatMonitor: persist progress events
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-08 13:50:27 -06:00
Sage Weil
08d1a6fc3c mgr: send progress events to mon
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-08 13:50:27 -06:00
Sage Weil
1d305f1264 mgr/progress: revise message syntax a bit
"osd.0", not "OSD 0"

Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-08 13:50:27 -06:00
Sage Weil
7678bfa6b2 mgr/progress: report events into mgr
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-08 13:49:57 -06:00
Sage Weil
5cbdf32430 qa/suites: exclude new packages when installing old versions
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-08 12:59:22 -06:00
Sage Weil
97cf0c5145 Merge PR #26335 into master
* refs/pull/26335/head:
	ceph-osd: fix warning

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-02-08 12:51:57 -06:00
Jeff Layton
dc13683c1a rpm: add dependency on python-kubernetes module to ceph-mgr-rook package
Signed-off-by: Jeff Layton <jlayton@redhat.com>
2019-02-08 12:03:15 -05:00
David Zafman
3ee2579ec8
Merge pull request #26330 from dzafman/wip-fixstats
test: osd-backfill-stats.sh Fix check of multi backfill OSDs, skip re…

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-02-08 08:41:29 -08:00
Sage Weil
9c729a78be qa/tasks/keystone.py: no need for notcmalloc in example
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-08 09:12:01 -06:00
Sage Weil
b8b398e1ab qa/suites/rgw/tempest/tasks/rgw_tempest: no need for notcmalloc
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-08 09:11:07 -06:00
Sage Weil
88b87c042d rpm,deb: add rbd_support module to ceph-mgr
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-08 08:29:45 -06:00
Ilya Dryomov
7fdb879004 qa: krbd namespaces test
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-02-08 15:29:20 +01:00
Sage Weil
bf52bcd219 ceph-osd: fix warning
/home/sage/src/ceph/src/ceph_osd.cc: In function ‘int main(int, const char**)’:
/home/sage/src/ceph/src/ceph_osd.cc:478:31: warning: comparison of integer expressions of different signedness: ‘int’ and ‘unsigned int’ [-Wsign-compare]
       require_osd_release + 2 < ceph_release()) {
       ~~~~~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~

Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-08 07:16:07 -06:00
Ricardo Marques
6f3471648d mgr/dashboard: iSCSI discovery authentication API
Fixes: https://tracker.ceph.com/issues/38017

Signed-off-by: Ricardo Marques <rimarques@suse.com>
2019-02-08 12:13:39 +00:00
Sebastian Wagner
dfe95eef11
Merge pull request #26317 from jtlayton/wip-jlayton-orch
mgr/orchestrator: Fix up rook osd create dispatcher

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-08 10:58:46 +01:00
Sebastian Wagner
0daae004f0
Merge pull request #26331 from tchaikov/wip-mgr-orchestrator-docstring
doc/mgr/orchestrator: Add Architecture Image

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-08 09:33:05 +01:00
Kefu Chai
8b144a1a5f
Merge pull request #26301 from tchaikov/wip-cxx17-aggre-init
changes to address FTBFS on fc30

Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Kaleb S. KEITHLEY <kkeithle@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2019-02-08 16:09:11 +08:00
Kefu Chai
92a7a3f6f7
Merge pull request #26311 from tchaikov/wip-docker-fc-29
tests: update Dockerfile to support fc-29

Reviewed-By: Neha Ojha <nojha@redhat.com>
2019-02-08 14:37:51 +08:00
Kefu Chai
dec885c651 mgr/orchestrator: reformat the docstring
we need to add an empty line before the param and return lines.

so it renders better with sphinx's `automethod::` directive.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-08 14:33:00 +08:00
Kefu Chai
00989aa0a3
Merge pull request #26313 from tchaikov/wip-mgr-ansible-tox
mgr/ansible: add install tox==2.9.1

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-08 13:12:25 +08:00
David Zafman
910a95b9c8 test: osd-backfill-stats.sh Fix check of multi backfill OSDs, skip remapped test
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-02-07 20:05:58 -08:00
David Zafman
690ff9a21f
Merge pull request #26213 from dzafman/wip-38041
osd: Fix recovery and backfill priority handling

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-02-07 17:26:34 -08:00
David Zafman
ca5cf14fa8 test: Add scripts to test backfill/recovery priority handling
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-02-07 15:46:23 -08:00