Commit Graph

88005 Commits

Author SHA1 Message Date
Sage Weil
6f0e60c831 ceph-osd: use new bindv()
Rely on the new and improved pick_addresses() to produce an addrvec of
addresses we should bind to.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:24 -05:00
Sage Weil
57d756332d msg/async: bind to multiple addresses
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
d0db627cc0 msg/async: (legacy) handshake using legacy addr
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
b966c0d368 msg/async: fix some debug prefixes
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
6625caa7ff msg/async: multiple listening ServerSockets
No functional change yet.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
9fb1e521c7 osd/OSDMap: make cluster addrs addrvecs too
This will allow a single-step upgrade from msgr1 to msgr2: as each
nautilus OSD starts up, it will bind to both msgr1 and msgr2 addrs
(assuming it starts up after the mons have been upgraded).  Peer OSDs will
use the msgr2 address if they can, or the legacy one if they can't.
Once require_osd_release >= nautilus OSDs will stop binding to msgr1
ports at all.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
5d95b29c9b msg/Messenger: my_addr -> my_addrs
Minimal changes to SimpleMessenger and AsyncMessenger to keep things
working, assuming we ony have a single addr in the addrvec.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
6d742a35ff msg/Connection: peer_addr -> peer_addrs
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
13a53cbe4b msg/msg_types: hash<> for entity_addrvec_t
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
700fd00322 mgr/DaemonServer: use new bindv() and pick_addresses()
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
1b80cfa8ae msg/Messenger: new bindv() that takes an addrvec
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
ff76ac43fc common/pick_address: fill in ipv4/6 and msgr1/msgr2 via config options
This allows users to simply pass in CLUSTER or PUBLIC and the function
fills in the rest.  (Or, if the caller is particular, they can pass in
the other flags too.)

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
9b7e49828b common/pick_addresses: new addrvec-based pick_addresses()
Flags for everything we would want.  The intent is to return an addrvec
of addrs that we can directly bind to.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
bc95a33979 common/pick_addresses: add filtering by ipv4 and ipv6
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
b2b4b0e307 CEPH_MON_PORT -> CEPH_MON_PORT_LEGACY; define CEPH_MON_PORT_IANA
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
543539e590 osd: kill osd_heartbeat_addr option
This serves no (good) purpose: we should always use the public addr/
network.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:23 -05:00
Sage Weil
30d3095ef2 common/options: add addrvec option type
Signed-off-by: Sage Weil <sage@redhat.com>
2018-07-03 13:01:08 -05:00
Patrick Donnelly
628927d5ba
Merge PR #22165 into master
* refs/pull/22165/head:
	qa: add one-off clusters to qa/cephfs/clusters
	qa: allocate more space for VM disk
	qa/cephfs/clusters/*: bigger cinder volumses

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-07-03 09:10:09 -07:00
Alfredo Deza
544bc3ea58
Merge pull request #22828 from ceph/wip-conf-error-message
ceph-volume: provide a nice errror message when missing ceph.conf

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-07-03 11:28:55 -04:00
Casey Bodley
f076960001
Merge pull request #22548 from ovh/bp-cls-otp-build
cls: build cls_otp only WITH_RADOSGW

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-07-03 09:24:02 -04:00
Alfredo Deza
d62fa58a11
Merge pull request #22764 from ceph/wip-rm24504
ceph-volume: refuse to zap mapper devices

Reviewed-by: Alfredo Deza
2018-07-03 08:15:18 -04:00
Andrew Schoen
0487a9ac60 ceph-volume: always ignore a missing ceph conf in main.py
Now that we have a nice error message when a ceph.conf is missing
and we try to use values from it, maintaining a list of commands that
don't need ceph.conf isn't as helpful. We had actually missed 'simple
trigger' when we first implemented this causing all our luminous tests
for simple to fail when we backported.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-07-03 06:45:24 -05:00
John Spray
85d78a8d56
Merge pull request #22808 from jcsp/wip-mgr-doc-initial-modules
doc/dashboard: don't advise mgr_initial_modules

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2018-07-03 11:54:57 +01:00
John Spray
414d94ae42 doc/dashboard: don't advise mgr_initial_modules
This setting tends to confuse people, as it's only respected
on the very first startup of the cluster.  Instead, mention
it (with appropriate caveats) on the general mgr admin
page.

Signed-off-by: John Spray <john.spray@redhat.com>
2018-07-03 09:48:56 +01:00
Jos Collin
7695b395aa
Merge pull request #22802 from bradfitz/its
doc: fix some it's -> its typos

Reviewed-by: Jos Collin <jcollin@redhat.com>
2018-07-03 10:14:52 +05:30
Brad Fitzpatrick
64212f3e6d doc: fix some it's -> its typos
Signed-off-by: Brad Fitzpatrick <brad@danga.com>
2018-07-02 19:16:23 -07:00
Josh Durgin
9106dc56c2
Merge pull request #22761 from fullerdj/wip-djf-24686
osd/filestore: Change default filestore_merge_threshold to -10

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-07-02 17:36:00 -07:00
Andrew Schoen
e42ecb8319 ceph-volume: show a nice error message when ceph.conf is not loaded
If the ceph configuration file is not loaded correctly and then values
from it are used then an undescript error message is shown, e.g.

AttributeError: 'property' object has no attribute 'get'

With this change that same error condition shows the message:

RuntimeError: No valid ceph configuration file was loaded.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-07-02 16:06:22 -05:00
Orit Wasserman
25508d538b
Merge pull request #21772 from oritwas/wip-rgw-test-bi-list
rgw: test bi list
2018-07-02 16:06:09 +03:00
Ilya Dryomov
762e122d69
Merge pull request #22769 from idryomov/wip-rbdmap-remote-fs-pre
systemd/rbdmap.service: order us before remote-fs-pre.target

Reviewed-by: Boris Ranto <branto@redhat.com>
2018-07-02 14:37:13 +02:00
Lenz Grimmer
77f83c7e2b
Merge pull request #22760 from s0nea/wip-dashboard-config-option-flags
mgr/dashboard: add supported flag information to config options documentation

Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-07-02 13:15:25 +02:00
Lenz Grimmer
a3465fd410
Merge pull request #22772 from joscollin/wip-doc-dashboard-ref
doc: s/doc/ref for dashboard urls

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-07-02 10:11:16 +02:00
Kefu Chai
505e29c072
Merge pull request #22776 from tchaikov/wip-thread-setaffinity
crimson/thread: pin thread pool to given CPU

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-30 09:00:51 +08:00
Kefu Chai
460ad1f8a1 crimson/thread: pin thread pool to given CPU
to take the full advantage of seastar reactor, we need to confine the
alien threads to given CPU core(s). in current setting, it's assumed
that alien threads do not perform CPU-bound tasks, so a single core
would suffice. we can always change the interface to pass a cpu_set_t
or a std::bitset if one CPU core is not enough.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-30 01:33:55 +08:00
Patrick Donnelly
92af779cc9
Merge PR #22111 into master
* refs/pull/22111/head:
	cephfs-journal-tool: check fsid when import purge queue

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 10:28:40 -07:00
Patrick Donnelly
0e50b1217d
Merge PR #22718 into master
* refs/pull/22718/head:
	qa/workunits/suites/ffsb.sh: fix strncpy bug in ffsb

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 10:23:38 -07:00
Patrick Donnelly
654aaa90ed
qa: add one-off clusters to qa/cephfs/clusters
To consistently handle openstack configuration.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 09:33:53 -07:00
Patrick Donnelly
5d4a1f232b
qa: allocate more space for VM disk
Otherwise daemons may run out of space due to logging.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 09:30:29 -07:00
Sage Weil
aa3dcb2b26
qa/cephfs/clusters/*: bigger cinder volumses
Fixes: http://tracker.ceph.com/issues/24238
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-29 09:27:59 -07:00
Douglas Fuller
75f55f2dfc osd/filestore: Change default filestore_merge_threshold to -1
Performance evaluations of medium to large size Ceph clusters have
demonstrated negligible performance impact from unnecessarily deep
directory hierarchies but significant performance impact from filestore
split and merge activity. Disable merges by default.

Fixes: http://tracker.ceph.com/issues/24686
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2018-06-29 11:45:12 -04:00
Kefu Chai
fade1ef049
Merge pull request #22736 from tchaikov/wip-seastar-lockless-shared-lru
common/shared_cache: add lockless SharedLRU

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-29 22:56:35 +08:00
Jos Collin
a703e22bc4 doc: s/doc/ref for dashboard urls
Replaced :doc: with :ref: as per https://github.com/ceph/ceph/pull/22750#discussion_r198895040.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-06-29 20:19:56 +05:30
Ilya Dryomov
37da5d8af9 systemd/rbdmap.service: order us before remote-fs-pre.target
If "/usr/bin/rbdmap unmap-all" notices a file system mounted on top of
an rbd device, it will call umount, interfering with systemd shutdown
logic.  Make sure we aren't invoked until all _netdev mounts are dealt
with by systemd.

Fixes: http://tracker.ceph.com/issues/24713
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2018-06-29 16:36:05 +02:00
Jason Dillaman
499eec729a
Merge pull request #22771 from tchaikov/wip-test-librados-ns
test/librados: fix LibRadosList.ListObjectsNS

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-06-29 10:26:44 -04:00
Andrew Schoen
8e602d5265 lvm zap: refuse to zap mapper devices
Fixes: http://tracker.ceph.com/issues/24504

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-06-29 07:56:04 -05:00
Andrew Schoen
852a466fdf adds the util.disk.is_mapper_device method
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-06-29 07:56:04 -05:00
Kefu Chai
a7e175140a
Merge pull request #22086 from ifed01/wip-ifed-new-bluefs-pcounter
os/bluestore: introduce new BlueFS perf counter to track the amount of

Reviewed-by: Sage Weil <sage@redhat.com>
2018-06-29 20:29:03 +08:00
Kefu Chai
cb3a6da5df test/librados: fix LibRadosList.ListObjectsNS
rados_ioctx_get_namespace() returns the length of namespace string on
success, not 0.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-29 20:23:44 +08:00
Nathan Cutler
10f2c6944a
Merge pull request #21634 from smithfarm/wip-bci-complain-dupe
scripts: backport-create-issue: complain about duplicates and support mimic

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-29 10:47:12 +02:00
Tatjana Dehler
abf9d35aaa mgr/dashboard: add flag info to config options documentation page
Add information about the supported flags (introduced by
https://github.com/ceph/ceph/pull/22595) to the config options
documentation page.

Fixes: https://tracker.ceph.com/issues/24605

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-06-29 08:49:10 +02:00