Commit Graph

88146 Commits

Author SHA1 Message Date
Kefu Chai
505e29c072
Merge pull request #22776 from tchaikov/wip-thread-setaffinity
crimson/thread: pin thread pool to given CPU

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-30 09:00:51 +08:00
Dan Mick
eb1103e94d doc/mgr: add doc for crash mgr module
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-06-29 14:53:14 -07:00
Dan Mick
85ab978567 qa/suites/rados/mgr: Add test_crash
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-06-29 14:52:17 -07:00
Dan Mick
8145598f59 qa/tasks/mgr: add test_crash, call from test_module_selftest
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-06-29 14:51:45 -07:00
Dan Mick
7fc8714a27 qa/tasks/{ceph_manager.py,vstart_runner.py}: allow kwargs in raw_*
Allow passing kwargs (like stdin=) to the local and teuthology
clusters when running tests

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-06-29 14:51:34 -07:00
Dan Mick
29209a3ea8 mgr/pybind/crash: handle crashdumps
Signed-off-by: Dan Mick <dan.mick@redhat.com>
2018-06-29 14:51:35 -07:00
Kefu Chai
460ad1f8a1 crimson/thread: pin thread pool to given CPU
to take the full advantage of seastar reactor, we need to confine the
alien threads to given CPU core(s). in current setting, it's assumed
that alien threads do not perform CPU-bound tasks, so a single core
would suffice. we can always change the interface to pass a cpu_set_t
or a std::bitset if one CPU core is not enough.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-30 01:33:55 +08:00
Patrick Donnelly
92af779cc9
Merge PR #22111 into master
* refs/pull/22111/head:
	cephfs-journal-tool: check fsid when import purge queue

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 10:28:40 -07:00
Patrick Donnelly
0e50b1217d
Merge PR #22718 into master
* refs/pull/22718/head:
	qa/workunits/suites/ffsb.sh: fix strncpy bug in ffsb

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 10:23:38 -07:00
Patrick Donnelly
654aaa90ed
qa: add one-off clusters to qa/cephfs/clusters
To consistently handle openstack configuration.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 09:33:53 -07:00
Patrick Donnelly
5d4a1f232b
qa: allocate more space for VM disk
Otherwise daemons may run out of space due to logging.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-29 09:30:29 -07:00
Sage Weil
aa3dcb2b26
qa/cephfs/clusters/*: bigger cinder volumses
Fixes: http://tracker.ceph.com/issues/24238
Signed-off-by: Sage Weil <sage@redhat.com>
2018-06-29 09:27:59 -07:00
Douglas Fuller
75f55f2dfc osd/filestore: Change default filestore_merge_threshold to -1
Performance evaluations of medium to large size Ceph clusters have
demonstrated negligible performance impact from unnecessarily deep
directory hierarchies but significant performance impact from filestore
split and merge activity. Disable merges by default.

Fixes: http://tracker.ceph.com/issues/24686
Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2018-06-29 11:45:12 -04:00
Kefu Chai
fade1ef049
Merge pull request #22736 from tchaikov/wip-seastar-lockless-shared-lru
common/shared_cache: add lockless SharedLRU

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-29 22:56:35 +08:00
Jos Collin
a703e22bc4 doc: s/doc/ref for dashboard urls
Replaced :doc: with :ref: as per https://github.com/ceph/ceph/pull/22750#discussion_r198895040.

Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-06-29 20:19:56 +05:30
Ilya Dryomov
37da5d8af9 systemd/rbdmap.service: order us before remote-fs-pre.target
If "/usr/bin/rbdmap unmap-all" notices a file system mounted on top of
an rbd device, it will call umount, interfering with systemd shutdown
logic.  Make sure we aren't invoked until all _netdev mounts are dealt
with by systemd.

Fixes: http://tracker.ceph.com/issues/24713
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2018-06-29 16:36:05 +02:00
Jason Dillaman
499eec729a
Merge pull request #22771 from tchaikov/wip-test-librados-ns
test/librados: fix LibRadosList.ListObjectsNS

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-06-29 10:26:44 -04:00
Andrew Schoen
8e602d5265 lvm zap: refuse to zap mapper devices
Fixes: http://tracker.ceph.com/issues/24504

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-06-29 07:56:04 -05:00
Andrew Schoen
852a466fdf adds the util.disk.is_mapper_device method
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-06-29 07:56:04 -05:00
Kefu Chai
a7e175140a
Merge pull request #22086 from ifed01/wip-ifed-new-bluefs-pcounter
os/bluestore: introduce new BlueFS perf counter to track the amount of

Reviewed-by: Sage Weil <sage@redhat.com>
2018-06-29 20:29:03 +08:00
Kefu Chai
cb3a6da5df test/librados: fix LibRadosList.ListObjectsNS
rados_ioctx_get_namespace() returns the length of namespace string on
success, not 0.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-29 20:23:44 +08:00
Nathan Cutler
10f2c6944a
Merge pull request #21634 from smithfarm/wip-bci-complain-dupe
scripts: backport-create-issue: complain about duplicates and support mimic

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-29 10:47:12 +02:00
Tatjana Dehler
abf9d35aaa mgr/dashboard: add flag info to config options documentation page
Add information about the supported flags (introduced by
https://github.com/ceph/ceph/pull/22595) to the config options
documentation page.

Fixes: https://tracker.ceph.com/issues/24605

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-06-29 08:49:10 +02:00
Kefu Chai
712a3d963c
Merge pull request #22756 from wjwithagen/wjw-fix-missing-vector
mgr: `#include <vector>` for clang

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-29 10:04:55 +08:00
Kefu Chai
32cb3023c6
Merge pull request #22752 from tchaikov/wip-freebsd-w/o-rdma
cmake,do_freebsd.sh: disable rdma features

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Haodong Tang <haodong.tang@intel.com>
2018-06-29 10:02:49 +08:00
Kefu Chai
4f51d11ec3
Merge pull request #22743 from rzarzynski/wip-common-drop-static_assert.h
common: drop static_assert.h as it looks unused.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-29 10:00:59 +08:00
Kefu Chai
96730aaae0
Merge pull request #22720 from rzarzynski/wip-build-static-ceph-common-in-osd
cmake: link ceph-osd with common statically

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-29 10:00:08 +08:00
David Zafman
663d96e934
Merge pull request #22727 from dzafman/wip-21664
qa/standalone/scrub: When possible show side-by-side diff in addition to regular diff

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-28 19:59:21 -04:00
Patrick Donnelly
db1c389adb
mds: refactor const ref return to avoid mem alloc
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-06-28 16:02:37 -07:00
David Zafman
3ff56a82a4
Merge pull request #22763 from dzafman/wip-remove-sudo
qa: Don't use sudo when moving logs

Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-06-28 18:37:24 -04:00
David Zafman
23ed63e15f
Merge pull request #22441 from ErwanAliasr1/evelu-makecheck
Improving make check reliability

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: David Zafman <dzafman@redhat.com>
2018-06-28 14:55:12 -04:00
David Zafman
808c628304 qa: Don't use sudo when moving logs
Caused by: f0964beac5

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-06-28 09:17:06 -07:00
Kefu Chai
a2a727b320
Merge pull request #22565 from tchaikov/wip-seastar-thread-pool
crimson/thread: add thread pool

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-06-28 23:56:34 +08:00
Kefu Chai
eea41d4d7c cmake: add crimson static library
libcrimson consolidates the object library of crimson_{net,thread} and
seastar_{buffer,net,thread}_objs. by offering a static library glueing
seastar,  we can link against these libraries and its dependencies in a
simpler way.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-28 23:52:54 +08:00
Kefu Chai
28f079e08a crimson/thread: add a thread pool impl
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-28 23:52:54 +08:00
Kefu Chai
d3a64e92d9
Merge pull request #22007 from dalgaaf/wip-da-SCA-20180514
rgw, common: Fixes SCA issues

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-06-28 23:39:55 +08:00
Kefu Chai
63656af5f2 cmake: extract the RDMA libraries interface properties out
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-28 23:26:28 +08:00
Kefu Chai
9a8ec11114 do_freebsd.sh: disable rdma features
FreeBSD does have libibiverb and librdmacm, but we disable them anyway
for minimal dependency.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-28 23:26:28 +08:00
Kefu Chai
38d0e22685 cmake: consolidate WITH_{VERBS,RDMACM}
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-28 23:26:28 +08:00
Lenz Grimmer
2e2c6e4501
Merge pull request #22759 from ricardoasmarques/wip-fix-rbd-features-style
mgr/dashboard: Fix RBD features style

Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-06-28 17:11:32 +02:00
Ilya Dryomov
ae61cf680b systemd/rbdmap.service: remove a dependency on local-fs.target
We don't require anything outside of rootfs.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2018-06-28 17:09:00 +02:00
Volker Theile
5623d61f2e mgr/dashboard: Improve str_to_bool
Signed-off-by: Volker Theile <vtheile@suse.com>
2018-06-28 13:44:40 +02:00
Lenz Grimmer
5164d17a25
Merge pull request #22750 from joscollin/wip-dashboard-intro
doc: updated the overview and glossary for dashboard

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2018-06-28 13:40:15 +02:00
Ricardo Marques
8f0ae54e3f mgr/dashboard: Fix RBD features style
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-06-28 12:00:03 +01:00
Jos Collin
1007a19b7e doc: Updated dashboard doc references
Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-06-28 16:02:06 +05:30
Jos Collin
22f205718a doc: updated the overview and glossary for dashboard
* Updated the overview of dashboard to avoid many paragraphs,
some outdated statements, etc.
* Updated glossary, glossary references and urls
* Dropped unnecessary term *module* in possible places
* Unified the new dashboard name as *Ceph Manager Dashboard*

Signed-off-by: Jos Collin <jcollin@redhat.com>
2018-06-28 16:01:30 +05:30
Willem Jan Withagen
9d68af58ce mgr: fix Clangs/FreeBSD missing vector
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2018-06-28 10:24:15 +02:00
David Zafman
dee4574a66
Merge pull request #22702 from dzafman/wip-standalone-log
qa: For teuthology copy logs to teuthology expected location

Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-06-28 01:57:25 -04:00
Kefu Chai
ea85753c9a cmake: remove stale comments
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-06-28 13:21:02 +08:00
Josh Durgin
b8536e44d5
Merge pull request #22726 from yuriw/wip-yuriw-crontab
qa/tests - added mimic-p2p suite

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2018-06-27 16:13:51 -07:00