Commit Graph

84877 Commits

Author SHA1 Message Date
Sage Weil
f67f3f87b7 Merge PR #21033 into wip-sage-testing-20180407.022623
* refs/pull/21033/head:
	buffer: kill push_front
	tools/RadosDump: avoid bufferlist::push_front
	os/filestore/FileJournal: avoid push_front
	erasure-code: avoid bufferlist::push_front
	buffer: kill claim_prepend
	unittest_compression: avoid claim_prepend
	os/bluestore: avoid claim_prepend
	osdc/Striper: rewrite assemble_result without push_front or claim_prepend

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Jesse Williamson <jwilliamson@suse.de>
2018-04-06 21:27:20 -05:00
Sage Weil
f38bb6577d githubmap: update contributors
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-06 21:27:19 -05:00
Nathan Cutler
bdb674639d
Merge pull request #19594 from smithfarm/wip-doc-make-check
doc: expand developer documentation of unit tests

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
2018-04-06 22:19:03 +02:00
Gregory Farnum
6d2e4c9b7b
Merge pull request #19973 from liewegas/wip-peering-fast-dispatch
osd: fast dispatch of peering events and pg_map + osd sharded wq refactor

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-04-06 11:48:11 -07:00
Sage Weil
8f8f65594b
Merge pull request #21250 from liewegas/wip-recovery-slow-ops
qa/suites/rados/singleton/all/recovery_preemption: whitelist SLOW_OPS
2018-04-06 10:59:23 -05:00
Sage Weil
b235a3f62a qa/suites/rados/singleton/all/ec-lost-unfound: whitelist SLOW_OPS
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-06 10:38:45 -05:00
Lenz Grimmer
95ee4e4142
Merge pull request #21239 from rjfd/wip-dashboard-routes
mgr/dashboard: using RoutesDispatcher as HTTP request dispatcher

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-04-06 16:36:34 +02:00
Joao Eduardo Luis
940dd941ef
Merge pull request #19331 from jecluis/wip-mon-osdmap-prune
mon: osdmap prune

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-06 15:22:28 +01:00
Casey Bodley
072a9be2e0
Merge pull request #20464 from cbodley/wip-rgw-beast-ssl
rgw: add ssl support to beast frontend

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-04-06 09:52:55 -04:00
Nathan Cutler
a9ba2011f6 doc: dev: improve headings within Testing chapter
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2018-04-06 14:18:37 +02:00
Lenz Grimmer
658e5d5a50
Merge pull request #21128 from ricardoasmarques/wip-usage-bar
mgr/dashboard: Add usage bar component

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-04-06 11:07:01 +02:00
Lenz Grimmer
6def989ade
Merge pull request #21240 from rjfd/wip-dashboard-task-fixes
mgr/dashboard: TaskManager bug fixes 

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-04-06 10:50:45 +02:00
Joao Eduardo Luis
3997eed4db qa: enable mon osdmap pruning on 'rados/' suites
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-04-06 04:18:23 +01:00
Joao Eduardo Luis
65e7e4a38f qa: enable mon osdmap pruning on rados/monthrash
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-04-06 04:18:23 +01:00
Joao Eduardo Luis
2ffed4c98f qa: mon: osdmap pruning standalone/workunit
Keep a standalone wrapper for the workunit, so we can test it locally,
leveraging the ceph-helpers to do the setup. Keep a workunit to be
exercised by teuthology.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-04-06 04:18:23 +01:00
Joao Eduardo Luis
6393c7ddeb qa/standalone: change PATH to allow finding sysctl
If, by default, a user's PATH does not contain /sbin and /usr/sbin, we
may have a hard time finding sysctl to adjust the kernel core pattern.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-04-06 04:18:22 +01:00
Joao Eduardo Luis
f501458967 qa/standalone: deduplicate cleanup code
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-04-06 04:18:22 +01:00
Joao Eduardo Luis
5ba6286834 qa/standalone: discard pipe in sysctl kernel.core_pattern
At least verified in openSUSE tumbleweed and ubuntu 16.04,
`sysctl -n kernel.core_pattern` returns a pipe at the start of the
value. We reset core_pattern to its original form once the script is
about to end, but if we do not discard the pipe the new value will
contain an extra pipe (apparently, the pipe is added automatically at
some point, possibly simply on read). We are simply stripping it on
read, as to prevent this behavior.

Additionally, we are also enclosing the reset of kernel.core_pattern in
quotes, so as to make sure patterns that include spaces (e.g., ubuntu's
apport, or tumbleweed's systemd-coredump) are properly reset.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-04-06 04:18:22 +01:00
Joao Eduardo Luis
5cd2b057f3 mon/OSDMonitor: allow triggering prunes from tick()
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-04-06 04:18:22 +01:00
Joao Eduardo Luis
029807b3e9 mon/OSDMonitor: allow blocking trim if option is enabled
We need to allow blocking osdmap trimming to test osdmap pruning.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-04-06 04:18:22 +01:00
Joao Eduardo Luis
b64122ac37 mon/OSDMonitor: dump osdmap manifest alongside other infos
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-04-06 04:18:22 +01:00
Joao Eduardo Luis
bc5df2b449 mon/OSDMonitor: prune full maps on encode_pending
If we have gone over a safety threshold for number of versions, start
pruning full osdmaps, poking holes in the sequence. To make up for the
missing maps, we will rebuild full maps based on the incremental maps
and the closest pinned full map we have available.

Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-04-06 04:18:22 +01:00
Joao Eduardo Luis
06f3ab684f doc: add dev notes for mon's full osdmap pruning
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-04-06 04:18:22 +01:00
Sage Weil
922a855817 osd: legacy pg_create creates pg in current epoch
For the legacy create path, we pregenerate the history and instantiate
the PG at the current epoch.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-05 21:47:48 -05:00
Nathan Cutler
507b872858
Merge pull request #21127 from smithfarm/wip-make-dist-py3
build/ops: make-dist: fall back to python3

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-04-06 04:00:46 +02:00
Patrick Donnelly
2156fd071c
Merge PR #21238 into master
* refs/pull/21238/head:
	doc: fix typos and other minor errors in cephfs-nfs doc

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-05 17:03:18 -07:00
Patrick Donnelly
fa430543d9
Merge PR #21204 into master
* refs/pull/21204/head:
	mds: PendingReleaseNotes and dev doc for open file table

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-05 17:02:20 -07:00
Casey Bodley
fe5fb47ba5 rgw: beast frontend calls shutdown before closing connections
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-04-05 17:38:41 -04:00
Casey Bodley
35fd4050b7 qa/rgw: verify suite tests beast with ssl
instead of adding special frontend configs like civetweb_ssl.yaml and
beast_ssl.yaml, added a new proto/ subdirectory for http.yaml and
https.yaml

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-04-05 15:30:22 -04:00
Casey Bodley
247e074338 rgw: add ssl support to beast frontend
adds frontend options ssl_certificate, ssl_private_key, ssl_port, ssl_endpoint

Fixes: http://tracker.ceph.com/issues/22832

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-04-05 15:30:22 -04:00
Casey Bodley
0753410bde rgw: factor the tcp::socket out of ClientIO
remove ClientIO's dependency on a concrete socket type by moving it into
a derived StreamIO class in rgw_asio_frontend.cc

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2018-04-05 15:30:22 -04:00
Matt Benjamin
c803fb12c8
Merge pull request #20992 from cbodley/wip-dmclock-remove-by-ptr
dmclock: update mClockPriorityQueue with changes in subtree
2018-04-05 14:57:41 -04:00
Sage Weil
4cb194eef5 mon/OSDMonitor: fix warnings
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-05 13:07:53 -05:00
Sage Weil
b626b4dcdc mon/OSDMonitor: keep sending legacy create messages for now
Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-05 13:04:09 -05:00
Sage Weil
07ee12d509
Merge pull request #21261 from batrick/ceph-update-ceph-object-corpus
ceph-object-corpus: update to fix make check
2018-04-05 12:55:18 -05:00
Patrick Donnelly
b8569e0155
ceph-object-corpus: update to fix make check
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-05 10:50:32 -07:00
Nathan Cutler
a903a769df
Merge pull request #21148 from wjwithagen/wjw-setup-virtualenv
tools: FreeBSD basic getopt does not use --options

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2018-04-05 15:14:13 +02:00
John Spray
a367b60740
Merge pull request #21237 from guzhongyan/zabbix-fix
mgr/zabbix: Fix wrong log message

Reviewed-by: John Spray <john.spray@redhat.com>
2018-04-05 12:00:40 +01:00
Kefu Chai
d440902b4d
Merge pull request #21253 from ceph/wip-yuriw-crontab
tests/qa - enabled `ceph-deploy` runs on `mira` nodes

Reviewed-by: Vasu Kulkarni <vasu@redhat.com>
2018-04-05 15:04:02 +08:00
Patrick Donnelly
7c6aff27c7
Merge PR #21254 into master
* refs/pull/21254/head:
	mds: bump mds_log_max_segments for trim buffer

Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-04-04 21:13:35 -07:00
Josh Durgin
7fbac83e10
Merge pull request #21252 from neha-ojha/wip-modify-crontab
qa/crontab: run the perf-basic suite every day

Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2018-04-04 17:50:07 -07:00
Patrick Donnelly
86e76d15f3
mds: bump mds_log_max_segments for trim buffer
Under create heavy workloads, the MDS will sometimes get behind trimming but
catch up. This avoids unnecessary warnings.

Fixes: http://tracker.ceph.com/issues/23560

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-04-04 16:47:06 -07:00
Yuri Weinstein
3846f8445f tests/qa - enabled ceph-deploy runs on mira nodes
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2018-04-04 16:18:41 -07:00
Ricardo Marques
4b7f56a83d mgr/dashboard: Apply usage-bar component on health
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-04-04 23:54:27 +01:00
Ricardo Marques
9d5df36e3a mgr/dashboard: Apply usage-bar component on osd
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-04-04 23:54:27 +01:00
Ricardo Marques
9dc966bc3e mgr/dashboard: Apply usage-bar component on cephfs
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-04-04 23:54:27 +01:00
Ricardo Marques
e3278b423d mgr/dashboard: Add usage bar component
Signed-off-by: Ricardo Marques <rimarques@suse.com>
2018-04-04 23:54:26 +01:00
Neha Ojha
109057c037 qa/crontab: run the perf-basic suite every day
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-04-04 15:26:21 -07:00
Sage Weil
3b3c32f643 qa/suites/rados/singleton/all/recovery_preemption: whitelist SLOW_OPS
Recovery and peering can be slow enough with all the logging enabled to
trigger a slow ops warning.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-04 16:24:31 -05:00
Sage Weil
7db0fd0a8d TEST Revert "mon/OSDMonitor: disallow pg_num changes until after pool is created"
This reverts commit 38319f8300.

I want to reproduce the race to see if there is a better way to avoid it.

This breaks tests that set pg_num, and generally makes interacting with
the cluster awkward for anything non-human.

# Conflicts:
#	src/mon/CreatingPGs.h

Signed-off-by: Sage Weil <sage@redhat.com>
2018-04-04 16:20:36 -05:00