Commit Graph

84193 Commits

Author SHA1 Message Date
Neha Ojha
af83cf9f7b osd: rename ECSubWrite parameter backfill to backfill_or_async_recovery
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-14 15:56:05 -07:00
Neha Ojha
4e78d8055b PG: cleanup and fixes for async recovery
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-14 15:56:04 -07:00
Neha Ojha
322a00b0e6 osd: introduce acting_recovery_backfill shards
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-14 15:56:04 -07:00
Neha Ojha
c6dfeb3253 PG: initial changes required for async recovery
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-14 15:56:04 -07:00
Josh Durgin
360bc69bcf
Merge pull request #20901 from neha-ojha/wip-fix-mgr
qa/tasks/ceph_manager: use set_config on revived osd

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-03-14 15:27:39 -07:00
Neha Ojha
e3899dc901 qa/tasks/ceph_manager: use set_config on revived osd
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-14 12:37:56 -07:00
Andrew Schoen
a8cd8b2625
Merge pull request #20824 from ceph/wip-rm23259
ceph-volume process the abspath of the executable first

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-03-14 20:21:37 +01:00
David Zafman
8a7e6c2349
Merge pull request #20220 from dzafman/wip-calc-stats3
osd: Improve recovery stat handling by using peer_missing and missing_loc info

Reviewed-by: Sage Weil <sage@redhat.com>
2018-03-14 11:07:44 -07:00
David Zafman
af85f3cc48 test: osd-backfill-stats.sh parallel osd-recovery-stats.sh check() changes
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
acc1f80684 test: Use "(est)" in log message when an osd doesn't have peer_missing
Consolidate check() code and common script code
TEST_recovery_multi() wasn't reliable due to delayed peer_missing

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
12e331b742 test: osd-recovery-stats.sh: New test with different missing objs on multiple OSDs
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
4bf4cd937c osd: Fix _update_calc_stats() to use peer_missing and missing_by_count
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
1e98533984 osd: Changes to handle sharding for EC in missing_by_count
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
Sage Weil
214ff7b0f3 osd/PrimaryLogPG: update missing_loc on peer recover
The MissingLoc structure already tracks locations of any missing object
on any acting OSD, and is updated on_local_recover and on_global_recover.
Update it on_peer_recover too so that the loc information (and derivative
missing_by_count info) is correct.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-14 10:07:11 -07:00
Sage Weil
eddf510e73 osd/PG: MissingLoc: track location counts by upset and other
For every object in missing_loc, calculate how many known locations are in
the upset and all others, and call that loc_count_t.  Keep
a map of loc_count_t to the number of missing objects with that
distribution.

Signed-off-by: Sage Weil <sage@redhat.com>
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
09b5697ba2 test: Correction for better degraded/misplaced handling
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
0e9d643875 osd: Always build peer_missing (including strays) for _update_calc_stats()
Fixes: http://tracker.ceph.com/issues/22837

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
d7fd9174b9 osd: Fix for handling more than 1 missing target
Fix test case to test more than 1 target

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:03 -07:00
Lenz Grimmer
78022e13e7
Merge pull request #20751 from s0nea/wip-mgr-dashboard_rbd_add
mgr/dashboard_v2: Add RBD create functionality to the Python backend

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-03-14 15:57:32 +01:00
Andrew Schoen
1cc5ad0d66
Merge pull request #20878 from ceph/wip-rm23337
ceph-volume document multipath support

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-03-14 15:02:53 +01:00
Lenz Grimmer
619d435a71
Merge pull request #20804 from Devp00l/cephfs-template-fix
mgr/dashboard_v2: Fix cephfs template table usage

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-03-14 12:31:44 +01:00
Lenz Grimmer
a7d34152cc
Merge pull request #20783 from tspmelo/mgr-perf-counters
mgr/dashboard_v2: add mgr to the list of perf counters

Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-03-14 12:11:47 +01:00
Lenz Grimmer
5dfdeccf5d
Merge pull request #20728 from jcsp/wip-dashboard-can_run
mgr/dashboard v2: implement can_run method

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-14 11:48:40 +01:00
Tatjana Dehler
5056cbacbf mgr/dashboard: Add RBD create functionality
This commit adds a basic RBD create functionality to the REST API. It enables
the POST request of the http://<host>:<port>/api/rbd API endpoint.

The commit adds also related tests.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-03-14 10:38:43 +01:00
Patrick Donnelly
09b79af819
Merge PR #20700 into master
* refs/pull/20700/head:
	client: use either dentry_invalidate_cb or remount_cb to invalidate kernel dcache

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-03-13 20:33:11 -07:00
Patrick Donnelly
52ea69762d
Merge PR #20719 into master
* refs/pull/20719/head:
	client: add new ceph_mount_perms_set function

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-03-13 20:33:07 -07:00
Patrick Donnelly
57364e6113
Merge PR #20780 into master
* refs/pull/20780/head:
	doc/cephfs: mention "ceph fs set-default"
	mds: include legacy_client_fscid in FSMap::dump

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-03-13 20:32:58 -07:00
Patrick Donnelly
76080ed795
Merge PR #20881 into master
* refs/pull/20881/head:
	messages/MClientRequest: fix a typo so we don't output 'setfilelockrule' in logs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-03-13 16:15:13 -07:00
Greg Farnum
629f05b563 messages/MClientRequest: fix a typo so we don't output 'setfilelockrule' in logs
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2018-03-13 13:50:25 -07:00
Alfredo Deza
b7140d2374 ceph-volume lvm.prepare simplify help menu with bluestore default flags
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-03-13 15:30:22 -04:00
Alfredo Deza
2d1b191828 ceph-volume lvm.create simplify help menu with bluestore default flags
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-03-13 15:28:28 -04:00
Alfredo Deza
1dca5eac38 doc/ceph-volume document multipath support
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-03-13 15:26:46 -04:00
Andrew Schoen
58560cf6b5
Merge pull request #20864 from ceph/wip-cv-env-flags-fix
ceph-volume tests use granular env vars for vagrant

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-03-13 19:56:48 +01:00
Casey Bodley
5fee2689c8
Merge pull request #20724 from mdw-at-linuxbox/wip-master-rgw-fixbuf
rgw: fix memory fragmentation problem reading data from client.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-03-13 12:02:25 -04:00
Sage Weil
27984e5590
Merge pull request #20872 from liewegas/wip-deterministic-cli-test
test/cli/osdmaptool/test-map-pgs.t: remove nondetermimistic test

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-03-13 10:52:26 -05:00
Tiago Melo
e8a1e267af mgr/dashboard_v2: add mgr to the list of perf counters
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-03-13 15:21:43 +00:00
Yuri Weinstein
82d828b68d
Merge pull request #20739 from Jeegn-Chen/wip-reject-sse-mpcp
rgw: reject encrypted object COPY before supported 

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-03-13 07:54:34 -07:00
Sage Weil
4a6101bd43 test/cli/osdmaptool/test-map-pgs.t: remove nondetermimistic test
This fails randomly; determinism is good!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-13 09:49:47 -05:00
Lenz Grimmer
6aaa4a9bc4
Merge pull request #20811 from tspmelo/fix-table-details
mgr/dashboard_v2: fix and improve table details

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-03-13 13:03:00 +01:00
Lenz Grimmer
be113e3e92
Merge pull request #20757 from tspmelo/wip-chart-tooltip
mgr/dashboard_v2: Improve charts tooltips

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-03-13 12:45:18 +01:00
Alfredo Deza
5b6e39617f ceph-volume tests use granular env vars for vagrant
Fixes the error that would inject an extra argument to vagrant when the
environment variable is not present

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-03-13 06:57:57 -04:00
Xie Xingguo
6432786c11
Merge pull request #20830 from Songweibin/wip-cleanup
osd: two cleanups

Reviewed-by: Luo Kexue <luo.kexue@zte.com.cn>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-03-13 15:06:00 +08:00
Xie Xingguo
796fe52797
Merge pull request #20838 from badone/test_dump_pgstate_history-check-for-empty-output
tests: Check for empty output in test_dump_pgstate_history

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-13 15:04:07 +08:00
Xie Xingguo
224c3cbe46
Merge pull request #20839 from guzhongyan/tree-from-cleanup
mon/OSDMonitor: clean up cmd 'osd tree-from'

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-13 15:03:31 +08:00
Kefu Chai
41ec438413
Merge pull request #20831 from zhsj/fix-spelling
misc: fix various spelling errors

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: iliul <liul.stone@gmail.com>
2018-03-13 08:29:29 +08:00
John Spray
841e497c00
Merge pull request #20777 from wjwithagen/wjw-mgr_dashboard_test
test: only test dashboard_v2 when it is enabled

Reviewed-by: John Spray <john.spray@redhat.com>
2018-03-12 23:33:07 +00:00
Alfredo Deza
8d4b0058ab ceph-volume process the abspath of the executable first
So that it can always log the full path to the executable when it is
logging the 'Running command:' line

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-03-12 16:52:15 -04:00
Andrew Schoen
d4eaefe302
Merge pull request #20849 from ceph/wip-cv-env-flags
ceph-volume tests add optional flags for vagrant

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-03-12 19:38:10 +01:00
Alfredo Deza
5fbea40fc6 ceph-volume tests add optional flags for vagrant
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-03-12 12:25:01 -04:00
Josh Durgin
fda0ff39d6
Merge pull request #20827 from jdurgin/wip-pg-log-trim-errors
osd: treat successful and erroroneous writes the same for log trimming

Reviewed-by: Sage Weil <sage@redhat.com>
2018-03-12 12:00:57 -04:00