Commit Graph

84263 Commits

Author SHA1 Message Date
Neha Ojha
af83cf9f7b osd: rename ECSubWrite parameter backfill to backfill_or_async_recovery
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-14 15:56:05 -07:00
Neha Ojha
4e78d8055b PG: cleanup and fixes for async recovery
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-14 15:56:04 -07:00
Neha Ojha
322a00b0e6 osd: introduce acting_recovery_backfill shards
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-14 15:56:04 -07:00
Neha Ojha
c6dfeb3253 PG: initial changes required for async recovery
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-14 15:56:04 -07:00
Josh Durgin
360bc69bcf
Merge pull request #20901 from neha-ojha/wip-fix-mgr
qa/tasks/ceph_manager: use set_config on revived osd

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-03-14 15:27:39 -07:00
Neha Ojha
e3899dc901 qa/tasks/ceph_manager: use set_config on revived osd
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-14 12:37:56 -07:00
Andrew Schoen
a8cd8b2625
Merge pull request #20824 from ceph/wip-rm23259
ceph-volume process the abspath of the executable first

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-03-14 20:21:37 +01:00
David Zafman
8a7e6c2349
Merge pull request #20220 from dzafman/wip-calc-stats3
osd: Improve recovery stat handling by using peer_missing and missing_loc info

Reviewed-by: Sage Weil <sage@redhat.com>
2018-03-14 11:07:44 -07:00
David Zafman
af85f3cc48 test: osd-backfill-stats.sh parallel osd-recovery-stats.sh check() changes
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
acc1f80684 test: Use "(est)" in log message when an osd doesn't have peer_missing
Consolidate check() code and common script code
TEST_recovery_multi() wasn't reliable due to delayed peer_missing

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
12e331b742 test: osd-recovery-stats.sh: New test with different missing objs on multiple OSDs
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
4bf4cd937c osd: Fix _update_calc_stats() to use peer_missing and missing_by_count
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
1e98533984 osd: Changes to handle sharding for EC in missing_by_count
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
Sage Weil
214ff7b0f3 osd/PrimaryLogPG: update missing_loc on peer recover
The MissingLoc structure already tracks locations of any missing object
on any acting OSD, and is updated on_local_recover and on_global_recover.
Update it on_peer_recover too so that the loc information (and derivative
missing_by_count info) is correct.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-14 10:07:11 -07:00
Sage Weil
eddf510e73 osd/PG: MissingLoc: track location counts by upset and other
For every object in missing_loc, calculate how many known locations are in
the upset and all others, and call that loc_count_t.  Keep
a map of loc_count_t to the number of missing objects with that
distribution.

Signed-off-by: Sage Weil <sage@redhat.com>
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
09b5697ba2 test: Correction for better degraded/misplaced handling
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
0e9d643875 osd: Always build peer_missing (including strays) for _update_calc_stats()
Fixes: http://tracker.ceph.com/issues/22837

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
d7fd9174b9 osd: Fix for handling more than 1 missing target
Fix test case to test more than 1 target

Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:03 -07:00
Lenz Grimmer
78022e13e7
Merge pull request #20751 from s0nea/wip-mgr-dashboard_rbd_add
mgr/dashboard_v2: Add RBD create functionality to the Python backend

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-03-14 15:57:32 +01:00
Igor Fedotov
f3be11091a os/bluestore: trim SSD devices on mkfs
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-03-14 17:46:17 +03:00
Andrew Schoen
1cc5ad0d66
Merge pull request #20878 from ceph/wip-rm23337
ceph-volume document multipath support

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-03-14 15:02:53 +01:00
Sage Weil
93ceffaccf osd/osd_types: remove backlog type for pg_log_entry_t
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-14 07:12:01 -05:00
Lenz Grimmer
619d435a71
Merge pull request #20804 from Devp00l/cephfs-template-fix
mgr/dashboard_v2: Fix cephfs template table usage

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-03-14 12:31:44 +01:00
Lenz Grimmer
a7d34152cc
Merge pull request #20783 from tspmelo/mgr-perf-counters
mgr/dashboard_v2: add mgr to the list of perf counters

Reviewed-by: Ricardo Dias <rdias@suse.com>
2018-03-14 12:11:47 +01:00
Lenz Grimmer
5dfdeccf5d
Merge pull request #20728 from jcsp/wip-dashboard-can_run
mgr/dashboard v2: implement can_run method

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
2018-03-14 11:48:40 +01:00
Kefu Chai
b1c8727eba common/options: drop unused options
async_compressor_* have never been used, so drop them.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-03-14 18:11:03 +08:00
Tatjana Dehler
5056cbacbf mgr/dashboard: Add RBD create functionality
This commit adds a basic RBD create functionality to the REST API. It enables
the POST request of the http://<host>:<port>/api/rbd API endpoint.

The commit adds also related tests.

Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2018-03-14 10:38:43 +01:00
Patrick Donnelly
09b79af819
Merge PR #20700 into master
* refs/pull/20700/head:
	client: use either dentry_invalidate_cb or remount_cb to invalidate kernel dcache

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-03-13 20:33:11 -07:00
Patrick Donnelly
52ea69762d
Merge PR #20719 into master
* refs/pull/20719/head:
	client: add new ceph_mount_perms_set function

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2018-03-13 20:33:07 -07:00
Patrick Donnelly
57364e6113
Merge PR #20780 into master
* refs/pull/20780/head:
	doc/cephfs: mention "ceph fs set-default"
	mds: include legacy_client_fscid in FSMap::dump

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-03-13 20:32:58 -07:00
Sage Weil
9e35e73743 include: kill MIN and MAX macros
Use std::min and std::max instead.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-13 21:16:42 -05:00
Sage Weil
abc4be48b7 osd/PrimaryLogPG: MIN -> std::min
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-13 21:16:29 -05:00
Patrick Donnelly
76080ed795
Merge PR #20881 into master
* refs/pull/20881/head:
	messages/MClientRequest: fix a typo so we don't output 'setfilelockrule' in logs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-03-13 16:15:13 -07:00
Sage Weil
caa3d48c96
Merge pull request #20832 from liewegas/wip-fix-do-copy-range-replay
os/filestore: fix do_copy_range replay bug

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-13 17:21:59 -05:00
Sage Weil
4e05cc748b "Correct" license from LGPL2 to LGPL2.1
Back in commit 7469f26a33 when the COPYING
file was added to the repository and the project was "licensed," the
license file was

                     GNU LESSER GENERAL PUBLIC LICENSE
                          Version 2.1, February 1999

However, the license was abbreviated as LGPL2 in various places (pretty
much everywhere, actually), due to my own ignorance/carelessness.  (I was
distinguishing it from shiny new version 3, released 6 months earlier.)

Version 2 of LGPL is the "Library General Public License," published in
June 1991: https://www.gnu.org/licenses/old-licenses/lgpl-2.0.html

Note that this ambiguity persists for most of the project's lifetime.  For
example, the original debian/copyright in 8adc9dac1d
said "LGPL2" bug in 4545f8b929 (2009, a year
later) it is changed to LGPL2.1 to satisfy Debian's lintian checks.  (It's
remained LGPL2.1 ever since.)

"Correct" the record by changing LGPL2 references to LGPL2.1.

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-13 16:07:50 -05:00
Greg Farnum
629f05b563 messages/MClientRequest: fix a typo so we don't output 'setfilelockrule' in logs
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2018-03-13 13:50:25 -07:00
Alfredo Deza
b7140d2374 ceph-volume lvm.prepare simplify help menu with bluestore default flags
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-03-13 15:30:22 -04:00
Alfredo Deza
2d1b191828 ceph-volume lvm.create simplify help menu with bluestore default flags
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-03-13 15:28:28 -04:00
Alfredo Deza
1dca5eac38 doc/ceph-volume document multipath support
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-03-13 15:26:46 -04:00
Andrew Schoen
58560cf6b5
Merge pull request #20864 from ceph/wip-cv-env-flags-fix
ceph-volume tests use granular env vars for vagrant

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-03-13 19:56:48 +01:00
Casey Bodley
5fee2689c8
Merge pull request #20724 from mdw-at-linuxbox/wip-master-rgw-fixbuf
rgw: fix memory fragmentation problem reading data from client.

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-03-13 12:02:25 -04:00
Sage Weil
27984e5590
Merge pull request #20872 from liewegas/wip-deterministic-cli-test
test/cli/osdmaptool/test-map-pgs.t: remove nondetermimistic test

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-03-13 10:52:26 -05:00
Tiago Melo
e8a1e267af mgr/dashboard_v2: add mgr to the list of perf counters
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-03-13 15:21:43 +00:00
Yuri Weinstein
82d828b68d
Merge pull request #20739 from Jeegn-Chen/wip-reject-sse-mpcp
rgw: reject encrypted object COPY before supported 

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-03-13 07:54:34 -07:00
Sage Weil
4a6101bd43 test/cli/osdmaptool/test-map-pgs.t: remove nondetermimistic test
This fails randomly; determinism is good!

Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-13 09:49:47 -05:00
Lenz Grimmer
6aaa4a9bc4
Merge pull request #20811 from tspmelo/fix-table-details
mgr/dashboard_v2: fix and improve table details

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-03-13 13:03:00 +01:00
Lenz Grimmer
be113e3e92
Merge pull request #20757 from tspmelo/wip-chart-tooltip
mgr/dashboard_v2: Improve charts tooltips

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2018-03-13 12:45:18 +01:00
Alfredo Deza
5b6e39617f ceph-volume tests use granular env vars for vagrant
Fixes the error that would inject an extra argument to vagrant when the
environment variable is not present

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-03-13 06:57:57 -04:00
Xie Xingguo
6432786c11
Merge pull request #20830 from Songweibin/wip-cleanup
osd: two cleanups

Reviewed-by: Luo Kexue <luo.kexue@zte.com.cn>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2018-03-13 15:06:00 +08:00
Xie Xingguo
796fe52797
Merge pull request #20838 from badone/test_dump_pgstate_history-check-for-empty-output
tests: Check for empty output in test_dump_pgstate_history

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-03-13 15:04:07 +08:00