Commit Graph

83097 Commits

Author SHA1 Message Date
Boris Ranto
aae7a21138 mgr/prometheus: Expose OSD Flags
Signed-off-by: Boris Ranto <branto@redhat.com>
2018-02-19 17:30:46 +01:00
Boris Ranto
6cefd4832f mgr/prometheus: Fix pg_* counts
Currently, the pg_* counts are not computed properly. We split the
current state by '+' sign but do not add the pg count to the already
found pg count. Instead, we overwrite any existing pg count with the new
count. This patch fixes it by adding all the pg counts together for all
the states.

It also introduces a new pg_total metric for pg_total that shows the
total count of PGs.

Signed-off-by: Boris Ranto <branto@redhat.com>
2018-02-19 17:30:46 +01:00
Boris Ranto
965aaad527 mgr/prometheus: Skip bogus entries
The osd data can contain bogus '-' entries, skip these when populating
osd metadata and disk occupation.

Signed-off-by: Boris Ranto <branto@redhat.com>
2018-02-19 17:30:46 +01:00
Andrew Schoen
9bc0b8b985
Merge pull request #20408 from ceph/wip-rm22785
ceph-volume consume mount/format options from ceph.conf

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-02-15 21:08:38 +01:00
Orit Wasserman
82ea1b5c6b
Merge pull request #20158 from liaoxin01/fix-list-multi-upload
rgw: fix the max-uploads parameter not work
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-02-15 21:28:32 +02:00
Kefu Chai
097e2de5f7
Merge pull request #20362 from tchaikov/wip-mgr-py3
mgr: fix py3 support

Reviewed-by: Jan Fajerski <jfajerski@suse.com>
2018-02-16 02:32:04 +08:00
Kefu Chai
57d1b785ff
Merge pull request #20430 from tchaikov/wip-bluefs-demotion
os/bluestore: fix the demotion in StupidAllocator::init_rm_free

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2018-02-16 02:26:09 +08:00
David Zafman
00d4c3eef0
Merge pull request #20410 from dzafman/wip-21218
osd: Fix assert when checking missing version

Reviewed-by: Sage Weil <sage@redhat.com>
2018-02-15 10:25:44 -08:00
Yuri Weinstein
bd26668ad1
Merge pull request #19322 from theanalyst/usage-trim-2
rgw: add an option to clear all usage entries

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:26:06 -08:00
Yuri Weinstein
bb4b98bf07
Merge pull request #19573 from Leeshine/wip-rgw-sync-status
rgw: improve sync status

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:25:36 -08:00
Yuri Weinstein
7e6edc0c46
Merge pull request #19606 from cfanz/wip-rgw-fix-collect-return
rgw: fix collect()'s return in coroutine

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-02-15 09:25:05 -08:00
Yuri Weinstein
fdeb12f6a7
Merge pull request #19815 from qrGitHub/wip-rgw-memory-optimize2
rgw: drop unused vector elements

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:24:35 -08:00
Yuri Weinstein
0762dbe9cc
Merge pull request #19921 from fangyuxiangGL/lc-ret
rgw: lifecycle omap entry was removed in abnormal situation

Reviewed-by: Daniel Gryniewicz <dang@redhat.com>
2018-02-15 09:07:57 -08:00
Yuri Weinstein
04d17acc99
Merge pull request #20006 from jcsp/wip-rgw-perfcounters
rgw: set priority on perf counters

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-02-15 09:07:00 -08:00
Yuri Weinstein
350eef5c61
Merge pull request #20021 from tianshan/fix_bilog_list
cls/rgw: fix bi_log_iterate_entries return wrong truncated

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:05:10 -08:00
Yuri Weinstein
f4080c4a61
Merge pull request #20023 from badone/wip-rgw-better-ERANGE-error
rgw: Better ERANGE error message

Reviewed-by: <mkogan@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2018-02-15 09:04:48 -08:00
Yuri Weinstein
0eab7516ba
Merge pull request #20024 from luomuyao/dev
rgw: fix a typo in rgw_perms[]

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 09:04:19 -08:00
Yuri Weinstein
327d3bd337
Merge pull request #20191 from yehudasa/wip-22833
rgw: sync tracing fixes

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
Reviewed-by: <mkogan@redhat.com>
2018-02-15 09:02:19 -08:00
Yuri Weinstein
3563d21664
Merge pull request #20063 from cethikdata/rgw_quota
rgw: upldate the max-buckets when the quota is uploaded

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 08:59:00 -08:00
Yuri Weinstein
d881a416e4
Merge pull request #20095 from tianshan/fix_reload
rgw: fix RGWCompletionManager get_next stuck after going down

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-02-15 08:58:39 -08:00
Alfredo Deza
287c952bc8 ceph-volume util.prepare extend flags when found
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:29 -05:00
Alfredo Deza
457a5173d2 ceph-volume util.constants update mount flags to include rw, normalize on list
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:29 -05:00
Alfredo Deza
b80e3bf117 ceph-volume configuration normalize underscore vs. whitespace named options
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:29 -05:00
Alfredo Deza
676c93fcf3 ceph-volume tests check for mount/format usage from ceph.conf
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:29 -05:00
Alfredo Deza
a8eecc6471 ceph-volume tests add ceph.conf stub for custom conf files
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-15 11:29:28 -05:00
Mykola Golub
cd3ae9b81f
Merge pull request #20423 from dillaman/wip-22945
librbd: new tag should use on-disk committed position

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-02-15 14:13:45 +02:00
John Wilkins
9d21c2983f
Merge pull request #20442 from JordanHus/master
doc: Fixes a spelling error and a broken hyperlink.

Reviewed-by: John Wilkins
2018-02-14 15:15:27 -08:00
Jordan Hus
d68e84dadf doc: Fixes a spelling error and a broken hyperlink.
Signed-off-by: Jordan Hus <jordan.hus@dicecorp.com>
2018-02-14 14:23:59 -05:00
Jason Dillaman
24df022e0b journal: flush commit positions should wait for refresh
Fixes: http://tracker.ceph.com/issues/22945
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-14 11:22:02 -05:00
Jason Dillaman
c5a5b20e08 journal: support concurrent refresh requests
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2018-02-14 11:22:01 -05:00
Kefu Chai
1b8ddee81b
Merge pull request #19859 from yaozongyou/rgw-remove-register-warning
rgw: silence not allow register storage class specifier warning

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-02-15 00:13:37 +08:00
John Spray
e69afea925
Merge pull request #20187 from wido/influxdb-connection-error
mgr/influx: Various fixes and improvements

Reviewed-by: John Spray <john.spray@redhat.com>
2018-02-14 15:18:31 +00:00
Alfredo Deza
f21200627d
Merge pull request #20265 from ceph/wip-rm22876
ceph-volume: lvm zap will unmount osd paths used by zapped devices

Reviewed-by: Alfredo Deza <adeza@redhat.com>
2018-02-14 07:07:16 -05:00
Mykola Golub
ad765021bc
Merge pull request #20406 from dillaman/wip-22979
librbd: fix issues discovered in clone v2 during upgrade tests

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-02-14 09:36:02 +02:00
Kefu Chai
d43c8da833 os/bluestore: fix the demotion in StupidAllocator::init_rm_free
* we should update the _size field when demotion kicks in, otherwise the
  interval_set::m and interval_set::_size won't be consistent.
* also rename post_process to claim, as it "steals" the leftover(s) of
chopped segment.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-02-14 12:22:56 +08:00
Andrew Schoen
3f2e7074ee ceph-volume: use terminal.MultiLogger in lvm zap
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
c8a6da4e1b ceph-volume: use api helper methods for pvs and lvs in lvm zap
This is just a cleaner way of doing this instead of using PVolumes
and Volumes directly.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
5552cefc4c ceph-volume: fix documentation typos for lvm zap
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
d4639ac116 ceph-volume: when zapping unmount osd directories
If you zap an lv, device or partition and it's currently mounted as a
ceph osd directory then it will be unmounted so the zap can complete.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:05 -06:00
Andrew Schoen
6909baef54 ceph-volume: adds a util.system.unmount function
This function will unmount the given path

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 16:58:04 -06:00
Andrew Schoen
5f7c250d29
Merge pull request #20427 from ceph/wip-rm22988
ceph-volume use realpath when checking mounts

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-02-13 23:57:04 +01:00
Patrick Donnelly
2e44b87141
Merge PR #19263 into master
* refs/pull/19263/head:
	qa: ignore bad backtrace cluster wrn
	qa/cephfs: Add tests to validate scrub functionality
	cephfs: Add option to load invalid metadata from disk
	cephfs: Reset scrub data when inodes move

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 14:43:32 -08:00
Patrick Donnelly
5224d94f4b
qa: ignore bad backtrace cluster wrn
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 14:12:53 -08:00
Alfredo Deza
16eabbc3ab ceph-volume tests verify realpath usage in mounts
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-13 15:55:11 -05:00
Alfredo Deza
53e691e1d5 ceph-volume util.system optionally use realpath on devices
To check a mounted device it is needed to verify on a combination of
realpath and plain devices against realpath and plain paths. In LVM, two
different paths might refer to the same devices

Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-02-13 15:55:11 -05:00
Patrick Donnelly
3ed7cc2cbc
Merge PR #19957 into master
* refs/pull/19957/head:
	client: fixup parallel calls to ceph_ll_lookup_inode() in NFS FASL

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2018-02-13 11:36:18 -08:00
Patrick Donnelly
e9468619f9
Merge PR #20336 into master
* refs/pull/20336/head:
	client: re-use free snap tag

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 11:36:11 -08:00
Patrick Donnelly
304efb05c6
Merge PR #20373 into master
* refs/pull/20373/head:
	client: clamp I/O sizes to INT_MAX when we can't return larger values
	test: new testcase for ceph_ll_readv and ceph_ll_writev
	client: hook up ceph_ll_readv and ceph_ll_writev
	client: type safety cleanup for _read and _write codepaths

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-02-13 11:36:04 -08:00
Patrick Donnelly
4d2106bfe7
Merge PR #20386 into master
* refs/pull/20386/head:
	mds: optimize getattr file size

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-13 11:35:57 -08:00
Douglas Fuller
07339e2d1d qa/cephfs: Add tests to validate scrub functionality
Add tests to ensure the scrub operation is not adversly affected
by certain metadata pathologies.

Signed-off-by: Douglas Fuller <dfuller@redhat.com>
2018-02-13 14:07:28 -05:00