Commit Graph

92760 Commits

Author SHA1 Message Date
Patrick Donnelly
9789f37fa5
Merge PR #24940 into master
* refs/pull/24940/head:
	qa: add test for getfattr ceph.dir.pin
	client: support getfattr ceph.dir.pin extended attribute

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-12-07 10:53:44 -08:00
Patrick Donnelly
4432aa5f26
Merge PR #24748 into master
* refs/pull/24748/head:
	qa: use 6h timeout for pjd test

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-12-07 10:50:57 -08:00
Nathan Cutler
a58a29e0bf
Merge pull request #25347 from smithfarm/wip-37485
build/ops: rpm: make ceph-grafana-dashboards own its directories

Reviewed-by: Tim Serong <tserong@suse.com>
2018-12-07 18:22:29 +01:00
Casey Bodley
358fd01385
Merge pull request #25414 from ivancich/wip-rgw-user-stats-mismatch
rgw: fix bad user stats on versioned bucket after reshard

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-12-07 11:53:30 -05:00
Nathan Cutler
c1083b2f4f build/ops: rpm: make ceph-grafana-dashboards own its directories on SUSE
This is only required to get the spec file to build in the OpenSUSE
Build Service (OBS). Also, this change could potentially make the
package impossible to install together with grafana (if the latter
owns the same directories with different ownership/permissions).
Therefore, make the change specific to SUSE.

Fixes: http://tracker.ceph.com/issues/37485
Signed-off-by: Nathan Cutler <ncutler@suse.com>
Signed-off-by: Tim Serong <tserong@suse.com>
2018-12-07 16:16:42 +01:00
Mykola Golub
af96e16271
Merge pull request #25415 from dillaman/wip-rbd-cli-integration
test/cli-integration/rbd: added new parent image attributes

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-12-07 10:19:24 +02:00
Jan Fajerski
73caf0a816
Merge pull request #25234 from jan--f/prometheus-add-iface-objstore-metadata
mgr/prometheus: add interface and objectstore to osd metadata
2018-12-07 09:13:23 +01:00
Kefu Chai
b03c2b4a17
Merge pull request #19454 from ifed01/wip-ifed-pool-sizes
osd: per-pool osd stats collection

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-07 10:35:23 +08:00
Sage Weil
811887edb1 Merge PR #25243 into master
* refs/pull/25243/head:
	osdc/Objecter: update op_target_t::paused in _calc_target

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-06 17:22:57 -06:00
Sage Weil
c1d757a7c6 Merge PR #25399 into master
* refs/pull/25399/head:
	osd: requeue waiting peering events from deleted slots in unprime_split_children

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-12-06 17:22:23 -06:00
Jason Dillaman
237a23eb29
Merge pull request #25428 from trociny/wip-open-flags
librbd: corrected usage of ImageState::open flag parameter

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-06 17:27:51 -05:00
Matt Benjamin
0702314909
Merge pull request #25430 from cbodley/wip-pr-22539
rgw: rgwgc:process coredump in some special case
2018-12-06 16:41:57 -05:00
sdnets
575a790066 rgw: rgwgc:process coredump in some special case。 Gc processes obja, objb, objc in order and pool of objb is deleted (obja and objc is in the same pool and pool exits). RGW will coredump as ctx->io_ctx_impl is an empty point during delete objc.
Fixes:http://tracker.ceph.com/issues/23199

Signed-off-by: zhaokun <develop@hikdata.com>
2018-12-06 16:15:22 -05:00
Casey Bodley
a74f705336
Merge pull request #17789 from shashalu/fix-bucket-link-dm
rgw: fix version bucket stats

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-12-06 15:31:58 -05:00
Casey Bodley
d29b03dd11
Merge pull request #21622 from tianshan/misc_es_fix
rgw: some fix for es sync

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-12-06 15:31:18 -05:00
Casey Bodley
7f1aa6f754
Merge pull request #24162 from zhangsw/cleanup-rgw-acl_op
rgw: remove repetitive conditional statement in RGWHandler_REST_Obj_S3

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-12-06 15:30:26 -05:00
Casey Bodley
c189b0bafa
Merge pull request #24683 from linuxbox2/wip-v2-url-meta
rgw: handle S3 version 2 pre-signed urls with meta-data

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-12-06 15:30:04 -05:00
Casey Bodley
eec7ad2dbb
Merge pull request #25142 from ivancich/wip-rgw-reshard-cleanup
rgw: reshard clean-up and associated commits

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-12-06 15:29:38 -05:00
Casey Bodley
8f254ca79f
Merge pull request #25406 from taoCH/wip-librgw-sync-user-regularly
rgw_file: user info never synced since librgw init

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-12-06 15:28:47 -05:00
Mykola Golub
c6c4e3b1f1 librbd: corrected usage of ImageState::open flag parameter
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-06 21:48:58 +02:00
Lenz Grimmer
3370095dda
Merge pull request #25423 from p-na/wip-pna-fix-pool-edit
mgr/dashboard: Fix renaming of pools

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2018-12-06 17:16:21 +01:00
Igor Fedotov
7b2d092068 mon/PGMap: Partially unify 'ceph pg stat' output with 'ceph df'
Global stats parameter (like 'available' or 'total') are dumped under the
same names now).

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
242ba0cacf pybind/diskprediction: rename raw_bytes_used field reference.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
61cb798120 pybind/mgr/telegraf: rename raw_bytes_used field reference.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
1991b70d3a qa/mgr: rename raw_bytes_used field reference.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
f4ea669147 osd: dump legacy (calculated for now) params in osd_stat_t::dump.
This is to ensure backward compatibility with python modules that use
them.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
e932053be4 PendingReleaseNotes: update according to statistics refactoring
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
71fe9149ac mgr: rename ceph df stat columns for both influx and prometheus.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
79fd227639 qa: replace raw_bytes_used field access in QA test cases
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
587f076ff7 mon: rearrange columns in ceph df output
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
377726afac os/test: extend BluestoreStatFS test with pool_statfs verification.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
deabe939ef os/bluestore: add fsck/repair coverage for per-pool stats
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
bfe3cd408b librados: fix a way rados approximate per-pool net amount.
In fact that's just a workaround for now as we need proper raw_used_rate
present at librados.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
24944bdfb4 test/mon/PGMap: fix the test case
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
b5b8aa6cf3 osd: remove assert on inconsistent total/available values from osd_stat_t encode
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
7ca25dfd5a osd,os,mon: extend 'ceph df' report to provide both USED and RAW_USED
totals where USED is space allocated for object keeping while RAW_USED
also includes space allocated/reserved for internal purposes, e.g.
DB/WAL or journal.

Signed-off-by: Igor Fedotv <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
6a01f36853 os/bluestore: add debug option to disable per pool statistics collection
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
25664c4ccf test: add test coverage for rados df reports
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
650aef1958 mon/pgmap: make pool id type consistent for statistics operations
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
db5c5cce55 rados,mon: improve ceph and rados df reports.
Fixes: https://tracker.ceph.com/issues/22159
Fixes: https://tracker.ceph.com/issues/20870

This adds  more parameters to estimate allocation granularity overhead and compression
effectiveness. RAW_USED column has been removed. USED column reflects
amount of space allocated for a pool at all replicas. Including
allocaction granularity overhead and taking ompression savings and
object content gaps into account.

Following columns were appended:
* STORED - approximation of bytes users've actually stored in a
pool, i.e netto data amount without compression, allocation and
other overheads (not applicable for 'rados df').
* USED COMPR - amount of bytes allocated to store compressed data, i.e.
compressed data plus allocation/replication overhead.
* UNDER COMPR - amount of data(icluding repicated one) passed through
compression and stored in that form.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
63df406082 osd,mon: start using per-pool statistics reported from OSD.
Notable changes:
* pool statistics collection has been changed to track actual allocated
  store space instead of previous object logical sizes summation.
* 'ceph/rados df' report total space(over all replicas) allocated for a pool under "USED" column.
* "RAW USED" column removed from 'ceph df detail' report

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
ad3d2e542f os: extend ObjectStore interface with per-pool statistics access method
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
9d433ee648 os/bluestore: add per-pool statistics collection
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Matt Benjamin
6fd2b15f4e
Merge pull request #25208 from cbodley/wip-rgw-getobj-throttle
rgw: adapt AioThrottle for RGWGetObj
yay!
2018-12-06 10:46:03 -05:00
Sage Weil
9ee3ce1ecd Merge PR #25345 into master
* refs/pull/25345/head:
	qa/suites: fix bluestore links
	qa/objectstore: bluestore -> bluestore-{bitmap,stupid}

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-12-06 08:42:04 -06:00
Sage Weil
96ca7ed859 Merge PR #25378 into master
* refs/pull/25378/head:
	mgr/hello: add serve() method

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2018-12-06 08:41:44 -06:00
Sage Weil
fb4bf34370 Merge PR #25382 into master
* refs/pull/25382/head:
	mon/OSDMonitor: include host, container info for 'osd find' command

Reviewed-by: Dan Mick <dmick@redhat.com>
2018-12-06 08:41:27 -06:00
Jason Dillaman
c0b8dab209
Merge pull request #25301 from wjwithagen/wjw-fix-dtor-pair
rbd: workaround for llvm linker problem, avoid std:pair dtor

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-06 08:27:33 -05:00
Jason Dillaman
634c659134
Merge pull request #25265 from trociny/wip-rbd-fuse-namespace
rbd-fuse: namespace support

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-06 08:26:55 -05:00
Volker Theile
ec3cae8fed
Merge pull request #24968 from s0nea/wip-dashboard-osd-recv-speed-profiles
mgr/dashboard: add profiles to set cluster's rebuild performance

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
2018-12-06 13:00:30 +01:00