RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-02-12 13:29:17 +00:00
Code Issues Packages Projects Releases Wiki Activity
92,716 Commits 211 Branches 395 Tags 1.9 GiB
7b2d092068
Commit Graph

92716 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Igor Fedotov
7b2d092068 mon/PGMap: Partially unify 'ceph pg stat' output with 'ceph df' 
Global stats parameter (like 'available' or 'total') are dumped under the
same names now).

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
242ba0cacf pybind/diskprediction: rename raw_bytes_used field reference. 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
61cb798120 pybind/mgr/telegraf: rename raw_bytes_used field reference. 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
1991b70d3a qa/mgr: rename raw_bytes_used field reference. 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
f4ea669147 osd: dump legacy (calculated for now) params in osd_stat_t::dump. 
This is to ensure backward compatibility with python modules that use
them.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
e932053be4 PendingReleaseNotes: update according to statistics refactoring 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
71fe9149ac mgr: rename ceph df stat columns for both influx and prometheus. 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
79fd227639 qa: replace raw_bytes_used field access in QA test cases 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
587f076ff7 mon: rearrange columns in ceph df output 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
377726afac os/test: extend BluestoreStatFS test with pool_statfs verification. 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
deabe939ef os/bluestore: add fsck/repair coverage for per-pool stats 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
bfe3cd408b librados: fix a way rados approximate per-pool net amount. 
In fact that's just a workaround for now as we need proper raw_used_rate
present at librados.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
24944bdfb4 test/mon/PGMap: fix the test case 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
b5b8aa6cf3 osd: remove assert on inconsistent total/available values from osd_stat_t encode 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
7ca25dfd5a osd,os,mon: extend 'ceph df' report to provide both USED and RAW_USED 
totals where USED is space allocated for object keeping while RAW_USED
also includes space allocated/reserved for internal purposes, e.g.
DB/WAL or journal.

Signed-off-by: Igor Fedotv <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
6a01f36853 os/bluestore: add debug option to disable per pool statistics collection 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
25664c4ccf test: add test coverage for rados df reports 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
650aef1958 mon/pgmap: make pool id type consistent for statistics operations 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
db5c5cce55 rados,mon: improve ceph and rados df reports. 
Fixes: https://tracker.ceph.com/issues/22159
Fixes: https://tracker.ceph.com/issues/20870

This adds  more parameters to estimate allocation granularity overhead and compression
effectiveness. RAW_USED column has been removed. USED column reflects
amount of space allocated for a pool at all replicas. Including
allocaction granularity overhead and taking ompression savings and
object content gaps into account.

Following columns were appended:
* STORED - approximation of bytes users've actually stored in a
pool, i.e netto data amount without compression, allocation and
other overheads (not applicable for 'rados df').
* USED COMPR - amount of bytes allocated to store compressed data, i.e.
compressed data plus allocation/replication overhead.
* UNDER COMPR - amount of data(icluding repicated one) passed through
compression and stored in that form.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
63df406082 osd,mon: start using per-pool statistics reported from OSD. 
Notable changes:
* pool statistics collection has been changed to track actual allocated
  store space instead of previous object logical sizes summation.
* 'ceph/rados df' report total space(over all replicas) allocated for a pool under "USED" column.
* "RAW USED" column removed from 'ceph df detail' report

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
ad3d2e542f os: extend ObjectStore interface with per-pool statistics access method 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
9d433ee648 os/bluestore: add per-pool statistics collection 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Matt Benjamin
6fd2b15f4e
Merge pull request #25208 from cbodley/wip-rgw-getobj-throttle 
rgw: adapt AioThrottle for RGWGetObj
yay!
 2018-12-06 10:46:03 -05:00
Sage Weil
9ee3ce1ecd Merge PR #25345 into master 
* refs/pull/25345/head:
	qa/suites: fix bluestore links
	qa/objectstore: bluestore -> bluestore-{bitmap,stupid}

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
 2018-12-06 08:42:04 -06:00
Sage Weil
96ca7ed859 Merge PR #25378 into master 
* refs/pull/25378/head:
	mgr/hello: add serve() method

Reviewed-by: Sebastian Wagner <swagner@suse.com>
 2018-12-06 08:41:44 -06:00
Sage Weil
fb4bf34370 Merge PR #25382 into master 
* refs/pull/25382/head:
	mon/OSDMonitor: include host, container info for 'osd find' command

Reviewed-by: Dan Mick <dmick@redhat.com>
 2018-12-06 08:41:27 -06:00
Jason Dillaman
c0b8dab209
Merge pull request #25301 from wjwithagen/wjw-fix-dtor-pair 
rbd: workaround for llvm linker problem, avoid std:pair dtor

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-06 08:27:33 -05:00
Jason Dillaman
634c659134
Merge pull request #25265 from trociny/wip-rbd-fuse-namespace 
rbd-fuse: namespace support

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-06 08:26:55 -05:00
Volker Theile
ec3cae8fed
Merge pull request #24968 from s0nea/wip-dashboard-osd-recv-speed-profiles 
mgr/dashboard: add profiles to set cluster's rebuild performance

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
 2018-12-06 13:00:30 +01:00
Kefu Chai
90ee8b8580
Merge pull request #25409 from tchaikov/wip-public-iterator-traits 
buffer: mark the iterator traits "public"

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
 2018-12-06 13:49:17 +08:00
Jason Dillaman
6db4c152a6
Merge pull request #25266 from trociny/wip-24608 
rbd-ggate: support namespaces

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 20:25:54 -05:00
Kefu Chai
5c708ece39 buffer: mark the iterator traits "public" 
the iterator traits should be accessible from non-dervative classes.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2018-12-06 08:59:35 +08:00
Gregory Farnum
dca5001b4e
Merge pull request #25230 from runsisi/wip-cleanup-objecter 
osdc/Objecter: no need null pointer check for op->session anymore

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
 2018-12-05 15:37:53 -08:00
Sage Weil
59d0844c12 Merge PR #23550 into master 
* refs/pull/23550/head:
	auth: Kerberos authentication
 2018-12-05 13:42:17 -06:00
Jason Dillaman
241896c660
Merge pull request #25166 from kungf/journal_remove_full 
journal: allow remove set when jounal pool is full

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 13:25:31 -05:00
Jason Dillaman
493dc89d08
Merge pull request #25175 from trociny/wip-36710 
librbd: restart io if migration parent gone

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 13:24:55 -05:00
Jason Dillaman
4bc7e0aa84
Merge pull request #25260 from trociny/wip-24609 
rbd-nbd: support namespaces

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 13:24:36 -05:00
Jason Dillaman
74d939799c
Merge pull request #25371 from trociny/wip-osd-query-subkey-types 
osd: support more dynamic perf query subkey types

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 13:24:23 -05:00
Jason Dillaman
bf5b75679e
Merge pull request #25151 from trociny/wip-osd-perf-query-limit 
mgr: add limit param to osd perf query

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 13:24:10 -05:00
Jason Dillaman
2a64af8928
Merge pull request #25379 from tchaikov/wip-37508 
librbd: reset snaps in rbd_snap_list()

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 13:23:33 -05:00
Sage Weil
269910fc8b qa/suites: fix bluestore links 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-12-05 10:30:14 -06:00
Kefu Chai
2919ada413
Merge pull request #24882 from rzarzynski/wip-bl-hypercombined 
common: hypercombined bufferlist

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
 2018-12-06 00:16:55 +08:00
Casey Bodley
c7bf1be10e rgw: store ref to librados::IoCtx in rgw::AioResult 
the IoCtx has to outlive its aio completions

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
7e6c232843 rgw: add const overload of RGWSI_RADOS::Obj::get_ref() 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
a4d3977cfa rgw: rgw_rados_ref contains rgw_raw_obj 
rgw_rados_ref duplicated each of the fields from rgw_raw_obj

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
046769848d rgw: use AioThrottle for Object::Read::iterate() ops 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
693dfd6b9e rgw: clean up iterate_obj() callbacks 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
f5a64fd9b4 rgw: add append_atomic_test() overload for RGWObjState 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
e81cedcf73 rgw: add id to distinguish between Aio results 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
81e79fe7a7 rgw: Aio reads return bufferlist in result 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00