RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-01-19 17:41:39 +00:00
Code Issues Packages Projects Releases Wiki Activity
92,710 Commits 216 Branches 0 Tags 1.8 GiB
71fe9149ac
Commit Graph

92710 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Igor Fedotov
71fe9149ac mgr: rename ceph df stat columns for both influx and prometheus. 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
79fd227639 qa: replace raw_bytes_used field access in QA test cases 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
587f076ff7 mon: rearrange columns in ceph df output 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
377726afac os/test: extend BluestoreStatFS test with pool_statfs verification. 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
deabe939ef os/bluestore: add fsck/repair coverage for per-pool stats 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
bfe3cd408b librados: fix a way rados approximate per-pool net amount. 
In fact that's just a workaround for now as we need proper raw_used_rate
present at librados.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
24944bdfb4 test/mon/PGMap: fix the test case 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
b5b8aa6cf3 osd: remove assert on inconsistent total/available values from osd_stat_t encode 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
7ca25dfd5a osd,os,mon: extend 'ceph df' report to provide both USED and RAW_USED 
totals where USED is space allocated for object keeping while RAW_USED
also includes space allocated/reserved for internal purposes, e.g.
DB/WAL or journal.

Signed-off-by: Igor Fedotv <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
6a01f36853 os/bluestore: add debug option to disable per pool statistics collection 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
25664c4ccf test: add test coverage for rados df reports 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
650aef1958 mon/pgmap: make pool id type consistent for statistics operations 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
db5c5cce55 rados,mon: improve ceph and rados df reports. 
Fixes: https://tracker.ceph.com/issues/22159
Fixes: https://tracker.ceph.com/issues/20870

This adds  more parameters to estimate allocation granularity overhead and compression
effectiveness. RAW_USED column has been removed. USED column reflects
amount of space allocated for a pool at all replicas. Including
allocaction granularity overhead and taking ompression savings and
object content gaps into account.

Following columns were appended:
* STORED - approximation of bytes users've actually stored in a
pool, i.e netto data amount without compression, allocation and
other overheads (not applicable for 'rados df').
* USED COMPR - amount of bytes allocated to store compressed data, i.e.
compressed data plus allocation/replication overhead.
* UNDER COMPR - amount of data(icluding repicated one) passed through
compression and stored in that form.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
63df406082 osd,mon: start using per-pool statistics reported from OSD. 
Notable changes:
* pool statistics collection has been changed to track actual allocated
  store space instead of previous object logical sizes summation.
* 'ceph/rados df' report total space(over all replicas) allocated for a pool under "USED" column.
* "RAW USED" column removed from 'ceph df detail' report

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
ad3d2e542f os: extend ObjectStore interface with per-pool statistics access method 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Igor Fedotov
9d433ee648 os/bluestore: add per-pool statistics collection 
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
 2018-12-06 18:54:21 +03:00
Matt Benjamin
6fd2b15f4e
Merge pull request #25208 from cbodley/wip-rgw-getobj-throttle 
rgw: adapt AioThrottle for RGWGetObj
yay!
 2018-12-06 10:46:03 -05:00
Sage Weil
9ee3ce1ecd Merge PR #25345 into master 
* refs/pull/25345/head:
	qa/suites: fix bluestore links
	qa/objectstore: bluestore -> bluestore-{bitmap,stupid}

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
 2018-12-06 08:42:04 -06:00
Sage Weil
96ca7ed859 Merge PR #25378 into master 
* refs/pull/25378/head:
	mgr/hello: add serve() method

Reviewed-by: Sebastian Wagner <swagner@suse.com>
 2018-12-06 08:41:44 -06:00
Sage Weil
fb4bf34370 Merge PR #25382 into master 
* refs/pull/25382/head:
	mon/OSDMonitor: include host, container info for 'osd find' command

Reviewed-by: Dan Mick <dmick@redhat.com>
 2018-12-06 08:41:27 -06:00
Jason Dillaman
c0b8dab209
Merge pull request #25301 from wjwithagen/wjw-fix-dtor-pair 
rbd: workaround for llvm linker problem, avoid std:pair dtor

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-06 08:27:33 -05:00
Jason Dillaman
634c659134
Merge pull request #25265 from trociny/wip-rbd-fuse-namespace 
rbd-fuse: namespace support

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-06 08:26:55 -05:00
Volker Theile
ec3cae8fed
Merge pull request #24968 from s0nea/wip-dashboard-osd-recv-speed-profiles 
mgr/dashboard: add profiles to set cluster's rebuild performance

Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Sebastian Krah <skrah@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
 2018-12-06 13:00:30 +01:00
Kefu Chai
90ee8b8580
Merge pull request #25409 from tchaikov/wip-public-iterator-traits 
buffer: mark the iterator traits "public"

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
 2018-12-06 13:49:17 +08:00
Jason Dillaman
6db4c152a6
Merge pull request #25266 from trociny/wip-24608 
rbd-ggate: support namespaces

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 20:25:54 -05:00
Kefu Chai
5c708ece39 buffer: mark the iterator traits "public" 
the iterator traits should be accessible from non-dervative classes.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2018-12-06 08:59:35 +08:00
Gregory Farnum
dca5001b4e
Merge pull request #25230 from runsisi/wip-cleanup-objecter 
osdc/Objecter: no need null pointer check for op->session anymore

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
 2018-12-05 15:37:53 -08:00
Sage Weil
59d0844c12 Merge PR #23550 into master 
* refs/pull/23550/head:
	auth: Kerberos authentication
 2018-12-05 13:42:17 -06:00
Jason Dillaman
241896c660
Merge pull request #25166 from kungf/journal_remove_full 
journal: allow remove set when jounal pool is full

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 13:25:31 -05:00
Jason Dillaman
493dc89d08
Merge pull request #25175 from trociny/wip-36710 
librbd: restart io if migration parent gone

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 13:24:55 -05:00
Jason Dillaman
4bc7e0aa84
Merge pull request #25260 from trociny/wip-24609 
rbd-nbd: support namespaces

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 13:24:36 -05:00
Jason Dillaman
74d939799c
Merge pull request #25371 from trociny/wip-osd-query-subkey-types 
osd: support more dynamic perf query subkey types

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 13:24:23 -05:00
Jason Dillaman
bf5b75679e
Merge pull request #25151 from trociny/wip-osd-perf-query-limit 
mgr: add limit param to osd perf query

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 13:24:10 -05:00
Jason Dillaman
2a64af8928
Merge pull request #25379 from tchaikov/wip-37508 
librbd: reset snaps in rbd_snap_list()

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2018-12-05 13:23:33 -05:00
Sage Weil
269910fc8b qa/suites: fix bluestore links 
Signed-off-by: Sage Weil <sage@redhat.com>
 2018-12-05 10:30:14 -06:00
Kefu Chai
2919ada413
Merge pull request #24882 from rzarzynski/wip-bl-hypercombined 
common: hypercombined bufferlist

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Adam Emerson <aemerson@redhat.com>
 2018-12-06 00:16:55 +08:00
Casey Bodley
c7bf1be10e rgw: store ref to librados::IoCtx in rgw::AioResult 
the IoCtx has to outlive its aio completions

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
7e6c232843 rgw: add const overload of RGWSI_RADOS::Obj::get_ref() 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
a4d3977cfa rgw: rgw_rados_ref contains rgw_raw_obj 
rgw_rados_ref duplicated each of the fields from rgw_raw_obj

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
046769848d rgw: use AioThrottle for Object::Read::iterate() ops 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
693dfd6b9e rgw: clean up iterate_obj() callbacks 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
f5a64fd9b4 rgw: add append_atomic_test() overload for RGWObjState 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
e81cedcf73 rgw: add id to distinguish between Aio results 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
81e79fe7a7 rgw: Aio reads return bufferlist in result 
Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Casey Bodley
85fb04416e rgw: move aio throttles to namespace rgw 
they're useful outside of putobj

Signed-off-by: Casey Bodley <cbodley@redhat.com>
 2018-12-05 11:16:54 -05:00
Kefu Chai
8ffe31a6e2
Merge pull request #25365 from xiexingguo/wip-37493 
osd/OSDMap: fix upmap mis-killing for erasure-coded PGs
 2018-12-06 00:13:28 +08:00
Kefu Chai
d80000fcf0
Merge pull request #25262 from aclamk/wip-kvstore-tool-dump 
ceph-kvstore-tool: dump fixes

Reviewed-by: Sage Weil <sage@redhat.com>
 2018-12-06 00:13:00 +08:00
Kefu Chai
52e4315c63
Merge pull request #25383 from dmick/wip-container-name 
common/util.cc: add CONTAINER_NAME processing for metadata

Reviewed-by: Sage Weil <sage@redhat.com>
 2018-12-06 00:02:49 +08:00
Kefu Chai
9a4d0ac754
Merge pull request #25400 from dillaman/wip-ceph-cli 
ceph: do not raise StopIteration within generator

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2018-12-06 00:01:43 +08:00
Willem Jan Withagen
eabeaf5fbc rbd: workaround for llvm linker proplem, avoid std:pair dtor 
When linking with llvm linker on FreeBSD:
```
/usr/bin/ld.lld: error: undefined symbol: std::__1::pair<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, bool>::~pair()
>>> referenced by Image.cc:349 (/home/jenkins/workspace/ceph-master/src/librbd/api/Image.cc:349)
>>>               Image.cc.o:(librbd::api::Image<librbd::ImageCtx>::list_children(librbd::ImageCtx*, cls::rbd::ParentImageSpec const&, std::__1::vector<librbd::linked_image_spec_t, std::__1::allocator<librbd::linked_image_spec_t> >*)) in archive ../../../lib/librbd_internal.a
```

Which is probably because the compiler calls a dtor on the just created pair.
But the FreeBSD linker does not find a dtor in the any of the libraries.
This rewrite build and links without the linker error.

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
 2018-12-05 15:35:37 +01:00