Commit Graph

92892 Commits

Author SHA1 Message Date
Patrick Nawracay
e704c1b4aa mgr/dashboard: Remove unused code
Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-12-07 09:34:51 +00:00
Mykola Golub
af96e16271
Merge pull request #25415 from dillaman/wip-rbd-cli-integration
test/cli-integration/rbd: added new parent image attributes

Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-12-07 10:19:24 +02:00
Jan Fajerski
73caf0a816
Merge pull request #25234 from jan--f/prometheus-add-iface-objstore-metadata
mgr/prometheus: add interface and objectstore to osd metadata
2018-12-07 09:13:23 +01:00
Jianpeng Ma
9c73dcbc98 osd/OSD: preallocate for _get_pgs/_get_pgids to avoid reallocate.
num_pgs is the most accurate value fore reserve when call _get_pgs &
_get_pgids.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2018-12-07 11:13:09 +08:00
Kefu Chai
b03c2b4a17
Merge pull request #19454 from ifed01/wip-ifed-pool-sizes
osd: per-pool osd stats collection

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-12-07 10:35:23 +08:00
Sage Weil
811887edb1 Merge PR #25243 into master
* refs/pull/25243/head:
	osdc/Objecter: update op_target_t::paused in _calc_target

Reviewed-by: Sage Weil <sage@redhat.com>
2018-12-06 17:22:57 -06:00
Sage Weil
c1d757a7c6 Merge PR #25399 into master
* refs/pull/25399/head:
	osd: requeue waiting peering events from deleted slots in unprime_split_children

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-12-06 17:22:23 -06:00
Jason Dillaman
237a23eb29
Merge pull request #25428 from trociny/wip-open-flags
librbd: corrected usage of ImageState::open flag parameter

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2018-12-06 17:27:51 -05:00
Matt Benjamin
0702314909
Merge pull request #25430 from cbodley/wip-pr-22539
rgw: rgwgc:process coredump in some special case
2018-12-06 16:41:57 -05:00
sdnets
575a790066 rgw: rgwgc:process coredump in some special case。 Gc processes obja, objb, objc in order and pool of objb is deleted (obja and objc is in the same pool and pool exits). RGW will coredump as ctx->io_ctx_impl is an empty point during delete objc.
Fixes:http://tracker.ceph.com/issues/23199

Signed-off-by: zhaokun <develop@hikdata.com>
2018-12-06 16:15:22 -05:00
Radoslaw Zarzynski
576a41c16a common: eradicate buffer_track_c_str in bufferlist.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2018-12-06 22:07:16 +01:00
Casey Bodley
a74f705336
Merge pull request #17789 from shashalu/fix-bucket-link-dm
rgw: fix version bucket stats

Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2018-12-06 15:31:58 -05:00
Casey Bodley
d29b03dd11
Merge pull request #21622 from tianshan/misc_es_fix
rgw: some fix for es sync

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2018-12-06 15:31:18 -05:00
Casey Bodley
7f1aa6f754
Merge pull request #24162 from zhangsw/cleanup-rgw-acl_op
rgw: remove repetitive conditional statement in RGWHandler_REST_Obj_S3

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-12-06 15:30:26 -05:00
Casey Bodley
c189b0bafa
Merge pull request #24683 from linuxbox2/wip-v2-url-meta
rgw: handle S3 version 2 pre-signed urls with meta-data

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-12-06 15:30:04 -05:00
Casey Bodley
eec7ad2dbb
Merge pull request #25142 from ivancich/wip-rgw-reshard-cleanup
rgw: reshard clean-up and associated commits

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2018-12-06 15:29:38 -05:00
Casey Bodley
8f254ca79f
Merge pull request #25406 from taoCH/wip-librgw-sync-user-regularly
rgw_file: user info never synced since librgw init

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2018-12-06 15:28:47 -05:00
Alfredo Deza
f53f67ca3d ceph-volume tests.functional.simple add zap by osd id to xenial
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-12-06 15:18:06 -05:00
Alfredo Deza
8955ec1456 ceph-volume tests.functional.simple add zap by osd id to centos7
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-12-06 15:17:55 -05:00
Alfredo Deza
40a4144647 ceph-volume tests.lvm verify associated lvs by osd id+fsid behavior
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-12-06 15:00:00 -05:00
Mykola Golub
c6c4e3b1f1 librbd: corrected usage of ImageState::open flag parameter
Signed-off-by: Mykola Golub <mgolub@suse.com>
2018-12-06 21:48:58 +02:00
Tiago Melo
286df17ced mgr/dashboard: Disable showing xi18n's progress
Signed-off-by: Tiago Melo <tmelo@suse.com>
2018-12-06 18:53:10 +00:00
Andrew Schoen
01185fb324 ceph-volume: add tests for Device.lvm_size
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:45:10 -06:00
Andrew Schoen
9e2175c400 ceph-volume: set a lvm_size property on the fakedevice fixture
This is so tests can continue to set sys_api['size'] and the code
can retrieve that as Device.lvm_size

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:37:56 -06:00
Andrew Schoen
4074cb7d6a ceph-volume: create 12GB devices with virtualbox
This increases the size of the HDD devices that virtualbox creates so
that they can pass the validator for filestore single type tests
locally.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:29:47 -06:00
Andrew Schoen
aaa915cfe6 ceph-volume: use Device.lvm_size in batch strategy validators
This will validate the devices on the size that lvm will allow to be
used, not the raw physical size of the device.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:29:47 -06:00
Andrew Schoen
071e7ce41a ceph-volume: use Device.lvm_size in batch strategies
We should show the user what the size of the device will be after lvm
creates a pv out of it. This way there isn't a discrepency between the
sizes that are reported to the user and what is actually created.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:29:47 -06:00
Andrew Schoen
5197c16b44 ceph-volume: adds a lvm_size property to util.Device
This will give us the size lvm should report because it takes into
account the 1GB physical extent size we set.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:29:47 -06:00
Andrew Schoen
0023961397 ceph-volume: batch mixed type scenarios have no need to calulate data size
We know with a mixed type scenario the device used for data will be used
at 100% capacity. This means we do not need to be explict when asking
for the size of the data lvs, which avoids rounding errors with very
small device sizes.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:29:47 -06:00
Andrew Schoen
3a5b7b5fa9 ceph-volume: add /dev/nvme1n1 to filestore mixed type batch tests
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:29:47 -06:00
Andrew Schoen
fdfb79b91c ceph-volume: set use_large_block_db in validate, not compute
The self.use_large_block_db property was never getting set because
the block in compute was never called as block_db_size was reset in
validate if it was 0. We needed to set self.use_large_block_db in
validate instead of compute.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:29:47 -06:00
Andrew Schoen
4a1b97efc8 ceph-volume: set a 1G extent size when creating vgs
This allows us to create larger lvs than the default of 4m
and is easier to reason about when sizing the lvs as everythign is
reported as GBs.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:29:47 -06:00
Andrew Schoen
eab962c6ef ceph-volume: set block_db_size to 9GB in centos7 mixed type test
This is to enable testing of the --block-db-size flag

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:29:46 -06:00
Andrew Schoen
934c32acb3 ceph-volume: use two NVME drives in centos7 mixed_type tests
Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:29:46 -06:00
Andrew Schoen
add9f88dc8 ceph-volume: use extents instead of size when creating block.db lvs
In the batch command use extents instead of size when creating lvs. This
gives a more precise size and avoids rounding errors.

Signed-off-by: Andrew Schoen <aschoen@redhat.com>
2018-12-06 12:29:46 -06:00
Andrew Schoen
893b61b256 ceph-volume: create two NVME drives for testing
Signed-off-by: Andrew Schoen <aschoen@redhat.com>

Resolves: bz#1650306
2018-12-06 12:29:46 -06:00
Lenz Grimmer
3370095dda
Merge pull request #25423 from p-na/wip-pna-fix-pool-edit
mgr/dashboard: Fix renaming of pools

Reviewed-by: Laura Paduano <lpaduano@suse.com>
2018-12-06 17:16:21 +01:00
Igor Fedotov
7b2d092068 mon/PGMap: Partially unify 'ceph pg stat' output with 'ceph df'
Global stats parameter (like 'available' or 'total') are dumped under the
same names now).

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
242ba0cacf pybind/diskprediction: rename raw_bytes_used field reference.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
61cb798120 pybind/mgr/telegraf: rename raw_bytes_used field reference.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
1991b70d3a qa/mgr: rename raw_bytes_used field reference.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
f4ea669147 osd: dump legacy (calculated for now) params in osd_stat_t::dump.
This is to ensure backward compatibility with python modules that use
them.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
e932053be4 PendingReleaseNotes: update according to statistics refactoring
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
71fe9149ac mgr: rename ceph df stat columns for both influx and prometheus.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
79fd227639 qa: replace raw_bytes_used field access in QA test cases
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
587f076ff7 mon: rearrange columns in ceph df output
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
377726afac os/test: extend BluestoreStatFS test with pool_statfs verification.
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
deabe939ef os/bluestore: add fsck/repair coverage for per-pool stats
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
bfe3cd408b librados: fix a way rados approximate per-pool net amount.
In fact that's just a workaround for now as we need proper raw_used_rate
present at librados.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00
Igor Fedotov
24944bdfb4 test/mon/PGMap: fix the test case
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2018-12-06 18:54:21 +03:00