Commit Graph

97840 Commits

Author SHA1 Message Date
David Zafman
3a234164d0
Merge pull request #27279 from dzafman/wip-divergent
Improvements to standalone tests

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-04-24 10:58:11 -07:00
Kefu Chai
67a34f2cf8
Merge pull request #27750 from tchaikov/wip-silence-gcc-warning
test/objectstore: silence -Wsign-compare warning

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-04-25 00:18:48 +08:00
Sage Weil
dd93973894 Merge PR #27721 into master
* refs/pull/27721/head:
	tools: pin the version of breathe that works with Python2

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-24 10:48:17 -05:00
Ilya Dryomov
b01133661e librbd: avoid repeatedly invoking is_zero() in CopyupRequest
Invoke is_zero() just once, either in handle_read_from_parent() or
handle_deep_copy().

Initialize m_copyup_is_zero to true to preserve existing behavior:
on an empty bufferlist is_zero() returns true.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-04-24 17:45:53 +02:00
Jason Dillaman
9b615c3075 librbd: copyup read stats were incorrectly tied to child
The parent IO stats should be updated when reading from the parent
image for a copyup.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2019-04-24 11:37:41 -04:00
Mykola Golub
32a3b85a0c librbd: leak on canceling simple io scheduler timer task
When the timer task is canceled it is just deleted and the passed
context will not be executed.

Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-04-24 15:44:57 +01:00
Casey Bodley
33a7ec6861 test/rgw: rgw throttle tests use mock operations
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 10:39:09 -04:00
Casey Bodley
6c3b26c877 rgw: add optional_yield to Aio::librados_op()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 10:39:09 -04:00
Casey Bodley
ff482e1798 rgw: add optional_yield to get_obj_data
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 10:39:09 -04:00
Casey Bodley
4259c3e334 rgw: add optional_yield to PutObjProcessors
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 10:39:09 -04:00
Nathan Cutler
0d0e87241a
Merge pull request #27221 from LenzGr/update-backportscripts
script: Obtain milestones via github API

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-04-24 15:49:00 +02:00
Casey Bodley
4b5f18e1b2 rgw: read ops use make_throttle() with optional_yield
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:45:37 -04:00
Casey Bodley
02df88d23d rgw: write ops use make_throttle() with optional_yield
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:45:37 -04:00
Casey Bodley
3979d32fa6 rgw: add make_throttle() for optionally-async AioThrottle
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:44:14 -04:00
Casey Bodley
3a2830325d rgw: add YieldingAioThrottle
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:44:14 -04:00
Casey Bodley
346b924cb2 rgw: add BlockingAioThrottle
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:44:14 -04:00
Casey Bodley
3d2d0892cc
Merge pull request #25692 from Liuchang0812/fix-26835
rgw: returns LimitExceeded when user creates too many ACLs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:42:28 -04:00
Casey Bodley
046043c235
Merge pull request #25044 from tianshan/fix_36763
rgw: set null version object acl issues

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:41:52 -04:00
Casey Bodley
3466bc1292
Merge pull request #21154 from mslovy/rgw-admin-api
rgw:  update op_mask of user via admin rest api

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:41:31 -04:00
Casey Bodley
09543f7131
Merge pull request #17338 from tianshan/fix_roles_pool
rgw: add roles_pool in RGWZoneParams dump/decode json

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:40:36 -04:00
Casey Bodley
de27881839
Merge pull request #17591 from shashalu/fix-bucket-list-versions
rgw: list_bucket versions return NextVersionIdMarker = "null" if next_marker.instance is empty

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:40:16 -04:00
Sage Weil
61d6d051de Merge PR #27472 into master
* refs/pull/27472/head:
	doc/rados/operations/devices: document device failure prediction

Reviewed-by: Rick Chen <rick.chen@prophetstor.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2019-04-24 08:37:49 -05:00
Kefu Chai
8b84eb6b3b messages: #include necessary header
* MOSDPGLog.h,MBackfillReserve.h,MOSDPGTrim.h,MRecoveryReserve.h:
  for instance, MLogRec is defined in PGPeeringEvent.h, we should not rely
  other header(s) to do this for us. so just #include PGPeeringEvent.h for
  its definition.
* MOSDPeeringOp: do not include PGPeeringEvent.h, as it's not used in
  this header. forward delcaration would suffice

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-24 21:36:58 +08:00
Kefu Chai
8f57abeb0a
Merge pull request #27573 from iotcg/corpus
import-generated.sh: use PATH to get ceph-dencoder

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-24 21:34:26 +08:00
Sage Weil
08f4768bec Merge PR #27696 into master
* refs/pull/27696/head:
	osd: make use of pg history and past_intervals in pg_create2 messages
	mon/OSDMonitor: track history and past_intervals for creating pgs
	osd/osd_types: make PastIntervals pi_compact_rep print participants
	osd/osd_types: take bare const OSDMap * to check_new_interval
	osd/osd_types: add pg_history_t ctor that takes creation epoch+stamp

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-04-24 08:15:19 -05:00
Sage Weil
a3a4af3454 Merge PR #27656 into master
* refs/pull/27656/head:
	doc/dev/erasure-coded-pool: update
	doc/rados/operations/erasure-code*: update default ec profile references
	common/options: change default erasure-code-profile to k=2 m=2

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-04-24 08:14:55 -05:00
Kefu Chai
f5d1991986 test/objectstore: silence -Wsign-compare warning
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-24 20:58:35 +08:00
Mykola Golub
22973d9d46
Merge pull request #27683 from dillaman/wip-24668
qa/workunits/rbd: use more recent qemu-iotests that support Bionic

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-04-24 15:40:43 +03:00
Lenz Grimmer
794f66f0fb script: Obtain milestones via github API
Replace the hard-coded list of milestones with an API request
that obtains this data from github directly.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2019-04-24 14:12:59 +02:00
Changcheng Liu
0c3ca82557 import-generated.sh: correct access to ceph-dencoder
align with instructions in doc/dev/corpus.rst.
doc/dev/corpus.rst is under change by kchai@redhat.com
in PR 27552.

Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
2019-04-24 20:06:11 +08:00
Kefu Chai
692f4b1a05 doc/dev/corpus.rst: correct instructions
* should keep all OSD up and running, otherwise some tests will wait for
  healthy cluster for ever.
* should start 2 MGR for an active-standby setting -- better coverage
this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-24 19:49:58 +08:00
Kefu Chai
b4040f09dd
Merge pull request #27704 from tchaikov/wip-denc-dump
denc: allow DencDumper to dump OOB buffer

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-24 19:49:54 +08:00
Lenz Grimmer
926654a893
mgr/dashboard: iSCSI: Limit members to 1 group (#27520)
mgr/dashboard: iSCSI: Limit members to 1 group

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-04-24 13:41:03 +02:00
Lenz Grimmer
3deb4f61ad
Merge pull request #27722 from rhcs-dashboard/39434-prometheus-replace-whitespaces
mgr/prometheus: replace whitespaces in metrics' names

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-04-24 13:38:14 +02:00
Lenz Grimmer
54a7cea965
Merge pull request #27678 from tspmelo/wip-iscsi-discovery-read
mgr/dashboard: Fix iSCSI Discovery user permissions
2019-04-24 13:31:50 +02:00
Lenz Grimmer
98d5e47f87
Merge pull request #27609 from tspmelo/wip-iscsi-form-warn
mgr/dashboard: Fix iSCSI target form warning

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-04-24 13:29:46 +02:00
Mykola Golub
536166b45b
Merge pull request #27720 from dillaman/wip-39407
rbd-mirror: clear out bufferlist prior to listing mirror images

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-04-24 13:00:52 +03:00
myoungwon oh
8a8d5e89bb src/test: remove unused objects to calculate accurate dedup ratio.
Signed-off-by: Myoungwon Oh <ommw@sk.com>
2019-04-24 18:22:37 +09:00
Jianpeng Ma
7e1fcf82b6 msg/async: no-need set connection for Message.
In function decode_message, it already did.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-04-24 16:28:45 +08:00
Kefu Chai
41ccb0926d denc: use scope_guard to close(fd)
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-24 16:26:07 +08:00
Kefu Chai
779419a745 crush,msg: silence -Wsign-compare warnings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-24 16:26:07 +08:00
Kefu Chai
17c15fb8be denc: allow DencDumper to dump OOB buffer
if encoder encodes buffers into the bufferlist directly, the
contiguous_appender's out_of_band_offset would be greater than zero, in
that case, we should dump the bufferlist passed to appender instead of
just looking at the [pre_pos, post_pos).

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-24 16:26:07 +08:00
Kefu Chai
6159476e4a denc: rewrite DENC_DUMP_{PRE,POST} using template
* for better readability
* for better debugging experience
* so we can `friend` it in a class in a follow-up change

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-24 16:26:07 +08:00
Xie Xingguo
78bcae1d6b
Merge pull request #27719 from xiexingguo/wip-crush-node-flags
mon/OSDMonitor: crush node flags - two fixes; add tests

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-24 08:44:08 +08:00
Sage Weil
6f2743b66c common/assert: include ceph_abort_msg(arg) arg in log output
This will also be part of the "assert_msg" field in the crash dump.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-23 16:48:52 -05:00
Casey Bodley
83ab6aac2a
Merge pull request #26107 from alimaredia/wip-dpp-rgw-put-obj-processor
rgw: log refactoring for putobj_processor

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-04-23 15:50:07 -04:00
Ali Maredia
f92a071e18 rgw: log refactoring for AtomicObjProcessor complete
Signed-off-by: Ali Maredia <amaredia@redhat.com>
2019-04-23 15:07:37 -04:00
Sage Weil
760cb2222f Merge PR #27628 into master
* refs/pull/27628/head:
	common: optimize check_utf8

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-23 13:08:29 -05:00
Sage Weil
f7ceac90d1 Merge PR #27702 into master
* refs/pull/27702/head:
	osd/PG: fix last_complete re-calculation on splitting

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-04-23 13:06:52 -05:00
Sage Weil
fd3c323ffd Merge PR #27691 into master
* refs/pull/27691/head:
	os/bluestore: fix out-of-bound access in bmap allocator.
	os/bluestore: reproduce out-of-bound access for bmap allocator

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-23 13:06:15 -05:00