Commit Graph

97685 Commits

Author SHA1 Message Date
Changcheng Liu
7a35128e39 msg/async/rdma: free member hold memory when destructing obj
device_context_list hold the memory allocated through
ibv_get_device_list. release the memory through calling
ibv_free_device_list.

Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
2019-04-25 14:08:00 +08:00
Changcheng Liu
8328312a0d msg/sync/rdma: abort rdma operation when ibv_query_device failed
ibv_query_device return none zero when failing to query rdma
device. run ceph_abort in any case when ibv_query_device return
none zero.

Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
2019-04-25 14:07:50 +08:00
Kefu Chai
49117a0414
Merge pull request #27741 from tchaikov/doc/dev/wip-corpus.rst
doc/dev/corpus.rst: correct instructions

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-04-25 13:30:10 +08:00
Sage Weil
30a8d911eb Merge PR #27626 into master
* refs/pull/27626/head:
	mgr/dashboard: Do not default to 'admin' as Admin Resource

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Gabriel Brascher <gabriel@apache.org>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
2019-04-24 20:40:17 -05:00
Sage Weil
5ef26e08ca Merge PR #26184 into master
* refs/pull/26184/head:
	mgr/dashboard: Replace IP address validation with Python standard library functions

Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Patrick Nawracay <pnawracay@suse.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
2019-04-24 20:38:19 -05:00
Sage Weil
d64d14a577 Merge PR #26730 into master
* refs/pull/26730/head:
	src/test: remove unused objects to calculate accurate dedup ratio.
	src/tools: fix counting total objects
	src/tools: fix printing wrong offset.
	src/tools: fix dedup tool's name
	qa/workunit: add rabin chunk test
	src/tool: add rabin fingerprint option to cephdeduptool
	src/common: add rabin fingerprint class
	Initail work for rabin fingerprint

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-24 20:38:02 -05:00
Sage Weil
66dac9d28a Merge PR #27566 into master
* refs/pull/27566/head:
	auth: kill AuthUnknownSessionHandler
	auth: kill AuthUnknown* (except AuthUnknownSessionHandler)
	msg: remove old ms_* auth methods from Dispatcher interface
	mon/MonClient: discard old challenge if authorizer is bad
	msg/async/ProtocolV1: use AuthServer and AuthClient
	mon/Monitor: handle v1 call into handle_auth_request
	msg/Connection: add is_msgr2()
	mon/MonClient: tolerate lack of authorizer for some dispatchers

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-04-24 17:00:57 -05:00
Casey Bodley
7e424e7208
Merge pull request #27579 from cbodley/wip-rgw-split-log-trim
rgw: split mdlog/datalog trimming into separate files

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2019-04-24 16:07:33 -04:00
Casey Bodley
7b27e627a7
Merge pull request #26173 from cbodley/wip-rgw-async-putobjprocessor
rgw: add YieldingAioThrottle for async PutObj/GetObj

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2019-04-24 15:47:59 -04:00
Sage Weil
a452d0707b auth: kill AuthUnknownSessionHandler
The only user is ProtocolV1, which passes in an in-use auth_method...
which must be either AUTH_NONE or AUTH_CEPHX since we successfully
authenticated at this point.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-24 13:46:04 -05:00
Sage Weil
31d71e8597 auth: kill AuthUnknown* (except AuthUnknownSessionHandler)
These are unreferenced by any other code.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-24 13:46:04 -05:00
Sage Weil
91c6016dd9 msg: remove old ms_* auth methods from Dispatcher interface
In the mon there is an opportunity to further clean up the code around
get_authorizer().

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-24 13:46:04 -05:00
Sage Weil
fc8d9c1135 mon/MonClient: discard old challenge if authorizer is bad
If we are a server/accepter, and we get a bad authorizer, discard our old
challenge, since the previous exchange has failed.  This way if the client
retries, their new authorize attempt won't conflict with our old challenge.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-24 13:46:04 -05:00
Sage Weil
c58c5754df msg/async/ProtocolV1: use AuthServer and AuthClient
Stop using the old ms_* auth methods and instead use the new interfaces
(like V2).

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-24 13:46:04 -05:00
David Zafman
3a234164d0
Merge pull request #27279 from dzafman/wip-divergent
Improvements to standalone tests

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-04-24 10:58:11 -07:00
Kefu Chai
67a34f2cf8
Merge pull request #27750 from tchaikov/wip-silence-gcc-warning
test/objectstore: silence -Wsign-compare warning

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-04-25 00:18:48 +08:00
Sage Weil
dd93973894 Merge PR #27721 into master
* refs/pull/27721/head:
	tools: pin the version of breathe that works with Python2

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-24 10:48:17 -05:00
Casey Bodley
33a7ec6861 test/rgw: rgw throttle tests use mock operations
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 10:39:09 -04:00
Casey Bodley
6c3b26c877 rgw: add optional_yield to Aio::librados_op()
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 10:39:09 -04:00
Casey Bodley
ff482e1798 rgw: add optional_yield to get_obj_data
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 10:39:09 -04:00
Casey Bodley
4259c3e334 rgw: add optional_yield to PutObjProcessors
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 10:39:09 -04:00
Nathan Cutler
0d0e87241a
Merge pull request #27221 from LenzGr/update-backportscripts
script: Obtain milestones via github API

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2019-04-24 15:49:00 +02:00
Casey Bodley
4b5f18e1b2 rgw: read ops use make_throttle() with optional_yield
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:45:37 -04:00
Casey Bodley
02df88d23d rgw: write ops use make_throttle() with optional_yield
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:45:37 -04:00
Casey Bodley
3979d32fa6 rgw: add make_throttle() for optionally-async AioThrottle
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:44:14 -04:00
Casey Bodley
3a2830325d rgw: add YieldingAioThrottle
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:44:14 -04:00
Casey Bodley
346b924cb2 rgw: add BlockingAioThrottle
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:44:14 -04:00
Casey Bodley
3d2d0892cc
Merge pull request #25692 from Liuchang0812/fix-26835
rgw: returns LimitExceeded when user creates too many ACLs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:42:28 -04:00
Casey Bodley
046043c235
Merge pull request #25044 from tianshan/fix_36763
rgw: set null version object acl issues

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:41:52 -04:00
Casey Bodley
3466bc1292
Merge pull request #21154 from mslovy/rgw-admin-api
rgw:  update op_mask of user via admin rest api

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:41:31 -04:00
Casey Bodley
09543f7131
Merge pull request #17338 from tianshan/fix_roles_pool
rgw: add roles_pool in RGWZoneParams dump/decode json

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:40:36 -04:00
Casey Bodley
de27881839
Merge pull request #17591 from shashalu/fix-bucket-list-versions
rgw: list_bucket versions return NextVersionIdMarker = "null" if next_marker.instance is empty

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-04-24 09:40:16 -04:00
Sage Weil
61d6d051de Merge PR #27472 into master
* refs/pull/27472/head:
	doc/rados/operations/devices: document device failure prediction

Reviewed-by: Rick Chen <rick.chen@prophetstor.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2019-04-24 08:37:49 -05:00
Kefu Chai
8f57abeb0a
Merge pull request #27573 from iotcg/corpus
import-generated.sh: use PATH to get ceph-dencoder

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-24 21:34:26 +08:00
Sage Weil
08f4768bec Merge PR #27696 into master
* refs/pull/27696/head:
	osd: make use of pg history and past_intervals in pg_create2 messages
	mon/OSDMonitor: track history and past_intervals for creating pgs
	osd/osd_types: make PastIntervals pi_compact_rep print participants
	osd/osd_types: take bare const OSDMap * to check_new_interval
	osd/osd_types: add pg_history_t ctor that takes creation epoch+stamp

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-04-24 08:15:19 -05:00
Sage Weil
a3a4af3454 Merge PR #27656 into master
* refs/pull/27656/head:
	doc/dev/erasure-coded-pool: update
	doc/rados/operations/erasure-code*: update default ec profile references
	common/options: change default erasure-code-profile to k=2 m=2

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-04-24 08:14:55 -05:00
Kefu Chai
f5d1991986 test/objectstore: silence -Wsign-compare warning
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-24 20:58:35 +08:00
Mykola Golub
22973d9d46
Merge pull request #27683 from dillaman/wip-24668
qa/workunits/rbd: use more recent qemu-iotests that support Bionic

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-04-24 15:40:43 +03:00
Lenz Grimmer
794f66f0fb script: Obtain milestones via github API
Replace the hard-coded list of milestones with an API request
that obtains this data from github directly.

Signed-off-by: Lenz Grimmer <lgrimmer@suse.com>
2019-04-24 14:12:59 +02:00
Changcheng Liu
0c3ca82557 import-generated.sh: correct access to ceph-dencoder
align with instructions in doc/dev/corpus.rst.
doc/dev/corpus.rst is under change by kchai@redhat.com
in PR 27552.

Signed-off-by: Changcheng Liu <changcheng.liu@intel.com>
2019-04-24 20:06:11 +08:00
Kefu Chai
692f4b1a05 doc/dev/corpus.rst: correct instructions
* should keep all OSD up and running, otherwise some tests will wait for
  healthy cluster for ever.
* should start 2 MGR for an active-standby setting -- better coverage
this way

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-24 19:49:58 +08:00
Kefu Chai
b4040f09dd
Merge pull request #27704 from tchaikov/wip-denc-dump
denc: allow DencDumper to dump OOB buffer

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-24 19:49:54 +08:00
Lenz Grimmer
926654a893
mgr/dashboard: iSCSI: Limit members to 1 group (#27520)
mgr/dashboard: iSCSI: Limit members to 1 group

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-04-24 13:41:03 +02:00
Lenz Grimmer
3deb4f61ad
Merge pull request #27722 from rhcs-dashboard/39434-prometheus-replace-whitespaces
mgr/prometheus: replace whitespaces in metrics' names

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-04-24 13:38:14 +02:00
Lenz Grimmer
54a7cea965
Merge pull request #27678 from tspmelo/wip-iscsi-discovery-read
mgr/dashboard: Fix iSCSI Discovery user permissions
2019-04-24 13:31:50 +02:00
Lenz Grimmer
98d5e47f87
Merge pull request #27609 from tspmelo/wip-iscsi-form-warn
mgr/dashboard: Fix iSCSI target form warning

Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-04-24 13:29:46 +02:00
Mykola Golub
536166b45b
Merge pull request #27720 from dillaman/wip-39407
rbd-mirror: clear out bufferlist prior to listing mirror images

Reviewed-by: Mykola Golub <mgolub@suse.com>
2019-04-24 13:00:52 +03:00
myoungwon oh
8a8d5e89bb src/test: remove unused objects to calculate accurate dedup ratio.
Signed-off-by: Myoungwon Oh <ommw@sk.com>
2019-04-24 18:22:37 +09:00
Kefu Chai
41ccb0926d denc: use scope_guard to close(fd)
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-24 16:26:07 +08:00
Kefu Chai
779419a745 crush,msg: silence -Wsign-compare warnings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-24 16:26:07 +08:00