1
0
mirror of https://github.com/ceph/ceph synced 2024-12-25 12:54:16 +00:00
Commit Graph

72456 Commits

Author SHA1 Message Date
Casey Bodley
de836ee684 qa/rgw: add test config to rgw_multisite_tests task
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-18 13:38:44 -04:00
Casey Bodley
e90bba65c4 test/rgw: add timing config options to test_multi.py
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-18 13:38:44 -04:00
Casey Bodley
f9fae9bf6e test/rgw: add timing configuration
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-18 13:38:42 -04:00
Casey Bodley
efb3b181fd qa/rgw: add log_level argument to rgwadmin()
changes default level from info to debug

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-18 13:37:35 -04:00
Casey Bodley
9830593249 test/rgw: dont assume zone1 and zone2 are on different clusters
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-18 13:37:35 -04:00
Casey Bodley
ea245ca6b3 test/rgw: add 5min timeouts to sync checkpoints
if multisite tests are going to run in teuthology, they can't loop forever

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-18 13:37:35 -04:00
Casey Bodley
16ab3a08a3 qa/rgw: add multisite suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-18 13:37:35 -04:00
Bassam Tabbara
23b073237e cmake: fix boost components for WITH_SYSTEM_BOOST
when using WITH_SYSTEM_BOOST dont set header-only packages
for BOOST_COMPONENTS. On some distros these packages dont
exist.

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
2017-05-18 10:18:10 -07:00
Mingxin Liu
6dc842d21d pybind/rados: avoid call free() on invalid pointer
Signed-off-by: Mingxin Liu <mingxin@xsky.com>
2017-05-19 00:23:56 +08:00
Kefu Chai
450d6cb5d0 Merge pull request from batrick/i19934
qa: silence upgrade test failure

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-19 00:06:35 +08:00
Sage Weil
b24fa931b2 mon/MgrMonitor: add 'mgr dump [epoch]' command
Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-18 12:05:13 -04:00
Jason Dillaman
9b72f74e2b Merge pull request from trociny/wip-19875
librbd: optimize copy-up to add hints only once to object op

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-05-18 11:51:23 -04:00
Jason Dillaman
726515e66e Merge pull request from runsisi/wip-fix-trashlist
librbd: do not raise an error if trash list returns -ENOENT

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-05-18 11:50:44 -04:00
Jason Dillaman
f6e513e208 Merge pull request from runsisi/wip-fix-trashpy
pybind/rbd: fix crash if more than 1024 images in trash bin

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2017-05-18 11:50:27 -04:00
Adam C. Emerson
a8fc220a21 Merge branch pull request from pritha-srivastava/wip-rgw-role-tenant
rgw: Replaced rgw userid with tenant in ARN for Roles.
rgw: Adding roles under the scope of tenants.
rgw: Added code for Role input validation.
rgw: Added code to fetch a role by its id.
rgw: Added code to allow tenant name as part of role name also.
rgw: Better reporting of missing input values in case of radosgw-admin
     commands for Roles.

Reviewed-By: Adam C. Emerson <aemerson@redhat.com>
2017-05-18 10:20:31 -04:00
Jos Collin
53a9ccf96f Merge pull request from guihecheng/rgw_file-extra-rele
rgw_file: removed extra rele() on fs in rgw_umount()
2017-05-18 19:18:00 +05:30
Kefu Chai
e40a381093 Merge pull request from bassam/pr-ccache-s-files
cmake: workaound ccache issue with .S assembly files

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-18 18:38:12 +08:00
Gui Hecheng
7720bca22e rgw_file: fix extra rele on fs in close
We got exactly a refcnt=0 after rele in close,
no need to rele twice.

Signed-off-by: Gui Hecheng <guihecheng@cmss.chinamobile.com>
2017-05-18 18:27:06 +08:00
Kefu Chai
b4648bf6e3 Merge pull request from theanalyst/rgw/cleanup/header-drop
rgw: drop using std ns in header files and other cleanups

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-18 18:18:41 +08:00
Loic Dachary
b7e65938ab Merge pull request from zealoussnow/wip-0518
mailmap: Leo Zhang infomation and affiliation

Reviewed-by: Loic Dachary <ldachary@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2017-05-18 12:06:50 +02:00
Leo Zhang
9f90087a45 build: move bash_completion.d/ceph from debian/ceph-base.install to debian/ceph-common.install
when only ceph-common is installed, can also use ceph completion

Signed-off-by: Leo Zhang <nguzcf@gmail.com>
2017-05-18 17:22:11 +08:00
Kefu Chai
6f7b339d27 Merge pull request from minshenglin/fix_broken_link
doc: fix broken link in erasure-code.rst

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-05-18 15:40:26 +08:00
Bassam Tabbara
58c4c9250f cmake: remove "-Wp" compile option to speedup ccache
"-Wp" in not needed and when building with ccache the "cache hits"
only happen afer preproccessing which is slower than a direct hit.
this change removes the "-Wp" option

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
2017-05-17 23:22:49 -07:00
Leo Zhang
5356f2a8b9 build: move bash_completion.d/ceph to ceph-common
When only ceph-common is installed, can also use ceph completion

Signed-off-by: Leo Zhang <nguzcf@gmail.com>
2017-05-18 14:18:10 +08:00
Leo Zhang
518f516d2e mailmap: Leo Zhang infomation and affiliation
Signed-off-by: Leo Zhang <nguzcf@gmail.com>
2017-05-18 12:19:14 +08:00
MinSheng Lin
e86cef3134 doc: fix broken link in erasure-code.rst
Fixes: http://tracker.ceph.com/issues/19972
Signed-off-by: MinSheng Lin <minsheng.l@inwinstack.com>
2017-05-18 09:48:07 +08:00
Bassam Tabbara
e1c3985148 cmake: workaound ccache issue with .S assembly files
when building with -DWITH_CCACHE=ON recent versions of ccache
(for example 3.3.3) seem to mangle object files from the cache
for source files that have a .S extension. This seems similar
but unrelated to PR . The workaround here is to rename .S
files to .s (lower case).

Signed-off-by: Bassam Tabbara <bassam.tabbara@quantum.com>
2017-05-17 17:51:06 -07:00
Adam C. Emerson
dcd1bfb3c6 Merge branch 'wip-sts-authorization'
Merge pull request  from adamemerson/wip-sts-authorization

common: Add make_unique
submodule: Tencent's RapidJSON library
common: Add ISO-8601 Date Support
rgw: Add is_identity to AuthApplier class
rgw: Move globbing flags to header
buffer: Make the use of static areas more convenient
rgw: Add basic support for IAM policies
rgw: Build bucket permission and environment in req_state
rgw: Verify policies as WELL as ACLs
rgw: RESTful bucket policy ops
rgw: Write documentation for bucket policies

Reviewed-By: Casey Bodley <cbodley@redhat.com>
Reviewed-By: Radoslaw Zarzynski <rzarzynski@mirantis.com>
Reviewed-By: Kefu Chai <kchai@redhat.com>
2017-05-17 16:06:23 -04:00
Casey Bodley
4722d1d920 qa/rgw: add rgw_multisite_tests task to run tests
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-17 14:48:55 -04:00
Casey Bodley
b6d86be2c5 qa/rgw: add rgw_multisite task based on rgw_multi
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-17 14:48:55 -04:00
Casey Bodley
a86ce77155 qa/rgw: add symlink to qa/tasks/rgw_multi
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-17 14:48:55 -04:00
Casey Bodley
746c630999 qa/rgw: move startup polling logic to util/rgw.py
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-17 14:48:55 -04:00
Casey Bodley
76e147614f qa/rgw: fixes for cluster name on cleanup
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-17 14:48:55 -04:00
Casey Bodley
4c59d343c3 qa/rgw: move compression type out of ceph.conf
this makes the 'compression type' setting global to all gateways, and
makes the setting visible to other tasks in ctx.rgw.compression_type

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-17 14:48:55 -04:00
Casey Bodley
d67018cb31 test/rgw: add import for StringIO
also removes unnecessary tuple parens

Signed-off-by: Casey Bodley <cbodley@redhat.com>
2017-05-17 14:48:55 -04:00
Adam C. Emerson
80b285d329 rgw: Write documentation for bucket policies
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-17 14:22:18 -04:00
Adam C. Emerson
b7d0b740c0 rgw: RESTful bucket policy ops
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-17 14:22:18 -04:00
Adam C. Emerson
266103fa22 rgw: Verify policies as WELL as ACLs
Only hook into object/bucket checks for now. Once we have STS (giving
us Roles) or User/Group policies it will make sense to hook into
those, too.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-17 14:22:18 -04:00
Adam C. Emerson
908d9e46d2 rgw: Build bucket permission and environment in req_state
Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-17 14:22:18 -04:00
Adam C. Emerson
69a5eebd8a rgw: Add basic support for IAM policies
This support is currently incomplete but should provide a starting
point.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-17 14:22:18 -04:00
Adam C. Emerson
8416f1c569 buffer: Make the use of static areas more convenient
Make three wrapper functions to tidy up the process of making a
bufferlist holding a single static buffer.

The lack of any decent handling of const in buffer::list makes me wax
wroth, but it's a bit much to fix right now.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-17 14:22:18 -04:00
Adam C. Emerson
9e8172b840 rgw: Move globbing flags to header
So they can be used when calling the function

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-17 14:22:18 -04:00
Adam C. Emerson
56167d19f8 rgw: Add is_identity to AuthApplier class
Eventually this will allow us to match all authentication information
against all specified principals in a policy.

Right now it handles users and wildcards.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-17 14:22:18 -04:00
Adam C. Emerson
7cd1ccf422 common: Add ISO-8601 Date Support
For parsing and unparsing from ceph::real_time.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-17 14:22:15 -04:00
Adam C. Emerson
c3f2447c80 submodule: Tencent's RapidJSON library
This is a high performance, MIT licensed JSON parsing library. It
provides a SAX interface so that I can compile an S3 policy without
building up a JSONObject tree in the middle that gets thrown away.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-17 12:26:39 -04:00
Adam C. Emerson
64acb16354 common: Add make_unique
There are parts of C++14 that are both useful and easy to
implement. This is one of them.

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
2017-05-17 12:26:39 -04:00
Sage Weil
3bb9dd475b ceph_test_rados_api_list: more fix LibRadosListNP.ListObjectsError
Follow-on to d7e6e8d60309e4800389b36f786b633d0ca2ec07; we need to
make sure the client gets the updated osdmap.

Fixes: http://tracker.ceph.com/issues/19963
Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-17 11:55:42 -04:00
Sage Weil
752b8389da Merge pull request from liewegas/wip-19119
PendingReleaseNotes: warning about 'osd rm ...' and 
2017-05-17 10:43:18 -05:00
Sage Weil
3c6755e036 PendingReleaseNotes: warning about 'osd rm ...' and
See http://tracker.ceph.com/issues/19119

Signed-off-by: Sage Weil <sage@redhat.com>
2017-05-17 11:42:55 -04:00
Sage Weil
c94645567b Merge pull request from liewegas/wip-bluefs-position
os/bluestore: put bluefs in the middle of the shared device

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-05-17 10:29:52 -05:00