Radoslaw Zarzynski
d3299b0fcb
rgw: accommodate Keystone v3 in S3-related auth mechanisms.
...
This patch is based on changes proposed by Mark Barnes
<mark.barnes@ocado.com> (lperiquito) in commit
af71f6a518
.
Signed-off-by: Mark Barnes <mark.barnes@ocado.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-02-19 12:16:28 -08:00
Radoslaw Zarzynski
c5b114bba4
rgw: accommodate Keystone v3 in RGWSwift class.
...
This patch is based on changes proposed by Mark Barnes
<mark.barnes@ocado.com> (lperiquito) in commit
af71f6a518
.
Signed-off-by: Mark Barnes <mark.barnes@ocado.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-02-19 12:16:21 -08:00
Radoslaw Zarzynski
38ee66143e
rgw: basic data structures for Keystone v3.
...
The change has been extracted from changeset proposed
in commit af71f6a518
by
Mark Barnes <mark.barnes@ocado.com> (lperiquito).
Signed-off-by: Mark Barnes <mark.barnes@ocado.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-02-19 12:16:15 -08:00
Luis Periquito
46a488137b
rgw: unify RGWValidateKeystoneToken with RGWPostHTTPData.
...
The change has been extracted from changeset proposed
in commit af71f6a518
by
Mark Barnes <mark.barnes@ocado.com> (lperiquito).
Signed-off-by: Mark Barnes <mark.barnes@ocado.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-02-19 12:16:15 -08:00
Radoslaw Zarzynski
a868e598bc
rgw: make RGWPostHTTPData able to extract X-Subject-Token.
...
The change has been extracted from changeset proposed
in commit af71f6a518
by
Mark Barnes <mark.barnes@ocado.com> (lperiquito).
Signed-off-by: Mark Barnes <mark.barnes@ocado.com>
Signed-off-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2016-02-19 12:16:05 -08:00
Orit Wasserman
6582b7d509
Merge pull request #7717 from cbodley/wip-cmake-rbd-image-watcher
...
cmake: add missing librbd image_watcher sources
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-02-19 17:33:47 +01:00
Casey Bodley
b61f467651
cmake: add missing librbd image_watcher sources
...
Fixes : #14823
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-19 11:18:32 -05:00
Yehuda Sadeh
0f45d58903
Merge pull request #7709 from ceph/wip-rgw-new-multisite-merge
...
rgw multisite v2 (Yehuda Sadeh, Orit Wasserman, Casey Bodley)
- rename region to zonegroup
- new zone and zonegroup configuration
- new realm and period structures
- rgw handles synchronization (no need for sync agent)
- active-active data
Signed-off-by: Yehuda Sadeh
2016-02-19 07:22:03 -08:00
Kefu Chai
f6692a42df
Merge pull request #7371 from theanalyst/mon/quota-msg-cleanup
...
mon: cleanup set-quota error msg
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-02-19 17:56:20 +08:00
Josh Durgin
49a7ef5001
Merge pull request #7708 from jdurgin/wip-cython-cleanup
...
pybind: replace __del__ with __dealloc__ for rbd
Reviewed-by: Hector Martin <marcan@marcan.st>
Reviewed-by: Mehdi Abaakouk <sileht@sileht.net>
2016-02-19 00:34:50 -08:00
Abhishek Lekshmanan
a917ccfce5
mon: cleanup set-quota error msg
...
When we send in an unrecognized field for set-quota, specify that the
options should be `max_bytes` or `max_objects`. This doesn't affect the
ceph-cli as the choices are caught at an earlier stage, however the
error message is seen while reaching the cluster via rados api for eg.
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2016-02-19 09:29:04 +01:00
Josh Durgin
b556b24a31
Merge pull request #7668 from dillaman/wip-librbd-replay-locks
...
librbd: use async librados notifications
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-02-19 00:15:36 -08:00
Yehuda Sadeh
9695a0b4d1
rgw: avoid empty object names
...
Don't try to sync an object with empty name (shouldn't happen, but
bugs may happen). Also, don't try to write_meta() of an empty object
name, in case we get there through a different path somehow.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 23:50:06 -08:00
Josh Durgin
3d391546f5
.gitignore: include recently added rgw programs
...
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2016-02-18 23:49:09 -08:00
Yehuda Sadeh
3f525f4043
rgw: fix s3 list bucket (affects format=json)
...
another merge casualty. The section wasn't opened properly.
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 23:49:00 -08:00
Josh Durgin
0a988f95bc
pybind: replace __del__ with __dealloc__ for rbd
...
Cython extension types like these don't call __del__, but use
__dealloc__ instead:
http://docs.cython.org/src/userguide/special_methods.html#finalization-method-dealloc
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2016-02-18 23:47:24 -08:00
Josh Durgin
5489ad3a21
Merge pull request #7706 from sileht/sileht/rados-cython
...
pybind: remove next() on iterators
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-02-18 23:46:21 -08:00
Yehuda Sadeh
1e47268557
rgw: only validate bucket name if not empty
...
This got broken due to code movement
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 23:09:48 -08:00
Yehuda Sadeh
804e6c8f94
rgw: resurrect lost code
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 23:07:07 -08:00
Mehdi Abaakouk
f98b4855e4
pybind: remove next() on iterator
...
Cython recommends to implement only __next__() methods.
http://docs.cython.org/src/userguide/special_methods.html#the-next-method
Signed-off-by: Mehdi Abaakouk <sileht@redhat.com>
2016-02-19 07:59:08 +01:00
Loic Dachary
78b3c40cbc
Merge pull request #7641 from batrick/vstart-usage
...
Clarify usage on starting single osd/mds/mon.
Reviewed-by: Loic Dachary <ldachary@redhat.com>
2016-02-19 13:25:46 +07:00
Yehuda Sadeh
72b0333017
test/Makefile-client.am: adjustment following merge
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 20:49:35 -08:00
Josh Durgin
398c493fa9
Merge pull request #7692 from sileht/sileht/rados-cython
...
pybind/rados: use __dealloc__ since __del__ is ignored by cython
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-02-18 17:42:26 -08:00
Yehuda Sadeh
4d494d5b05
Merge remote-tracking branch 'origin/master' into wip-rgw-new-multisite
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
Conflicts:
src/CMakeLists.txt
src/rgw/Makefile.am
src/rgw/rgw_admin.cc
src/rgw/rgw_common.h
src/rgw/rgw_main.cc
src/rgw/rgw_op.cc
src/rgw/rgw_rados.h
src/rgw/rgw_rest_s3.cc
src/test/Makefile-client.am
2016-02-18 17:14:07 -08:00
Yehuda Sadeh
ac168e3f00
rgw: add drain_all() before exiting a cr
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 15:25:52 -08:00
Yehuda Sadeh
d95fcfa544
rgw: silence compilation #warnings
...
these are now FIXMEs
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 15:20:20 -08:00
Yehuda Sadeh
996e6e9a8a
rgw: more error reporting
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 15:18:08 -08:00
Yehuda Sadeh
ac726c6dd4
rgw: data sync error handling (for sync init)
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 15:18:03 -08:00
Yehuda Sadeh
d2d0f8471e
rgw: a bit better hashing
...
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2016-02-18 15:11:00 -08:00
Jason Dillaman
4f15332db3
librbd: don't hold owner lock while refreshing image synchronously
...
The write lock will be taken when the new state is applied.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-18 17:58:28 -05:00
Jason Dillaman
4ecdf066fd
librbd: need owner write lock when disabling exclusive lock
...
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-18 17:56:20 -05:00
Jason Dillaman
922072aeb5
librbd: correct memory leaks discovered via valgrind
...
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-18 17:46:35 -05:00
Jason Dillaman
7e09cb132b
librbd: notifications should be flushed between exclusive lock states
...
Avoid leaving in-flight notification messages when transitioning lock
states.
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-02-18 17:46:34 -05:00
Casey Bodley
eebe61a579
rgw: RGWMetaSyncCR loops through period history
...
RGWMetaSyncCR uses a period history Cursor to track its position. it
uses this to get the max sync markers for each shard from the following
period, so that RGWMetaSyncShardCR knows when to stop syncing and return
control to RGWMetaSyncCR
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:21 -08:00
Casey Bodley
6b6625e28c
rgw: get period history cursor when starting sync
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:21 -08:00
Casey Bodley
12cae9e702
rgw: remove RGWMetadataManager::store_md_log_entries
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:20 -08:00
Casey Bodley
be5c263fa4
rgw: rados coroutines take bucket by const ref
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:20 -08:00
Casey Bodley
f10a6d4f92
rgw: add first log period to mdlog info response
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:20 -08:00
Casey Bodley
988133019a
rgw: factor get_log_shard_id() out of RGWMetadataLog
...
by using RGWRados::key_to_shard_id(), we can avoid the dependency on
RGWMetadataLog's prefix (and period)
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:20 -08:00
Casey Bodley
adab1e1859
rgw: add period id to rgw_rest_log operations
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:20 -08:00
Casey Bodley
02edcdd905
rgw-admin: update callers of get_log
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:20 -08:00
Casey Bodley
34ea6bcc85
rgw: add map of period_id -> RGWMetadataLog
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:20 -08:00
Casey Bodley
5b12ec0b7d
rgw: add period id to metadata log oids
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:19 -08:00
Casey Bodley
699809e1fd
rgw: RGWRemoteMetaLog passes period id with requests to master
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:19 -08:00
Casey Bodley
25771efa94
rgw: move sync_status into RGWRemoteMetaLog
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:19 -08:00
Casey Bodley
3c990d22f2
rgw: include period id in rgw_meta_sync_info
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:19 -08:00
Casey Bodley
ea9f0fc374
rgw: use std::move for strings in RGWFetchAllMetaCR
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:19 -08:00
Casey Bodley
fe681503a9
cmake: remove duplicate rgw source files
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:19 -08:00
Casey Bodley
1ebb55b286
rgw: remove RemoteMetaLog::fetch() and admin command
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:19 -08:00
Casey Bodley
be06128bfe
rgw: remove unused RGWRemoteMetaLog::list_shards
...
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2016-02-18 14:04:18 -08:00