Commit Graph

31144 Commits

Author SHA1 Message Date
Yehuda Sadeh
c1c40df12b rgw: implement quota handlers for user stats
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:50 -08:00
Yehuda Sadeh
c13634e888 rgw: extend infrastructure to handle user stats read
Some helper functions that return data in required format for quota, add
async functions.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:49 -08:00
Yehuda Sadeh
364f7c54fc rgw: move some code around, no actual changes
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:49 -08:00
Yehuda Sadeh
92a87b3dfd rgw: refactor quota cache
bucket quota cache is going to be reused, add a new abstract layer.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:49 -08:00
Yehuda Sadeh
4aee3fa228 rgw: rename RGWBucketStats to RGWStorageStats
make it more generic, will be reused for user's stats.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:49 -08:00
Yehuda Sadeh
5612ded3b1 rgw: pass bucket owner all around
User quota operations require that we know who the actual user we do the
operation on is. Pass that info when creating new object and when
removing objects.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:48 -08:00
Yehuda Sadeh
cbe1da85c8 radosgw-admin: bucket stats --sync-stats [--bucket=...]
Sync user stats, either for a single buckets, or for all user's buckets.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:48 -08:00
Yehuda Sadeh
c8793fbad0 cls/user: some fixes + handle old buckets case
If a bucket was created prior to the new accounting, we can't substract
the old values, as the header stats didn't account for them.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:48 -08:00
Yehuda Sadeh
eef7ba48df rgw, radosgw-admin, cls/user: retrieve user stats
add a new op to retrieve user header, new radosgw-admin command to stat
user.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:48 -08:00
Yehuda Sadeh
edcf9fed02 cls/user: a new op to retrieve user header
user header holds user total stats

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:47 -08:00
Yehuda Sadeh
438aea7f7f cls/user: accounting functionality
Keep user total accounting in omap header, handle add/dec functionality.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:47 -08:00
Yehuda Sadeh
c7b4d00815 rgw: move bucket add / remove to new user objclass
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:47 -08:00
Yehuda Sadeh
23aa65f62a rgw: replace user bucket listing with objclass call
instead of directly accessing the omap operation

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:47 -08:00
Yehuda Sadeh
248c4aefff rgw: new user objclass
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-24 10:28:41 -08:00
Sage Weil
5756f7c492 Merge pull request #1102 from ceph/wip-rgw-civetweb-2
Wip rgw civetweb 2

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-24 08:31:37 -08:00
Josh Durgin
28af392bc3 Merge pull request #1116 from jcsp/doc_toofull
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-01-23 22:43:43 -08:00
Josh Durgin
e23513fbe2 Merge pull request #1135 from ceph/use-ceph-sharedptr
libc++: convert tr1 uses

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-01-23 22:36:18 -08:00
Noah Watkins
faae5b94b4 libc++: convert tr1 uses
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2014-01-23 20:35:53 -08:00
John Wilkins
ea026c6cc9 doc: Added domain pool, and changed zone configs to use domain tool so they don't clash.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-23 17:11:59 -08:00
John Wilkins
0303f0f17a doc: Change zone domain to include "domain" so it is clear.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-23 17:11:23 -08:00
John Wilkins
95e63ac6dd doc: Added space between {Query_String} and [E=HTTP ... to solve for 500 error.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-23 16:03:25 -08:00
athanatos
9a7643bbdc Merge pull request #1134 from ceph/wip-backend-uninit-use
ReplicatedBackend: fix uninitialized use warning/bug

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-01-23 15:44:39 -08:00
Greg Farnum
6f6b1eeaca ReplicatedBackend: fix uninitialized use warning/bug
Signed-off-by: Greg Farnum <greg@inktank.com>
2014-01-23 15:40:18 -08:00
Greg Farnum
df4df46df0 Monitor: use a single static accessor for getting CompatSet features off disk
This way we don't need to maintain two working code paths.

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-01-23 15:32:03 -08:00
John Wilkins
2216afdfc3 doc: Fixed omission of a comma in zone configuration.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-01-23 13:34:25 -08:00
Samuel Just
55ab35ba9c FileStore: perform LFNIndex lookup without holding fdcache lock
Fixes: #7207

Signed-off-by: Samuel Just <sam.just@inktank.com>
Signed-off-by: Greg Farnum <greg@inktank.com>
2014-01-23 12:48:26 -08:00
Greg Farnum
689f983e6f Merge remote-tracking branch 'origin/next' 2014-01-23 12:47:00 -08:00
Yehuda Sadeh
1560cc0130 mongoose: git rm src/mongoose
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-23 11:00:05 -08:00
Loic Dachary
102c83a338 Merge pull request #1132 from ceph/wip-erasure-rule
osd/OSDMap: do not create erasure rule by default

Reviewed-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Loic Dachary <loic@dachary.org>
2014-01-23 10:22:49 -08:00
Yehuda Sadeh
bd089b127c civetweb: md5.inl -> md5.h
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-23 09:41:00 -08:00
Yehuda Sadeh
1a2bed1ef1 civetweb: add include to makefile
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-23 09:41:00 -08:00
Yehuda Sadeh
287ea5ca6e rgw: modify the civetweb rule
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-23 09:41:00 -08:00
Yehuda Sadeh
d26e76655b civetweb: fix module uri
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-23 09:41:00 -08:00
Yehuda Sadeh
3f20a41f87 civetweb: update submodule
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-23 09:41:00 -08:00
Yehuda Sadeh
f2f74754c9 rgw: switch mongoose to civetweb
Fixes: #7054
mongoose is now GPL, using the civetweb fork instead.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-01-23 09:40:59 -08:00
Sage Weil
d8bafaebd0 Merge pull request #1131 from ceph/use-unordered-map
osd: use ceph:: scoped hash_map

Reviewed-by: Sage Weil <sage@inktank.com>
2014-01-23 09:27:03 -08:00
Sage Weil
08fa34d94e osd/OSDMap: do not create erasure rule by default
If we do, we will require the v2 feature bit from clients.

We could only include feature bits for rules that are actually referenced
by pools, but for now making the user create the rule is simpler.  There is
no need to create this rule ahead of time.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-01-23 09:16:54 -08:00
Noah Watkins
6f8541c8da osd: use ceph:: scoped hash_map
Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2014-01-23 07:20:42 -08:00
Josh Durgin
645dd31ca4 Merge pull request #1064 from ceph/port/libc++
support libc++
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-01-23 00:27:30 -08:00
Samuel Just
2b0f8cbf23 Merge branch 'wip-client-io-final'
Reviewed-by: Greg Farnum <greg@inktank.com>
Reviewed-by: David Zafman <david.zafman@inktank.com>
2014-01-22 14:52:39 -08:00
Samuel Just
ecbdeb19ff PGBackend: clarify rollback_stash name and method comments
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:18 -08:00
Samuel Just
4fc4573fd2 PG: drop messages from down peers
This overlaps with the existing old_peering_msg() mechanism
except in one case: pulls from a replica not in the acting
set.  If such a replica gets marked down, we may resend
pulls to another replica without causing a new interval
to start.  If we recieved, but didn't process, a push in
response to such a pull prior to processing the map marking
the peer down, we might process the push after having reset
the pull state for a different pull operation.  We can
avoid this by discarding ops from down peers.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:18 -08:00
Samuel Just
e73a9f7b7a ReplicatedPG: make STARTSYNC a noop
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:18 -08:00
Samuel Just
96d4a0c26e PG::calc_acting: consider newest_update_osd when choosing backfill peers
We must include newest_update_osd->second.log_tail when considering backfill
peers because in GetLog we will request logs back to the min last_update over
our acting_backfill set.  This will result in our log being extended as far
backwards as necessary to pick up any peers which can be log recovered by the
union of newest_update_osd's log and that of the chosen primary.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:18 -08:00
Samuel Just
7e3ccfef65 ReplicatedPG: take ReplicatedPGRef in BlessedContext
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:18 -08:00
Samuel Just
167f852387 RadosModel: RollBack dirties the object
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:18 -08:00
Samuel Just
6e74123c78 RadosModel: undirty with update_object_undirty
Otherwise it doesn't behave properly with snapshots since
update_object_version doesn't add another snapshot entry.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:17 -08:00
Samuel Just
ca37d08ea9 ReplicatedPG::trim_object: remove unused int r; declaration
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:17 -08:00
Samuel Just
d0eda792de common/hobject: print shard as unsigned, not as char
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:17 -08:00
Samuel Just
9273177afd ReplicatedPG::_process_copy_chunk: use append
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-01-22 14:39:17 -08:00