Commit Graph

29398 Commits

Author SHA1 Message Date
Yehuda Sadeh
c1acf9a555 rgw_quoa.{h,cc}: add copyright notice
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-10-11 16:43:00 -07:00
Yehuda Sadeh
fb96740651 Merge branch 'wip-6444' into next
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-10-11 15:44:00 -07:00
John Wilkins
8d8ae58c42 doc: Created new index to incorporate side-by-side deb/rpm installs.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-11 15:08:22 -07:00
John Wilkins
bc50dbbbe5 doc: Created installation doc for Yum priorities. Ceph-specific packages need it.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-11 15:07:40 -07:00
John Wilkins
05b2e445da doc: Created new QEMU install for RPMs with provision for Ceph-specific packages.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-11 15:07:08 -07:00
John Wilkins
f37c75b05d doc: Created new QEMU install for debian.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-11 15:06:30 -07:00
John Wilkins
869b721052 doc: Added new libvirt install for RPM.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-11 15:06:02 -07:00
John Wilkins
d4668742ec doc: Created new libvirt install for debian/ubuntu.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-11 15:05:36 -07:00
John Wilkins
99fe31e538 doc: Removed Gatway from Ceph Object Storage. Added Yum repo information.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-11 15:05:08 -07:00
John Wilkins
cdd851b984 doc: Moved installation portion to the installation section.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-11 15:03:34 -07:00
John Wilkins
1dff92ba88 doc: Moved installation portion to the installation section.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-11 15:02:38 -07:00
Yehuda Sadeh
a1825356ad librados: add some clarifying comments
about async pool operation handle

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-10-11 14:53:45 -07:00
Yehuda Sadeh
7ef5eb06ec librados: drop reference to completion in container destructor
Move the PoolAsyncCompletionImpl reference drop from
C_PoolAsync_Safe::finish() to ~C_PoolAsyncSafe(), as finish() is only
called when the async request is actually sent.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-10-11 14:53:25 -07:00
John Wilkins
f13cc684c6 doc: Fixed hyperlinks. Cleanup of old references to Chef.
fixes: #6493

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-11 14:04:36 -07:00
Joao Eduardo Luis
70250e8456 osd: osd_types: Output pool's flag names during dump
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-10-11 17:50:16 +01:00
Sage Weil
7113186c32 osdc/Objecter: clean up completion handlers that set *prval=0
If the OSD operations returns 0, these are unnecessary.  If it does not,
then these are misleading.  In both cases here, the OSD sets the result to
zero, so this has no client-visible change.r

Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-11 09:23:10 -07:00
Sage Weil
82e93303fb osdc/Objecter: only make handlers set *prval if EIO
The normal Objecter handlers set *prval for each operation; we only need to
(re)set it if we have a special reason (like a decoding error).

Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-11 09:23:10 -07:00
Joao Eduardo Luis
1c2886964a mon: OSDMonitor: allow (un)setting 'hashpspool' flag via 'osd pool set'
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-10-11 08:05:02 -07:00
Joao Eduardo Luis
2fe0d0d97a mon: OSDMonitor: split 'osd pool set' out of 'prepare_command'
We should start doing this across the whole 'prepare_command' function.
Makes it prettier to the reader, and easier to add new code.

Change the command to send a string instead of an int to allow us to have
non-integer pool paramters that can be modified.  Support input json with
both int and string values so that we work with all flavors of client.

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-10-11 08:04:57 -07:00
Sage Weil
6bbb772e71 test/filestore/run_seed_to_range.sh: fix -d syntax
Signed-off-by: Sage Weil <sage@inktank.com>
2013-10-11 08:04:06 -07:00
Sage Weil
b214584b84 Merge pull request #702 from ceph/wip-4405
mds: fix infinite loop of MDCache::populate_mydir().

Reviewed-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-10-11 07:33:35 -07:00
Yan, Zheng
4e2ff539bf mds: avoid leaking objects when purging file.
The filer implementation does not delete stripe objects that are truncated
to zero. When purging a deleted file, we need to purge stripe objects up to
the max size the file has ever been.

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2013-10-11 17:24:33 +08:00
Yan, Zheng
eb381ffc8d mds: don't decrease file size when recovering file
Otherwise we may truncate sparse file to wrong size

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2013-10-11 17:13:11 +08:00
Yehuda Sadeh
1803f3b0e1 radosgw-admin: limit user bucket-level quota
We only allow it if --quota-scope=bucket is specified. This is done in
order to avoid confusion with the future user level quota command.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-10-10 21:04:39 -07:00
Yan, Zheng
18a271d8d5 mds: optimize map element dereference
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2013-10-11 10:29:30 +08:00
Samuel Just
d8faa82fe4 ReplicatedPG: remove unused RWTracker::ObjState::clear
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-10-10 16:23:02 -07:00
Yehuda Sadeh
89d3f47f62 radosgw-admin: can set user's bucket quota
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-10-10 14:45:46 -07:00
John Wilkins
cb9ebd6f36 doc: Minor correction.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-10 14:31:37 -07:00
Yehuda Sadeh
14eabd4aa7 rgw: bucket quota threshold
Add bucket quota threshold so that when we're passed that value we
reread the bucket stats before every write and not rely on cached value.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-10-10 13:51:24 -07:00
Yehuda Sadeh
34d05262e5 rgw: configurable bucket quota size
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-10-10 13:51:23 -07:00
Yehuda Sadeh
fc35807768 rgw: protect against concurrent async quota updates
Leverage the cache lru_map locking for making sure that we don't end
up with more than a single concurrent async update on the same bucket
within the same update window.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-10-10 13:51:23 -07:00
Yehuda Sadeh
2e4ecc29de rgw: async quota update
Asynchronously update bucket stats when a period passed, but bucket
stats are within the ttl window.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-10-10 13:51:17 -07:00
John Wilkins
5bc6327666 doc: Merge cleanup.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-10 12:21:34 -07:00
John Wilkins
c0c332c120 doc: minor clean up.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-10 12:20:37 -07:00
John Wilkins
fa909ad6ed doc: Update from wip-doc-quickstart branch.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-10-10 11:47:56 -07:00
Yan, Zheng
007f06ec17 mds: fix infinite loop of MDCache::populate_mydir().
make MDCache::populate_mydir() only fetch bare-bone stray dirs.
After all stray dirs are populated, call MDCache::scan_stray_dir(),
it fetches incomplete stray dirs.

Fixes: #4405
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2013-10-10 10:53:24 +08:00
Samuel Just
1f50750d0f ReplicatedPG: remove the other backfill related flushes
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-10-09 13:35:42 -07:00
Samuel Just
db6623fa3e RadosModel: send racing read on write
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-10-09 13:35:42 -07:00
Samuel Just
2b216c3ae2 ReplicatedPG: block reads on an object until the write is committed
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-10-09 13:35:42 -07:00
Yehuda Sadeh
e8a2992d6c rgw: rearrange includes
Need to have ceph_json.h first due to some boost weirdness.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-10-08 14:34:53 -07:00
Sandon Van Ness
6ff9570726 Go back to $PWD in fsstress.sh if compiling from source.
Although fsstress was being called with a static path the directory
it was writing to was in the current directory so doing a cd to the
source directory that is made in /tmp and then removing it later
caused it to be unable to write the files in a non-existent dir.

This change gets the current path first and cd's back into it after
it is done compiling fsstress.

Issue #6479.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
Reviewed-by: Alfredo Deza <alfredo.deza@inktank.com>
2013-10-08 12:05:11 -07:00
Sandon Van Ness
8e493ef23b Go back to $PWD in fsstress.sh if compiling from source.
Although fsstress was being called with a static path the directory
it was writing to was in the current directory so doing a cd to the
source directory that is made in /tmp and then removing it later
caused it to be unable to write the files in a non-existent dir.

This change gets the current path first and cd's back into it after
it is done compiling fsstress.

Issue #6479.

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
Reviewed-by: Alfredo Deza <alfredo.deza@inktank.com>
2013-10-08 12:05:02 -07:00
Sage Weil
1575895bdc Merge pull request #700 from dachary/master
doc: fix openstack rbd installation command
2013-10-08 07:52:42 -07:00
Loic Dachary
768fb0a2a2 doc: fix openstack rbd installation command
This cannot work because client.volumes.key is not a command

   ssh {your-compute-host} client.volumes.key

replace with a tee to allow for copy/paste as well as using the

   cat client.volumes.key

in the following lines.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-10-08 12:07:00 +02:00
David Zafman
86b5b42718 Merge pull request #699 from dachary/wip-ghobject-assert
os: stronger assert on FileStore::lfn_open

Reviewed-by: David Zafman <david.zafman@inktank.com>
2013-10-07 17:05:01 -07:00
Loic Dachary
e21e5736b3 os: stronger assert on FileStore::lfn_open
Signed-off-by: Loic Dachary <loic@dachary.org>
2013-10-08 01:15:41 +02:00
Greg Farnum
b9cc91dcef Merge branch 'next' 2013-10-07 14:40:42 -07:00
Gregory Farnum
9f75a42336 Merge pull request #697 from dachary/master
This lets "make check" pass, so I like it.
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-10-07 14:15:19 -07:00
Loic Dachary
0f323bc4d6 common: unintended use of the wrong bloom_filter prototype
For encoding/decoding test purposes. The generate_test_instances should
be improved to cover more encoding/decoding cases.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-10-07 23:11:20 +02:00
Greg Farnum
4b911cf817 ReplicatedPG: copy: use aggregate return code instead of individual Op return
It appears that the OSD is not filling in the individual return codes, and they
should be equivalent for all purposes we care about here (the only Op we are
doing is the copy-get, and if it fails we are getting its failure code).

Reported-by: Sage Weil <sage@inktank.com>
Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-10-07 13:50:30 -07:00