Commit Graph

30042 Commits

Author SHA1 Message Date
Samuel Just
964c8e978f PG: retry GetLog() each time we get a notify in Incomplete
If for some reason there are no up OSDs in the history which
happen to have usable copies of the pg, it's possible that
there is a usable copy elsewhere on the cluster which will
become known to the primary if it waits.

Fixes: #6909
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-11-27 15:17:33 -08:00
Yehuda Sadeh
14cf4caff5 rgw: don't error out on empty owner when setting acls
Fixes: #6892
Backport: dumpling, emperor
s3cmd specifies empty owner field when trying to set acls on object
/ bucket. We errored out as it didn't match the current owner name, but
with this change we ignore it.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-11-27 13:36:38 -08:00
James Page
7ec21ed8cf Mark libcls_kvs as a module
This was missed by the changes in commit 909a733fe7

Signed-off-by: James Page <james.page@ubuntu.com>
2013-11-27 09:06:28 +00:00
Sage Weil
ff60c364d3 Merge pull request #859 from ceph/wip-pr781
fix the bug  ctypes.util.find_library to search for librados failed on...
2013-11-26 15:09:18 -08:00
Sage Weil
909a733fe7 Merge pull request #864 from javacruft/wip-debian-feedback
Misc fixes from current Debian packaging

Reviewed-by: Sage Weil <sage@inktank.com>
2013-11-26 15:00:51 -08:00
Sage Weil
17b495ab58 Merge pull request #873 from ceph/wip-mds-assert
mds: Add assertion to catch object mutation error

Reviewed-by: Sage Weil <sage@inktank.com>
2013-11-26 14:59:46 -08:00
Josh Durgin
e5357c0c44 test: remove zero-copy read_fd test temporarily
This fails since zero-copy from read_fd was temporarily disabled by
03d63c4b2d.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-26 11:40:13 -08:00
Loic Dachary
bafb5c3604 doc: clarify crush rule create-simple and fix typos
update the description of osd crush rule create-simple using terms that
match the keywords from the crushmap to avoid confusion.

fix missing closing parenthesis in osd crush commands

Signed-off-by: Loic Dachary <loic@dachary.org>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-26 09:44:49 -08:00
Loic Dachary
371dc71e12 doc: fix formatting typo in mon configuration
Signed-off-by: Loic Dachary <loic@dachary.org>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-26 09:44:47 -08:00
Loic Dachary
00ee9a5289 doc: improve ceph-mon usage, fix ceph tell examples
The ceph-mon command usage is updated to document all of the ceph-mon
specific options.

The ceph tell usage examples for log and debug are using a deprecated syntax.

Signed-off-by: Loic Dachary <loic@dachary.org>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-26 09:44:45 -08:00
Josh Durgin
890bd5b3a8 Merge pull request #862 from ceph/wip-6829
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-26 09:06:15 -08:00
Josh Durgin
8db8ed73da Merge pull request #871 from dmick/wip-6894
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-26 09:02:26 -08:00
Sage Weil
5254cbd3f6 Merge pull request #872 from ceph/wip-5871
mds: remove superfluous warning of releasing lease

Reviewed-by: Sage Weil <sage@inktank.com>
2013-11-26 08:59:51 -08:00
Sage Weil
57f9c252cd Merge pull request #874 from liewegas/wip-readme
README: add yum command line
2013-11-26 07:59:09 -08:00
Sage Weil
4fa8f68ff6 README: add yum command line
This makes it easy to cut and paste. Yay!

Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-26 07:19:24 -08:00
Yan, Zheng
b0dce8a0dc mds: Add assertion to catch object mutation error
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2013-11-26 15:10:17 +08:00
Yan, Zheng
09a4c1bbe9 mds: remove superfluous warning of releasing lease
When receiving the lease release message, it's possible that the lease
has already expired and the corresponding dentry has been trimmed from
the cache.

Fixes #5871

Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2013-11-26 14:56:30 +08:00
Dan Mick
c409e362c8 mon: osd dump should dump pool snaps as array, not object
Fixes: #6894
Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-11-25 22:37:59 -08:00
Josh Durgin
1804e136da Merge pull request #835 from ceph/wip-6705
qa: workunits: mon: ping.py: test 'ceph ping'

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-25 18:03:02 -08:00
Josh Durgin
29ef3d4607 Merge branch 'wip-zero-copy-bufferlist-last'
Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-11-25 17:12:03 -08:00
Josh Durgin
03d63c4b2d buffer: turn off zero-copy reads for now
Some users will need to be changed to handle getting the correct
length from bufferlist::read_fd.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-25 14:38:20 -08:00
Li Wang
784d1888a6 mds: Release resource before return
Close file before return.
Fix coverity issue: CID 1019571

Signed-off-by: Li Wang <liwang@ubuntukylin.com>
Reported-by: Xianxia Xiao <xianxiaxiao@ubuntukylin.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-25 13:57:40 -08:00
Li Wang
524f666e84 rbd: Release resource before return
Close file before return.
Fix coverity issue: CID 1019579

Signed-off-by: Li Wang <liwang@ubuntukylin.com>
Reported-by: Xianxia Xiao <xianxiaxiao@ubuntukylin.com>
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-25 13:57:40 -08:00
David Zafman
d6c8830b28 Merge pull request #868 from ceph/wip-6896
osd: Remove bogus assert(active == acting.size())

Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-11-25 13:22:25 -08:00
David Zafman
66f51f82d4 osd: Remove bogus assert(active == acting.size())
We saw this assert because active is not correctly computed.
Remove assert and incorrectly computed active count.
We already use acting.size() to determine whether to set PG_STATE_DEGRADED.

Fixes: #6896

Signed-off-by: David Zafman <david.zafman@inktank.com>
2013-11-25 13:20:49 -08:00
Sage Weil
5ccc2ecd30 SubmittingPatches: describe github pull-request process
Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-25 09:24:19 -08:00
Bastian Blank
ab05580a68 Add missing stuff to clean target
Sweepup a few bits a pieces that get left behind by make clean.

Signed-off-by: James Page <james.page@ubuntu.com>
2013-11-25 16:20:10 +00:00
Bastian Blank
ae46c38c2d Correctly mark library modules
Mark RADOS class libraries as module so that they will be automatically
ignored when stripping binaries.

Signed-off-by: James Page <james.page@ubuntu.com>
2013-11-25 16:19:25 +00:00
Sage Weil
94ca1cc663 ceph-object-corpus: revert accidental revert
From 5df3024d78

Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-25 08:10:13 -08:00
Sage Weil
fd1ec0fa90 Merge pull request #863 from ceph/wip-6804
rgw: lower some debug message

Reviewed-by: Sage Weil <sage@inktank.com>
2013-11-25 07:53:03 -08:00
Gregory Farnum
b089adb85a Merge pull request #861 from dachary/init-ceph
init: fix typo s/{$update_crush/${update_crush/
2013-11-24 22:07:35 -08:00
David Zafman
0b14c155a0 Merge pull request #832 from ceph/wip-flush-5855-review
Reviewed-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: David Zafman <david.zafman@inktank.com>
2013-11-22 17:09:54 -08:00
Josh Durgin
75d4a72086 buffer: enable tracking of calls to c_str()
Track buffer::ptr::c_str() to catch internal calls that use it, like
buffer::ptr::cmp(). buffer::list::c_str() will be captured by this as
well, since it will do a final buffer::ptr::c_str() and possibly
several more if it needs to rebuild into a single raw buffer.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-22 16:14:03 -08:00
Josh Durgin
445fb18390 buffer: try to do zero copy in read_fd
Leave the explicit read_fd_zero_copy around as well for testing.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-22 16:14:03 -08:00
Josh Durgin
be29b3471c buffer: attempt to size raw_pipe buffers
Make sure the requested length is below the maximum pipe size for now,
since we're only using one pipe and splicing once into and out of
it. The default max is 1MB on recent kernels, so this isn't such a
terrible limitation.

To get around this we could use multiple pipes, or keep both source and
destination fds open at the same time and call splice many times. This
is more usual usage for splice, but would require a lot more work to
restructure the filestore and messenger to handle it.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-22 16:14:03 -08:00
Josh Durgin
3f6fa05d72 buffer: add methods to read and write using zero copy
Create explicit methods for testing. Make buffer::list::write_fd() use
zero-copy if all the buffers support it.  Don't automatically handle
reads yet, since we need better detection of read length first.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-22 16:14:03 -08:00
Josh Durgin
5021b43e0a buffer: create raw pipe-based buffer
This uses a pipe to reference kernel memory so we can use splice(2) to
avoid extra data copies. Take an fd in the factory to create it, since
that's the only way to use it efficiently, which is its whole purpose.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-22 16:14:03 -08:00
Josh Durgin
eb94b8fd52 buffer: add an exception with an error code
This allows e.g. raw buffer constructors to provide more specific
information about what failed, as well as a useful error string
automatically.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-22 16:14:03 -08:00
Josh Durgin
30bc0e2791 safe_io: add functions for handling splice
Like the other functions, these don't handle non-blocking I/O.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-22 16:14:03 -08:00
Josh Durgin
b8518fea03 buffer: remove unused raw::length() method
This was accidentally introduced in
0c23a5624a

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-22 16:13:36 -08:00
Josh Durgin
ebb261f978 buffer: abstract raw data related methods
Create a virtual function that returns the raw data instead of
accessing it directly, so raw buffers backed by pipes can be used as
buffer::ptrs. Make raw::is_page_aligned() virtual so it will not need
to look at the raw data for a pipe-based buffer.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-11-22 16:13:36 -08:00
John Wilkins
740d406e37 doc: Clarified description on scrub load threshold.
fixes: #6735

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-11-22 15:49:16 -08:00
John Wilkins
8a3ed9be2f doc: Fixed instruction.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-11-22 15:48:25 -08:00
John Wilkins
e8ccb91fd3 Merge branch 'master' of https://github.com/ceph/ceph 2013-11-22 15:16:18 -08:00
John Wilkins
fc5789da01 doc: Added commentary to configure pg defaults. Clarified size commentary.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-11-22 15:15:41 -08:00
John Wilkins
dceaef439d doc: PG splitting added to docs.
fixes: #6727

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-11-22 15:14:46 -08:00
John Wilkins
d39676b164 doc: Took out "future" reference to namespaces.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-11-22 15:13:49 -08:00
John Wilkins
9a55d89250 doc: Clarification of terms.
fixes: #6749

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-11-22 12:59:40 -08:00
Yehuda Sadeh
b35fc1bc2e rgw: lower some debug message
Fixes: #6084
Backport: dumpling, emperor

Reported-by: Ron Allred <rallred@itrefined.com>
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-11-22 07:08:29 -08:00
Yehuda Sadeh
561e7b0b28 rgw: initialize RGWUserAdminOpState::system_specified
Fixes: #6829
Backport: dumpling, emperor
We didn't init this member variable, which might cause that when
modifying user info that has this flag set the 'system' flag might
inadvertently reset.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-11-22 07:06:35 -08:00