Commit Graph

37748 Commits

Author SHA1 Message Date
Nilamdyuti Goswami
62b3fcdd24 doc: Updates man page for ceph-disk with suggested changes.
Signed-off-by: Nilamdyuti Goswami <ngoswami@redhat.com>
2014-12-18 16:48:50 +05:30
Nilamdyuti Goswami
2862a49483 doc: Adds updated man page for ceph-disk under man/
Signed-off-by: Nilamdyuti Goswami <ngoswami@redhat.com>
2014-12-18 16:31:35 +05:30
Nilamdyuti Goswami
3f6be22f64 doc: Updates man page for ceph-disk.
Changes format style to improve readability as html.

Signed-off-by: Nilamdyuti Goswami <ngoswami@redhat.com>
2014-12-18 16:31:35 +05:30
Wido den Hollander
883e1aea96 doc: Show how new data pools can be added to CephFS for file layouts 2014-12-18 10:59:31 +01:00
Yan, Zheng
bfa4acf26e Merge pull request #3198 from ceph/wip-10335
MDS: do not allow invocation of most commands on an inactive MDS
2014-12-18 10:32:31 +08:00
Greg Farnum
1b2b344313 MDS: do not allow invocation of most commands on an inactive MDS
They just cause all kinds of trouble!

Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2014-12-17 15:32:23 -08:00
Gregory Farnum
be7b2f8a30 Merge pull request #2836 from ceph/wip-7317
#7317 ENOSPC and OSD epoch barrier handling

Reviewed-by: Yan, Zheng <zyan@redhat.com>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2014-12-17 14:12:51 -08:00
Loic Dachary
65be519b03 Merge pull request #3197 from ktdreyer/rpm-spec-comment
ceph.spec.in: quote %files macro in comment

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2014-12-17 22:00:53 +01:00
Ken Dreyer
69fa5329ce ceph.spec.in: quote %files macro in comment
Prior to this commit, RPM would expand the %files macro that was present
in the comment.

Use a double percent sign to quote the macro so that RPM will not expand
it.

This fixes an rpmlint warning, "W: macro-in-comment %files"

More information from rpmlint's "-I" (help) command:

  $ rpmlint -I macro-in-comment
  macro-in-comment:
  There is a unescaped macro after a shell style comment in the
  specfile.  Macros are expanded everywhere, so check if it can cause a
  problem in this case and escape the macro with another leading % if
  appropriate.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2014-12-17 13:06:58 -07:00
Loic Dachary
38768da1b6 Merge pull request #3171 from tchaikov/refactor-rados-class
python-rados: refactor class Rados a little bit

Reviewed-by: Josh During <jdurgin@redhat.com>
Reviewed-by: Loic Dachary <ldachary@redhat.com>
2014-12-17 19:32:34 +01:00
Kefu Chai
378ebb79d0 python-rados: refactor class Rados a little bit
Signed-off-by: Kefu Chai <tchaikov@gmail.com>
2014-12-18 02:05:32 +08:00
Wido den Hollander
0c9d55d404 pybind/cephfs: Fix setxattr function. Pass value as character pointer
This passes the value of the xattr correctly and makes it work.
2014-12-17 14:01:44 +01:00
Loic Dachary
9b73c76209 Merge pull request #3190 from dachary/wip-test-helpers
tests: ignore xmlstarlet extra empty lines
2014-12-17 09:00:42 +01:00
Loic Dachary
023a8aca8c tests: ignore xmlstarlet extra empty lines
With xmlstarlet 1.3.0 (which is on Ubuntu precise)

xmlstarlet sel -t -m '//pg_stat/state[(contains(.,'\''active'\'') and
contains(.,'\''clean'\'') and not(contains(.,'\''stale'\'')))]' -v . -n

will output an extra empty line which does not show on xmlstarlet
1.5.0 (which is on Ubuntu trusty and Fedora 20).

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-12-17 08:02:17 +01:00
Sage Weil
242e28d13a Merge pull request #2530 from majianpeng/fiemap
Fiemap

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Samuel Just <sjust@redhat.com>
2014-12-16 16:50:45 -08:00
Sage Weil
ca1b216b47 Merge pull request #2137 from yuyuyu101/pg-sparse-recovery
ReplicatedPG: Make recovery using fiemap and fix perf counter

sage-2014-12-16_08:43:28-powercycle-wip-sage-testing-distro

Reviewed-by: Sage Weil <sage@redhat.com>
2014-12-16 15:15:02 -08:00
Sage Weil
9323ab29cd Merge pull request #3000 from yuyuyu101/wip-10166
Wip 10166: fiemap or FileStore::do_sparse_copy_range bug

sage-2014-12-16_08:43:28-powercycle-wip-sage-testing-distr

Reviewed-by: Sage Weil <sage@redhat.com>
2014-12-16 15:14:20 -08:00
Sage Weil
f8d37a2cc4 Merge remote-tracking branch 'gh/master' into wip-watch-notify
Conflicts:
	PendingReleaseNotes

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Josh During <jdurgin@redhat.com>
2014-12-16 14:02:32 -08:00
Samuel Just
868d7496f5 Merge pull request #3033 from dachary/wip-10201-osd-scrub-repair
osd scrub repair uses ceph_objecstore_tool + shell toolbox

Reviewed-by: Samuel Just <sjust@redhat.com>
2014-12-16 13:54:11 -08:00
Josh Durgin
9d61dec011 Merge pull request #3181 from ceph/wip-10299
librbd: complete all pending aio ops prior to closing image

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2014-12-16 13:44:21 -08:00
John Spray
9f53eeb88d doc: add cephfs ENOSPC and eviction information
Adding this at this time to give us a sensible place
to talk about the epoch barrier stuff.  The eviction
stuff will probably get simplified once we add a mon-side
eviction command that handles blacklisting and MDS session
eviction in one go.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:55:24 +00:00
John Spray
a8babcbaa9 client: add 'status' asok
Useful in test/debug for querying OSD epoch
and OSD barrier epoch.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:55:24 +00:00
John Spray
6fdf890355 client: propagate flush errors to fclose/fsync
Ensure that all calls to _flush get an explicit
context (rather than implicit PutInode used
before), which tags any error onto the Inode object.

Later, read the error from the Inode object in _release_fh
and ensure all callers of _release_fh properly handle
its return code.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:55:24 +00:00
John Spray
a8611ace59 client: handle ENOSPC in _flush
Previously we would avoid issuing writes
from _write, but the same condition was
not applied to _flush.  This was okay
when we were blocking on ENOSPC, but now
we're cancelling ops on ENOSPC so need
to make sure we don't issue any new ones.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:55:24 +00:00
John Spray
cdf679be3c mds: add 'osdmap barrier' admin command
This is for use with client eviction.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:51:49 +00:00
John Spray
fcc64f3849 mds: set epoch barrier on transition to active
To handle case where MDSs restart after experiencing
a barrier-inducing operation: rather than persisting
OSD barrier somewhere, just have the MDSs always barrier
on latest OSD epoch at startup.

Effect is that after restart, MDS cap issues will
be delayed in (compliant) clients until the client
sees the latest OSD map.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:51:49 +00:00
John Spray
40503ffbd7 mds: implement osd epoch barrier on caps
Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:51:49 +00:00
John Spray
2d993c4b2b messages: always encode barrier
Instead of truncating on INLINE_DATA, send
some blank fields there for clients that
don't support it (the kclient) in order
that we can include the following
epoch_barrier field.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:51:49 +00:00
John Spray
68ba7f5838 messages: add osd_epoch_barrier to cap msgs
Extension to client-server protocol to allow clients
to release capabilities conditional on the receiver
having a particular OSD map, and the MDS to issue
caps conditional on the user having a particular
OSD map.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:51:49 +00:00
John Spray
fc7d62a17c mds: return ENOSPC on write ops while osds full
Allow removals and read-only ops, prevent others.  This
is a soft policy aimed at reducing the likelihood of a
"full" (mon_osd_full_ratio) OSD becoming physically full
(where it is unable to accept journal writes from MDS
even though it does not respect the FULL flag)

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:51:49 +00:00
John Spray
09287fd666 osdc: add public Objecter::osdmap_full_flag
For the (now numerous) places where callers
would like to check this without doing a verbose
lock/unlock cycle.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:51:49 +00:00
John Spray
bab3d3d414 osdc: remove spurious _maybe_request_map return value
This was always zero: make the function return void, and
remove all the places we asserted on its return value.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:45:58 +00:00
John Spray
cf3101af8f osdc: implement Objecter::set_epoch_barrier
For use in MDS and Client when they want to wait
for a particular OSDMap epoch before using caps
that depend on a prior blacklist or op cancellation.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:45:58 +00:00
John Spray
c4861a61df osdc: continuously subscribe to osd map on pause
We were doing this on FULL, should also have done it
on PAUSERD and PAUSEWR, to avoid paused requests
staying that way forever.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:45:58 +00:00
John Spray
3ad6ed3d4e osdc/Objecter: add have_map method
This is for places we're going to call wait_for_map, so
that we can easily check if we will *probably* get
a true from wait_for_map, and thereby avoid
allocating Contexts we won't need.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:45:58 +00:00
John Spray
fe32d6ee88 osdc/Objecter: add op_cancel_writes
This is for use by Client when it encounters
the FULL flag and wants to abort operations
rather than having them pause.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:45:58 +00:00
John Spray
a99121242b osdc/ObjectCacher: invoke flush_set_callback on purge_set
For the benefit of Client, so that it can get its
caps released when using purge_set to deal with
an ENOSPC condition.  Does not affect librbd because
librbd doesn't provide flush_set_callback.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-12-16 20:45:58 +00:00
Sage Weil
eef1705354 Merge pull request #2300 from ceph/wip-osdmap
add osdmap checksums

    sage-2014-12-16_06:27:10-rados:singleton-wip-sage-testing2-distro-basic-multi
    sage-2014-12-15_13:18:23-rados:thrash-wip-sage-testing2-distro-basic-multi

Reviewed-by: Samuel Just <sjust@redhat.com>
2014-12-16 08:49:44 -08:00
Sage Weil
e27d3bda5c Merge pull request #3166 from ceph/wip-librados-fadvise
fadvise for librados, librbd + osd guts

    sage-2014-12-16_06:27:10-rados:singleton-wip-sage-testing2-distro-basic-multi
    sage-2014-12-15_13:18:23-rados:thrash-wip-sage-testing2-distro-basic-multi
2014-12-16 08:46:26 -08:00
Sage Weil
dacab7b7a7 Merge pull request #3080 from ceph/wip-fadvise
osd: reenable fadvise; use it more often

sage-2014-12-16_06:27:10-rados:singleton-wip-sage-testing2-distro-basic-multi
sage-2014-12-15_13:18:23-rados:thrash-wip-sage-testing2-distro-basic-multi

Reviewed-by: Sage Weil <sage@redhat.com>
2014-12-16 08:38:40 -08:00
John Wilkins
8241f114d1 Merge pull request #3165 from nilamdyuti/wip-doc-ceph
doc: Updates man page for Ceph

Reviewed-by: John Wilkins <jowilkin@redhat.com>
2014-12-16 08:13:53 -08:00
Loic Dachary
f614fae100 Merge pull request #3184 from dachary/wip-10325-cauchy
erasure-code: relax cauchy w restrictions

Reviewed-by:  David Zhang <david.z1003@yahoo.com>
2014-12-16 15:10:54 +01:00
Loic Dachary
bb80437f24 erasure-code: relax cauchy w restrictions
A restriction that the w parameter of the cauchy technique is limited to
8, 16 or 32 was added incorrectly while refactoring parameter parsing in
the jerasure plugin and must be relaxed.

http://tracker.ceph.com/issues/10325 Fixes: #10325

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2014-12-16 13:56:31 +01:00
Wido den Hollander
058f433930 man: Deprecate preferred OSD setting for cephfs
In the source code of cephfs there is no reference to it anymore,
but it's still in the man page. Leave it there for now, but make
it more clear that it is deprecated and unsupported.
2014-12-16 13:07:36 +01:00
Josh Durgin
cbc6c7cab0 Merge pull request #2970 from ceph/wip-swift-storage-policy
rgw: support swift storage policy api

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2014-12-15 23:36:40 -08:00
Josh Durgin
75a165db63 Merge pull request #3163 from ceph/wip-9254
rgw: http headers need to end with \r\n

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Sage Weil <sweil@redhat.com>
2014-12-15 23:35:27 -08:00
Jason Dillaman
37a99694b1 librbd: complete all pending aio ops prior to closing image
It was possible for an image to be closed while aio operations
were still outstanding.  Now all aio operations are tracked and
completed before the image is closed.

Fixes: #10299
Backport: giant, firefly, dumpling
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2014-12-15 23:25:04 -05:00
Alfredo Deza
9ff914405c librados: do not choke on asphyxiate doc generation
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2014-12-15 14:23:31 -05:00
Sage Weil
a282f7e119 Merge pull request #3142 from ceph/wip-10220
mon: suspend proposing paxos values when flushing pending writes

Reviewed-by: Sage Weil <sage@redhat.com>
2014-12-15 10:44:51 -08:00
Loic Dachary
1396e55d77 Merge pull request #3182 from ceph/wip-9405
librbd: fixed garbage output from test LibRBD.TestIOPP

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2014-12-15 19:18:01 +01:00