Commit Graph

28506 Commits

Author SHA1 Message Date
Sage Weil
2af59d5e81 ceph-disk: partprobe after creating journal partition
At least one user reports that a partprobe is needed after creating the
journal partition.  It is not clear why sgdisk is not doing it, but this
fixes ceph-disk for them, and should be harmless for other users.

Fixes: #5599
Tested-by: lurbs in #ceph
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-20 22:39:09 -07:00
Sage Weil
cf8dbd248b Merge remote-tracking branch 'gh/wip-6004' into next
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
Reviewed-by: Yan, Zheng <zheng.z.yan@intel.com>
2013-08-20 16:57:46 -07:00
Sage Weil
edf2c3449e .gitignore: ignore test-driver
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-20 16:54:20 -07:00
Sage Weil
9833e9dabe fuse: fix warning when compiled against old fuse versions
client/fuse_ll.cc: In function 'void invalidate_cb(void*, vinodeno_t, int64_t, int64_t)':
warning: client/fuse_ll.cc:540: unused variable 'fino'

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-20 16:54:10 -07:00
Sage Weil
6abae35a39 json_spirit: remove unused typedef
In file included from json_spirit/json_spirit_writer.cpp:7:0:
json_spirit/json_spirit_writer_template.h: In function 'String_type json_spirit::non_printable_to_string(unsigned int)':
json_spirit/json_spirit_writer_template.h:37:50: warning: typedef 'Char_type' locally defined but not used [-Wunused-local-typedefs]
         typedef typename String_type::value_type Char_type;

(Also, ha ha, this file uses \r\n.)

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-20 16:54:05 -07:00
Sage Weil
c9cdd19d1c gtest: add build-aux/test-driver to .gitignore
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-20 16:54:02 -07:00
Sage Weil
e8e50f60bd crc32c: remove old intel implementation
The license is not LGPL compatible.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-20 16:42:53 -07:00
Sage Weil
a286090602 common/crc32c: refactor a bit
- the generic function without the _le suffix (useless)
- use a static global so that detection only happens once
- make the structure a bit cleaner to plug in new implementations

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-20 16:42:53 -07:00
Dan Mick
0ccb9be3b6 Merge pull request #517 from dmick/wip-6049
mon/PGMap: OSD byte counts 4x too large (conversion to bytes overzealous)

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-08-20 12:18:43 -07:00
Sage Weil
981eda9f77 mon/Paxos: always refresh after any store_state
If we store any new state, we need to refresh the services, even if we
are still in the midst of Paxos recovery.  This is because the
subscription path will share any committed state even when paxos is
still recovering.  This prevents a race like:

 - we have maps 10..20
 - we drop out of quorum
 - we are elected leader, paxos recovery starts
 - we get one LAST with committed states that trim maps 10..15
 - we get a subscribe for map 10..20
   - we crash because 10 is no longer on disk because the PaxosService
     is out of sync with the on-disk state.

Fixes: #6045
Backport: dumpling
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-08-20 11:27:23 -07:00
Sage Weil
7e0848d8f8 mon/Paxos: return whether store_state stored anything
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-08-20 11:27:09 -07:00
Sage Weil
b9dee2285d mon/Paxos: cleanup: use do_refresh from handle_commit
This avoid duplicated code by using the helper created exactly for this
purpose.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-08-20 11:26:57 -07:00
Sage Weil
6ef1970340 pybind: fix Rados.conf_parse_env test
This happens after we connect, which means we get ENOSYS always.
Instead, parse_env inside the normal setup method, which had the added
benefit of being able to debug these tests.

Backport: dumpling
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-20 11:23:46 -07:00
Dan Mick
eca53bbf58 mon/PGMap: OSD byte counts 4x too large (conversion to bytes overzealous)
Fixes: #6049
Signed-off-by: Dan Mick <dan.mick@inktank.com>
2013-08-20 11:14:43 -07:00
athanatos
9cea33ab39 Merge pull request #516 from dachary/master
erasure code : plugin, interface and glossary documentation updates

Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-08-20 10:34:32 -07:00
Loic Dachary
3a83129283 erasure code : plugin, interface and glossary documentation updates
* replace the erasure code plugin abstract interface with a doxygen link
  that will be populated when the header shows in master
* update the plugin documentation to reflect the current draft implementation
* fix broken link to PGBackend-h
* add a glossary to define chunk, stripe, shard and strip with a drawing

http://tracker.ceph.com/issues/4929 refs #4929

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-08-20 17:34:52 +02:00
Christophe Courtaut
8e53301840 Do not use some compilation flag invalid for clang
-Wstrict-null-sentinel and -rdynamic are invalid flags
for clang compiler.

Signed-off-by: Christophe Courtaut <christophe.courtaut@gmail.com>
2013-08-20 11:42:19 +02:00
Sage Weil
928a0d4270 Merge remote-tracking branch 'gh/next' 2013-08-19 22:53:28 -07:00
Samuel Just
1f851cb248 PG: remove old log when we upgrade log version
Otherwise the log_oid will be non-empty and the next
boot will cause us to try to upgrade again.

Fixes: #6057
Signed-off-by: Samuel Just <sam.just@inktank.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-08-19 22:51:05 -07:00
Sage Weil
d948f07ae9 Merge branch 'wip-fallocate'
Reviewed-by: Sage Weil <sage@inktank.com>
2013-08-19 22:50:11 -07:00
Sage Weil
6eee73c9b7 ceph-fuse: fallocate appears in fuse 2.9.1, not 2.9
There is no macro to differentiate 2.9 from 2.9.1, so we have to wait
to use this until 3.0.  :(

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-19 22:49:49 -07:00
Sage Weil
1019274743 client: do not mark_caps_dirty for generic fallocate
A normal fallocate in which the size is not changed is still a no-op.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-19 22:49:48 -07:00
Sage Weil
c339456514 client: guard fallocate with #ifdefs
Only include linux header if it's linux.  Only implement the fallocate
method if FALLOC_FL_PUNCH_HOLE is defined.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-19 22:49:48 -07:00
Li Wang
35b00c8b2c Ceph-fuse: Fallocate and punch hole support
This patch implements fallocate and punch hole support for Ceph fuse client.

Signed-off-by: Yunchuan Wen <yunchuanwen@ubuntukylin.com>
Signed-off-by: Li Wang <liwang@ubuntukylin.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-08-19 22:49:37 -07:00
Sage Weil
c2548a5c42 mon: add 'pg dump delta' to get just the rate info
Still include it in the basic 'pg dump summary' info.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-19 21:37:00 -07:00
Samuel Just
00080d785f PGLog: add a config to disable PGLog::check()
This is a debug check which may be causing excessive
cpu usage.

Reviewed-by: Sage Weil <sage@inktank.com>
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-08-19 18:04:55 -07:00
John Wilkins
2398c1b57d doc: Title change.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-08-19 17:27:10 -07:00
Sage Weil
220f7d6161 osd/ReplicatedPG: remove broken AccessMode logic
The original intent here was to handle reads in two modes.  For
workloads with read/modify/write ops, the RMW mode would:

 - queue writes for local store and replicas immediately
 - block reads until the write commits to all replicas

For mixed read/write workloads without read/modify/write ops, the
DELAYED mode would:

 - queue writes for replicas
 - allow local reads
 - once replicas commit, queue write locally
 - block local reads until local write completes

In reality, we never use the DELAYED mode.  It's untested and possibly
broken, and it is unlikely we will see a workload where it is important
in the near to mid term.

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-08-19 15:21:58 -07:00
Gregory Farnum
c64878b520 Merge pull request #508 from ceph/wip-5905
examples: add a librados/hello_world program

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
Reviewed-by: Loic Dachary <loic@dachary.org>
Reviewed-by: Dan Mick <dan.mick@inktank.com>
2013-08-19 15:14:40 -07:00
Greg Farnum
823435ce65 examples: add a librados/hello_world program
This is a simple program with lots of explanatory comments people
can use as a model for using librados.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-08-19 14:55:09 -07:00
Sage Weil
67a95b9880 ceph: parse CEPH_ARGS environment variable
Fixes: #6052
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Dan Mick <dan.mick@inktank.com>
2013-08-19 12:48:58 -07:00
Sage Weil
eef7cacdb1 rados pybind: add conf_parse_env()
Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Dan Mick <dan.mick@inktank.com>
2013-08-19 12:48:58 -07:00
Sage Weil
68c1c70e1f Merge remote-tracking branch 'gh/next' 2013-08-19 12:41:54 -07:00
Sage Weil
9dda1cc044 doc/release-notes: v0.61.8
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-19 12:41:44 -07:00
Sage Weil
233fed8c97 Merge pull request #513 from dalgaaf/fix/wip-da-documentation
Fix documentation issues
2013-08-19 12:32:30 -07:00
Danny Al-Gaaf
090e4c4a31 filestore-config-ref.rst: mark some filestore keys as deprecated
Marked the following keys as deprecated since v0.65:
- filestore flusher
- filestore flusher max fds
- filestore sync flush

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-08-19 20:56:48 +02:00
Sage Weil
a396e02713 Merge pull request #512 from ceph/wip-5988
Reviewed-by: Sage Weil <sage@inktank.com>
2013-08-19 11:16:57 -07:00
Samuel Just
0c5f842e49 Merge branch 'wip-erasure-coded-doc' 2013-08-19 11:02:45 -07:00
Greg Farnum
4e86be9232 librados: synchronous commands should return on commit instead of ack
This is unlikely to be noticed by anybody, but it is a big change. Document
in the PendingReleaseNotes and bump up the librados minor version number
to 68.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-08-19 10:29:49 -07:00
athanatos
efd1bce4cf Merge pull request #493 from dachary/wip-erasure-coding-doc
rearrange erasure code documents

Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-08-19 10:28:48 -07:00
Greg Farnum
f5636be742 mon: make MonMap error message about unspecified monitors less specific.
The error message helpfully references the -m and -c CLI options for
specifying monitors, but this code can be invoked from non-core librados
client applications so that's unfortunately not kosher. Remove the
reference.

Fixes #5979.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-08-19 10:21:16 -07:00
Danny Al-Gaaf
a846294533 auth-config-ref.rst: fix signature keys
Fix names of cephx signature keys.

Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
2013-08-19 10:33:37 +02:00
Sage Weil
4677041da3 objclass: move cls_log into class_api.cc
Not sure why but this seems to resolve a linking problem when loading
classes:

2013-08-17 13:28:19.015776 7fb2bcffa700  0 _load_class could not open class /usr/lib/rados-classes/libcls_hello.so (dlopen failed): /usr/lib/rados-classes/libcls_hello.so: undefined symbol: cls_log
2013-08-17 13:28:19.015786 7fb2bcffa700 -1 osd.4 12 class hello open got (5) Input/output error

In any case, it's simpler.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-17 14:30:37 -07:00
Sage Weil
70790ab6b4 doc/dev/filestore-filesystem-compatibliity: remove outdated xattr notes
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-17 12:34:11 -07:00
Sage Weil
d7f1d166ea Merge pull request #494 from kri5/wip-s3-compliance-doc
doc: complete S3 features status from existing doc page
2013-08-17 11:00:59 -07:00
Sage Weil
87affa2d1c Merge pull request #491 from kri5/wip-clang-compilation
Fix compilation -Wmismatched-tags warnings

Reviewed-by: Loic Dachary <loic@dachary.org>
2013-08-17 10:59:01 -07:00
John Wilkins
2f221fe03c doc: Updated upgrade doc to include dumpling and incorporate ceph-deploy.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-08-17 10:35:32 -07:00
Sage Weil
ae7436ffb5 Merge pull request #479 from devoid/fix-5797
Document unstable nature of CephFS
2013-08-17 10:09:01 -07:00
Sage Weil
060a463754 Makefile: move objclass/*.cc to libosd.la
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-17 09:40:44 -07:00
Sage Weil
8ac1af887b doc/changelog: add missing file
Signed-off-by: Sage Weil <sage@inktank.com>
2013-08-17 08:38:55 -07:00