Commit Graph

29887 Commits

Author SHA1 Message Date
Noah Watkins
c99cf265fd make: increase maximum template recursion depth
With clang on OSX spirit blows up without this.

Signed-off-by: Noah Watkins <noahwatkins@gmail.com>
2013-12-07 10:22:54 -08:00
Gregory Farnum
e94ca0bd9c Merge pull request #891 from ceph/wip-filestore-remount
allow various threaded services to be restarted to allow mount->umount->mount to work

Reviewed-by: Greg Farnum <greg@inktank.com>
2013-12-03 12:56:25 -08:00
Sage Weil
8f377cc1f7 Merge pull request #879 from xinglin/coverity-fixes
Coverity fixes

The rgw patch is
Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>

The rest is
Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-03 12:47:25 -08:00
Sage Weil
858a21b90f common/WorkQueue: allow start() after stop()
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-03 12:27:14 -08:00
Sage Weil
36505e85b4 os/FileStore: allow mount after umount
Clear the stop flag on successful shutdown so that we can start again
later.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-03 12:27:14 -08:00
Sage Weil
cd6be292b1 common/Finisher: allow finisher to be restarted
Allow a start() after stop() by clearing the stop flag on a successful
stop.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-03 12:27:14 -08:00
Sage Weil
f60f5fe943 Merge pull request #843 from ceph/wip-osd-metadata
feed osd info about os, kernel, memory, arch to the mons

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
Reviewed-by: Loic Dachary <loic@dachary.org>
2013-12-03 10:48:57 -08:00
Josh Durgin
9770d5d84e Merge pull request #860 from dachary/wip-6827
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-12-03 10:39:17 -08:00
Xing Lin
dc06e23e23 test/mon/workloadgen: added check of return value for statfs()
check the return value of statfs() in update_osd_stat()

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>

test/mon/workloadgen: fixed typo in error message

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>
2013-12-03 11:19:13 -07:00
Xing Lin
0fd3cbf631 rgw/rgw_op: added check of return value for rgw_unlink_bucket()
checked the return value of rgw_unlink_bucket() in RGWCreateBucket::execute()

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>
2013-12-03 11:19:13 -07:00
Xing Lin
9c8df34919 os/WBThrottle: added check of return value for posix_fadvise()
check the return value of posix_fadvise() in WBThrottle::entry()

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>
2013-12-03 11:19:13 -07:00
Xing Lin
de09778561 test/filestore: add check of return values in StoreTest::SetUp
add return value check for function calls, including mkdir, mkfs
and mount

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>

test/filestore: fix return value check for mkdir

allow EEXIST from mkdir()

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>
2013-12-03 11:18:55 -07:00
Xing Lin
2884c81766 test/filestore/workloadgen: added check of return value for mkdir
check return value of mkdir

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>

test/filestore/workloadgen: fix return value check for mkdir

allow EEXIST from mkdir()

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>
2013-12-03 11:18:19 -07:00
Sage Weil
6ac9269d45 Merge pull request #889 from dachary/wip-osd-metadata
depends on #843 : CPU info + check osd metadata
2013-12-03 08:13:03 -08:00
Loic Dachary
602d5d53c0 osd: include CPU info
It will be handy when trying to figure out CPU bound problems / benchmarks.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-03 15:39:36 +01:00
Loic Dachary
f5025307d9 pybind: syntax check osd metadata
Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-03 15:12:23 +01:00
Loic Dachary
6570197871 ceph-disk: blacklist /dev/fd0
blkid -s TYPE /dev/fd0 has been verified to hang forever on a
H8DMR-82 supermicro motherboard running

3.8.0-33-generic #48~precise1-Ubuntu SMP Thu Oct 24 16:28:06 UTC 2013
x86_64

It is unlikely that ceph will ever be used on floppy disks, they
can be blacklisted.

http://tracker.ceph.com/issues/6827 fixes: #6827

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-03 09:31:05 +01:00
Xing Lin
bcb6bfd29d test/ceph_decoder: add return value check for read_file()
check the return value of read_file function call

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>
2013-12-02 23:36:20 -07:00
Sage Weil
3f1352ff38 doc/rados/operations/crush-map: describe crush locations, hook
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-02 21:48:54 -08:00
Sage Weil
396ee0d423 add script/run-coverity
Keep this in-tree.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-02 21:46:25 -08:00
Sage Weil
283de99c74 Merge pull request #887 from jdurgin/wip-peek-meta
osd: read into correct variable for magic string

Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-02 17:36:32 -08:00
John Wilkins
a5eda4fcc3 doc: Updated scrub defaults and added note about deep scrubbing.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-12-02 15:26:19 -08:00
Josh Durgin
f11b380e9a osd: read into correct variable for magic string
4d140a71a1 refactored this and
introduced a bug. peek_meta() was accidentally reading into magic,
then replacing magic with val, which was always the empty string,
resulting in the osd always failing to start due to 'mismatched'
magic values.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-12-02 15:16:46 -08:00
athanatos
cc71fae70b Merge pull request #881 from ceph/wip-objectstore
osd: clean up the osd / objectstore separation

Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-12-02 13:07:19 -08:00
John Wilkins
c77ce90f5b doc: Fixed hyperlink to the manual installation section.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-12-02 10:49:04 -08:00
John Wilkins
648f3bcd39 doc: Added a link to get packages.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-12-02 10:48:27 -08:00
Sage Weil
16b75768b8 osd/OSDMap: fix typo and crush types helper
Bah!

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-02 10:21:28 -08:00
Sage Weil
1242642dab Merge pull request #882 from ceph/wip-6699
sysvinit, upstart: use df -P when weighting new OSDs

Reviewed-by: Noah Watkins <noah.watkins@inktank.com>
2013-12-02 10:19:30 -08:00
Sage Weil
a4254f7f0a Merge pull request #876 from javacruft/wip-missed-module
Mark libcls_kvs as a module

Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-02 10:10:45 -08:00
Sage Weil
5274b3ef02 Merge pull request #841 from ceph/wip-crush-chassis
osd/OSDMap: add 'chassis' to default type hierarchy

Reviewed-by: Loic Dachary <loic@dachary.org>
2013-12-02 09:59:39 -08:00
Sage Weil
78df4a148e Merge pull request #883 from idryomov/wip-readme
README: update a list of build deps for rpm-based systems

Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-02 09:24:41 -08:00
Sage Weil
6298a576d3 osd/OSDMap: add region, pdu, pod types while we are at it
One use noted that they have a 'pdu' type in their type hierarchy that
typically spans multiple racks.  Others are known to use the 'pod'
terminology; add that to.  And I can imagine 'region' above datacenter.

Factor this into a helper to make things a bit less fragile.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-02 08:31:23 -08:00
Sage Weil
3a6707a183 osd/OSDMap: add 'chassis' to default type hierarchy
A chassis is usually bigger than a host but smaller than a rack.  This will
be useful for a broad class of modern hardware that sticks multiple hosts
in the same chassis (in sleds, or on cards, or blades, or whatever).

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-02 08:25:34 -08:00
Ilya Dryomov
5e1fc14757 README: update a list of build deps for rpm-based systems
A list of build dependencies for rpm-based OSes is missing a few items.
This fills in the gaps.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2013-12-02 11:52:31 +02:00
Sage Weil
f5ddb12a82 Merge remote-tracking branch 'gh/next' 2013-12-01 22:47:11 -08:00
Sage Weil
e80ab94bf4 Partial revert "mon: osd pool set syntax relaxed, modify unit tests"
This reverts commit 08327fed82, except
for the hashpspool bit.  We switched back to an integer argument in
commit 337195f046.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-01 22:21:31 -08:00
Sage Weil
f50371f081 Merge remote-tracking branch 'gh/next' 2013-11-30 13:44:27 -08:00
Sage Weil
fd175ab921 sysvinit, upstart: use df -P when weighting new OSDs
This avoids parsing out the wrong value when a long device name makes
df wrap over two lines.

Fixes: #6699
Reported-by: Jan Harkes <jaharkes@cs.cmu.edu>
Reviewed-by: Noah Watkins <noah.watkins@inktank.com>
Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-30 13:41:15 -08:00
Sage Weil
4d140a71a1 os/ObjectStore: add {read,write}_meta
Move these from the OSD.  Use a generic implementation in ObjectStore that
hopefully all backends can share (so that it can remain in sync with the
start/stop scripts, ceph-disk, and other orchestration machinery).

Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:28:36 -08:00
Sage Weil
6bb42a0c44 osd: move peek_journal_fsid() into ObjectStore (from OSD)
This kills the last FileJournal reference in the OSD!

Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:28:36 -08:00
Sage Weil
bf5a7b2427 os/ObjectStore: generalize the FileStore's target_version
This kills the last FileStore reference in the OSD.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:28:36 -08:00
Sage Weil
e0f208926b osd: construct ObjectStore outside of OSD
This lets ceph_osd.cc handle the config details and use it directly for
all of the random command-line stuff, eliminating a bunch of mostly-
useless static wrappers in OSD.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:28:36 -08:00
Sage Weil
41056e5297 osd: use ObjectStore::create() helper to create ObjectStore impl
No more knowledge of FileStore!

Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:28:36 -08:00
Sage Weil
237d6b8375 os/ObjectStore: add static create() method
Generic way to create an ObjectStore implementation of the required type,
so that users don't need to know anything about it.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:28:35 -08:00
Sage Weil
6d92a8ef82 osd: drop obsolete 'filestore' bool option
Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:28:35 -08:00
Sage Weil
2974eb5ac4 osd: include misc osd config info in metadata sent to the mon
addr info, pathnames.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:26:59 -08:00
Sage Weil
ea9dabf7f8 mon/OSDMonitor: include osd metadata in 'ceph report'
Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:26:59 -08:00
Sage Weil
c4f817f9cd mon/OSDMonitor: move osd metadata dump into a helper
Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:26:57 -08:00
Sage Weil
51cd75080d Merge pull request #838 from xinglin/boost-program-option-check
autoconf: add check for the boost_program_options library

Reviewed-by: Noah Watkins <noah.watkins@inktank.com>
2013-11-29 22:25:28 -08:00
Sage Weil
444ddaef7b Merge pull request #829 from ceph/port/detect-clang
conf: use better clang detection
2013-11-29 22:24:34 -08:00