Commit Graph

30002 Commits

Author SHA1 Message Date
Sage Weil
4551fee9ad crush/mapper: add note about r in recursive choose
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-03 14:41:24 -08:00
Sage Weil
7967ae0e0f crush/CrushWrapper: add dump_tree()
This is based on the OSDMap::print_tree(), but is a bit simpler because
we do not have up/down information at this level.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-03 14:41:24 -08:00
Sage Weil
86e978036a crush: use breadth-first search for indep mode
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-03 14:41:24 -08:00
Sage Weil
b1d4dd4eb0 crush: return CRUSH_ITEM_UNDEF for failed placements with indep
For firstn mode, if we fail to make a valid placement choice, we just
continue and return a short result to the caller.  For indep mode, however,
we need to make the position stable, and return an undefined value on
failed placements to avoid shifting later results to the left.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-03 14:41:24 -08:00
Sage Weil
1cfe140bf2 crush: eliminate CRUSH_MAX_SET result size limitation
This is only present to size the temporary scratch arrays that we put on
the stack.  Let the caller allocate them as they wish and remove the
limitation.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-03 14:41:24 -08:00
Gregory Farnum
e94ca0bd9c Merge pull request #891 from ceph/wip-filestore-remount
allow various threaded services to be restarted to allow mount->umount->mount to work

Reviewed-by: Greg Farnum <greg@inktank.com>
2013-12-03 12:56:25 -08:00
Sage Weil
8f377cc1f7 Merge pull request #879 from xinglin/coverity-fixes
Coverity fixes

The rgw patch is
Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>

The rest is
Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-03 12:47:25 -08:00
Sage Weil
858a21b90f common/WorkQueue: allow start() after stop()
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-03 12:27:14 -08:00
Sage Weil
36505e85b4 os/FileStore: allow mount after umount
Clear the stop flag on successful shutdown so that we can start again
later.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-03 12:27:14 -08:00
Sage Weil
cd6be292b1 common/Finisher: allow finisher to be restarted
Allow a start() after stop() by clearing the stop flag on a successful
stop.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-03 12:27:14 -08:00
John Wilkins
941875defe doc: Partially incorporated comments from Aaron Ten Clay.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-12-03 11:07:53 -08:00
Sage Weil
f60f5fe943 Merge pull request #843 from ceph/wip-osd-metadata
feed osd info about os, kernel, memory, arch to the mons

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
Reviewed-by: Loic Dachary <loic@dachary.org>
2013-12-03 10:48:57 -08:00
Josh Durgin
9770d5d84e Merge pull request #860 from dachary/wip-6827
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2013-12-03 10:39:17 -08:00
Xing Lin
dc06e23e23 test/mon/workloadgen: added check of return value for statfs()
check the return value of statfs() in update_osd_stat()

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>

test/mon/workloadgen: fixed typo in error message

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>
2013-12-03 11:19:13 -07:00
Xing Lin
0fd3cbf631 rgw/rgw_op: added check of return value for rgw_unlink_bucket()
checked the return value of rgw_unlink_bucket() in RGWCreateBucket::execute()

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>
2013-12-03 11:19:13 -07:00
Xing Lin
9c8df34919 os/WBThrottle: added check of return value for posix_fadvise()
check the return value of posix_fadvise() in WBThrottle::entry()

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>
2013-12-03 11:19:13 -07:00
Xing Lin
de09778561 test/filestore: add check of return values in StoreTest::SetUp
add return value check for function calls, including mkdir, mkfs
and mount

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>

test/filestore: fix return value check for mkdir

allow EEXIST from mkdir()

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>
2013-12-03 11:18:55 -07:00
Xing Lin
2884c81766 test/filestore/workloadgen: added check of return value for mkdir
check return value of mkdir

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>

test/filestore/workloadgen: fix return value check for mkdir

allow EEXIST from mkdir()

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>
2013-12-03 11:18:19 -07:00
Sage Weil
6ac9269d45 Merge pull request #889 from dachary/wip-osd-metadata
depends on #843 : CPU info + check osd metadata
2013-12-03 08:13:03 -08:00
Loic Dachary
602d5d53c0 osd: include CPU info
It will be handy when trying to figure out CPU bound problems / benchmarks.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-03 15:39:36 +01:00
Loic Dachary
f5025307d9 pybind: syntax check osd metadata
Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-03 15:12:23 +01:00
Loic Dachary
6570197871 ceph-disk: blacklist /dev/fd0
blkid -s TYPE /dev/fd0 has been verified to hang forever on a
H8DMR-82 supermicro motherboard running

3.8.0-33-generic #48~precise1-Ubuntu SMP Thu Oct 24 16:28:06 UTC 2013
x86_64

It is unlikely that ceph will ever be used on floppy disks, they
can be blacklisted.

http://tracker.ceph.com/issues/6827 fixes: #6827

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-03 09:31:05 +01:00
Xing Lin
bcb6bfd29d test/ceph_decoder: add return value check for read_file()
check the return value of read_file function call

Signed-off-by: Xing Lin <xinglin@cs.utah.edu>
2013-12-02 23:36:20 -07:00
Sage Weil
20507b5fc7 crush/CrushWrapper: default to the "new" bobtail-era tunables
These are supported as of kernel version v3.9:
 - chooseleaf_descend_once was added in 1604f48
 - others were added in 546f04e

And of course these are supported by bobtail and later.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-02 22:15:54 -08:00
Sage Weil
07978bb220 crush/CrushWrapper: explicitly set tunables on create, decode
Set the tunables to the 'default' values on create.

Default to the legacy values when we decode, so that an old map without
values defined gets legacy values.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-02 22:12:14 -08:00
Sage Weil
031b9ed5da Merge pull request #877 from ceph/wip-6892
rgw: don't error out on empty owner when setting acls

Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-02 21:55:28 -08:00
Sage Weil
3f1352ff38 doc/rados/operations/crush-map: describe crush locations, hook
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-02 21:48:54 -08:00
Sage Weil
396ee0d423 add script/run-coverity
Keep this in-tree.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-02 21:46:25 -08:00
Sage Weil
283de99c74 Merge pull request #887 from jdurgin/wip-peek-meta
osd: read into correct variable for magic string

Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-02 17:36:32 -08:00
John Wilkins
a5eda4fcc3 doc: Updated scrub defaults and added note about deep scrubbing.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-12-02 15:26:19 -08:00
Josh Durgin
f11b380e9a osd: read into correct variable for magic string
4d140a71a1 refactored this and
introduced a bug. peek_meta() was accidentally reading into magic,
then replacing magic with val, which was always the empty string,
resulting in the osd always failing to start due to 'mismatched'
magic values.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2013-12-02 15:16:46 -08:00
Greg Farnum
4fdc5d9e9d workunits: use integers instead of true/false for hashpspool command
Backport: emperor

Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Samuel Just <sam.just@inktank.com
2013-12-02 13:26:37 -08:00
athanatos
cc71fae70b Merge pull request #881 from ceph/wip-objectstore
osd: clean up the osd / objectstore separation

Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-12-02 13:07:19 -08:00
John Wilkins
c77ce90f5b doc: Fixed hyperlink to the manual installation section.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-12-02 10:49:04 -08:00
John Wilkins
648f3bcd39 doc: Added a link to get packages.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-12-02 10:48:27 -08:00
Sage Weil
16b75768b8 osd/OSDMap: fix typo and crush types helper
Bah!

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-02 10:21:28 -08:00
Sage Weil
1242642dab Merge pull request #882 from ceph/wip-6699
sysvinit, upstart: use df -P when weighting new OSDs

Reviewed-by: Noah Watkins <noah.watkins@inktank.com>
2013-12-02 10:19:30 -08:00
Sage Weil
a4254f7f0a Merge pull request #876 from javacruft/wip-missed-module
Mark libcls_kvs as a module

Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-02 10:10:45 -08:00
Sage Weil
5274b3ef02 Merge pull request #841 from ceph/wip-crush-chassis
osd/OSDMap: add 'chassis' to default type hierarchy

Reviewed-by: Loic Dachary <loic@dachary.org>
2013-12-02 09:59:39 -08:00
Sage Weil
78df4a148e Merge pull request #883 from idryomov/wip-readme
README: update a list of build deps for rpm-based systems

Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-02 09:24:41 -08:00
Sage Weil
6298a576d3 osd/OSDMap: add region, pdu, pod types while we are at it
One use noted that they have a 'pdu' type in their type hierarchy that
typically spans multiple racks.  Others are known to use the 'pod'
terminology; add that to.  And I can imagine 'region' above datacenter.

Factor this into a helper to make things a bit less fragile.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-02 08:31:23 -08:00
Sage Weil
3a6707a183 osd/OSDMap: add 'chassis' to default type hierarchy
A chassis is usually bigger than a host but smaller than a rack.  This will
be useful for a broad class of modern hardware that sticks multiple hosts
in the same chassis (in sleds, or on cards, or blades, or whatever).

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-02 08:25:34 -08:00
Ilya Dryomov
5e1fc14757 README: update a list of build deps for rpm-based systems
A list of build dependencies for rpm-based OSes is missing a few items.
This fills in the gaps.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2013-12-02 11:52:31 +02:00
Sage Weil
f5ddb12a82 Merge remote-tracking branch 'gh/next' 2013-12-01 22:47:11 -08:00
Sage Weil
e80ab94bf4 Partial revert "mon: osd pool set syntax relaxed, modify unit tests"
This reverts commit 08327fed82, except
for the hashpspool bit.  We switched back to an integer argument in
commit 337195f046.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-01 22:21:31 -08:00
Sage Weil
f50371f081 Merge remote-tracking branch 'gh/next' 2013-11-30 13:44:27 -08:00
Sage Weil
fd175ab921 sysvinit, upstart: use df -P when weighting new OSDs
This avoids parsing out the wrong value when a long device name makes
df wrap over two lines.

Fixes: #6699
Reported-by: Jan Harkes <jaharkes@cs.cmu.edu>
Reviewed-by: Noah Watkins <noah.watkins@inktank.com>
Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-30 13:41:15 -08:00
Sage Weil
4d140a71a1 os/ObjectStore: add {read,write}_meta
Move these from the OSD.  Use a generic implementation in ObjectStore that
hopefully all backends can share (so that it can remain in sync with the
start/stop scripts, ceph-disk, and other orchestration machinery).

Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:28:36 -08:00
Sage Weil
6bb42a0c44 osd: move peek_journal_fsid() into ObjectStore (from OSD)
This kills the last FileJournal reference in the OSD!

Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:28:36 -08:00
Sage Weil
bf5a7b2427 os/ObjectStore: generalize the FileStore's target_version
This kills the last FileStore reference in the OSD.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-11-29 22:28:36 -08:00