Commit Graph

14602 Commits

Author SHA1 Message Date
Sam Lang
cfbcfd7c9e Fix typo in usage output for --num-osds
This patch fixes the typo in the usage description to match the actual argument string.

Signed-off-by: Sam Lang <samlang@gmail.com>
Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-08 11:27:33 -07:00
Sam Lang
5d56dfb7f8 Fix segfault caused by invalid argument string.
This patchset includes minor fixes to the crushtool utility.  If an invalid bucket type is speicifed on the command line, the code was iterating through bucket_types for the length of the static array, but the last entry in that array has null (0) values, which was causing a segfault.  This patch just checks that bucket_types[i].name is non-null instead.  Also, if the wrong bucket type or algorithm is specified, prints the usage string on exit.

Signed-off-by: Sam Lang <samlang@gmail.com>
Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-08 11:25:13 -07:00
Sage Weil
8e69c39f69 v0.29 2011-06-06 11:09:28 -07:00
Greg Farnum
f9af9ced28 remove dumpjournal
This code has suffered a great deal of bitrot and is superceded
by the cmds --dump-journal functionality anyway, which
is much more full-featured.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-06-06 11:46:07 -07:00
Sage Weil
4e95ac5a62 Merge remote branch 'origin/stable' into next 2011-06-06 09:57:41 -07:00
Sage Weil
6f21e41a91 Merge remote branch 'origin/filestore_debugging' into next 2011-06-06 09:56:45 -07:00
Samuel Just
befcff021b SimpleMessenger: Keep a disposable flag for use in reset
pipes marked disposable must not inherit the lossy policy on reconnect.
Also, in Pipe::writer, when sent.empty() && close_on_empty, mark as
lossy to ensure that fault will close the connection.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-06-03 13:28:07 -07:00
Greg Farnum
7bd016f976 rados_bencher: re-add written objects constraint to read benchmark.
Somehow, in the last major change, the constraints that kept the
bencher from trying to read non-existent objects got removed. Put
a check back in the main bench loop to fix that.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-06-03 12:13:47 -07:00
Josh Durgin
5fc6d92180 filestore: compare dentry->d_type against d_type constant
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-06-02 18:21:24 -07:00
Josh Durgin
ea76ea502b filestore: stat to test for file type if d_type is unsupported
This only affects list_collections. Previously, when using an FS that
does not support d_type, like xfs, load_pgs would fail to find any
pgs, since list_collections skipped all files.

This made clients hang because all pgs were considered non-existent by
the osd.

Reported-by: Yoshiaki Tamura <yoshi@midokura.jp>
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-06-02 18:10:53 -07:00
Josh Durgin
ade2ccbe51 osd, filestore: debug collection listing
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-06-02 18:10:53 -07:00
Laszlo Boszormenyi
6fd694c394 Remove unneeded libcrush1 files 2011-06-02 15:14:54 -07:00
Sage Weil
d6bbf3e5fb mds: journal parents of srci when srcdn is remote
If srcdn is a remote dentry, we will be journaling the src inode to update
the mtime, but we need to ensure the parent dirs are in the metablob.

Fixes: #1132
Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 15:13:42 -07:00
Sage Weil
806646b05e journaler: also initialize safe_pos
on reread_head.  Keep consistent across the two methods.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 14:51:20 -07:00
Sage Weil
a13b664365 journaler: fix trim crash after standby-replay -> active
The reread_head method needs to initialize trimming_pos (like read_head
does) or else we get confused later.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 14:50:45 -07:00
Sage Weil
7ca240bf6d mds: cleanup rename_prepare a bit
Use *srci tmp.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 14:14:15 -07:00
Sage Weil
0bcd9ac73c vstart.sh: turn down debug ms
Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 13:57:55 -07:00
Sage Weil
4cf342a13a mds: pin inode while one renamed_files list
Make sure the inode is pinned while it is on the LogSegment::renamed_files
list.  Avoids a crash when an inode on that list is wrongly trimmed.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 13:16:31 -07:00
Sage Weil
6ca168ed71 filestore: fix fallback/slow do_clone_range
We need to seek to the appropriate offsets on the src and destination
fd's for this to do the right thing.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 09:17:02 -07:00
Sage Weil
7e2e4779e4 mon: make sure osd paxos is writeable before doing timeouts
The osd paxos machine has to be writeable before we can update it.

Fixes: #1130
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-06-01 21:20:58 -07:00
Samuel Just
c5470e0f85 OSD: don't keep old connection over new one in update_heartbeat_peers
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-06-01 17:05:57 -07:00
Sage Weil
e11958b2fc Merge branch 'stable' into next 2011-06-01 16:28:17 -07:00
Tommi Virtanen
9b37f4fa5f Allow embedded '\0' in bufferlists when copying to std::string.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2011-06-01 09:44:55 -07:00
Sage Weil
1528d2c42b debian: depend on libboost-dev >= 1.34
for statechart.  Partially fixes #1124.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-31 12:58:35 -07:00
Sage Weil
0cfa911ff4 osd: don't leak Connection reference
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-31 09:37:34 -07:00
Sage Weil
8aa67aa402 osd: ignore old/stale heartbeat messages
If we get heartbeat messages from old epochs from peers that are not
current, drop them and mark the connection down.  Even if they are peers
we _should_ have (because we haven't gotten a notify yet to learn about
a pg we should have but don't yet) we have a newer map epoch and will learn
about them shortly, reopening the connection.

Fixes: #1107
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-31 09:37:31 -07:00
Sage Weil
e5c9100bca osd: fix map sharing due to heartbeats
- share the map with the cluster addr
- use the new {note,get}_peer_epoch helpers to do it sanely
- don't share if we're booting; see 818fa33a66

Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-31 09:37:28 -07:00
Greg Farnum
5b7c8ae8bd osd: protect recovery_wq ops with the recovery lock
We were calling recovery_item.remove_myself() without holding the
recoveryWQ::lock. Naughty naughty!

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-05-30 12:37:42 -07:00
Sage Weil
b3fb58ea4e crushtool: add -v verbose for --test mode
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-05-30 12:37:31 -07:00
Laszlo Boszormenyi
57ea502045 Add content to obsync package 2011-05-29 15:00:53 -07:00
Sage Weil
23242045db v0.28.2 2011-05-28 09:14:31 -07:00
Colin Patrick McCabe
7e1de380eb hadoop: track Hadoop API changes
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-27 14:46:37 -07:00
Colin Patrick McCabe
4ddf8df804 SimpleMessenger: allow multiple calls to shutdown
Fixes a case where radostool crashed on an error shutdown.

Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-27 14:05:27 -07:00
Colin Patrick McCabe
8490b784cf common/Thread.h: const cleanup
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-27 14:01:45 -07:00
Colin Patrick McCabe
7cfb3b6afe Merge branch 'wip-obsync' 2011-05-27 10:59:21 -07:00
Sage Weil
574b58f389 mkcephfs: pass config to osdmaptool
This lets OSDMap::create_simple() see g_conf.osd_pool_default_size when
creating the initial data, metadata, and rbd pools.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-05-26 21:37:03 -07:00
Sage Weil
d2ab764b34 drop useless cm.txt
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-05-26 21:31:18 -07:00
Sage Weil
1292436b8f osdmap: take default pool size from config
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-05-26 21:20:55 -07:00
Sage Weil
9b8daa92cd crushtool: update help
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-26 15:07:37 -07:00
Colin Patrick McCabe
6f704e3398 obysnc: rgw target: validate all users
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-26 14:11:04 -07:00
Colin Patrick McCabe
ae5bbc7b08 Merge branch 'wip-obsync' 2011-05-26 13:17:03 -07:00
Sage Weil
22082c4f7c mon: remove pg_temp mappings when we delete pools
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-26 13:17:12 -07:00
Colin Patrick McCabe
e0cbb131e1 test-obsync: test sync directly from s3->rgw
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-26 13:15:50 -07:00
Sage Weil
a93c86e525 crushtool: fix --add-item weight being zero when parent bucket(s) created
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-26 13:12:04 -07:00
Colin Patrick McCabe
56d5d95921 obsync: fix bucket creation through rgw target
The rgw: target can now create buckets. Add a test.

Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-26 11:21:23 -07:00
Sage Weil
9cefb56be8 Merge branch 'stable' 2011-05-26 11:04:03 -07:00
Colin Patrick McCabe
b2c1bff87c test-obsync: test big objects, user-defined xattr
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-26 10:25:40 -07:00
Sage Weil
e9eeb1610c mkcephfs: set rdir for local mon setup
Fixes: #1113
Reported-by: Bernard Grymonpon <bernard@openminds.be>
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-26 10:19:04 -07:00
Sage Weil
5d51b8fdb0 init-ceph: ssh
Another bell/whistle.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-26 09:55:37 -07:00
Colin Patrick McCabe
05cfb4d5ca obysnc: fix content-type on RGWStore
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-25 17:48:02 -07:00