Commit Graph

14600 Commits

Author SHA1 Message Date
Sage Weil
8e69c39f69 v0.29 2011-06-06 11:09:28 -07:00
Greg Farnum
f9af9ced28 remove dumpjournal
This code has suffered a great deal of bitrot and is superceded
by the cmds --dump-journal functionality anyway, which
is much more full-featured.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-06-06 11:46:07 -07:00
Sage Weil
4e95ac5a62 Merge remote branch 'origin/stable' into next 2011-06-06 09:57:41 -07:00
Sage Weil
6f21e41a91 Merge remote branch 'origin/filestore_debugging' into next 2011-06-06 09:56:45 -07:00
Samuel Just
befcff021b SimpleMessenger: Keep a disposable flag for use in reset
pipes marked disposable must not inherit the lossy policy on reconnect.
Also, in Pipe::writer, when sent.empty() && close_on_empty, mark as
lossy to ensure that fault will close the connection.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-06-03 13:28:07 -07:00
Greg Farnum
7bd016f976 rados_bencher: re-add written objects constraint to read benchmark.
Somehow, in the last major change, the constraints that kept the
bencher from trying to read non-existent objects got removed. Put
a check back in the main bench loop to fix that.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-06-03 12:13:47 -07:00
Josh Durgin
5fc6d92180 filestore: compare dentry->d_type against d_type constant
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-06-02 18:21:24 -07:00
Josh Durgin
ea76ea502b filestore: stat to test for file type if d_type is unsupported
This only affects list_collections. Previously, when using an FS that
does not support d_type, like xfs, load_pgs would fail to find any
pgs, since list_collections skipped all files.

This made clients hang because all pgs were considered non-existent by
the osd.

Reported-by: Yoshiaki Tamura <yoshi@midokura.jp>
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-06-02 18:10:53 -07:00
Josh Durgin
ade2ccbe51 osd, filestore: debug collection listing
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2011-06-02 18:10:53 -07:00
Laszlo Boszormenyi
6fd694c394 Remove unneeded libcrush1 files 2011-06-02 15:14:54 -07:00
Sage Weil
d6bbf3e5fb mds: journal parents of srci when srcdn is remote
If srcdn is a remote dentry, we will be journaling the src inode to update
the mtime, but we need to ensure the parent dirs are in the metablob.

Fixes: #1132
Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 15:13:42 -07:00
Sage Weil
806646b05e journaler: also initialize safe_pos
on reread_head.  Keep consistent across the two methods.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 14:51:20 -07:00
Sage Weil
a13b664365 journaler: fix trim crash after standby-replay -> active
The reread_head method needs to initialize trimming_pos (like read_head
does) or else we get confused later.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 14:50:45 -07:00
Sage Weil
7ca240bf6d mds: cleanup rename_prepare a bit
Use *srci tmp.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 14:14:15 -07:00
Sage Weil
0bcd9ac73c vstart.sh: turn down debug ms
Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 13:57:55 -07:00
Sage Weil
4cf342a13a mds: pin inode while one renamed_files list
Make sure the inode is pinned while it is on the LogSegment::renamed_files
list.  Avoids a crash when an inode on that list is wrongly trimmed.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 13:16:31 -07:00
Sage Weil
6ca168ed71 filestore: fix fallback/slow do_clone_range
We need to seek to the appropriate offsets on the src and destination
fd's for this to do the right thing.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-06-02 09:17:02 -07:00
Sage Weil
7e2e4779e4 mon: make sure osd paxos is writeable before doing timeouts
The osd paxos machine has to be writeable before we can update it.

Fixes: #1130
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-06-01 21:20:58 -07:00
Samuel Just
c5470e0f85 OSD: don't keep old connection over new one in update_heartbeat_peers
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2011-06-01 17:05:57 -07:00
Sage Weil
e11958b2fc Merge branch 'stable' into next 2011-06-01 16:28:17 -07:00
Tommi Virtanen
9b37f4fa5f Allow embedded '\0' in bufferlists when copying to std::string.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2011-06-01 09:44:55 -07:00
Sage Weil
1528d2c42b debian: depend on libboost-dev >= 1.34
for statechart.  Partially fixes #1124.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-31 12:58:35 -07:00
Sage Weil
0cfa911ff4 osd: don't leak Connection reference
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-31 09:37:34 -07:00
Sage Weil
8aa67aa402 osd: ignore old/stale heartbeat messages
If we get heartbeat messages from old epochs from peers that are not
current, drop them and mark the connection down.  Even if they are peers
we _should_ have (because we haven't gotten a notify yet to learn about
a pg we should have but don't yet) we have a newer map epoch and will learn
about them shortly, reopening the connection.

Fixes: #1107
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-31 09:37:31 -07:00
Sage Weil
e5c9100bca osd: fix map sharing due to heartbeats
- share the map with the cluster addr
- use the new {note,get}_peer_epoch helpers to do it sanely
- don't share if we're booting; see 818fa33a66

Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-31 09:37:28 -07:00
Greg Farnum
5b7c8ae8bd osd: protect recovery_wq ops with the recovery lock
We were calling recovery_item.remove_myself() without holding the
recoveryWQ::lock. Naughty naughty!

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-05-30 12:37:42 -07:00
Sage Weil
b3fb58ea4e crushtool: add -v verbose for --test mode
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-05-30 12:37:31 -07:00
Laszlo Boszormenyi
57ea502045 Add content to obsync package 2011-05-29 15:00:53 -07:00
Sage Weil
23242045db v0.28.2 2011-05-28 09:14:31 -07:00
Colin Patrick McCabe
7e1de380eb hadoop: track Hadoop API changes
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-27 14:46:37 -07:00
Colin Patrick McCabe
4ddf8df804 SimpleMessenger: allow multiple calls to shutdown
Fixes a case where radostool crashed on an error shutdown.

Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-27 14:05:27 -07:00
Colin Patrick McCabe
8490b784cf common/Thread.h: const cleanup
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-27 14:01:45 -07:00
Colin Patrick McCabe
7cfb3b6afe Merge branch 'wip-obsync' 2011-05-27 10:59:21 -07:00
Sage Weil
574b58f389 mkcephfs: pass config to osdmaptool
This lets OSDMap::create_simple() see g_conf.osd_pool_default_size when
creating the initial data, metadata, and rbd pools.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-05-26 21:37:03 -07:00
Sage Weil
d2ab764b34 drop useless cm.txt
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-05-26 21:31:18 -07:00
Sage Weil
1292436b8f osdmap: take default pool size from config
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-05-26 21:20:55 -07:00
Sage Weil
9b8daa92cd crushtool: update help
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-26 15:07:37 -07:00
Colin Patrick McCabe
6f704e3398 obysnc: rgw target: validate all users
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-26 14:11:04 -07:00
Colin Patrick McCabe
ae5bbc7b08 Merge branch 'wip-obsync' 2011-05-26 13:17:03 -07:00
Sage Weil
22082c4f7c mon: remove pg_temp mappings when we delete pools
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-26 13:17:12 -07:00
Colin Patrick McCabe
e0cbb131e1 test-obsync: test sync directly from s3->rgw
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-26 13:15:50 -07:00
Sage Weil
a93c86e525 crushtool: fix --add-item weight being zero when parent bucket(s) created
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-26 13:12:04 -07:00
Colin Patrick McCabe
56d5d95921 obsync: fix bucket creation through rgw target
The rgw: target can now create buckets. Add a test.

Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-26 11:21:23 -07:00
Sage Weil
9cefb56be8 Merge branch 'stable' 2011-05-26 11:04:03 -07:00
Colin Patrick McCabe
b2c1bff87c test-obsync: test big objects, user-defined xattr
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-26 10:25:40 -07:00
Sage Weil
e9eeb1610c mkcephfs: set rdir for local mon setup
Fixes: #1113
Reported-by: Bernard Grymonpon <bernard@openminds.be>
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-26 10:19:04 -07:00
Sage Weil
5d51b8fdb0 init-ceph: ssh
Another bell/whistle.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-26 09:55:37 -07:00
Colin Patrick McCabe
05cfb4d5ca obysnc: fix content-type on RGWStore
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-25 17:48:02 -07:00
Colin Patrick McCabe
6cf67a26ad test-obsync: compare_directory now compares xattrs
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-25 17:36:36 -07:00
Colin Patrick McCabe
4cae0ea8d0 ceph-pybind-test: test embedded NULLs in data
Test embedded nulls in rados data. Fix a bug in rados.Object.__str__

Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-05-25 15:55:22 -07:00