Commit Graph

64 Commits

Author SHA1 Message Date
sageweil
0d0e046633 asdf
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1270 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-20 20:37:24 +00:00
sageweil
8a8cf2ba46 * libhadoopcephfs.so
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1269 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-20 20:31:12 +00:00
eestolan
f275c16a46 more Hadoop stuff
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1267 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-20 20:12:15 +00:00
sageweil
f212de37cd * some client cache tweaks
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1266 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-20 19:58:39 +00:00
rsdio
eb07ec9646 2007-03-19 Casey Marshall <csm@soe.ucsc.edu>
* osbdb/OSBDB.cc (CLEANUP, COMMIT): new macros.
	(scoped_lock): new class.
	(getenv): new function.
	The rest replaces Context cleanup/commit with macros; fixes
	some debug output; adds locks to mutator methods.
	* osbdb/OSBDB.h (lock): new member.
	(OSBDB): initialize `lock.'
	(getenv): new function.



git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1264 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-20 05:58:05 +00:00
sageweil
6ed8c55ee2 * O_TRUNC implemented in open()
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1255 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-16 17:36:40 +00:00
sageweil
b80c3a6b04 * fixed problem with client cache caps
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1254 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-16 17:30:50 +00:00
sageweil
785e6e5c19 * fixed bug with lost waiters on null dentries (e.g. mknod race)
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1251 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-16 00:21:18 +00:00
sageweil
2bcc95a7e3 * some changes to client cache: readers/writers block properly, wake up when data is flushed
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1250 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-16 00:19:38 +00:00
sageweil
1d423e3cee * csyn: start up N synthetic clients, not just 1
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1246 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-15 23:12:32 +00:00
sageweil
89c6aabb29 * fixed getdir() on empty dir shutdown hang in client
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1244 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-15 21:15:42 +00:00
sageweil
4bb27d78ed * fixed buglet with open(O_CREAT)
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1243 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-15 21:02:47 +00:00
sageweil
df0126377f * fixed looping bug with clean_dir (called after trace playback)
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1242 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-15 20:59:21 +00:00
sageweil
79e24af3d4 * fixed read/write idiocy in MonitorStore
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1228 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-13 22:22:54 +00:00
sageweil
c1e9220896 * emacs headers, formatting
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1221 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-13 00:59:51 +00:00
sageweil
3562c8b436 * minor osdmap cleanup
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1220 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-13 00:52:32 +00:00
sageweil
baaee0f7aa * fixed SyntheticCLient.read_file() to notice EOF
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1219 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-13 00:13:19 +00:00
sageweil
11add1fae1 * added try_map_read, which checks for missing bufferheads without creating them. for _is_cached.
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1218 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-12 23:26:18 +00:00
sageweil
f35b883067 * fixed bug with writefile/readfile data fingerprinting (for detecting data corruption errors)
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1217 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-12 22:08:13 +00:00
sageweil
c7a1b84020 error suppression file to make valgrind shut up about a bug in libc's writev
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1212 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-12 03:41:08 +00:00
sageweil
958e3ece4b fixed lots of memory leaks! cleaned up C_Gather. Thread has stricter interface (join() dies if thread didn't start). lots of objectcacher cleanup (including memory leakage). some fakemessenger cleanup.
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1207 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-12 02:52:30 +00:00
rsdio
42bc516d1b 2007-03-10 Casey Marshall <csm@soe.ucsc.edu>
* osbdb/OSBDB.cc: add some more debug tracing.
	(rmattr, collection_rmattr): fix buglet where we'd zero-fill
	the input name, not the `attr_name' we're copying it to.
	* test/testos.cc: hacks to support ebofs-on-raw-device.
	* test/testosbdb.cc: add more tests for attributes.



git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1199 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-10 22:49:05 +00:00
sageweil
f646f4a502 fixed warnings on LP64; removed MonitorStore debug message
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1198 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-10 20:50:07 +00:00
sageweil
2a38c3e968 don't require 'fs' to be defined
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1193 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-09 22:48:17 +00:00
sageweil
93dfe2de0a a sample
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1183 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-09 03:36:39 +00:00
sageweil
34d3bcd647 use absolute paths when using fuse
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1179 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-07 17:22:45 +00:00
sageweil
611c608def eek, use SimpleMessenger. surprised that worked at all!
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1171 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-05 23:43:46 +00:00
sageweil
95be0dc467 client describe_layout interface; monitorstore fuse-changes-cwd workaround; osdc debug printer cleanup
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1167 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-03 01:58:35 +00:00
sageweil
2abaa3fb24 added lseek to Client
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1164 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-02 23:28:25 +00:00
sageweil
3efd4745fc build on 64-bit machines (LP64)
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1159 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-02 20:03:58 +00:00
rsdio
8fa2c00f43 2007-03-01 Casey Marshall <csm@soe.ucsc.edu>
* config.cc (g_conf): initialize bdbstore_transactional.
	(parse_config_options): accept `--bdbstore-transactional' and
	`--debug-bdbstore'.
	* config.h (struct md_config_t): add `bdbstore_transactional.'
	* doc/bdb.txt: new file.
	* osbdb/OSBDB.cc (statfs): implemented.
	Added optional transactions to most methods.
	* osbdb/OSBDB.h: updated for transactions.
	* test/testosbdb.cc: new file.
	* test/testos.cc: updated.



git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1156 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-02 04:07:56 +00:00
sageweil
27ac80ee91 comment
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1148 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-01 16:37:00 +00:00
sageweil
fa5e6eb9f6 newsyn fix for numclients>1, mds_beacon_* args for config.cc, simplemessenger now dies on dup register_entity, doesn't assert on missing local destination (still warns)
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1147 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-01 16:36:23 +00:00
eestolan
42c9f1c813 Start of new interface to use Ceph under Hadoop
--Esteban



git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1146 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-01 03:55:53 +00:00
sageweil
5b9186f74f stupid bug fix for _is_cached and _trim_from_cache
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1143 29311d96-e01e-0410-9327-a35deaab8ce9
2007-03-01 03:20:10 +00:00
sageweil
1e0a427691 der
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1140 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-28 23:15:51 +00:00
sageweil
a476b85b8f make mds notice incarnation, even when it starts up as a specific mds# (e.g. via newsyn)
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1139 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-28 23:05:17 +00:00
sageweil
edcf4c0d73 merge branches/riccardo/monitor1 changes into trunk (pg log storage fix, monitorstore, simplemssenger fixes, fakestore rewrite, and the latest monitor stuff)
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1130 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-26 00:17:32 +00:00
rsdio
e50846fead 2007-02-20 Casey Marshall <csm@soe.ucsc.edu>
* test/testos.cc: try to compute run times better.



git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1114 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-21 00:54:26 +00:00
sageweil
d8814bda4f minor cap bit handling fixes. should tide us over until there's time for a more thorough code review.
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1113 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-20 23:23:35 +00:00
rsdio
771f8f25fb 2007-02-19 Casey Marshall <csm@soe.ucsc.edu>
* config.cc (g_conf): set `bdbstore_cachesize' to 0 (== use
	default BDB cache size).
	(parse_config_options): handle `--bdbstore-cachesize'.
	* config.h (md_config_t): add `bdbstore_cachesize.'
	* osbdb/OSBDB.cc (binary_search): reimplemented, non-dumb like.
	(OSBDB::opendb): new method.
	(OSBDB::mount): handle db opening here.
	(OSBDB::umount): close the DB, dispose of Db pointer.
	(OSBDB::mkfs): handle db opening here.
	(OSBDB::pick_object_revision_lt): implemented.
	(OSBDB::stat): handle split between object data and object
	"inode."
	(OSBDB::remove): likewise; also remove attributes.
	(OSBDB::truncate): likewise; don't worry about large objects
	here.
	(OSBDB::read): handle data/inode split; only use DB_DBT_PARTIAL if
	we have to.
	(OSBDB::write): likewise.
	(OSBDB::clone): handle data/inode split; just read in the whole
	object.
	(OSBDB::create_collection): fix collections list move.
	(OSBDB::collection_add): fix objects list move.
	(OSBDB::_setattr): handle attribute key changes; fix attribute
	names move.
	(OSBDB::_getattr): new method.
	(OSBDB::getattr): new method.
	(OSBDB::getattrs): new method.
	(OSBDB::rmattr): new method.
	(OSBDB::listattr): fix attribute key types; fix reading
	attributes.
	(OSBDB::collection_setattr): implemented.
	(OSBDB::collection_rmattr): implemented.
	(OSBDB::collection_getattr): implemented.
	(OSBDB::collection_listattr): implemented.
	* osbdb/OSBDB.h: enforce POD types for DB keys; add << operator
	for DB key types. Make an "inode" type for object metadata, so we
	don't need to prepend an object length to the object data.
	(OSBDB::env, OSBDB::mounted, OSBDB::opened): new fields.
	(OSBDB::OSBDB): don't initialize `db' here.
	(OSBDB::~OSBDB): handle db closure.



git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1111 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-20 01:11:09 +00:00
rsdio
acea5fb42f 2007-02-17 Casey Marshall <csm@soe.ucsc.edu>
* config.cc (g_conf): add `bdbstore' variables.
	(parse_config_options): handle `bdbstore' arguments.
	* config.h (struct md_config_t): add `bdbstore' fields.
	* ebofs/Ebofs.cc: fix includes for Darwin.
	* Makefile (CFLAGS): add `-DUSE_OSBDB' if `want_bdb' is `yes'.
	(OSBDB_LIBS, OSBDB_OBJS, OSBDB_OBJ): define if `want_bdb'.
	(cosd): link in `osbdb.o'.
	(testos): new target.
	(osbdb.o): new target.
	* test/testos.cc: new file.
	* osd/OSD.cc: include `osbdb/OSBDB.h' if `USE_OSBDB' is defined.
	(OSD::OSD): create an OSBDB store if requested.
	* osbdb/OSBDB.h: new file.
	* osbdb/OSBDB.cc: new file.



git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1110 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-18 00:47:52 +00:00
sageweil
92f7e6e053 merge from branches/sage/cephmds2
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1106 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-17 22:49:47 +00:00
sageweil
53a7ffa3d4 create a mess of directories w/ a realistic nesting structure
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1094 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-14 22:29:40 +00:00
sageweil
ae472dbf87 some web page updates
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1092 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-09 19:13:52 +00:00
sageweil
feb103f7d2 try to close bound socket to avoid TIME_WAIT after control-c
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1083 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-08 03:27:59 +00:00
sageweil
7856be3d20 tweak to cache purge thing
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1082 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-08 03:27:34 +00:00
sageweil
7978d899c4 elector signedness cleanup
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1079 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-05 18:59:31 +00:00
sageweil
87c47f752e only use ar -rc for darwin, ld is faster the rest of the time
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1078 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-05 18:59:17 +00:00
sageweil
809da8bfc4 ebofs trim_from_cache(object, start, len)
git-svn-id: https://ceph.svn.sf.net/svnroot/ceph@1077 29311d96-e01e-0410-9327-a35deaab8ce9
2007-02-05 18:08:27 +00:00