Commit Graph

18623 Commits

Author SHA1 Message Date
Sage Weil
e455d38838 doc: update project status/stability blurb
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Reviewed-by: Mark Kampe <mark.kampe@dreamhost.com>
2012-03-13 13:48:53 -07:00
Sage Weil
e6969258c4 global: drop yellow warning on startup
Fixes: #2143
Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-13 13:48:53 -07:00
Sage Weil
e5934f10be qa: kclient/file_layout.sh: ...
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-13 12:55:53 -07:00
Josh Durgin
0a2068fc00 Merge branch 'librados-cleanup'
Reviewed-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-13 11:46:33 -07:00
Josh Durgin
16f99606c9 osd_types: use uint64_t for ObjectExtent offsets and lengths
This is just client in-memory state, and allows us to address objects >4GiB,
to match the existing librados/Objecter interfaces.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2012-03-13 11:46:02 -07:00
Josh Durgin
095c3a0e71 OSDMap: make get_pools() const
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2012-03-13 11:46:02 -07:00
Josh Durgin
db12627946 ObjectCacher: remove unused and crufty atomic sync operations
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2012-03-13 11:46:02 -07:00
Josh Durgin
5f92f338be librados: move methods that require an IoCtx to IoCtxImpl
RadosClient still does a few different things, but at least it
no longer does all the work of an IoCtx.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2012-03-13 11:46:02 -07:00
Josh Durgin
8f278647f4 librados: split into separate files and remove unnecessary headers
Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2012-03-13 11:46:02 -07:00
Yehuda Sadeh
98792e9363 rgw: add more meaningful tests instances of encoded objects
this completes #2140

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-12 17:02:53 -07:00
Sage Weil
dfe50bcbec build-doc: use alternate virtualenv dir, if specified
The docs gitbuilder will use this to avoid rebuilding the virtualenv on
every build.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-12 16:46:31 -07:00
Sage Weil
6869c5766b test_idempotent: fix global_init call
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-12 15:12:55 -07:00
Sage Weil
401a571613 qa: kclient/file_layout.sh poking
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-12 15:01:59 -07:00
Yehuda Sadeh
7e0e7ce1eb rgw: modify bucket instance for encoding test
This makes 'make check' happy, otherwise we need to create
a bucket name that starts with a period. This version is better.

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-12 14:59:44 -07:00
Samuel Just
f20f6ea7f1 test: add test_filestore_idempotent2
Signed-off-by: Samuel Just <rexludorum@gmail.com>
2012-03-12 14:58:26 -07:00
Samuel Just
6ca070ad2f FileStore: ignore ERANGE and ENOENT on replay
The source object may either not exist or be the wrong size
during replay if the destination object was deleted in a future
already-applied operation.  This should not impact correctness
of the replay.

Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2012-03-12 14:58:26 -07:00
Samuel Just
9969bba879 FileStore: clarify debug/error output
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2012-03-12 14:58:26 -07:00
Yehuda Sadeh
e19417ef55 Makefile.am, rgw: remove fcgi dependency where not needed
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-12 14:41:24 -07:00
Yehuda Sadeh
3ff5492c62 rgw: add more meaningful test instances of some encoded objects
still need to add tests for other objects

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-12 14:22:53 -07:00
Yehuda Sadeh
31578c19ff rgw: tone down some log messages
dout(0) -> dout(1)

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-12 13:22:49 -07:00
Yehuda Sadeh
452b1248a6 rgw: provide different default values for 'debug rgw'
Currently rgw and radosgw-admin require different chattiness
defaults.

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-12 13:21:27 -07:00
Yehuda Sadeh
2c88f85c6d config: alternative config options for global_init()
We want to be able to provide alternative default config values, than
the ones we set in common/config_opts.h. This can be useful when we
want different default for different modules (e.g., rgw, rgw-admin).
Just passing it on the command line won't do because then we'd override
any config set by the user, so we need to process that before the regular
parsing (but after initializing the config context).

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-12 13:21:22 -07:00
Sage Weil
968d29d138 qa: use recent kernel for kernel_untar_build.sh
Happier on oneiric!

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-12 12:01:41 -07:00
Yehuda Sadeh
93164393b3 rgw: switch ops log flag to use ceph config
It's turned on by default. So now we're using the
'rgw enable ops log' config param in ceph.conf, instead
of RGW_SHOULD_LOG_DEFAULT in the apache conf.

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-12 11:43:20 -07:00
Sage Weil
c9898f4352 filestore: fix op_num offset/labels
Start at 0, not 1.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-12 11:22:27 -07:00
Yehuda Sadeh
7c75349804 config: tmap to omap upgrade, true by default
Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-03-12 11:20:08 -07:00
Sage Weil
3bba6b72e4 Makefile: link libfcgi to librgw
Need this to make a linker error go away on my squeeze dev box.  We
probably need to make sure librgw doesn't touch fcgi, once that is
revisited down the line.  Opened #2166.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-11 21:16:31 -07:00
Sage Weil
945218cc30 qa/workunits/kclient/file_layout: escape *
Escape * so that it is expanded as root.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-11 20:36:47 -07:00
Sage Weil
a8497874b7 filejournal: less log noise
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-11 12:31:17 -07:00
Sage Weil
0851b747ba filestore: remove unused bool idempotent
This was from the old broken mechanism.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 20:55:09 -08:00
Sage Weil
6980ed988b filestore: fix arguments
From a change that was rebased out; missed this caller.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-09 17:07:02 -08:00
Sage Weil
ea34aa59ee Merge remote branch 'gh/wip-2098'
Reviewed-by: Samuel Just <samuel.just@dreamhost.com>
2012-03-09 16:42:15 -08:00
Sage Weil
9b2a5c5d84 filestore: sync object_map on _set_replay_guard()
We need to sync the object_map too.  We can _almost_ check to see if there
are keys for the object and only do it then, except that they may have
existed previously and then been deleted.

So, always sync.  leveldb is reasonably nice about this... it should just
be another fsync.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-09 16:34:55 -08:00
Sage Weil
c9550c59ad omap: add sync method to ObjectMap
Signed-off-by: Samuel Just <rexludorum@gmail.com>
2012-03-09 16:32:23 -08:00
Sage Weil
13afce8300 filestore: remove old post-idempotent transaction trigger_commit
The old strategy was to initiate a commit after any non-idempotent
transaction.  This only worked if the transaction was idempotent with
respect to itself, or could be replayed partially without problems,
and in reality that isn't the case.  For example:

 - clone A -> B
 - write to A
 - <sync>

If we crash before the sync, and replay the clone A->B, we corrupt B with
the new A data.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:23 -08:00
Sage Weil
6613b41564 filestore: guard collection_remove replay
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:23 -08:00
Sage Weil
51372a769e filestore: guard replay of collection_add
- set guard on apply
- check guard on replay

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:23 -08:00
Sage Weil
4ea6e0d24f filestore: guard replay of basic collection ops
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:22 -08:00
Sage Weil
dd284c4f3a filestore: guard collection_rename replay
- check guard on replay
- set guard on apply

Signed-off-by: Sage Weil <sage@newdream.net>
2012-03-09 16:32:22 -08:00
Sage Weil
63d2c93dbe filestore: fix collection_rename error code
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:22 -08:00
Sage Weil
e99940d1a2 filestore: guard clone replay
- set guard xattr on clone, clone_range
- check before applying/replaying

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:22 -08:00
Sage Weil
f8a047f240 filestore: implement _set_replay_guard, _check_replay_guard
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:22 -08:00
Sage Weil
3b47c6ba55 filestore: maintain SequencerPosition during _do_transaction
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:22 -08:00
Sage Weil
e81bc971c8 filestore: fgetxattr helpers/wrappers
Also, do the getxattr using fgetxattr, to avoid duplicating code.  This is
slightly slower probably because we open a file handle, but if we care we
should really clean up the code to use lfn_open instead of lfn_find and
avoid the repeated path traversal too.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:22 -08:00
Sage Weil
babb1e9032 add SequencerPosition type
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:22 -08:00
Sage Weil
a6077f6c37 filestore: pass trans_num into _do_transaction
This gives us the <op_seq, trans_num, op_num> triple to identify every
constituent operation.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:22 -08:00
Sage Weil
808812a2a4 filestore: use proper type for readdir_r tmp
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 16:32:22 -08:00
Sage Weil
118449788a levedb: fix commit
This got reverted back to the old commit, somehow.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-03-09 14:24:14 -08:00
Sage Weil
184b180256 Merge branch 'master' of github.com:ceph/ceph 2012-03-09 14:13:03 -08:00
Samuel Just
7f9cfdd994 RadosModel: fix omap_clear case in RemoveAttrsOp
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2012-03-09 14:12:24 -08:00