Commit Graph

13937 Commits

Author SHA1 Message Date
Sage Weil
44900d4c13 v0.27.1 2011-05-05 13:42:20 -07:00
Sage Weil
7d12d1807f mds: fix --reset-journal
Don't fork.  (Already fixed in master branch by the start_with_nonce
refactor, so this is just for 0.27.1.)

Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-05 13:35:50 -07:00
Sage Weil
5ac87ffd36 cfuse: encode/decode dev_t properly
The fuse layer passes through "encoded" dev_t values (probably for
compatibility reasons or something).  I copied the encode/decode methods
from the kernel and encode/decode the st_rdev values where appropriate
(where struct stat is exposed directory or via the fuse_entry_param
struct).

Fixes: #1031
Signed-off-by: Sage Weil <sage@newdream.net>
2011-05-02 18:23:13 -07:00
Yehuda Sadeh
fc36eb6b99 filestore: fiemap should close the fd 2011-04-29 14:10:53 -07:00
Sage Weil
47afbdae38 mon: make 'ceph osd (down,out,in) N' take mulitple osd numbers
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-04-28 12:42:23 -07:00
Wido den Hollander
d2a18f6930 config: Remove debug output in conf_get
Signed-off-by: Wido den Hollander <wido@widodh.nl>
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-04-28 08:55:11 -07:00
Sage Weil
896de0ac94 osd: include (some) osd op flags in MOSDOp print method
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-04-26 12:10:33 -07:00
Sage Weil
b08ee2c634 osd: add RWORDERED osd op flag
Order this op wrt reads the same way a read-modify-write would be.
(Otherwise we may get a fast/stale read result on a not-yet-complete
write.)

This fixes a problem where the Filer was marking a probe stat as a write
to get this same effect, but the OSD would EINVAL if it was a snapped
object (which happens in certain cases where the MDS is recovering the
file size of a snapped file).

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-04-26 12:10:12 -07:00
Sage Weil
dd99226ee7 mds: only include head dentries in check_rstats() rstat check
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-04-26 10:39:46 -07:00
Sage Weil
e8847b2cdd mds: only move the journaler expire_pos forward
We were seeing weird trim errors because expire_pos was getting moved
backwards after a standby-replay -> replay transition.  Make sure the two
places that update the expire_pos only move it forward--never backward.

Fixes: #1023
Signed-off-by: Sage Weil <sage@newdream.net>
2011-04-25 14:14:41 -07:00
Sage Weil
b31400d75f mds: always trim standby segments after rereading the head
When we re-read the head we may get an expire_pos that has moved forward in
time.  That is the appropriate time to trim segments during standby-replay.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-04-25 14:14:41 -07:00
Sage Weil
68bafc0665 mds: only write head once after expiring logsegments
Signed-off-by: Sage Weil <sage@newdream.net>
2011-04-25 14:14:41 -07:00
Sage Weil
746447327e mds: small journaler cleanups
Signed-off-by: Sage Weil <sage@newdream.net>
2011-04-25 14:14:41 -07:00
Sage Weil
885acf58c3 journaler: separate out trimmed_pos setter
Signed-off-by: Sage Weil <sage@newdream.net>
2011-04-25 14:14:41 -07:00
Sage Weil
6cc6788066 mds: wait for blacklisting osdmap on standby-replay -> replay final pass
Signed-off-by: Sage Weil <sage@newdream.net>
2011-04-25 14:14:41 -07:00
Sage Weil
829ca52616 journaler: fix flush completion when nothing to flush
Signed-off-by: Sage Weil <sage@newdream.net>
2011-04-25 10:01:31 -07:00
Sage Weil
aca14f99af journaler: default to readonly; fix asserts
Previously were were never in a readonly state, which made all the existing
asserts meaningless.

Signed-off-by: Sage Weil <sage@newdream.net>
2011-04-25 09:44:17 -07:00
Sage Weil
0c38da26ef vstart.sh: fix -s
Signed-off-by: Sage Weil <sage@newdream.net>
2011-04-25 09:14:09 -07:00
Sage Weil
793034c62c v0.27
Signed-off-by: Sage Weil <sage@newdream.net>
2011-04-22 16:52:04 -07:00
Sage Weil
36f0068563 cauthtool: -C not -c in man page
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-04-19 15:33:16 -07:00
Sage Weil
f9056d0d9f osd: better debug output on replay completion
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-04-19 14:32:56 -07:00
Sage Weil
634dfc90c8 mkcephfs: allow a prebuild osdmap to be specified
Otherwise we'll create one with osdmaptool --createsimple with the default
generic settins.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-04-19 14:13:02 -07:00
Sage Weil
4428d1ec3b Revert "Revert "autoconf: Complain if tcmalloc is not found.""
This reverts commit 05c281bfa9.

This should be okay now.
2011-04-19 12:05:36 -07:00
Tommi Virtanen
f6179fc375 debian: Handle missing tcmalloc on Debian lenny.
lenny doesn't have a suitable libgoogle-perftools-dev, and
release.sh edits it out of build-deps. Detect that and tell
configure that not having tcmalloc is ok.

This should make 05c281bfa9
unnecessary.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2011-04-19 12:05:32 -07:00
Tommi Virtanen
0d98a62ce2 debian: Build without tcmalloc on non-i386/amd64.
This is not strictly needed as of 05c281bfa9,
but that reverting is hopefully only temporary.

Without this, with 05c281 undone, non-mainstream architectures
would fail to build.

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2011-04-19 12:05:29 -07:00
Sage Weil
d55399ffec mds: remove MDSlaveUpdate from list on deletion
These are added to the LogSegment list on the slaves, but also need to be
removed from that list when we replay a COMMIT|ROLLBACK or when the op's
fate is determined during the resolve stage.

This fixes a crash like

./include/elist.h: In function 'elist<T>::item::~item() [with T =
MDSlaveUpdate*]', in thread '0x7fb2004d5700'
./include/elist.h: 39: FAILED assert(!is_on_list())
 ceph version 0.26 (commit:9981ff90968398da43c63106694d661f5e3d07d5)
 1: (MDSlaveUpdate::~MDSlaveUpdate()+0x59) [0x4d9fe9]
 2: (ESlaveUpdate::replay(MDS*)+0x422) [0x4d2772]
 3: (MDLog::_replay_thread()+0xb90) [0x67f850]
 4: (MDLog::ReplayThread::entry()+0xd) [0x4b89ed]
 5: (()+0x7971) [0x7fb20564a971]
 6: (clone()+0x6d) [0x7fb2042e692d]
 ceph version 0.26 (commit:9981ff90968398da43c63106694d661f5e3d07d5)
 1: (MDSlaveUpdate::~MDSlaveUpdate()+0x59) [0x4d9fe9]
 2: (ESlaveUpdate::replay(MDS*)+0x422) [0x4d2772]
 3: (MDLog::_replay_thread()+0xb90) [0x67f850]
 4: (MDLog::ReplayThread::entry()+0xd) [0x4b89ed]
 5: (()+0x7971) [0x7fb20564a971]

Fixes: #1019
Signed-off-by: Sage Weil <sage@newdream.net>
2011-04-19 09:25:30 -07:00
Sage Weil
e4e2b742fe Merge commit '8038c491ba90a8cbcd569e84d4cafc8bbdff81d5' into next 2011-04-18 16:26:06 -07:00
Sage Weil
c93c6619ff Merge remote branch 'origin/stable' into next 2011-04-18 16:23:03 -07:00
Sage Weil
68863bb453 osd: make ZERO on non-existent object a no-op
Fixes bug where oi.size gets out of sync with the object size because we
actually write zeros.  (This explains #933.)

Signed-off-by: Sage Weil <sage@newdream.net>
2011-04-18 13:55:16 -07:00
Colin Patrick McCabe
8038c491ba clitests: fix radosgw_admin test
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-04-18 11:44:37 -07:00
Colin Patrick McCabe
3f275bcf3c clitests: eliminate use of old-style section name
Signed-off-by: Colin McCabe <colin.mccabe@dreamhost.com>
2011-04-18 11:44:37 -07:00
Greg Farnum
6058a36c4e MDS: move slave rename xlock handling before finish_export_inode.
finish_export_inode changes states! That's not good for our checks,
so just handle unpinning and stuff before we finish_export_inode.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-04-18 10:41:29 -07:00
Greg Farnum
14dd299489 improve debug printing 2011-04-18 10:41:08 -07:00
Greg Farnum
d857983301 mds: Unify migration-handling code in _commit_slave_rename.
We need to handle locks and pins on exported inodes but we
were using a separate if block with its own (non-matching!) check
for no good reason.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-04-18 10:41:02 -07:00
Greg Farnum
6bd20815e2 mds: _commit_slave_rename needs to drop auth_pins for exported xlocks.
Otherwise these pins are never dropped from the inode since we
don't go through our normal xlock teardown code. Now we do!

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-04-18 10:40:43 -07:00
Greg Farnum
1a6f43763f MDS: Make _rename_apply inode import auth_pinning more intelligent.
We don't want auth_pins on the locallocks (they're never auth_pinned)
and we only want new auth_pins that are for locks on the inode that we
imported -- not for each xlock that the mdr has everywhere (like,
say, on the srcdn)!

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-04-18 10:40:21 -07:00
Greg Farnum
478c617311 mds: If we're a slave, clean up xlocks when we export an inode.
Because we can do an inode import during a rename that skips the usual
channels, we were getting into an odd state with the xlocks (which we
did as a slave for an inode that we exported away). Clean up the
record of these xlocks for inodes before we get into the request
cleanup (at which point we are labeled as no-longer-auth, and the
standard cleanup routines will break).

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-04-18 10:40:10 -07:00
Greg Farnum
5299aabe1c mds: properly drop imported xlocks.
Because we can do an inode import during a rename that skips the usual
channels, we were getting into an odd state with the xlocks (which
were formerly remote and are now local). Clean up the record of
those remote xlocks.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-04-18 10:40:04 -07:00
Greg Farnum
97e357c430 MDS: Server takes auth_pins for xlocks on imported inodes.
Should fix #934.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-04-18 10:36:22 -07:00
Sage Weil
216fd77610 objecter: resub ops on full->nonfull transition
This was broken a while ago during the last refactor.  Whoops!  Clean it
up to be smarter (and work at all).

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-04-18 10:15:07 -07:00
Sage Weil
c966410fab osd: show "full" or "nearfull" in osdmap summary line
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-04-18 09:57:55 -07:00
Sage Weil
879adb6190 Merge remote branch 'origin/stable'
Conflicts:
	src/osdc/Journaler.cc
2011-04-18 09:58:15 -07:00
Yehuda Sadeh
fa7061d2da Merge branch 'rgw_uid' 2011-04-18 09:56:08 -07:00
Yehuda Sadeh
796528c3db rgw: remove get_user_info() and clean up
rename all the get_uid_by_* to get_user_info_by_*, remove get_user_info()
and call the appropriate function instead (either the by_uid or by_access_key).
2011-04-18 08:56:52 -07:00
Yehuda Sadeh
d8fe208d06 rgw: store user info on all indexes in the same format
this breaks backward compatibility, we'll have to deal with that
later.
2011-04-18 08:32:09 -07:00
Yehuda Sadeh
11f1e2ef52 rgw_admin: can lookup user by access key 2011-04-18 08:15:11 -07:00
Sage Weil
d778921888 mount.ceph: behave when CONFIG_KEYS is not compiled in
In that case we get ENOSYS.  This also implies an old version of the client
and that we should fall back.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-04-17 21:58:27 -07:00
Wido den Hollander
d21bdd6e29 radosgw_admin: Update manpage to new syntax
Signed-off-by: Wido den Hollander <wido@widodh.nl>
Signed-off-by: Colin McCabe <cmccabe@alumni.cmu.edu>
2011-04-17 17:42:04 -07:00
Greg Farnum
1eccc019ed MDS: Fix Locker::handle_reqrdlock for xlocked locks.
We previously dropped the request but that was inappropriate for that
one case because the replica has no way to trigger a resend.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2011-04-16 21:04:52 -07:00
Sage Weil
79cac5ee3a mds: Always _open_parents when opening a new snaprealm
Signed-off-by: Sage Weil <sage@newdream.net>
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2011-04-16 21:03:48 -07:00