Commit Graph

19345 Commits

Author SHA1 Message Date
Sage Weil
ce5842b60b crushtool: add --update-item command
Similar to --add-item, except it will move, rename, or reweight the item if
it is already present in the map.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-02 14:55:53 -07:00
Sage Weil
5aadb57833 crush: do some docs
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-02 14:55:53 -07:00
Sage Weil
8220ab251b crush: implement update_item()
This is similar to insert_item(), except it will succeed if the item is
already there, and will move an item to the specified location if it is
not.  It returns 0 for no change, 1 if a chance was made.  It also makes
sure the weight and name match.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-02 14:55:53 -07:00
Sage Weil
bfa7635162 crush: add check_item_loc
The check_item_loc() method will take an item and position and tell you if
it matches the items current location.  The matching is identical to that
used for insert_item, in that a specific location constraint match means
success, even if a less specific one does not match (e.g., rack=wrongrack,
host=correcthost will return true).

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-02 14:55:53 -07:00
Sage Weil
eca7eac34a crush: fix weights when removing items
Reweight an item to 0 before removing it, so that the parent weights are
adjusted accordingly.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-02 14:55:53 -07:00
Josh Durgin
76d166f9d1 rbd.py: add new error for deleting an image with snapshots
Forgot to update the python bindings in
88dda3be5a

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2012-05-02 13:59:15 -07:00
Sage Weil
e20cd4baf9 config: no -C shorthand for --cluster
ceph-authtool uses it!

Fixes: #2376
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-02 13:32:05 -07:00
John Wilkins
ec9977509c Edits.
Signed-off-by: John Wilkins <john.wilkins@dreamhost.com>
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:56 -07:00
John Wilkins
0fb0ef9ee3 Corrections.
Signed-off-by: John Wilkins <john.wilkins@dreamhost.com>
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:56 -07:00
John Wilkins
ee44db4a51 Significant updates to introduction, getting packages, building from source, installing packages, and creating a cluster.
Signed-off-by: John Wilkins <john.wilkins@dreamhost.com>
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:56 -07:00
Sage Weil
4cd44ecc84 doc: document NOIN, NOOUT, NOUP, NODOWN flags and flapping
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:56 -07:00
John Wilkins
7d501fcd2a Removed this. As part of restructuring of install to include admin host.
Signed-off-by: John Wilkins <john.wilkins@dreamhost.com>
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:56 -07:00
John Wilkins
f53c8206f8 Minor edits. Still WIP.
Signed-off-by: John Wilkins <john.wilkins@dreamhost.com>
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:56 -07:00
John Wilkins
33dc4c2636 The new files contain S3 APIs and a build from source doc.
Signed-off-by: John Wilkins <john.wilkins@dreamhost.com>
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
9b487571e6 Minor cleanup.
Signed off by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
f8b00f3ebe Added a new landing page graphic, and made some minor edits on the landing page.
Submitted by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
d7922e0d7b Removed some files for reorg.
Submitted by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
9f9b7f884f Added a plug for commercial support. ;)
Submitted by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
859da18e5e Building out information architecture. Modified getting involved, why use ceph, etc.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
bc857d8696 Remove reference to Introduction to RADOS OSDs
Submitted by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
b0ee6e87d3 Added introduction to clustered storage and deleted older files that have been moved.
Submitted by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
541a875cba Restructuring documentation.
Submitted by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
a1b31ddfda Initial cut of introduction, getting started, and installing. More to do on installation. RADOS gateway to follow.
Signed-off-by: John Wilkins <john.wilkins@dreamhost.com>
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:54 -07:00
Dan Mick
31fb8f97b6 Put change to rbd manpage in .rst instead, update man/ from output 2012-05-02 11:46:32 -07:00
John Wilkins
d3a2c56566 doc: move documentation build instructions to doc/dev section
Signed-off-by: John Wilkins <john.wilkins@dreamhost.com>
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 11:21:12 -07:00
Dan Mick
ee26c5d73a Treat rename across pools as an error
Fixes: #2370
Reviewed-by: Samuel Just <samuel.just@dreamhost.com>
2012-05-01 20:08:00 -07:00
Greg Farnum
2a93258ae8 doc: add warning about multiple monitors on one machine.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-05-01 16:40:46 -07:00
Yehuda Sadeh
b41f4d14aa rgw: normalize bucket/obj before updating cache
Fixes bug #2369. The problem was that sometimes we send the
notification with the un-normalized bucket/obj pair. We
should make sure that we use the caonical name before doing
any cache update.

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-05-01 16:47:32 -07:00
Sage Weil
695d3775c2 vstart.sh: explicitly specify uuids during startup
This exercises all the new per-osd uuid code.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 16:20:59 -07:00
Sage Weil
09e08287da osd: --get-{osd,journal}-uuid synonyms for --get-{osd,journal}-fsid
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 16:16:56 -07:00
Sage Weil
5a2fe979e1 osd: allow uuid to be fed to mkfs with 'osd uuid' setting
E.g., ceph-osd --mkfs --osd-uuid <uuid> -i 123 ...

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 16:16:32 -07:00
Sage Weil
8ec39205b3 filestore: allow fsid to be fed in for mkfs
Mkfs currently always generates a new uuid.  Allow the caller to feed one
in.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 16:15:45 -07:00
Sage Weil
779914ba5c mon: 'osd create <uuid>'
Make the osd create command idempotent by providing a uuid.  If you call it
multiple times with the same (or some other existing) uuid you'll get back
the osd id that is already using it.

Drop support for 'osd create <id>', which was mostly useless and
non-idempotent anyway.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 16:14:20 -07:00
Sage Weil
78b9ccd371 mon: fill in osd uuid in map on boot
We may want to make this more strict, so that if it is defined it has to
match the map, and only fill it in when the map's uuid is still zeroed
(for legacy clusters)...

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 16:13:12 -07:00
Sage Weil
ca4311e5e3 osdmap: store a uuid for each osd
Rev the extended section of the map to store it.  Dump it when the osd
exists.  Zero it out if an osd is destroyed.  Provide some accessors to
identify an osd given a uuid (linear search).

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 16:12:02 -07:00
Sage Weil
c3fb68ee1b osd: make output less ugly
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 13:48:43 -07:00
Sage Weil
4d095e9549 osd: create a 'ready' file on mkfs completion
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 13:47:27 -07:00
Sage Weil
29399eec5f osd: use fsync+rename when writing meta files (during mkfs)
It's overkill to do the dir fsync on each file, but not worth making
efficient.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 13:46:01 -07:00
Samuel Just
bb7e5da322 PG: Add probe set to HB peers during GetInfo
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2012-05-01 13:12:05 -07:00
Samuel Just
b9a54b4431 PG: check_new_interval now handles adding new maps to past intervals
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2012-05-01 13:12:05 -07:00
Sage Weil
06fd0b68f6 filestore: allow flusher+sync_flush enable/disable via injectargs
This only affects the decision to queue or do things inline, so it is safe
to change while the filestore is up and running.

Also adjust the #ifdef so that there we share a single path through the
code when sync_file_range() is missing.

Fixes: #2368
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 12:37:20 -07:00
Sage Weil
342e76fb33 filestore: fix op_queue_{len,bytes} instrumentation
(re)set these in logger when they actually change.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 11:30:53 -07:00
Sage Weil
81d2f8887e Merge branch 'wip-throttle'
Reviewed-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-05-01 10:49:36 -07:00
Sage Weil
274cd0c60c throttle: count get_or_fail success/failure explicitly
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 10:47:05 -07:00
Sage Weil
81f51d28d6 osd: pg creation calc_priors_during() should count primary as up
If only want to include down osds if *all* of the prior acting osds are
down.  If osd->whoami is one of them, then we're okay.

For example, if osd.13 is down, then the below should be satisfied that
osd.14 (osd->whoami) is alive:

2012-04-27 10:46:38.746681 7f5258a63700 15 osd.14 27 calc_priors_during 6.5 [9,25)
2012-04-27 10:46:38.746688 7f5258a63700 20 osd.14 27   6.5 in epoch 9 was [13,14]
2012-04-27 10:46:38.746695 7f5258a63700 20 osd.14 27   6.5 in epoch 10 was [13,14]
2012-04-27 10:46:38.746701 7f5258a63700 20 osd.14 27   6.5 in epoch 11 was [13,14]
2012-04-27 10:46:38.746709 7f5258a63700 20 osd.14 27   6.5 in epoch 12 was [13,14]
2012-04-27 10:46:38.746715 7f5258a63700 20 osd.14 27   6.5 in epoch 13 was [13,14]
2012-04-27 10:46:38.746722 7f5258a63700 20 osd.14 27   6.5 in epoch 14 was [13,14]
2012-04-27 10:46:38.746729 7f5258a63700 20 osd.14 27   6.5 in epoch 15 was [14]
2012-04-27 10:46:38.746735 7f5258a63700 20 osd.14 27   6.5 in epoch 16 was [14]
2012-04-27 10:46:38.746742 7f5258a63700 20 osd.14 27   6.5 in epoch 17 was [14]
2012-04-27 10:46:38.746748 7f5258a63700 20 osd.14 27   6.5 in epoch 18 was [13,14]
2012-04-27 10:46:38.746755 7f5258a63700 20 osd.14 27   6.5 in epoch 19 was [13,14]
2012-04-27 10:46:38.746762 7f5258a63700 20 osd.14 27   6.5 in epoch 20 was [13,14]
2012-04-27 10:46:38.746768 7f5258a63700 20 osd.14 27   6.5 in epoch 21 was [13,14]
2012-04-27 10:46:38.746775 7f5258a63700 20 osd.14 27   6.5 in epoch 22 was [14]
2012-04-27 10:46:38.746781 7f5258a63700 20 osd.14 27   6.5 in epoch 23 was [14]
2012-04-27 10:46:38.746788 7f5258a63700 20 osd.14 27   6.5 in epoch 24 was [14]
2012-04-27 10:46:38.746790 7f5258a63700 10 osd.14 27 calc_priors_during 6.5 [9,25) = 13

In that case, it wasn't, and the pg creation was blocked.

Fixes: #2355
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 10:39:09 -07:00
Sage Weil
75a107cbfa throttle: note current value and max in perfcounters
This exposes a snapshot of the current Throttle value and limit.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 09:10:52 -07:00
Sage Weil
1acdc579d9 .gitignore: ceph-kdump-copy
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-30 19:16:28 -07:00
Sage Weil
627761f87c Merge remote-tracking branch 'gh/wip-ceph-kdump-copy' 2012-04-30 17:27:47 -07:00
Greg Farnum
18790b1f33 osd: add is_unmanaged_snaps_mode() to pg_pool_t; use more consistently
Create an is_unmanaged_snaps_mode() function to parallel
is_pool_snaps_mode(), and replace all the checks directly referencing
removed_snaps or snaps with calls to these functions.
Fixes #2345.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-04-30 17:24:35 -07:00
Greg Farnum
22bd5dfa25 pick_address: don't bother checking struct ifaddrs which have a null ifa_addr
I assume that's the localhost interface or similar.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-04-30 17:24:03 -07:00