Commit Graph

19268 Commits

Author SHA1 Message Date
John Wilkins
33dc4c2636 The new files contain S3 APIs and a build from source doc.
Signed-off-by: John Wilkins <john.wilkins@dreamhost.com>
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
9b487571e6 Minor cleanup.
Signed off by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
f8b00f3ebe Added a new landing page graphic, and made some minor edits on the landing page.
Submitted by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
d7922e0d7b Removed some files for reorg.
Submitted by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
9f9b7f884f Added a plug for commercial support. ;)
Submitted by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
859da18e5e Building out information architecture. Modified getting involved, why use ceph, etc.
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
bc857d8696 Remove reference to Introduction to RADOS OSDs
Submitted by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
b0ee6e87d3 Added introduction to clustered storage and deleted older files that have been moved.
Submitted by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
541a875cba Restructuring documentation.
Submitted by: John Wilkins <john.wilkins@dreamhost.com>

Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:55 -07:00
John Wilkins
a1b31ddfda Initial cut of introduction, getting started, and installing. More to do on installation. RADOS gateway to follow.
Signed-off-by: John Wilkins <john.wilkins@dreamhost.com>
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 12:09:54 -07:00
John Wilkins
d3a2c56566 doc: move documentation build instructions to doc/dev section
Signed-off-by: John Wilkins <john.wilkins@dreamhost.com>
Signed-off-by: Tommi Virtanen <tommi.virtanen@dreamhost.com>
2012-05-02 11:21:12 -07:00
Dan Mick
ee26c5d73a Treat rename across pools as an error
Fixes: #2370
Reviewed-by: Samuel Just <samuel.just@dreamhost.com>
2012-05-01 20:08:00 -07:00
Greg Farnum
2a93258ae8 doc: add warning about multiple monitors on one machine.
Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-05-01 16:40:46 -07:00
Yehuda Sadeh
b41f4d14aa rgw: normalize bucket/obj before updating cache
Fixes bug #2369. The problem was that sometimes we send the
notification with the un-normalized bucket/obj pair. We
should make sure that we use the caonical name before doing
any cache update.

Signed-off-by: Yehuda Sadeh <yehuda@hq.newdream.net>
2012-05-01 16:47:32 -07:00
Samuel Just
bb7e5da322 PG: Add probe set to HB peers during GetInfo
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2012-05-01 13:12:05 -07:00
Samuel Just
b9a54b4431 PG: check_new_interval now handles adding new maps to past intervals
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2012-05-01 13:12:05 -07:00
Sage Weil
06fd0b68f6 filestore: allow flusher+sync_flush enable/disable via injectargs
This only affects the decision to queue or do things inline, so it is safe
to change while the filestore is up and running.

Also adjust the #ifdef so that there we share a single path through the
code when sync_file_range() is missing.

Fixes: #2368
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 12:37:20 -07:00
Sage Weil
342e76fb33 filestore: fix op_queue_{len,bytes} instrumentation
(re)set these in logger when they actually change.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 11:30:53 -07:00
Sage Weil
81d2f8887e Merge branch 'wip-throttle'
Reviewed-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-05-01 10:49:36 -07:00
Sage Weil
274cd0c60c throttle: count get_or_fail success/failure explicitly
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 10:47:05 -07:00
Sage Weil
81f51d28d6 osd: pg creation calc_priors_during() should count primary as up
If only want to include down osds if *all* of the prior acting osds are
down.  If osd->whoami is one of them, then we're okay.

For example, if osd.13 is down, then the below should be satisfied that
osd.14 (osd->whoami) is alive:

2012-04-27 10:46:38.746681 7f5258a63700 15 osd.14 27 calc_priors_during 6.5 [9,25)
2012-04-27 10:46:38.746688 7f5258a63700 20 osd.14 27   6.5 in epoch 9 was [13,14]
2012-04-27 10:46:38.746695 7f5258a63700 20 osd.14 27   6.5 in epoch 10 was [13,14]
2012-04-27 10:46:38.746701 7f5258a63700 20 osd.14 27   6.5 in epoch 11 was [13,14]
2012-04-27 10:46:38.746709 7f5258a63700 20 osd.14 27   6.5 in epoch 12 was [13,14]
2012-04-27 10:46:38.746715 7f5258a63700 20 osd.14 27   6.5 in epoch 13 was [13,14]
2012-04-27 10:46:38.746722 7f5258a63700 20 osd.14 27   6.5 in epoch 14 was [13,14]
2012-04-27 10:46:38.746729 7f5258a63700 20 osd.14 27   6.5 in epoch 15 was [14]
2012-04-27 10:46:38.746735 7f5258a63700 20 osd.14 27   6.5 in epoch 16 was [14]
2012-04-27 10:46:38.746742 7f5258a63700 20 osd.14 27   6.5 in epoch 17 was [14]
2012-04-27 10:46:38.746748 7f5258a63700 20 osd.14 27   6.5 in epoch 18 was [13,14]
2012-04-27 10:46:38.746755 7f5258a63700 20 osd.14 27   6.5 in epoch 19 was [13,14]
2012-04-27 10:46:38.746762 7f5258a63700 20 osd.14 27   6.5 in epoch 20 was [13,14]
2012-04-27 10:46:38.746768 7f5258a63700 20 osd.14 27   6.5 in epoch 21 was [13,14]
2012-04-27 10:46:38.746775 7f5258a63700 20 osd.14 27   6.5 in epoch 22 was [14]
2012-04-27 10:46:38.746781 7f5258a63700 20 osd.14 27   6.5 in epoch 23 was [14]
2012-04-27 10:46:38.746788 7f5258a63700 20 osd.14 27   6.5 in epoch 24 was [14]
2012-04-27 10:46:38.746790 7f5258a63700 10 osd.14 27 calc_priors_during 6.5 [9,25) = 13

In that case, it wasn't, and the pg creation was blocked.

Fixes: #2355
Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 10:39:09 -07:00
Sage Weil
75a107cbfa throttle: note current value and max in perfcounters
This exposes a snapshot of the current Throttle value and limit.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-05-01 09:10:52 -07:00
Sage Weil
1acdc579d9 .gitignore: ceph-kdump-copy
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-30 19:16:28 -07:00
Sage Weil
627761f87c Merge remote-tracking branch 'gh/wip-ceph-kdump-copy' 2012-04-30 17:27:47 -07:00
Greg Farnum
18790b1f33 osd: add is_unmanaged_snaps_mode() to pg_pool_t; use more consistently
Create an is_unmanaged_snaps_mode() function to parallel
is_pool_snaps_mode(), and replace all the checks directly referencing
removed_snaps or snaps with calls to these functions.
Fixes #2345.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-04-30 17:24:35 -07:00
Greg Farnum
22bd5dfa25 pick_address: don't bother checking struct ifaddrs which have a null ifa_addr
I assume that's the localhost interface or similar.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-04-30 17:24:03 -07:00
Sage Weil
f415018453 Merge remote-tracking branch 'gh/wip-2352'
Reviewed-by: Sage Weil <sage@newdream.net>
2012-04-30 17:22:52 -07:00
Sage Weil
292ff7fdfe msgr: include msgr name in dispatch_throttler name
Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-30 16:33:08 -07:00
Sage Weil
be6a9a6c1f msgr: name messengers
Give each Messenger a logical name describing its role.  For instance, the
OSD will have client, cluster, and heartbeat messengers.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-30 16:31:21 -07:00
Sage Weil
36ac4524d2 throttle: report stats via perfcounter
Fixes: #2358
Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-30 16:25:46 -07:00
Greg Farnum
ccfb6b3a86 global_init: don't fail out if there is no default config.
There are plenty of scenarios where the user doesn't need a config file.
Instead, just print a warning and let things move on.

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-04-30 15:06:17 -07:00
Greg Farnum
845718d9fb global: fix incorrect CINIT flag.
There is nobody responding to CLOSE_STDERR, but this block sure looks
like it should be doing so. Fix that!

Signed-off-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-04-30 14:10:35 -07:00
Sage Weil
f3771b0e52 throttle: feed cct, name, and add logging
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
Reviewed-by: Greg Farnum <gregory.farnum@dreamhost.com>
2012-04-30 13:55:05 -07:00
Sage Weil
29de435d1a v0.46
-----BEGIN PGP SIGNATURE-----
 Version: GnuPG v1.4.11 (GNU/Linux)
 
 iEYEABECAAYFAk+e0icACgkQ2kQg7SiJlchzQQCg3LDTO1MMrMoqaffjd0oNjBPr
 I6MAn3TQSkm0zWRO+pLnqKX0Qw/YOwhE
 =k5Px
 -----END PGP SIGNATURE-----

Merge tag 'v0.46'

v0.46
2012-04-30 13:54:29 -07:00
Sage Weil
74138288d7 osdmap: do no dereference NULL entity_addr_t pointer in addr accessors
These may be NULL if we expand the addr vectors but haven't ever stored an
address yet.  Check for NULL and return a reference to a blank
entity_addr_t as needed.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-30 13:37:55 -07:00
Samuel Just
4c597fa45b OSD: add different config options for map bl caches
Signed-off-by: Samuel Just <samuel.just@dreamhost.com>
2012-04-30 11:13:02 -07:00
Sage Weil
cefaa7d372 mon: fix nion -> noin typo
Thanks Greg!

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-30 11:12:59 -07:00
Sage Weil
05bbe1415b Merge branch 'wip-pi'
Reviewed-by: Samuel Just <samuel.just@dreamhost.com>
2012-04-30 11:12:26 -07:00
Sage Weil
cb7f1c9c75 v0.46 2012-04-30 10:55:45 -07:00
Josh Durgin
88dda3be5a librbd: use unique error code for image removal failures
This allows the rbd tool to provide a useful error message, instead of
compounding more possible causes into one error code.

Signed-off-by: Josh Durgin <josh.durgin@dreamhost.com>
2012-04-30 10:55:45 -07:00
Sage Weil
580b5203c6 run_xfstests.sh: drop #62
Until #2359 is resolved.

Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-30 09:48:27 -07:00
Sage Weil
4465c3ab74 osdmap: fix identify_osd() and find_osd_on_ip()
In 313c1566d3 we switched to using the
get_addr() accessor methods, which assert that the osd exists.  Check that
before calling.

Fixes: #2361
Signed-off-by: Sage Weil <sage@newdream.net>
2012-04-29 10:10:41 -07:00
Sage Weil
d64e1b9740 osd: keep pgs locked during handle_osd_map dance
Currently we drop and retake locks during handle_osd_map calls to
advance_map and activate_map.  Instead, take them all once, and hold them.
This avoids leaving dirty in-core state in the PG without the lock held.

This will clearly go away as soon as the map threading stuff is redone.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-29 09:03:24 -07:00
Sage Weil
4ae857cb12 mon: drop obsolete osd/PG.h #includes
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-29 09:03:23 -07:00
Sage Weil
d48549d5b9 osd: set dirty flags on rewind_divergent_log
Make sure we record any rewind_divergent_log.  In the activate case, this
will happen anyway, but mark it dirty here for correctness/completeness.

The merge_log case might be a bug.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-29 08:11:25 -07:00
Sage Weil
f750c3f46b osd: use dirty flags in activate(), merge_log()
These are all called from within the state machine, so we can simply set
the dirty flags.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-29 08:11:25 -07:00
Sage Weil
36b02575eb osd: fix nested transaction in all_activated_and_committed()
all_activated_and_committed() is called from _activate_committed(), called
from a objectstore completion, and also from the state machine, which is
part of a larger transaction.

Instead, set dirty_info, and build/apply a transaction in the caller
(the completion) as needed.  Fixes part of #2360.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-29 08:11:25 -07:00
Sage Weil
3e84ce862e osd: use PG::write_if_dirty() helper
Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-29 08:11:24 -07:00
Sage Weil
fc8ce16a84 osd: do not merge history on query
We shouldn't modify the local notion of the history without recording it to
disk.  And we (probably) also don't need to do that at all on query.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-28 22:32:08 -07:00
Sage Weil
ff9bce9724 osd: dirty_info if history.merge updated anything
In proc_replica_info and proc_primary_info, we may or may not update
the pg_info_t.  If we do, set dirty_info, so that it will be recorded.
Same goes for when the primary pushes out updated stats to us.

Also, do not write a purged_snaps() update directory; rely on the caller
to write out dirty info.

Signed-off-by: Sage Weil <sage.weil@dreamhost.com>
2012-04-28 22:31:23 -07:00