Commit Graph

28870 Commits

Author SHA1 Message Date
Samuel Just
2bc1e38c1c ReplicatedPG: assert build_push_op succeeds on primary
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:28 -07:00
Samuel Just
aeadecda0e ReplicatedPG.h: remove temp_coll stub
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:28 -07:00
Samuel Just
3290065333 OSD,ReplicatedPG: queue pushes in a op_tp workqueue
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:28 -07:00
Samuel Just
039da62f3e ReplicatedPG: don't proceed to backfill until recovering is empty
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:28 -07:00
Samuel Just
02e5c1fca7 ReplicatedPG: correctly handle backfill
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:28 -07:00
Samuel Just
b06dce3bd1 ReplicatedPG/Backend: fix up recalc_subsets
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:28 -07:00
Samuel Just
6cccef2d8d ReplicatedBackend: wire in start_pushes
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:27 -07:00
Samuel Just
a287167cf8 ReplicatedBackend: handle stats properly
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:27 -07:00
Samuel Just
656d084d00 ReplicatedBackend: track object contexts in Push/PullInfo
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:27 -07:00
Samuel Just
e7a0b23418 ReplicatedBackend: remove priority from Pull/PushInfo
Instead, we'll just nab the priority from the messages.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:27 -07:00
Samuel Just
9e8c3c3d82 ReplicatedPG/Backend: move prep_push and friends to ReplicatedBackend
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:27 -07:00
Samuel Just
3d6eb6ea5a ReplicatedPG: remove pushing/pulling
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:27 -07:00
Samuel Just
31c604225c ReplicatedPG/Backend: handle down pull sources
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:27 -07:00
Samuel Just
4bc0eab151 ReplicatedPG/Backend: split recover_missing out of prepare_pull
Also, move prepare_pull to PGBackend.

Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:27 -07:00
Samuel Just
273ac2b4b8 ReplicatedPG/Backend: shuffle over submit_push_*/build_push_op
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:27 -07:00
Samuel Just
fea30f5bea ReplicatedPG/Backend: move over send_pushes/send_pulls/prep_push_op_blank
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:26 -07:00
Samuel Just
c1c2debdb9 ReplicatedPG/Backend: move over _failed_push
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:26 -07:00
Samuel Just
f9810797af ReplicatedPG/Backend: move handle_*
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:26 -07:00
Samuel Just
666a316d5a ReplicatedPG/Backend: shuffle do_pull/do_push_reply
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:26 -07:00
Samuel Just
3e7347222c ReplicatedPG/Backend: move _do_push,_do_pull_response,do_push
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:26 -07:00
Samuel Just
8daaeba3f5 ReplicatedPG/Backend: convert sub_op_pull
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:26 -07:00
Samuel Just
0e16230fd7 ReplicatedPG: make log_subop_stats static
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:26 -07:00
Samuel Just
d53fc899eb ReplicatedPG/Backend: shuffle sub_op_push_reply
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:26 -07:00
Samuel Just
8d447be1c8 ReplicatedPG/Backend: shuffle sub_op_push over to ReplicatedBackend
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:25 -07:00
Samuel Just
087f708ba0 osd/: allow dout for ReplicatedBackend methods to work in ReplicatedPG.cc
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:25 -07:00
Samuel Just
7da308bba0 ReplicatedPG: extract PGBackend::Listener recovery callbacks
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:25 -07:00
Samuel Just
3148b12141 PG,ReplicatedPG: handle do_request in ReplicatedPG,PGBackend
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:25 -07:00
Samuel Just
30ac934e22 ReplicatedPG: pass on dump_recovery_info to PGBackend
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:25 -07:00
Samuel Just
138ccbee73 OSD,ReplicatedPG: let PGBackend handle the temp collection
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:25 -07:00
Samuel Just
62a1eb6f69 osd/: add PGBackend interfaces and stubs
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:25 -07:00
Samuel Just
f94e6a30a7 ReplicatedPG: Allow get_object_context caller to provide attributes
This will be used by PGBackend implementers to get the SnapSet
and ObjectInfo for newly recovered objects on the primary.

get_object_context may be called on a missing object for a lost_revert

Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:24:17 -07:00
Samuel Just
5b7fa6272a ReplicatedPG: send_push is unused
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:21:15 -07:00
Samuel Just
de4cc8717e FileStore: ping tphandle between each operation within a transaction
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:21:15 -07:00
Samuel Just
5f44a949ef WorkQueue: add a workqueue which simply runs queued GenContexts
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-26 11:21:11 -07:00
Samuel Just
fde0f864a6 Context: add GenContext templated on the callback argument
Signed-off-by: Samuel Just <sam.just@inktank.com>
2013-09-25 19:18:42 -07:00
Sage Weil
52c7f27963 Merge pull request #640 from ceph/wip-mon-pgmap
fix mon crash when osdmap and pgmap aren't yet synced

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-09-25 16:08:05 -07:00
Sage Weil
4d8f78bc65 mon/PGMonitor: fix segfault when osdmap and pgmap stats are out of sync
The leader mon is responsible for propagating changes in the osdmap
into the pgmap (e.g., when a pool or osd goes away).  If that hasn't
happened yet, the pg_map map will be out of sync with the current set
of pools.  We shouldn't crash.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-25 15:47:39 -07:00
Sage Weil
aead63cf0b Merge pull request #637 from dachary/master
mailmap: add Matthew Roy, Matthew Wodrich
2013-09-25 15:39:22 -07:00
Sage Weil
9a9e4ca284 Merge pull request #639 from ceph/wip-gtest
Makefile: don't use srcdir in TESTS

Reviewed-by: Roald J. van Loon <roaldvanloon@gmail.com>
2013-09-25 15:39:01 -07:00
Sage Weil
479936806e Makefile: don't use srcdir in TESTS
src/Makefile-env.am:31: error: using '$(srcdir)' in TESTS is currently broken: '$(srcdir)/unittest_bufferlist.sh'
src/Makefile.am:1:   'src/Makefile-env.am' included from here
src/Makefile-env.am:31: error: using '$(srcdir)' in TESTS is currently broken: '$(srcdir)/test/encoding/check-generated.sh'
src/Makefile.am:1:   'src/Makefile-env.am' included from here

on my (raring) laptop.

Signed-off-by: Sage Weil <sage@inktank.com>
2013-09-25 13:37:13 -07:00
Loic Dachary
7bbadf1959 mailmap: add Matthew Roy, Matthew Wodrich
Signed-off-by: Loic Dachary <loic@dachary.org>
2013-09-25 19:46:27 +02:00
Sage Weil
60d541d36d Merge pull request #615 from dachary/wip-jerasure-copy
ErasureCode: get rid of extra copy when encoding

Reviewed-by: Sage Weil <sage@inktank.com>
2013-09-25 09:31:58 -07:00
Sage Weil
cea343d078 Merge pull request #634 from dachary/master
git: consolidate mails in commit logs

Reviewed-by: Sage Weil <sage@inktank.com>
2013-09-25 09:23:48 -07:00
Sage Weil
81e571fb95 Merge pull request #636 from dachary/wip-get_command_description
autoconf: remove get_command_descriptions  dependency to gtest

Reviewed-by: Sage Weil <sage@inktank.com>
2013-09-25 09:23:21 -07:00
Loic Dachary
812234cb09 ErasureCode: get rid of extra copy when encoding
The substr_of bufferlist method is used to reduce the copies to the
strict minimum. It is both able to split bufferptr when they are larger
than a chunk and to concatenate them when they are smaller.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-09-25 16:26:49 +02:00
Loic Dachary
2422b2aefb autoconf: remove get_command_descriptions dependency to gtest
It is not required and a leftover of the time when it was a unit test
which was a mistake to begin with. It has been reported to create
dependencies problems in some cases, when gest is not available at the
time get_command_descriptions is compiled.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-09-25 14:11:19 +02:00
Loic Dachary
04c7207aaa git: consolidate mails in commit logs
Map duplicate mails / names in commit logs to a single canonical names.
Useful to report to management with git shortlog -nes

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-09-25 08:07:57 +02:00
Sage Weil
952b39d4c4 Merge remote-tracking branch 'gh/next'
Conflicts:
	src/osd/ReplicatedPG.cc
2013-09-24 21:46:47 -07:00
David Zafman
c9e7e2f750 Merge pull request #633 from ceph/wip-repop-leaks
fix a copule of leaks of RepGather structs

Reviewed-by: David Zafman <david.zafman@inktank.com>
2013-09-24 15:39:26 -07:00
John Wilkins
ac0faaa359 doc: Removed service ops language and added reference to operations.
fixes: #6374

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2013-09-24 15:26:35 -07:00