mirror of
https://github.com/ceph/ceph
synced 2024-12-09 13:08:28 +00:00
c0dc3a5697
Signed-off-by: Sage Weil <sage@redhat.com>
3267 lines
112 KiB
Plaintext
3267 lines
112 KiB
Plaintext
commit f93610a4421cb670b08e974c6550ee715ac528ae (tag: refs/tags/v0.80.6, refs/remotes/gh/firefly)
|
||
Author: Jenkins <jenkins@inktank.com>
|
||
Date: Wed Oct 1 09:37:12 2014 -0700
|
||
|
||
0.80.6
|
||
|
||
commit 2ecf362e15301ee07b511b2a84585ad691543569
|
||
Merge: 1fafd6b 76341b0
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Mon Sep 29 13:55:02 2014 -0700
|
||
|
||
Merge pull request #2603 from dachary/wip-9620-test-mon-thrash-firefly
|
||
|
||
qa/workunits/cephtool/test.sh: fix thrash (ultimate)
|
||
|
||
Reviewed-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit 76341b0b7581194273ac787df2b940221825d083
|
||
Author: Loic Dachary <loic-201408@dachary.org>
|
||
Date: Mon Sep 29 13:47:06 2014 +0200
|
||
|
||
qa/workunits/cephtool/test.sh: fix thrash (ultimate)
|
||
|
||
Keep the osd trash test to ensure it is a valid command but make it a
|
||
noop by giving it a zero argument (meaning thrash 0 OSD maps).
|
||
|
||
Remove the loops that were added after the command in an attempt to wait
|
||
for the cluster to recover and not pollute the rest of the tests. Actual
|
||
testing of osd thrash would require a dedicated cluster because it the
|
||
side effects are random and it is unnecessarily difficult to ensure they
|
||
are finished.
|
||
|
||
http://tracker.ceph.com/issues/9620 Fixes: #9620
|
||
|
||
Signed-off-by: Loic Dachary <loic-201408@dachary.org>
|
||
(cherry picked from commit beade63a17db2e6fc68d1f55332d602f8f7cb93a)
|
||
|
||
Conflicts:
|
||
qa/workunits/cephtool/test.sh
|
||
|
||
commit 1fafd6bf2ef03672dfa27ec7a201a274927040b7
|
||
Merge: ebb5995 71005c1
|
||
Author: Josh Durgin <josh.durgin@inktank.com>
|
||
Date: Thu Sep 25 10:08:03 2014 -0700
|
||
|
||
Merge pull request #2576 from ceph/wip-9593
|
||
|
||
osd/ReplicatedPG: fix objecter locking in start_flush
|
||
|
||
Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
|
||
|
||
commit 71005c1bdf38212ea2fde12de08c45598c815d37
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Sep 25 09:59:29 2014 -0700
|
||
|
||
osd/ReplicatedPG: fix objecter locking in start_flush
|
||
|
||
Broken in backport fd96eb62ece27f5c660429584c2ff2e058bc6e94.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit ebb599545d70e4289e385f88b4f0594b4f23f3b7
|
||
Merge: 2abd7a3 2e60c2f
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Sep 23 10:37:27 2014 -0700
|
||
|
||
Merge pull request #2548 from dachary/wip-9547-python-rados-truncate-firefly
|
||
|
||
python radio aio_read must not truncate on \000 (firefly)
|
||
|
||
Reviewed-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit 2abd7a3fd018b52f45f9d6b7c9d847242aa97fe9
|
||
Merge: 2675b0d 80f2f9c
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Sep 23 10:27:15 2014 -0700
|
||
|
||
Merge branch 'wip-sam-testing-firefly' into firefly
|
||
|
||
commit 80f2f9cf687e25d6f2c4cee34fef55215ac6b027
|
||
Merge: bb9e65b e6da732
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Sun Sep 21 10:04:30 2014 -0700
|
||
|
||
Merge remote-tracking branch 'origin/wip-9240' into wip-sam-testing-firefly
|
||
|
||
commit bb9e65bd9292e2ee03a260cc98aa6715008e6682
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Thu Aug 28 15:32:22 2014 -0700
|
||
|
||
PG: wait until we've build the missing set to discover_all_missing
|
||
|
||
Fixes: #9179
|
||
Backport: firefly
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
(cherry picked from commit 970d9830a3a6e8568337c660fb8b4c4a60a2b3bf)
|
||
|
||
Conflicts:
|
||
src/osd/PG.cc
|
||
|
||
commit fa645b21b587b6a1d9adbb9cedce1af3af1e5a62
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Aug 26 16:53:02 2014 -0700
|
||
|
||
PG: mark_log_for_rewrite on resurrection
|
||
|
||
Fixes: #8777
|
||
Backport: firefly
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
(cherry picked from commit 8346e10755027e982f26bab4642334fd91cc31aa)
|
||
|
||
commit fd96eb62ece27f5c660429584c2ff2e058bc6e94
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Sun Sep 7 20:13:41 2014 -0700
|
||
|
||
ReplicatedPG:start_flush send a second delete
|
||
|
||
Suppose we start with the following in the cache pool:
|
||
|
||
30:[29,21,20,15,10,4]:[22(21), 15(15,10), 4(4)]+head
|
||
|
||
The object doesn't exist at 29 or 20.
|
||
|
||
First, we flush 4 leaving the backing pool with:
|
||
|
||
3:[]+head
|
||
|
||
Then, we begin to flush 15 with a delete with snapc 4:[4] leaving the
|
||
backing pool with:
|
||
|
||
4:[4]:[4(4)]
|
||
|
||
Then, we finish flushing 15 with snapc 9:[4] with leaving the backing
|
||
pool with:
|
||
|
||
9:[4]:[4(4)]+head
|
||
|
||
Next, snaps 10 and 15 are removed causing clone 10 to be removed leaving
|
||
the cache with:
|
||
|
||
30:[29,21,20,4]:[22(21),4(4)]+head
|
||
|
||
We next begin to flush 22 by sending a delete with snapc 4(4) since
|
||
prev_snapc is 4 <---------- here is the bug
|
||
|
||
The backing pool ignores this request since 4 < 9 (ORDERSNAP) leaving it
|
||
with:
|
||
|
||
9:[4]:[4(4)]
|
||
|
||
Then, we complete flushing 22 with snapc 19:[4] leaving the backing pool
|
||
with:
|
||
|
||
19:[4]:[4(4)]+head
|
||
|
||
Then, we begin to flush head by deleting with snapc 22:[21,20,4] leaving
|
||
the backing pool with:
|
||
|
||
22[21,20,4]:[22(21,20), 4(4)]
|
||
|
||
Finally, we flush head leaving the backing pool with:
|
||
|
||
30:[29,21,20,4]:[22(21*,20*),4(4)]+head
|
||
|
||
When we go to flush clone 22, all we know is that 22 is dirty, has snaps
|
||
[21], and 4 is clean. As part of flushing 22, we need to do two things:
|
||
1) Ensure that the current head is cloned as cloneid 4 with snaps [4] by
|
||
sending a delete at snapc 4:[4].
|
||
2) Flush the data at snap sequence < 21 by sending a copyfrom with snapc
|
||
20:[20,4].
|
||
|
||
Unfortunately, it is possible that 1, 1&2, or 1 and part of the flush
|
||
process for some other now non-existent clone have already been
|
||
performed. Because of that, between 1) and 2), we need to send
|
||
a second delete ensuring that the object does not exist at 20.
|
||
|
||
Fixes: #9054
|
||
Backport: firefly
|
||
Related: 66c7439ea0888777b5cfc08bcb0fbd7bfd8653c3
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
(cherry picked from commit 4843fd510b33a71999cdf9c2cfa2b4c318fa80fd)
|
||
|
||
commit 5aa35ac262c6e0910f99086f46dd792775ab6790
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Mon Aug 11 12:59:16 2014 -0700
|
||
|
||
ReplicatedPG::start_flush: remove superfluous loop
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
(cherry picked from commit 66c7439ea0888777b5cfc08bcb0fbd7bfd8653c3)
|
||
|
||
commit 14fb643bbda51cc31919197541973c332b0c37bc
|
||
Merge: c468507 3578b11
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Sun Sep 21 10:03:53 2014 -0700
|
||
|
||
Merge remote-tracking branch 'origin/wip-9339' into wip-sam-testing-firefly
|
||
|
||
commit 2e60c2f1ec8c2aaf56b73a64f55becd679dd2825
|
||
Author: Loic Dachary <loic-201408@dachary.org>
|
||
Date: Sat Sep 20 12:41:30 2014 +0200
|
||
|
||
test: check python rados aio_read with buffers containing null
|
||
|
||
http://tracker.ceph.com/issues/9547 Refs: #9547
|
||
|
||
Signed-off-by: Loic Dachary <loic-201408@dachary.org>
|
||
(cherry picked from commit 226c0c7ac6ee95ff2c1665d4e7164e2962c0346e)
|
||
|
||
commit 72a46dec211d5c08d1ca9f969013d939c4361ba9
|
||
Author: Mohammad Salehe <salehe+dev@gmail.com>
|
||
Date: Sun May 25 10:42:11 2014 +0430
|
||
|
||
pybind: Fix aio_read handling of string buffer
|
||
|
||
Read data may contain \0, and buf.value interprerts them as string terminator.
|
||
|
||
Signed-off-by: Mohammad Salehe <salehe+dev@gmail.com>
|
||
(cherry picked from commit 8bda44ff37fd04a0fc9498fbbc22f0daf515d721)
|
||
|
||
commit 2675b0d159ff0608bc6e607be3727ed23e7e2976
|
||
Merge: a67f915 d535fab
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Sep 19 11:30:17 2014 -0700
|
||
|
||
Merge pull request #2535 from dachary/wip-9470-pidfile-firefly
|
||
|
||
daemons: write pid file even when told not to daemonize (firefly)
|
||
|
||
Reviewed-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit d535fab6ac4a025541340ded0d3568f565acf1cd
|
||
Author: Alexandre Oliva <oliva@gnu.org>
|
||
Date: Wed Jul 30 23:08:43 2014 -0300
|
||
|
||
daemons: write pid file even when told not to daemonize
|
||
|
||
systemd wants to run daemons in foreground, but daemons wouldn't write
|
||
out the pid file with -f. Fixed.
|
||
|
||
Signed-off-by: Alexandre Oliva <oliva@gnu.org>
|
||
(cherry picked from commit bccb0eb64891f65fd475e96b6386494044cae8c1)
|
||
|
||
commit c4685075f583ff58cc05220a3044a10b8392033c (refs/remotes/gh/wip-log-crash-firefly)
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Mon Sep 15 15:44:11 2014 -0700
|
||
|
||
PGLog::claim_log_and_clear_rollback_info: fix rollback_info_trimmed_to
|
||
|
||
We have been setting it to the old head value. This is usually
|
||
harmless since the new head will virtually always be ahead of the
|
||
old head for claim_log_and_clear_rollback_info, but can cause trouble
|
||
in some edge cases.
|
||
|
||
Fixes: #9481
|
||
Backport: firefly
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
(cherry picked from commit 0769310ccd4e0dceebd8ea601e8eb5c0928e0603)
|
||
|
||
commit 112f6f021bd063e2647169ba42729a447e5848e1
|
||
Merge: a67f915 92cfd37 07f54f2
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Thu Sep 18 09:46:38 2014 -0700
|
||
|
||
Merge remote-tracking branches 'origin/wip-9497' and 'origin/wip-9482' into wip-log-crash-firefly
|
||
|
||
commit 07f54f28df7429a88dd9243800281ecf23f10036
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Mon Sep 15 16:53:21 2014 -0700
|
||
|
||
PG::find_best_info: let history.last_epoch_started provide a lower bound
|
||
|
||
If we find a info.history.last_epoch_started above any
|
||
info.last_epoch_started, we must be missing updates and
|
||
min_last_update_acceptable should provisionally be max().
|
||
|
||
Fixes: #9482
|
||
Backport: firefly
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit 92cfd370395385ca5537b5bc72220934c9f09026
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Sep 16 20:36:51 2014 -0700
|
||
|
||
PG::choose_acting: let the pg go down if acting is smaller than min_size
|
||
|
||
Even if the backfill peer would bring us up to min_size, we can't go
|
||
active since build_prior will not consider the interval maybe_went_rw.
|
||
|
||
Fixes: #9497
|
||
Backport: firefly
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit a67f9152f128d693d160e5b08f2ac8b8bc83e8e0
|
||
Author: Josh Durgin <josh.durgin@inktank.com>
|
||
Date: Thu Jul 24 15:29:40 2014 -0700
|
||
|
||
librbd: fix crash using clone of flattened image
|
||
|
||
The crash occurs due to ImageCtx->parent->parent being uninitialized,
|
||
since the inital open_parent() -> open_image(parent) ->
|
||
ictx_refresh(parent) occurs before ImageCtx->parent->snap_id is set,
|
||
so refresh_parent() is not called to open an ImageCtx for the parent
|
||
of the parent. This leaves the ImageCtx->parent->parent NULL, but the
|
||
rest of ImageCtx->parent updated to point at the correct parent snapshot.
|
||
|
||
Setting the parent->snap_id earlier has some unintended side effects
|
||
currently, so for now just call refresh_parent() during
|
||
open_parent(). This is the easily backportable version of the
|
||
fix. Further patches can clean up this whole initialization process.
|
||
|
||
Fixes: #8845
|
||
Backport: firefly, dumpling
|
||
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
|
||
(cherry picked from commit 2545e80d274b23b6715f4d8b1f4c6b96182996fb)
|
||
|
||
commit 2422f9fd634c239a1159c99aa4a49cfb5c5d097f
|
||
Author: JuanJose 'JJ' Galvez <jgalvez@redhat.com>
|
||
Date: Sun Sep 14 20:38:20 2014 -0700
|
||
|
||
init-radosgw.sysv: Support systemd for starting the gateway
|
||
|
||
When using RHEL7 the radosgw daemon needs to start under systemd.
|
||
|
||
Check for systemd running on PID 1. If it is then start
|
||
the daemon using: systemd-run -r <cmd>. pidof returns null
|
||
as it is executed too quickly, adding one second of sleep and
|
||
script reports startup correctly.
|
||
|
||
Signed-off-by: JuanJose 'JJ' Galvez <jgalvez@redhat.com>
|
||
(cherry picked from commit ddd52e87b25a6861d3b758a40d8b3693a751dc4d)
|
||
|
||
commit 6070383bc2c433e36f7ab5dc1ec09a3e7439d523
|
||
Merge: 668cd13 7b25512
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Sep 12 17:31:03 2014 -0700
|
||
|
||
Merge pull request #2479 from ceph/wip-9444
|
||
|
||
mds: fix root and mdsdir inodes' rsubdirs
|
||
|
||
Reviewed-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit 7b25512d65c6337cbddc7d6c6f55747ba1591be5
|
||
Author: Yan, Zheng <zheng.z.yan@intel.com>
|
||
Date: Fri May 2 23:08:41 2014 +0800
|
||
|
||
mds: fix root and mdsdir inodes' rsubdirs
|
||
|
||
inode rstat accounts inode itself.
|
||
|
||
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
|
||
(cherry picked from commit da17394941386dab88ddbfed4af2c8cb6b5eb72f)
|
||
|
||
commit 668cd1359c94698bbb4f7b841e2f30264d4af937
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Sep 9 14:03:50 2014 -0700
|
||
|
||
FileStore: report l_os_j_lat as commit latency
|
||
|
||
l_os_commit_lat is actually the commit cycle latency.
|
||
|
||
Fixes: #9269
|
||
Backport: firefly
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
(cherry picked from commit d165238b4ee7e925e06ca22890c1e9dac101a7da)
|
||
|
||
commit 7686966677867d098141aa08f45364eaa97121dd
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Sep 9 12:58:07 2014 -0700
|
||
|
||
Objecter::_recalc_linger_op: resend for any acting set change
|
||
|
||
Fixes: #9220
|
||
Backport: firefly
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
(cherry picked from commit 1349383ac416673cb6df2438729fd2182876a7d1)
|
||
|
||
Conflicts:
|
||
|
||
src/osdc/Objecter.cc
|
||
src/osdc/Objecter.h
|
||
|
||
commit 3abf95456783346e6686919b803c4819d5e82ab7
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Mon Sep 8 13:44:57 2014 -0700
|
||
|
||
osdc/Objecter: revoke rx_buffer on op_cancel
|
||
|
||
If we cancel a read, revoke the rx buffers to avoid a use-after-free and/or
|
||
other undefined badness by using user buffers that may no longer be
|
||
present.
|
||
|
||
Fixes: #9362
|
||
Backport: firefly, dumpling
|
||
Reported-by: Matthias Kiefer <matthias.kiefer@1und1.de>
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 2305b2897acba38384358c33ca3bbfcae6f1c74e)
|
||
|
||
(adjusted for op->con instead of s->con)
|
||
|
||
commit bc4108443a17de47b7c582e50fb884396a287152
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Mon Sep 8 13:45:52 2014 -0700
|
||
|
||
ceph_test_rados_api_io: add read timeout test
|
||
|
||
Verify we don't receive data after a timeout.
|
||
|
||
Based on reproducer for #9362 written by
|
||
Matthias Kiefer <matthias.kiefer@1und1.de>.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit f295c1fee4afb9447cdf46f05a44234274d23b6c)
|
||
|
||
commit 19e7606545f829e5b9ea0255049d9130c51e42fd
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Mon Sep 8 13:42:43 2014 -0700
|
||
|
||
ceph_test_rados_api_*: expose nspace
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 977d289055d69ab8a7baaf7ef68c013019225833)
|
||
|
||
commit 881c267fa4f8257a9205ec897c631183ef5c6388
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Sep 9 12:40:51 2014 -0700
|
||
|
||
Revert "PG: mark_log_for_rewrite on resurrection"
|
||
|
||
Actually, we don't want to backport this one without the fix
|
||
for #9293.
|
||
|
||
This reverts commit 7ddf0a252bb887553b29fd93e58d01cac38835e6.
|
||
|
||
commit 3578b1193d497373db14d040ff7f0fc9e06e5ac2
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Wed Sep 3 15:49:47 2014 -0700
|
||
|
||
ReplicatedPG: create max hitset size
|
||
|
||
Otherwise, hit_set_create could create an unbounded size hitset
|
||
object.
|
||
|
||
Fixes: #9339
|
||
Backport: firefly
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit d73eb895cdc792ddef2626643e61c1521cf53434
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Wed Aug 27 16:21:41 2014 -0700
|
||
|
||
PG::can_discard_op: do discard old subopreplies
|
||
|
||
Otherwise, a sub_op_reply from a previous interval can stick around
|
||
until we either one day go active again and get rid of it or delete the
|
||
pg which is holding it on its waiting_for_active list. While it sticks
|
||
around futily waiting for the pg to once more go active, it will cause
|
||
harmless slow request warnings.
|
||
|
||
Fixes: #9259
|
||
Backport: firefly
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
(cherry picked from commit ae3d87348ca4e2dde809c9593b0d54ce0469f7a0)
|
||
|
||
commit 7ddf0a252bb887553b29fd93e58d01cac38835e6
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Aug 26 16:53:02 2014 -0700
|
||
|
||
PG: mark_log_for_rewrite on resurrection
|
||
|
||
Fixes: #8777
|
||
Backport: firefly
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
(cherry picked from commit 8346e10755027e982f26bab4642334fd91cc31aa)
|
||
|
||
commit 49a08eb46ef277225fff0d9a0920c37427175f54
|
||
Author: Thorsten Glaser <tg@mirbsd.de>
|
||
Date: Mon Sep 8 12:49:50 2014 -0700
|
||
|
||
debian: only B-R yasm on amd64
|
||
|
||
Make yasm dependency amd64 only, it isn?t used elsewhere
|
||
but breaks x32 (which is mis-detected as amd64)
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 9ab46dc5b49219aa6194861c393c938f23001c52)
|
||
|
||
commit f19162adc241e627ce20140360352ac96f809a6e
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Aug 26 17:43:10 2014 -0700
|
||
|
||
osd: fix osd_tp shutdown
|
||
|
||
We need to clear the queue, not just drain the currently executing jobs.
|
||
|
||
Fixes: #9218
|
||
Backport: firefly
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit c2f21c04207b9a2a65e514994a775632b36d6874)
|
||
|
||
Conflicts:
|
||
|
||
src/osd/OSD.cc
|
||
|
||
commit 598cde42e7f57fd0b294f70c0a930f94fd361fb3
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Aug 27 06:19:12 2014 -0700
|
||
|
||
osd/PG: fix crash from second backfill reservation rejection
|
||
|
||
If we get more than one reservation rejection we should ignore them; when
|
||
we got the first we already sent out cancellations. More importantly, we
|
||
should not crash.
|
||
|
||
Fixes: #8863
|
||
Backport: firefly, dumpling
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 2b13de16c522754e30a0a55fb9d072082dac455e)
|
||
|
||
commit 0a9d49e5b5867c58ca1f5c6b9a4c5106639a8d01
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Mon Sep 8 06:58:45 2014 -0700
|
||
|
||
mon/Paxos: don't spam log with is_readable at dout level 1
|
||
|
||
Backport: firefly, dumpling
|
||
Reported-by: Aanchal Agrawal <Aanchal.Agrawal@sandisk.com>
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 62ca27d0b119b597ebad40dde64c4d86599e466d)
|
||
|
||
commit 1660503ffafd69fac3722aea9915008113906e05
|
||
Author: Alfredo Deza <alfredo.deza@inktank.com>
|
||
Date: Thu Sep 4 13:58:14 2014 -0400
|
||
|
||
doc: add note on soft JS dependency for navigating docs
|
||
|
||
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
|
||
(cherry picked from commit 657be818375bea2d8b5998ea1e5505eedc2f294d)
|
||
|
||
commit 2f075d442f58e9cfefdbc421b9b20f2034a56314
|
||
Author: Alfredo Deza <alfredo.deza@inktank.com>
|
||
Date: Wed Sep 3 21:21:45 2014 -0400
|
||
|
||
doc: fix missing bracket
|
||
|
||
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
|
||
(cherry picked from commit 69638dfaeb0dcd96dac4b5f5c00ed08042432487)
|
||
|
||
commit 4dacb593e830f42cd0394486333315f1709b502f
|
||
Author: Alfredo Deza <alfredo.deza@inktank.com>
|
||
Date: Wed Sep 3 20:47:54 2014 -0400
|
||
|
||
doc: attempt to get the ayni JS into all head tags
|
||
|
||
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
|
||
(cherry picked from commit 35663fa55ac1579a3b0c8b67028a3a8dfea87b48)
|
||
|
||
commit 275df4407b37923cb47510890a686ed370e2f39e
|
||
Author: Dmitry Smirnov <onlyjob@member.fsf.org>
|
||
Date: Sat Aug 23 22:41:30 2014 +1000
|
||
|
||
Fix FTBFS on alpha due to incorrect check on BLKGETSIZE
|
||
|
||
Ceph FTBFS on Alpha with:
|
||
|
||
~~~~
|
||
libtool: compile: g++ -DHAVE_CONFIG_H -I. -D__CEPH__ -D_FILE_OFFSET_BITS=64 -D_REENTRANT -D_THREAD_SAFE -D__STDC_FORMAT_MACROS -D_GNU_SOURCE -DCEPH_LIBDIR=\"/usr/lib/alpha-linux-gnu\" -DCEPH_PKGLIBDIR=\"/usr/lib/alpha-linux-gnu/ceph\" -DGTEST_HAS_TR1_TUPLE=0 -D_FORTIFY_SOURCE=2 -I/usr/include/nss -I/usr/include/nspr -Wall -Wtype-limits -Wignored-qualifiers -Winit-self -Wpointer-arith -Werror=format-security -fno-strict-aliasing -fsigned-char -rdynamic -ftemplate-depth-1024 -Wnon-virtual-dtor -Wno-invalid-offsetof -Wstrict-null-sentinel -g -O2 -Wformat -Werror=format-security -c common/blkdev.cc -fPIC -DPIC -o common/.libs/blkdev.o
|
||
In file included from /usr/include/alpha-linux-gnu/asm/ioctls.h:4:0,
|
||
from /usr/include/alpha-linux-gnu/bits/ioctls.h:23,
|
||
from /usr/include/alpha-linux-gnu/sys/ioctl.h:26,
|
||
from common/blkdev.cc:3:
|
||
common/blkdev.cc:13:7: error: missing binary operator before token "int"
|
||
#elif BLKGETSIZE
|
||
^
|
||
~~~~
|
||
|
||
This error occurs because the value of BLKGETSIZE is tested in a
|
||
c-preprocessor conditional compilation test whereas the test should
|
||
be for existence.
|
||
|
||
From: Michael Cree <mcree@orcon.net.nz>
|
||
Bug-Debian: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=756892
|
||
Signed-off-by: Dmitry Smirnov <onlyjob@member.fsf.org>
|
||
(cherry picked from commit 6ad8e61a428cfc9fc60ccdb9bce812e1f49822ac)
|
||
Reviewed-by: Greg Farnum <greg@inktank.com>
|
||
|
||
commit fbbdc31a8cd4c6457e06570ddeb9b2021563498e
|
||
Merge: 46d9611 895bddc
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Aug 29 17:31:29 2014 -0700
|
||
|
||
Merge pull request #2356 from dachary/wip-9273-mon-preload-erasure-code-firefly
|
||
|
||
erasure-code: preload the default plugins in the mon (firefly)
|
||
|
||
Reviewed-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit 46d9611aedd3194cfd55a338e5f94011e6e70668
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Fri Aug 29 20:21:25 2014 +0100
|
||
|
||
osd: OSDMap: ordered blacklist on non-classic encode function
|
||
|
||
Fixes: #9211
|
||
Backport: firefly
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Reviewed-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 81102044f417bd99ca570d9234b1df5195e9a8c9)
|
||
|
||
commit 994a9e35e96984c0806261f7eb349d95c0fb4873
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Aug 26 08:16:29 2014 -0700
|
||
|
||
osd/OSDMap: encode blacklist in deterministic order
|
||
|
||
When we use an unordered_map the encoding order is non-deterministic,
|
||
which is problematic for OSDMap. Construct an ordered map<> on encode
|
||
and use that. This lets us keep the hash table for lookups in the general
|
||
case.
|
||
|
||
Fixes: #9211
|
||
Backport: firefly
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 4672e50922b75d642056020b9745a3a5844424d3)
|
||
|
||
commit 895bddc5d4dabd2f05c13c343eb0d7457d6f132f
|
||
Author: Loic Dachary <loic-201408@dachary.org>
|
||
Date: Fri Aug 29 18:13:08 2014 +0200
|
||
|
||
erasure-code: preload the default plugins in the mon
|
||
|
||
The commit 164f1a1959a863848319585fa752250c7b261381 preloads the
|
||
jerasure plugin in the OSD. They must also be preloaded in the mon for
|
||
the same reasons.
|
||
|
||
http://tracker.ceph.com/issues/9273 Fixes: #9273
|
||
|
||
Signed-off-by: Loic Dachary <loic-201408@dachary.org>
|
||
|
||
commit db8d6e6e190de964ec3d5d1bbc87da2dcb3213f5
|
||
Author: John Spray <john.spray@redhat.com>
|
||
Date: Tue Aug 26 17:36:16 2014 +0100
|
||
|
||
mds: fix FP error in ROUND_UP_TO
|
||
|
||
Explicitly handle case where denominator is 0, instead of
|
||
passing into ROUND_UP_TO.
|
||
|
||
Regression from 9449520b121fc6ce0c64948386d4ff77f46f4f5f
|
||
|
||
Signed-off-by: John Spray <john.spray@redhat.com>
|
||
(cherry picked from commit bf3e4835dabc057982def1b5c9a6499c04ac5312)
|
||
|
||
commit 8e3120fcb379a00d370e4c04d34af35e596e2de9
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Aug 21 11:14:39 2014 -0700
|
||
|
||
mon: generate cluster_fingerprint if null
|
||
|
||
This triggers after an upgrade of a legacy cluster that has no fingerprint.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit b245d600163f6337af15aedd1fea68f4e2a668a8)
|
||
|
||
commit ebcdeb4cfe201dd0c630386226f9970650689ccf
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Aug 20 08:59:46 2014 -0700
|
||
|
||
mon: add a cluster fingerprint
|
||
|
||
Generate it on cluster creations with the initial monmap. Include it in
|
||
the report. Provide no way for this uuid to be fed in to the cluster
|
||
(intentionally or not) so that it can be assumed to be a truly unique
|
||
identifier for the cluster.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 675b0042eff0ad5e1453838410210b1206c39004)
|
||
|
||
commit b3b029165d4ac0af3f2143fad205f4e8ab08a30f
|
||
Merge: 21e1faa 07e1ceb
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Aug 26 13:13:08 2014 -0700
|
||
|
||
Merge pull request #2244 from dachary/wip-9044-use-ruleset-firefly
|
||
|
||
erasure-code: OSDMonitor::crush_ruleset_create_erasure needs ruleset (firefly)
|
||
|
||
commit 21e1faa75da4e9cab8e139a8e2a1c4fc0ee30867
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Aug 12 16:41:38 2014 -0700
|
||
|
||
ReplicatedPG::cancel_copy: clear cop->obc
|
||
|
||
Otherwise, an objecter callback might still be hanging
|
||
onto this reference until after the flush.
|
||
|
||
Fixes: #8894
|
||
Introduced: 589b639af7c8834a1e6293d58d77a9c440107bc3
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
(cherry picked from commit 5040413054e923d6d5a2b4928162dba140d980e0)
|
||
|
||
commit e6da7323655f3bfa4f669fb8361fcaa96f633456
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Aug 26 12:02:52 2014 -0700
|
||
|
||
PG: recover from each osd at most once
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit 8a1723f67f995253c9e6da95ab433743ef23f61c
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Aug 26 11:38:53 2014 -0700
|
||
|
||
PG: make the reservation sets more descriptively named
|
||
|
||
These sets won't precisely be the backfill_targets or actingbackfill
|
||
shortly.
|
||
|
||
%s/sorted_backfill_set/remote_shards_to_reserve_backfill/g
|
||
%s/acting_osd_it/remote_recovery_reservation_it/g
|
||
%s/sorted_actingbackfill_set/remote_shards_to_reserve_recovery/g
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit 938d735697e2af0b01dd2613a9152b3caef5db57
|
||
Merge: 2f11631 9ca451a
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Aug 26 10:30:14 2014 -0700
|
||
|
||
Merge pull request #2203 from ceph/wip-scrub-firefly
|
||
|
||
backport scrub throttling to firefly
|
||
|
||
Reviewed-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit 2f11631f3144f2cc0e04d718e40e716540c8af19
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Sat Aug 16 12:42:33 2014 -0700
|
||
|
||
os/FileStore: fix mount/remount force_sync race
|
||
|
||
Consider:
|
||
|
||
- mount
|
||
- sync_entry is doing some work
|
||
- umount
|
||
- set force_sync = true
|
||
- set done = true
|
||
- sync_entry exits (due to done)
|
||
- ..but does not set force_sync = false
|
||
- mount
|
||
- journal replay starts
|
||
- sync_entry sees force_sync and does a commit while op_seq == 0
|
||
...crash...
|
||
|
||
Fixes: #9144
|
||
Backport: firefly, dumpling
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit dd11042f969b94f7a461d02e1475794031c79f61)
|
||
|
||
Conflicts:
|
||
src/os/FileStore.cc
|
||
|
||
commit a38cf1bd503a09843d439f65937e7d60aed163e2
|
||
Author: Haomai Wang <haomaiwang@gmail.com>
|
||
Date: Thu Jul 10 10:32:17 2014 +0800
|
||
|
||
Add random_cache.hpp to Makefile.am
|
||
|
||
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
|
||
(cherry picked from commit a3e5c6d632119febd2150944a6f2cbce33cfda3a)
|
||
|
||
commit a2c1532b5610207eccd24b8253643eec6bb05294
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Aug 26 06:42:12 2014 -0700
|
||
|
||
os/KeyValueStore, MemStore: fix warning
|
||
|
||
os/MemStore.cc: In member function 'void MemStore::_do_transaction(ObjectStore::Transaction&)':
|
||
os/MemStore.cc:956:18: warning: unused variable 'expected_object_size' [-Wunused-variable]
|
||
os/MemStore.cc:957:18: warning: unused variable 'expected_write_size' [-Wunused-variable]
|
||
os/KeyValueStore.cc: In member function 'unsigned int KeyValueStore::_do_transaction(ObjectStore::Transaction&, KeyValueStore::BufferTransaction&, ThreadPool::TPHandle*)':
|
||
os/KeyValueStore.cc:1426:18: warning: unused variable 'expected_object_size' [-Wunused-variable]
|
||
os/KeyValueStore.cc:1427:18: warning: unused variable 'expected_write_size' [-Wunused-variable]
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit 2b86bf4f4c1be2603368d5031ee7d706056e2d1e
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Tue Apr 29 11:23:58 2014 -0700
|
||
|
||
osd: automatically scrub PGs with invalid stats
|
||
|
||
If a PG has recnetly split and has invalid stats, scrub it now, even if
|
||
it has scrubbed recently. This helps the stats become valid again soon.
|
||
|
||
Fixes: #8147
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit 68b440d66539e820c9ce86a6942c3188be4ee1ec)
|
||
|
||
commit 271ca7d9bc41e3a2ac387b05ca9f30d8a250fb62
|
||
Merge: 54333a4 87cd3a8
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Aug 26 06:38:34 2014 -0700
|
||
|
||
Merge pull request #2328 from dachary/wip-9209-round-up-to-firefly
|
||
|
||
common: ROUND_UP_TO accepts any rounding factor (firefly)
|
||
|
||
commit 54333a49c9e99a398bf3695845b248ba76ee3930
|
||
Merge: 4bff6f3 58d0871
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Aug 26 06:09:17 2014 -0700
|
||
|
||
Merge pull request #2326 from yuyuyu101/wip-kvstore-firefly
|
||
|
||
Backport from master to Firefly(KeyValueStore)
|
||
|
||
commit 87cd3a8f6e190aed06e361595afc4ec83148da98
|
||
Author: Loic Dachary <loic-201408@dachary.org>
|
||
Date: Mon Aug 25 17:05:04 2014 +0200
|
||
|
||
common: ROUND_UP_TO accepts any rounding factor
|
||
|
||
The ROUND_UP_TO function was limited to rounding factors that are powers
|
||
of two. This saves a modulo but it is not used where it would make a
|
||
difference. The implementation is changed so it is generic.
|
||
|
||
http://tracker.ceph.com/issues/9209 Fixes: #9209
|
||
|
||
Signed-off-by: Loic Dachary <loic-201408@dachary.org>
|
||
(cherry picked from commit 9449520b121fc6ce0c64948386d4ff77f46f4f5f)
|
||
|
||
commit 58d08714340049a5165ad682ec5b54292525b45d
|
||
Author: Haomai Wang <haomaiwang@gmail.com>
|
||
Date: Thu Mar 20 14:09:49 2014 +0800
|
||
|
||
Remove exclusive lock on GenericObjectMap
|
||
|
||
Now most of GenericObjectMap interfaces use header as argument not the union of
|
||
coll_t and ghobject_t. So caller should be responsible for maintain the
|
||
exclusive header.
|
||
|
||
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
|
||
|
||
commit 98df982a6f830154ff6880f5ee00350ba3375b6b
|
||
Author: Haomai Wang <haomaiwang@gmail.com>
|
||
Date: Wed Jul 23 11:26:18 2014 +0800
|
||
|
||
common/RandomCache: Fix inconsistence between contents and count
|
||
|
||
The add/clear method may cause count inconsistent with the real size of
|
||
contents.
|
||
|
||
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
|
||
|
||
commit c8ec7721526ccf4bfd91a220fee0dd75bef8fb21
|
||
Author: Haomai Wang <haomaiwang@gmail.com>
|
||
Date: Tue Aug 26 04:41:28 2014 +0000
|
||
|
||
Add random cache and replace SharedLRU in KeyValueStore
|
||
|
||
SharedLRU plays pool performance in KeyValueStore with large header cache size,
|
||
so a performance optimized RandomCache could improve it.
|
||
|
||
RandomCache will record the lookup frequency of key. When evictint element,
|
||
it will randomly compare several elements's frequency and evict the least
|
||
one.
|
||
|
||
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
|
||
|
||
Conflicts:
|
||
|
||
src/common/config_opts.h
|
||
src/os/KeyValueStore.cc
|
||
|
||
commit 33ca26a103a0d99627fddc30f2916c5aeb37c691
|
||
Author: Haomai Wang <haomaiwang@gmail.com>
|
||
Date: Tue Aug 26 04:40:16 2014 +0000
|
||
|
||
Add Header cache to KeyValueStore
|
||
|
||
In the performance statistic recently, the header lookup becomes the main time
|
||
consuming for the read/write operations. Most of time it occur 50% to deal with
|
||
header lookup, decode/encode logics.
|
||
|
||
Now adding header cache using SharedLRU structure which will maintain the header
|
||
cache and caller will get the pointer to the real header. It also avoid too much
|
||
header copy operations overhead.
|
||
|
||
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
|
||
|
||
Conflicts:
|
||
|
||
src/os/KeyValueStore.cc
|
||
src/os/KeyValueStore.h
|
||
|
||
commit e8dcb8cc603cff64bafc11ee42c5c04a9cf85d12
|
||
Author: Haomai Wang <haomaiwang@gmail.com>
|
||
Date: Wed Feb 26 17:46:07 2014 +0800
|
||
|
||
Fix write operation on a deleted object in the same transaction
|
||
|
||
If the following op happened:
|
||
touch obj
|
||
delete obj
|
||
write obj
|
||
|
||
KeyValueStore will fail at "write" operation.
|
||
|
||
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
|
||
|
||
commit e0ae6f9de685b60eee5efa5ca960c7a15481e41a
|
||
Author: Haomai Wang <haomaiwang@gmail.com>
|
||
Date: Tue Aug 26 04:35:57 2014 +0000
|
||
|
||
Remove SequencerPosition from KeyValueStore
|
||
|
||
Now KeyValueStore expects kv backend to ensure consistency and there is unusable
|
||
for KeyValueStore to store a SequencerPosition.
|
||
|
||
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
|
||
|
||
Conflicts:
|
||
|
||
src/os/KeyValueStore.cc
|
||
src/os/KeyValueStore.h
|
||
|
||
commit 44721f71266e3098169ed00f1ca7e86496b76b07
|
||
Author: Haomai Wang <haomaiwang@gmail.com>
|
||
Date: Wed Jun 4 12:58:07 2014 +0800
|
||
|
||
Fix keyvaluestore fiemap bug
|
||
|
||
The result of fiemap is wrong and the offset get from
|
||
"StripObjectMap::file_to_extents" need to multiply by sequence number
|
||
|
||
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
|
||
|
||
commit 4bff6f3476e5df400db3dc1f0ad7b35a2a41830e
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Aug 21 13:05:35 2014 -0700
|
||
|
||
mon: fix occasional message leak after session reset
|
||
|
||
Consider:
|
||
|
||
- we get a message, put it on a wait list
|
||
- the client session resets
|
||
- we go back to process the message later and discard
|
||
- _ms_dispatch returns false, but nobody drops the msg ref
|
||
|
||
Since we call _ms_dispatch() a lot internally, we need to always return
|
||
true when we are an internal caller.
|
||
|
||
Fixes: #9176
|
||
Backport: firefly, dumpling
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 19df386b2d36d716be2e6d02de0386fac9e7bc1f)
|
||
|
||
commit ca3ac907aa73c5d77760e12da6f1509ea860e894
|
||
Merge: fdbab46 8d7e77b
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Aug 21 10:14:18 2014 -0700
|
||
|
||
Merge pull request #2298 from dachary/wip-9153-jerasure-upgrade-firefly
|
||
|
||
erasure-code: preload the jerasure plugin variant (sse4,sse3,generic)
|
||
|
||
Reviewed-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit 8d7e77b9747f1b3dc3c10d1b0877a4b9c899ba86
|
||
Author: Loic Dachary <loic-201408@dachary.org>
|
||
Date: Thu Aug 21 14:41:55 2014 +0200
|
||
|
||
erasure-code: preload the jerasure plugin variant (sse4,sse3,generic)
|
||
|
||
The preloading of the jerasure plugin ldopen the plugin that is in
|
||
charge of selecting the variant optimized for the
|
||
CPU (sse4,sse3,generic). The variant plugin itself is not loaded because
|
||
it does not happen at load() but when the factory() method is called.
|
||
|
||
The JerasurePlugin::preload method is modified to call the factory()
|
||
method to load jerasure_sse4 or jerasure_sse3 or jerasure_generic as a
|
||
side effect.
|
||
|
||
Indirectly loading another plugin in the factory() method is error prone
|
||
and should be moved to the load() method instead. This change should be
|
||
done in a separate commit.
|
||
|
||
http://tracker.ceph.com/issues/9153 Fixes: #9153
|
||
|
||
Signed-off-by: Loic Dachary <loic-201408@dachary.org>
|
||
|
||
commit fdbab46852e74d405b5c747da98564a5866ec8a7
|
||
Author: Haomai Wang <haomaiwang@gmail.com>
|
||
Date: Tue May 20 14:32:18 2014 +0800
|
||
|
||
Fix set_alloc_hint op cause KeyValueStore crash problem
|
||
|
||
Now KeyValueStore doesn't support set_alloc_hit op, the implementation of
|
||
_do_transaction need to consider decoding the arguments. Otherwise, the
|
||
arguments will be regarded as the next op.
|
||
|
||
Fix the same problem for MemStore.
|
||
|
||
Fix #8381
|
||
|
||
Reported-by: Xinxin Shu <xinxin.shu5040@gmail.com>
|
||
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
|
||
(cherry picked from commit c08adbc98ff5f380ecd215f8bd9cf3cab214913c)
|
||
|
||
commit 922e24e658f09a8a772309f18a8d54c560fad653
|
||
Merge: ae787cf 164f1a1
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Aug 20 10:10:08 2014 -0700
|
||
|
||
Merge pull request #2286 from dachary/wip-9153-jerasure-upgrade-firefly
|
||
|
||
erasure-code: preload the jerasure plugin (firefly)
|
||
|
||
Reviewed-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit 164f1a1959a863848319585fa752250c7b261381
|
||
Author: Loic Dachary <loic-201408@dachary.org>
|
||
Date: Tue Aug 19 01:30:15 2014 +0200
|
||
|
||
erasure-code: preload the jerasure plugin
|
||
|
||
Load the jerasure plugin when ceph-osd starts to avoid the following
|
||
scenario:
|
||
|
||
* ceph-osd-v1 is running but did not load jerasure
|
||
|
||
* ceph-osd-v2 is installed being installed but takes time : the files
|
||
are installed before ceph-osd is restarted
|
||
|
||
* ceph-osd-v1 is required to handle an erasure coded placement group and
|
||
loads jerasure (the v2 version which is not API compatible)
|
||
|
||
* ceph-osd-v1 calls the v2 jerasure plugin and does not reference the
|
||
expected part of the code and crashes
|
||
|
||
Although this problem shows in the context of teuthology, it is unlikely
|
||
to happen on a real cluster because it involves upgrading immediately
|
||
after installing and running an OSD. Once it is backported to firefly,
|
||
it will not even happen in teuthology tests because the upgrade from
|
||
firefly to master will use the firefly version including this fix.
|
||
|
||
While it would be possible to walk the plugin directory and preload
|
||
whatever it contains, that would not work for plugins such as jerasure
|
||
that load other plugins depending on the CPU features, or even plugins
|
||
such as isa which only work on specific CPU.
|
||
|
||
http://tracker.ceph.com/issues/9153 Fixes: #9153
|
||
|
||
Backport: firefly
|
||
Signed-off-by: Loic Dachary <loic-201408@dachary.org>
|
||
(cherry picked from commit 9b802701f78288ba4f706c65b853415c69002d27)
|
||
|
||
Conflicts:
|
||
src/test/erasure-code/test-erasure-code.sh
|
||
src/common/config_opts.h
|
||
|
||
commit ae787cfa88dfd0f5add5932b297258c46af4e333
|
||
Author: Matt Benjamin <matt@linuxbox.com>
|
||
Date: Thu May 29 10:34:20 2014 -0400
|
||
|
||
Work around an apparent binding bug (GCC 4.8).
|
||
|
||
A reference to h->seq passed to std::pair ostensibly could not bind
|
||
because the header structure is packed. At first this looked like
|
||
a more general unaligned access problem, but the only location the
|
||
compiler rejects is a false positive.
|
||
|
||
Signed-off-by: Matt Benjamin <matt@linuxbox.com>
|
||
(cherry picked from commit c930a1f119069a424af28a618b0abff4947c221f)
|
||
|
||
commit 486deefdc1496b72cc680e432a61d71e5fa265c9
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Sun Aug 17 20:54:28 2014 -0700
|
||
|
||
qa/workunits/rbd/qemu-iotests: touch common.env
|
||
|
||
This seems to be necessary on trusty.
|
||
|
||
Backport: firefly, dumpling
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 055be68cf8e1b84287ab3631a02e89a9f3ae6cca)
|
||
|
||
commit cc4e6258d67fb16d4a92c25078a0822a9849cd77
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Fri May 23 16:52:08 2014 +0100
|
||
|
||
unittest_strtol: fix compilation warning
|
||
|
||
Was fixed in master by a4923f5bc373d530d1ffdf6c58a4d88139daedd2
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit 7f9fe22a1c73d5f2783c3303fb9f3a7cfcea61c5
|
||
Author: huangjun <hjwsm1989@gmail.com>
|
||
Date: Tue Jun 17 13:12:58 2014 +0800
|
||
|
||
Fix EINVAL err when use "ceph tell osd.* bench"
|
||
|
||
Signed-off-by: huangjun <hjwsm1989@gmail.com>
|
||
(cherry picked from commit 7dc93a9651f602d9c46311524fc6b54c2f1ac595)
|
||
|
||
commit 14607fc045aa169f1e8fa6872b412fba8f09d645
|
||
Author: Ma Jianpeng <jianpeng.ma@intel.com>
|
||
Date: Wed Jul 16 17:48:34 2014 -0700
|
||
|
||
qa/workunits/cephtool/test.sh: fix get erasure_code_profile test
|
||
|
||
Manual backport of 4d6899c7560e990650959b442980a7249f0ba4c1
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit 068b906ee396f1ad717968f214610ea86dd8d6b4
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Fri Jun 27 21:41:18 2014 +0100
|
||
|
||
mon: OSDMonitor: add 'osd pool get-quota' command
|
||
|
||
Enables us to obtain current quotas for a given pool.
|
||
|
||
Fixes: #8523
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 714a9bb5a058b2553f3be3e4cfb7e7f30150e75a)
|
||
|
||
commit 2ed0fa034aa8e49ab703bdb798bd6211a83e3a9d
|
||
Author: John Spray <jspray@redhat.com>
|
||
Date: Tue Jun 3 10:12:41 2014 +0100
|
||
|
||
mon: name instead of id in "has tiers" message
|
||
|
||
Instead of "Pool foo has tiers 1 2" print
|
||
"Pool foo has tiers bar baz".
|
||
|
||
Signed-off-by: John Spray <jspray@redhat.com>
|
||
(cherry picked from commit 97772c2f53f726bd71710d0d3e34159d2679390a)
|
||
|
||
commit 7e509b1b8b5a3679094f794cd9334598aef4441e
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Fri May 23 17:01:38 2014 +0100
|
||
|
||
common/config.cc: allow integer values to be parsed as SI units
|
||
|
||
We are allowing this for all and any integer values; that is, OPT_INT,
|
||
OPT_LONGLONG, OPT_U32 and OPT_U64.
|
||
|
||
It's on the user to use appropriate units. For instance, the user should
|
||
not use 'E(xabyte)' when setting a signed int, and use his best judgment
|
||
when setting options that, for instance, ought to receive seconds.
|
||
|
||
Fixes: 8265
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 5500437e064cd6b4b45d63ee9396193df87f4d44)
|
||
|
||
commit 4e34d83e337d0febf20c86b051721878feef49a8
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Fri May 23 16:52:08 2014 +0100
|
||
|
||
test/strtol.cc: Test 'strict_strtosi()'
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 40587d4792fd55db72d33870aae8b6a806c9baaf)
|
||
|
||
commit 3b06b8f4893bd18440ecb9705414831a827cef90
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Fri May 23 16:51:37 2014 +0100
|
||
|
||
common/strtol.cc: strict_strtosi() converts str with SI units to uint64_t
|
||
|
||
Accepts values with a suffix (B, K, M, G, T, P, E) and returns the
|
||
appropriate byte value.
|
||
|
||
E.g., 10B = 10, while 10K = 10240.
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 67dc5751ba9a4e527ff12ea65000d1ba45d956f6)
|
||
|
||
commit 92ab6ecf321ab68ea8fe3e8c2b310303a5726af3
|
||
Author: Alfredo Deza <alfredo.deza@inktank.com>
|
||
Date: Wed Aug 13 15:50:20 2014 -0400
|
||
|
||
ceph-disk: linter cleanup
|
||
|
||
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
|
||
(cherry picked from commit d74ed9d53fab95f27a9ad8e9f5dab7192993f6a3)
|
||
|
||
commit 08772fd888fb0eca4570bd6b4bb25f8122691cb4
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Aug 13 12:00:50 2014 -0700
|
||
|
||
ceph-disk: warn about falling back to sgdisk (once)
|
||
|
||
This way the user knows something funny might be up if dmcrypt is in use.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 6f7798e37e098de38fbc73f86c4c6ee705abbe38)
|
||
|
||
commit 50166efd205f46fa325dec9636d817387e5d4d3b
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Aug 13 11:40:34 2014 -0700
|
||
|
||
ceph-disk: only fall back to sgdisk for 'list' if blkid seems old
|
||
|
||
If the blkid doesn't show us any ID_PART_ENTRY_* fields but we know it is
|
||
a GPT partition, *then* fallback. Otherwise, don't bother.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit b1651afb34d9d2c324db3bf5f54ac9ce001c6af9)
|
||
|
||
commit a45e815cb00f1a807691cbf687990839995f7629
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Aug 13 11:39:47 2014 -0700
|
||
|
||
ceph-disk: add get_partition_base() helper
|
||
|
||
Return the base devices/disk for a partition device.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit b75e8a340c49cbc067baa19790b994a5f904bb4f)
|
||
|
||
commit 8c04e475efb4471c605e3c921ec8a03b67934899
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Aug 12 17:26:07 2014 -0700
|
||
|
||
ceph-disk: display information about dmcrypted data and journal volumes
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit c7a1ceba441fa99a82e19ed2cd3c6782a5d77636)
|
||
|
||
commit b09e659226b26002b58c7697f8c600d06fe78c58
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Aug 12 17:25:42 2014 -0700
|
||
|
||
ceph-disk: move fs mount probe into a helper
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit f80ed26d2403ba12e80da6459fc45c22584f72de)
|
||
|
||
commit 6775f46e4a5862ddbf81bef11016bc036222fda9
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Aug 12 17:25:10 2014 -0700
|
||
|
||
ceph-disk: use partition type UUIDs, and blkid
|
||
|
||
Use blkid to give us the GPT partition type. This lets us distinguish
|
||
between dmcrypt and non-dmcrypt partitions. Fake it if blkid doesn't
|
||
give us what we want and try with sgdisk. This isn't perfect (it can't
|
||
tell between dmcrypt and not dmcrypt), but such is life, and we are better
|
||
off than before.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 6c77f5f2f994c881232d76ce9c69af80d10772bd)
|
||
|
||
commit 1804a83400b7c3dc07650e09da5224bb999d0940
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Aug 12 13:53:16 2014 -0700
|
||
|
||
ceph-disk: fix log syntax error
|
||
|
||
File "/usr/sbin/ceph-disk", line 303, in command_check_call
|
||
LOG.info('Running command: %s' % ' '.join(arguments))
|
||
TypeError: sequence item 2: expected string, NoneType found
|
||
|
||
Backport: firefly
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 1088d6cd11b476cd67ed30e07edd363c4057a003)
|
||
|
||
commit 8a8a9c35349d3f58d899afa1a9e219b99586bc9f
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Mon Aug 11 15:58:15 2014 -0700
|
||
|
||
Revert "Fix for bug #6700"
|
||
|
||
This reverts commit 673394702b725ff3f26d13b54d909208daa56d89.
|
||
|
||
This appears to break things when the journal and data disk are *not* the same.
|
||
And I can't seem to reproduce the original failure...
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 2edf01ffa4a7425af2691b4e94bc5fd0bfab1e5b)
|
||
|
||
commit 50b700fadf6ce6e0bf14b5daa2288786426d7359
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Mon Aug 11 15:57:52 2014 -0700
|
||
|
||
ceph-disk: fix verify_no_in_use check
|
||
|
||
We only need to verify that partitions aren't in use when we want to
|
||
consume the whole device (osd data), not when we want to create an
|
||
additional partition for ourselves (osd journal).
|
||
|
||
Backport: firefly
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit d6e6ba198efc4b3afff0c70af53497a70c6b3f19)
|
||
|
||
commit c9847ef059f182ad15ef027c8bdfae6c99d91867
|
||
Author: Alfredo Deza <alfredo@deza.pe>
|
||
Date: Thu May 22 17:04:28 2014 -0400
|
||
|
||
better error reporting on incompatible device requirements
|
||
|
||
Signed-off-by: Alfredo Deza <alfredo@deza.pe>
|
||
(cherry picked from commit 1ac3a503a15ddf7f7c1a33310a468fac10a1b7b6)
|
||
|
||
commit 40649902891244242d5861ccd9538aec026cae3a
|
||
Author: Stuart Longland <stuartl@vrt.com.au>
|
||
Date: Tue May 6 14:06:36 2014 -0700
|
||
|
||
ceph-disk: fix list for encrypted or corrupt volume
|
||
|
||
Continue gracefully if an fs type is not detected, either because it is
|
||
encrypted or because it is corrupted.
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit 09beebe3f1fd1b179547743648049b891cb8bc56)
|
||
|
||
commit 80896dcf2c3ccba0b9b0b1bd9f6e075585e3d502
|
||
Author: Alfredo Deza <alfredo.deza@inktank.com>
|
||
Date: Fri Jun 13 09:37:33 2014 -0400
|
||
|
||
support dmcrypt partitions when activating
|
||
|
||
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
|
||
(cherry picked from commit ef8a1281512c4ee70a3764b28891da691a183804)
|
||
|
||
commit 1b0da81d733a36de4a9dc80263058a6cdf05c745
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Aug 15 16:41:43 2014 -0700
|
||
|
||
init-ceph: don't use bashism
|
||
|
||
-z STRING
|
||
the length of STRING is zero
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 0d6d1aa7e0c5e0b5f99c9b548a1f890c511b4299)
|
||
|
||
commit 9005f33d0d80d6d2b93493b38866b7f74f87d1eb
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Aug 15 14:28:57 2014 -0700
|
||
|
||
osd: fix feature requirement for mons
|
||
|
||
These features should be set on the client_messenger, not
|
||
cluster_messenger.
|
||
|
||
Backport: firefly
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit ae0b9f17760eda9a7e09a6babac50bfe8ebb4b36)
|
||
|
||
commit 9e46c5ad7dadd1c342c82629577b5a1bf037fe75
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Aug 15 13:54:11 2014 -0700
|
||
|
||
unittest_osdmap: test EC rule and pool features
|
||
|
||
TODO: tiering feature bits.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 2f0e2951d773b6acce781b4b991d6d8e817ee2f9)
|
||
|
||
commit dbbe0c627bcd4a60c1346bb120698b5a0c2192c2
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Aug 15 14:04:05 2014 -0700
|
||
|
||
unittest_osdmap: create an ec pool in test osdmap
|
||
|
||
This is part of 7294e8c4df6df9d0898f82bb6e0839ed98149310.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit c2aa74a22718d9a59d60201d71213aaff2492ff8
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Aug 15 08:55:10 2014 -0700
|
||
|
||
osd: only require crush features for rules that are actually used
|
||
|
||
Often there will be a CRUSH rule present for erasure coding that uses the
|
||
new CRUSH steps or indep mode. If these rules are not referenced by any
|
||
pool, we do not need clients to support the mapping behavior. This is true
|
||
because the encoding has not changed; only the expected CRUSH output.
|
||
|
||
Fixes: #8963
|
||
Backport: firefly
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 16dadb86e02108e11a970252411855d84ab0a4a2)
|
||
|
||
commit 12430fed85b2cfeaeb33a443e6a4c6538d0833f8
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Aug 15 08:52:37 2014 -0700
|
||
|
||
crush: add is_v[23]_rule(ruleid) methods
|
||
|
||
Add methods to check if a *specific* rule uses v2 or v3 features. Refactor
|
||
the existing checks to use these.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 1d95486780a54c85a5c88936a4da4bdc3576a7b8)
|
||
|
||
commit 2427ea8f153caf55b3bce77cd2fc88935563c7b3
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Mon Jun 30 13:40:07 2014 -0700
|
||
|
||
PGLog: fix clear() to avoid the IndexLog::zero() asserts
|
||
|
||
Introduced in:
|
||
c5b8d8105d965da852c79add607b69d5ae79a4d4
|
||
ac11ca40b4f4525cbe9b1778b1c5d9472ecb9efa
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
(cherry picked from commit 959f2b25910360b930183fbf469ce984a48542dd)
|
||
|
||
commit 9ca451a6bf2f29e75f72cbd3dbcff0bf8986e462
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Jun 19 12:34:36 2014 -0700
|
||
|
||
osd: allow io priority to be set for the disk_tp
|
||
|
||
The disk_tp covers scrubbing, pg deletion, and snap trimming
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit d9073f486527ca13cdb2774745c4c63c218333ad)
|
||
|
||
commit 11858d7e7a493c9493f7039b7e45dc03fc4feb90
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Jun 18 11:02:09 2014 -0700
|
||
|
||
common/WorkQueue: allow io priority to be set for wq
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit dd6badcb5eedfec6748b3e6ca4d46e3b266038f6)
|
||
|
||
Conflicts:
|
||
|
||
src/common/WorkQueue.cc
|
||
|
||
commit b75f85a2c4dd9807947862f7b89a5f25dfa1defe
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Jun 18 11:01:42 2014 -0700
|
||
|
||
common/Thread: allow io priority to be set for a Thread
|
||
|
||
Ideally, set this before starting the thread. If you set it after, we
|
||
could potentially race with create() itself.
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit 1b8741022c5a2ebae38905215dadee696433e931)
|
||
|
||
commit 9f29788fbc19aea341b4fe997a567aa3054b9d1c
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Jun 18 11:01:09 2014 -0700
|
||
|
||
common/io_priority: wrap ioprio_set() and gettid()
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit a2b49110ef65efd526c3430ad03c988ca9dde768)
|
||
|
||
commit fac5bfafef1eb82f8cf23c369fb5f50502e2e6f3
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Tue Jun 17 10:47:24 2014 -0700
|
||
|
||
osd: introduce simple sleep during scrub
|
||
|
||
This option is similar to osd_snap_trim_sleep: simply inject an optional
|
||
sleep in the thread that is doing scrub work. This is a very kludgey and
|
||
coarse knob for limiting the impact of scrub on the cluster, but can help
|
||
until we have a more robust and elegant solution.
|
||
|
||
Only sleep if we are in the NEW_CHUNK state to avoid delaying processing of
|
||
an in-progress chunk. In this state nothing is blocked on anything.
|
||
Conveniently, chunky_scrub() requeues itself for each new chunk.
|
||
|
||
Backport: firefly, dumpling
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit c4e8451cc5b4ec5ed07e09c08fb13221e31a7ac6)
|
||
|
||
commit ad82f28122dc41095d5e703279a8a5c494d35913
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Sat Jun 14 10:30:50 2014 -0700
|
||
|
||
osd: add sanity check/warning on a few key configs
|
||
|
||
Warn when certain config values are set to bad values.
|
||
|
||
Backport: firefly, dumpling
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit f3ec7d0b23fdee39a34bda7595cd2a79c08daf8a)
|
||
|
||
commit 289360c5dc57a4788289472f90d63781143539be
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Thu May 1 17:24:48 2014 -0700
|
||
|
||
osd: prevent pgs from getting too far ahead of the min pg epoch
|
||
|
||
Bound the range of PG epochs between the slowest and fastest pg
|
||
(epoch-wise) with 'osd map max advance'. This value should be set to
|
||
something less than 'osd map cache size' so that the maps we are
|
||
processing will be in memory as many PGs advance forward in time in
|
||
loose synchrony.
|
||
|
||
This is part of the solution to #7576.
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit cf25bdf6b0090379903981fe8cee5ea75efd7ba0)
|
||
|
||
commit 662af7ac83b67af8c9edc554bbd505de717f9709
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Aug 7 17:42:06 2014 -0700
|
||
|
||
osd: fix pg epoch floor tracking
|
||
|
||
If you call erase() on a multiset it will delete all instances of a value;
|
||
we only want to delete one of them. Fix this by passing an iterator.
|
||
|
||
Backport: firefly
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit a52a855f6c92b03dd84cd0cc1759084f070a98c2)
|
||
|
||
commit 229a346d824d84c361d7963a356af5251adc9e2e
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Wed Apr 2 14:29:08 2014 -0700
|
||
|
||
osd: track per-pg epochs, min
|
||
|
||
Add some simple tracking so that we can quickly determine what the min
|
||
pg osdmap epoch is.
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit 81e4c47722255ac3d46f701a80e104cc390e766c)
|
||
|
||
commit 38c3a3c0b0d1903aea2fdc6224fc4f70bbc39329
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Aug 13 13:31:10 2014 -0700
|
||
|
||
mon: fix divide by zero when pg_num adjusted and no osds
|
||
|
||
Fixes: #9052
|
||
Backport: firefly, dumpling
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 239401db7b51541a57c59a261b89e0f05347c32d)
|
||
|
||
commit 87bf00a2cb93ce2dc904a42c45cc9f43023725c3
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Sun Aug 10 12:48:29 2014 -0700
|
||
|
||
ceph_test_rados_api_tier: fix cache cleanup (ec too)
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit d7fb7bf5f2059f411633751e376c2270e6040fba)
|
||
|
||
commit 3be0d731cbe158d837d05c907aefe16aa95977be
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Sun Aug 10 12:15:38 2014 -0700
|
||
|
||
ceph_test_rados_api: fix cleanup of cache pool
|
||
|
||
We can't simply try to delete everything in there because some items may
|
||
be whiteouts. Instead, flush+evict everything, then remove overlay, and
|
||
*then* delete what remains.
|
||
|
||
Fixes: #9055
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit ebbe8aab17cfa2281902f167a706639535da4010)
|
||
|
||
commit 7f511ef7fd55cca8f1babaf696ca0faa0e1e411d
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Sun Aug 10 11:41:23 2014 -0700
|
||
|
||
librados/TestCase: inheret cleanup_default_namespace
|
||
|
||
No need to duplicate this code.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 1d199fb1173dc9685dba96c22b83e4e9edf51a11)
|
||
|
||
commit 4a5c93a90986de4510c50f0fba72ae7d5aed8a15
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Aug 13 10:34:53 2014 -0700
|
||
|
||
osd/ReplicatedPG: only do agent mode calculations for positive values
|
||
|
||
After a split we can get negative values here. Only do the arithmetic if
|
||
we have a valid (positive) value that won't through the floating point
|
||
unit for a loop.
|
||
|
||
Fixes: #9082
|
||
Tested-by: Karan Singh <karan.singh@csc.fi>
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 5be56ff86d9f3ab2407a258a5285d0b8f52f041e)
|
||
|
||
commit 39bcafa6f2b14e4e11e1541cf01f24525e2b6449
|
||
Merge: 7da121d cb48cd4
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Tue Aug 12 21:15:26 2014 -0700
|
||
|
||
Merge pull request #2231 from ceph/wip-8944-firefly
|
||
|
||
Wip 8944 firefly
|
||
|
||
Reviewed-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit 7da121d2aa1ea5c5c8accef92d7304912d4b2eb3
|
||
Author: Greg Farnum <greg@inktank.com>
|
||
Date: Mon Jul 28 18:33:56 2014 -0700
|
||
|
||
OSD: add require_same_peer_inst(OpRequestRef&,OSDMap&) helper
|
||
|
||
Signed-off-by: Greg Farnum <greg@inktank.com>
|
||
(cherry picked from commit e99acf9810976b1fc74b84ad289773af43be973f)
|
||
|
||
Conflicts:
|
||
|
||
src/osd/OSD.cc
|
||
|
||
commit 8595e9bed3689933c03a8f3443052a36ff1d62f5
|
||
Author: Greg Farnum <greg@inktank.com>
|
||
Date: Mon Jul 28 14:19:59 2014 -0700
|
||
|
||
OSD: introduce require_self_aliveness(OpRequestRef&,epoch_t) function
|
||
|
||
Take the self-aliveness checks out of require_same_or_newer_map() and use
|
||
the new function for that and for require_up_osd_peer().
|
||
|
||
Signed-off-by: Greg Farnum <greg@inktank.com>
|
||
(cherry picked from commit e179e9227b4a4482d8359682092fd7f426b9a919)
|
||
|
||
Conflicts:
|
||
|
||
src/osd/OSD.cc
|
||
|
||
commit d0f2c4891bbcc1938bee15b3fc0bfb796ce4c7de
|
||
Author: Greg Farnum <greg@inktank.com>
|
||
Date: Mon Jul 28 14:08:30 2014 -0700
|
||
|
||
OSD: use OpRequestRef& for a few require_* functions
|
||
|
||
Signed-off-by: Greg Farnum <greg@inktank.com>
|
||
(cherry picked from commit eb2f1ea2c33647934af878b504383829f5a198ce)
|
||
|
||
commit 8d395f1cbbc63f4cd5d166fd0a667938c83f303c
|
||
Author: Greg Farnum <greg@inktank.com>
|
||
Date: Tue Jul 22 16:57:00 2014 -0700
|
||
|
||
OSD: introduce require_up_osd_peer() function for gating replica ops
|
||
|
||
This checks both that a Message originates from an OSD, and that the OSD
|
||
is up in the given map epoch.
|
||
We use it in handle_replica_op so that we don't inadvertently add operations
|
||
from down peers, who might or might not know it.
|
||
|
||
Signed-off-by: Greg Farnum <greg@inktank.com>
|
||
(cherry picked from commit ccd0eec50103b919b3eb6eea96f7dc6438520ed3)
|
||
|
||
commit 72c2474e05b918535047181d876678a6a077aa1d
|
||
Author: Alfredo Deza <alfredo.deza@inktank.com>
|
||
Date: Fri Aug 8 10:16:20 2014 -0400
|
||
|
||
init-ceph: conditionally update after argparsing
|
||
|
||
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
|
||
(cherry picked from commit 44ed1885fb588aad7e4729373e06c5933178b5e5)
|
||
|
||
commit 8d7fb538e0163f828289d7da719692bd36a66f83
|
||
Author: Alfredo Deza <alfredo.deza@inktank.com>
|
||
Date: Thu Aug 7 11:11:57 2014 -0400
|
||
|
||
make ceph-disk use the new init flag for cluster
|
||
|
||
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
|
||
(cherry picked from commit d0ccb1cbef86b8ccd8967af892e3582ee80edd55)
|
||
|
||
commit 260a9c84630ca6956eb772d87abdc3bd4c4bb8fc
|
||
Author: Alfredo Deza <alfredo.deza@inktank.com>
|
||
Date: Thu Aug 7 10:48:09 2014 -0400
|
||
|
||
allow passing a --cluster flag to the init script
|
||
|
||
It will fallback to looking at /etc/ceph/$cluster.conf
|
||
otherwise.
|
||
|
||
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
|
||
(cherry picked from commit 23b4915fa252852cf02cc42a1b6143e2cd61b445)
|
||
|
||
commit cb5ecdce68dcd4e4bc32b5c7c029cfd7ffe7c80e
|
||
Author: Alfredo Deza <alfredo.deza@inktank.com>
|
||
Date: Wed Aug 6 15:30:30 2014 -0400
|
||
|
||
use cluster name when checking the host
|
||
|
||
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
|
||
(cherry picked from commit bdf5f30010117c71a227855a47fe22ab55b3e0b8)
|
||
|
||
commit 79452540826d0aed7b94d374cc61b5002e89e4a4
|
||
Author: Alfredo Deza <alfredo.deza@inktank.com>
|
||
Date: Wed Aug 6 15:30:09 2014 -0400
|
||
|
||
use name in /var/lib/ceph paths
|
||
|
||
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
|
||
(cherry picked from commit 3fb25c28e8e3cc62bc541538cc11f5ed41471611)
|
||
|
||
commit 92755d1060ea06f13577cd2fffda6c7984a610b2
|
||
Author: Alfredo Deza <alfredo.deza@inktank.com>
|
||
Date: Wed Aug 6 15:29:42 2014 -0400
|
||
|
||
when starting an OSD, pass in the cluster name
|
||
|
||
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
|
||
(cherry picked from commit 9e08e3a7794ce007c80c8fdb56e96900eb5240a3)
|
||
|
||
commit 272b26f5aab71c22a1954ff92548b535a1f018d8
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Fri Aug 1 14:04:35 2014 -0700
|
||
|
||
osd_types: s/stashed/rollback_info_completed and set on create
|
||
|
||
Originally, this flag indicated that the object had already been stashed and
|
||
that therefore recording subsequent changes is unecessary. We want to set it
|
||
on create() as well since operations like [create, writefull] should not need
|
||
to stash the object.
|
||
|
||
Fixes: #8625
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
(cherry picked from commit 4260767973d96978e808cb87ef6ae991104b4f8d)
|
||
|
||
commit 7b5bcb943578b99f5a2aeeae0bbc67f371c30233
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Thu Jun 19 18:27:49 2014 +0100
|
||
|
||
osd: use appropriate json types instead of stream when dumping info
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 363496ad878c685008ccd87f26f121d62a48c24c)
|
||
|
||
commit daec3226e073b8d6047eb9111f3deb39b1001647
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Thu Jun 19 16:52:06 2014 +0100
|
||
|
||
osd: have 'tid' dumped as a json unsigned int where appropriate
|
||
|
||
Most of the places dumping it would dump it as a string. Others as an int.
|
||
Just a couple would dump it as an unsigned int.
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 3f0ea9512be78d10ac0bc605a38e83cfbab7ffee)
|
||
|
||
commit 439bce34bc25cd7c8eba7ffc124185d810d3711f
|
||
Author: Yehuda Sadeh <yehuda@redhat.com>
|
||
Date: Sat Aug 2 13:01:05 2014 -0700
|
||
|
||
rgw: need to pass need_to_wait for throttle_data()
|
||
|
||
need_to_wait wasn't passed into processor->throttle_data(). This was
|
||
broken in fix for #8937.
|
||
|
||
CID 1229541: (PW.PARAM_SET_BUT_NOT_USED)
|
||
|
||
Backport: firefly
|
||
|
||
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
|
||
(cherry picked from commit e93818df33286a2a7f73b593dc20da412db4e0a6)
|
||
(cherry picked from commit 8519e9ab06caf6999e1243514a93eaffb155ab2e)
|
||
|
||
commit fc1a4b5fdce7b92ba1b321dec37c4c75501e3521
|
||
Author: Sylvain Munaut <s.munaut@whatever-company.com>
|
||
Date: Thu Jun 5 11:28:27 2014 +0200
|
||
|
||
rgw: Don't send error body when it's a HEAD request
|
||
|
||
The main 'operation' know not to send any body for HEAD requests.
|
||
|
||
However for errors, this was not the case, the formatter would be
|
||
flushed and would send the error 'message' in the body in all cases.
|
||
|
||
For the FastCGI case it doesn't seem to be an issue, it's possible
|
||
that the webserver (apache/lighttpd/...) cleans up the response
|
||
into shape.
|
||
|
||
But when using the new civetweb frontend this cause invalid HTTP.
|
||
|
||
Backport: firefly
|
||
Fixes #8539
|
||
|
||
Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>
|
||
Signed-off-by: Sylvain Munaut <s.munaut@whatever-company.com>
|
||
(cherry picked from commit 0a2b4c25541bbd15776d3d35986518e37166910f)
|
||
|
||
commit e3bc15343720d0455e32e429e7cf865037bd90d7
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Jul 30 13:57:34 2014 -0700
|
||
|
||
osd: prevent old clients from using tiered pools
|
||
|
||
If the client is old and doesn't understand tiering, don't let them use a
|
||
tiered pool. Reply with EOPNOTSUPP.
|
||
|
||
Fixes: #8714
|
||
Backport: firefly
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 0190df53056834f219e33ada2af3a79e8c4dfb77)
|
||
|
||
commit f3113e9adde54fa50a64010381f5b6c113f5cda0
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Jul 31 11:02:55 2014 -0700
|
||
|
||
mon/OSDMonitor: warn when cache pools do not have hit_sets configured
|
||
|
||
Give users a clue when cache pools are enabled but the hit_set is not
|
||
configured. Note that technically this will work, but not well, so for
|
||
now let's just steer them away.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 383536a2ef2506c5591b25c0fd61dc8c181fdab9)
|
||
|
||
NOTE: removed readforward state for backport
|
||
|
||
commit aaf732f7475c075f8bf8e79bc08b11a020e5fadf
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Jul 31 09:28:12 2014 -0700
|
||
|
||
osd/ReplicatedPG: improve agent_choose_mode args
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit caf554bf2f752b50670d118c99843b7c4a2967b4)
|
||
|
||
commit 76a519b215e591e0948d627fb1de826ed0bf415d
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Jul 31 09:26:03 2014 -0700
|
||
|
||
osd/ReplicatedPG: evict blindly if there is no hit_set
|
||
|
||
If there is no hit set for a PG, blindly evict objects. This avoids an
|
||
assert(hit_set) in agent_estimate_atime_temp().
|
||
|
||
Fixes: #8982
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit ea4996d3ef15c5d5a776d162b08d9fad6859c976)
|
||
|
||
commit 8ff48d79697e98dca04799ee5982a5308a4efc92
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Jul 31 09:13:11 2014 -0700
|
||
|
||
osd/ReplicatedPG: check agent_mode if agent is enabled but hit_sets aren't
|
||
|
||
It is probably not a good idea to try to run the tiering agent without a
|
||
hit_set to inform its actions, but it is technically possible. For
|
||
example, one could simply blindly evict when we reach the full point.
|
||
However, this doesn't work because the agent mode is guarded by a hit_set
|
||
check, even though agent_setup() is not. Fix that.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 5d1c76f641310f5f65600f70ae76945b2aa472d7)
|
||
|
||
commit f98a6194a9a9f5794c38814c1c33d13b7fcea538
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Aug 12 07:05:34 2014 -0700
|
||
|
||
common/LogClient: fix sending dup log items
|
||
|
||
We need to skip even the most recently sent item in order to get to the
|
||
ones we haven't sent yet.
|
||
|
||
Fixes: #9080
|
||
Backport: firefly, dumpling
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 057c6808be5bc61c3f1ac2b956c1522f18411245)
|
||
|
||
commit bbb1e6a3a84b2d853f935687f01016e7c6a67951
|
||
Author: Pavan Rallabhandi <pavan.rallabhandi@sandisk.com>
|
||
Date: Wed Aug 6 15:10:14 2014 +0530
|
||
|
||
RadosClient: Fixing potential lock leaks.
|
||
|
||
In lookup_pool and pool_delete, a lock is taken
|
||
before invoking wait_for_osdmap, but is not
|
||
released for the failure case of the call. Fixing the same.
|
||
|
||
Fixes: #9022
|
||
Signed-off-by: Pavan Rallabhandi <pavan.rallabhandi@sandisk.com>
|
||
(cherry picked from commit f1aad8bcfc53f982130dbb3243660c3c546c3523)
|
||
|
||
commit e767254ce9a1610f3d640d8157fcb0d1fdf8edf2
|
||
Author: Josh Durgin <josh.durgin@inktank.com>
|
||
Date: Mon Aug 11 16:41:26 2014 -0700
|
||
|
||
librbd: fix error path cleanup for opening an image
|
||
|
||
If the image doesn't exist and caching is enabled, the ObjectCacher
|
||
was not being shutdown, and the ImageCtx was leaked. The IoCtx could
|
||
later be closed while the ObjectCacher was still running, resulting in
|
||
a segfault. Simply use the usual cleanup path in open_image(), which
|
||
works fine here.
|
||
|
||
Fixes: #8912
|
||
Backport: dumpling, firefly
|
||
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
|
||
(cherry picked from commit 3dfa72d5b9a1f54934dc8289592556d30430959d)
|
||
|
||
commit dec028d113ab4bcc7106fea0bf413b54829f67e7
|
||
Merge: e087862 c7fbf27
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Aug 12 14:38:33 2014 -0700
|
||
|
||
Merge remote-tracking branch 'gh/firefly-next' into firefly
|
||
|
||
commit 07e1ceb55ac3cf0bea58cec27737e45391de9106
|
||
Author: Loic Dachary <loic@dachary.org>
|
||
Date: Sun Aug 10 17:10:04 2014 +0200
|
||
|
||
erasure-code: ErasureCodeJerasure::create_ruleset must return a ruleset
|
||
|
||
CrushWrapper::add_simple_ruleset does not return a ruleset, it returns
|
||
a ruleid that must be converted into a ruleset before being returned.
|
||
|
||
http://tracker.ceph.com/issues/9044 Fixes: #9044
|
||
|
||
Signed-off-by: Loic Dachary <loic@dachary.org>
|
||
(cherry picked from commit 0029a35872d3fc15f9a0d60d095b2e111d6e98a6)
|
||
|
||
commit 96047f1de4e0591a294e31ed6af6edfb3b2357e4
|
||
Author: Loic Dachary <loic@dachary.org>
|
||
Date: Sun Aug 10 17:06:33 2014 +0200
|
||
|
||
erasure-code: OSDMonitor::crush_ruleset_create_erasure needs ruleset
|
||
|
||
When OSDMonitor::crush_ruleset_create_erasure checks the ruleset for
|
||
existence, it must convert the ruleid into a ruleset before assigning it
|
||
back to the *ruleset parameter.
|
||
|
||
http://tracker.ceph.com/issues/9044 Fixes: #9044
|
||
|
||
Signed-off-by: Loic Dachary <loic@dachary.org>
|
||
(cherry picked from commit 04a484a4d5800c9bcf9805d3e87ed0c8dee01c9a)
|
||
|
||
commit e087862d5bd894572a6c223b45f4275cadd4b480
|
||
Author: Haomai Wang <haomaiwang@gmail.com>
|
||
Date: Mon Jul 14 14:27:17 2014 +0800
|
||
|
||
Add rbdcache max dirty object option
|
||
|
||
Librbd will calculate max dirty object according to rbd_cache_max_size, it
|
||
doesn't suitable for every case. If user set image order 24, the calculating
|
||
result is too small for reality. It will increase the overhead of trim call
|
||
which is called each read/write op.
|
||
|
||
Now we make it as option for tunning, by default this value is calculated.
|
||
|
||
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
|
||
(cherry picked from commit 3c7229a2fea98b30627878c86b1410c8eef2b5d7)
|
||
|
||
commit 5f74fb294a0cd9b973aae45de17f38436bac6d61
|
||
Author: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
|
||
Date: Wed Jun 4 23:22:18 2014 +0200
|
||
|
||
librbd/internal.cc: check earlier for null pointer
|
||
|
||
Fix potential null ponter deref, move check for 'order != NULL'
|
||
to the beginning of the function to prevent a) deref in ldout() call
|
||
and b) to leave function as early as possible if check fails.
|
||
|
||
[src/librbd/internal.cc:843] -> [src/librbd/internal.cc:865]: (warning)
|
||
Possible null pointer dereference: order - otherwise it is redundant
|
||
to check it against null.
|
||
|
||
Signed-off-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
|
||
(cherry picked from commit 3ee3e66a9520a5fcafa7d8c632586642f7bdbd29)
|
||
|
||
commit b2189465f36fc375b864f88a47d25c7808c08901
|
||
Author: Josh Durgin <josh.durgin@inktank.com>
|
||
Date: Thu Apr 24 14:47:24 2014 -0700
|
||
|
||
librbd: add an interface to invalidate cached data
|
||
|
||
This is useful for qemu to guarantee live migration with caching is
|
||
safe, by invalidating the cache on the destination before starting it.
|
||
|
||
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
|
||
(cherry picked from commit 5d340d26dd70192eb0e4f3f240e3433fb9a24154)
|
||
|
||
commit f7dc58552a9ee228b7fa2a10094e962ed66fe8fd
|
||
Author: Josh Durgin <josh.durgin@inktank.com>
|
||
Date: Thu Apr 24 14:43:35 2014 -0700
|
||
|
||
librbd: check return code and error out if invalidate_cache fails
|
||
|
||
This will only happen when shrinking or rolling back an image is done
|
||
while other I/O is in flight to the same ImageCtx. This is unsafe, so
|
||
return an error before performing the resize or rollback.
|
||
|
||
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
|
||
(cherry picked from commit e08b8b66c77be3a3d7f79d91c20b1619571149ee)
|
||
|
||
commit c7fbf272a202cd8a72d91b7a55e53fbb5cbbbadd
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Sat Aug 9 13:23:06 2014 -0700
|
||
|
||
os/FileStore: dump open fds before asserting
|
||
|
||
Backport: firefly, dumpling
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 4e8de1792731cf30f2744ab0659d036adc0565a3)
|
||
|
||
commit 978f5749f3d08bb4c96529ca2d1b10760ee2606d
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Jul 25 13:51:45 2014 -0700
|
||
|
||
ceph_test_rados_api_tier: do fewer writes in HitSetWrite
|
||
|
||
We don't need to do quite so many writes. It can be slow when we are
|
||
thrashing and aren't doing anything in parallel.
|
||
|
||
Fixes: #8932
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit c5f766bb16c0ab3c3554e73791ad0b74077ad35c)
|
||
|
||
commit 22aa81413e7db43418e613aea037e978031f5b8a
|
||
Merge: b65cef6 7025075
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Aug 8 19:05:37 2014 -0700
|
||
|
||
Merge remote-tracking branch 'gh/firefly-next' into firefly
|
||
|
||
commit cb48cd47a26d27869884af83012d6a8a684abf25
|
||
Author: Dan Mick <dan.mick@inktank.com>
|
||
Date: Wed Jul 30 14:50:37 2014 -0700
|
||
|
||
qa/workunits/cephtool/test_daemon.sh: verify ceph -c works with daemon
|
||
|
||
Signed-off-by: Dan Mick <dan.mick@inktank.com>
|
||
(cherry picked from commit aa9ae1f270293778aa937e7f7e4bcaee3099b9b2)
|
||
|
||
commit 1ac0e5436da68e441f42a1016b12481046147850
|
||
Author: Dan Mick <dan.mick@inktank.com>
|
||
Date: Wed Jul 30 14:49:02 2014 -0700
|
||
|
||
qa/workunits/cephtool/test_daemon.sh: typo
|
||
|
||
Signed-off-by: Dan Mick <dan.mick@inktank.com>
|
||
(cherry picked from commit 22d20f39b7355966554319d5a1aa888967607569)
|
||
|
||
commit a144950624208d8ed2901fd7421060a706ac2016
|
||
Author: Dan Mick <dan.mick@inktank.com>
|
||
Date: Wed Jul 30 14:48:28 2014 -0700
|
||
|
||
qa/workunits/cephtool/test_daemon.sh: allow local ceph command
|
||
|
||
(cherry picked from commit 97a8d5a9fdbd3a25cc922c242ee57da58c57d0bc)
|
||
|
||
commit 76b593f6268d77e6cf5a9931f6f3524b3f574c09
|
||
Author: Dan Mick <dan.mick@inktank.com>
|
||
Date: Mon Jul 28 21:28:42 2014 -0700
|
||
|
||
ceph.in: Pass global args to ceph-conf for proper lookup
|
||
|
||
Fixes: #8944
|
||
Signed-off-by: Dan Mick <dan.mick@inktank.com>
|
||
(cherry picked from commit 6d89a99648630f81b85ad115fe7662dba6b08a55)
|
||
|
||
commit b65cef678777c1b87d25385595bf0df96168703e
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Mon Jul 14 08:04:16 2014 -0700
|
||
|
||
ceph_test_rados_api_tier: fix [EC] HitSet{Read,Write,Trim} tests
|
||
|
||
The hit_set_ fields can only be set on tier pools as of
|
||
f131dfbaedf6f451572e7aa3a83f653912122953.
|
||
|
||
Fixes: #8823
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit e17e9d857722ee478abda10adb32e15b11fff2ff)
|
||
|
||
commit 70250755e4b2c114f1f0f463b42930dd99751d81
|
||
Merge: 6f1a544 f8494c8
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Sun Aug 3 12:47:23 2014 -0700
|
||
|
||
Merge branch 'wip-8701-firefly' into firefly-next
|
||
|
||
commit f8494c87e5276f0587c3341ddef9d7a933dfea11
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Jul 22 06:53:41 2014 -0700
|
||
|
||
ceph_test_objectstore: clean up on finish of MoveRename
|
||
|
||
Otherwise, we leave collections around, and the next test fails.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit d4faf747b73e70dff9cb5c98ee6aaa4ecec215fc)
|
||
|
||
commit 94fee997204d439abfd642be20a7e33df5979342
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Mon Jul 21 13:45:21 2014 -0700
|
||
|
||
os/LFNIndex: use FDCloser for fsync_dir
|
||
|
||
This prevents an fd leak when maybe_inject_failure() throws an exception.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 3ec9a42b470422b1fe72b6294d82d9efcaca7f53)
|
||
|
||
commit b213866eac422a6ac6aeacd3ab4741a6421ce20c
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Jul 18 23:16:09 2014 -0700
|
||
|
||
os/LFNIndex: only consider alt xattr if nlink > 1
|
||
|
||
If we are doing a lookup, the main xattr fails, we'll check if there is an
|
||
alt xattr. If it exists, but the nlink on the inode is only 1, we will
|
||
kill the xattr. This cleans up the mess left over by an incomplete
|
||
lfn_unlink operation.
|
||
|
||
This resolves the problem with an lfn_link to a second long name that
|
||
hashes to the same short_name: we will ignore the old name the moment the
|
||
old link goes away.
|
||
|
||
Fixes: #8701
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 6fb3260d59faab1e20ebf1e44f850f85f6b8342a)
|
||
|
||
commit 4fc72d8d936ac499fbb53a1d73a3f7c05ebe596a
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Jul 18 17:28:18 2014 -0700
|
||
|
||
os/LFNIndex: remove alt xattr after unlink
|
||
|
||
After we unlink, if the nlink on the inode is still non-zero, remove the
|
||
alt xattr. We can *only* do this after the rename or unlink operation
|
||
because we don't want to leave a file system link in place without the
|
||
matching xattr; hence the fsync_dir() call.
|
||
|
||
Note that this might leak an alt xattr if we happen to fail after the
|
||
rename/unlink but before the removexattr is committed. We'll fix that
|
||
next.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit ec36f0a130d67df6cbeefcc9c2d83eb703b6b28c)
|
||
|
||
commit 816ed7e951b32bb9ac57466c0affaec9781ac7f4
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Mon Jul 21 13:43:42 2014 -0700
|
||
|
||
os/LFNIndex: FDCloser helper
|
||
|
||
Add a helper to close fd's when we leave scope. This is important when
|
||
injecting failures by throwing exceptions.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit a320c260a9e088ab0a4ea3d5298c06a2d077de37)
|
||
|
||
commit cbfbe637851c7ebe4a9ec1fd6e429cdf85aef608
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Jul 18 17:09:07 2014 -0700
|
||
|
||
os/LFNIndex: handle long object names with multiple links (i.e., rename)
|
||
|
||
When we rename an object (collection_move_rename) to a different name, and
|
||
the name is long, we run into problems because the lfn xattr can only track
|
||
a single long name linking to the inode. For example, suppose we have
|
||
|
||
foobar -> foo_123_0 (attr: foobar) where foobar hashes to 123.
|
||
|
||
At first, collection_add could only link a file to another file in a
|
||
different collection with the same name. Allowing collection_move_rename
|
||
to rename the file, however, means that we have to convert:
|
||
|
||
col1/foobar -> foo_123_0 (attr: foobar)
|
||
|
||
to
|
||
|
||
col1/foobaz -> foo_234_0 (attr: foobaz)
|
||
|
||
This is a problem because if we link, reset xattr, unlink we end up with
|
||
|
||
col1/foobar -> foo_123_0 (attr: foobaz)
|
||
|
||
if we restart after we reset the attr. This will cause the initial foobar
|
||
lookup to since the attr doesn't match, and the file won't be able to be
|
||
looked up.
|
||
|
||
Fix this by allow *two* (long) names to link to the same inode. If we
|
||
lfn_link a second (different) name, move the previous name to the "alt"
|
||
xattr and set the new name. (This works because link is always followed
|
||
by unlink.) On lookup, check either xattr.
|
||
|
||
Don't even bother to remove the alt xattr on unlink. This works as long
|
||
as the old name and new name don't hash to the same shortname and end up
|
||
in the same LFN chain. (Don't worry, we'll fix that next.)
|
||
|
||
Fixes part of #8701
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
|
||
(cherry picked from commit b2cdfce6461b81f4926602a8c63b54aa92684e6c)
|
||
|
||
commit 5db6c12b61e00b0bc8084ead5976a912ece0fc65
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Jul 18 15:46:58 2014 -0700
|
||
|
||
ceph_test_objectstore: fix warning
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit cf98805c09a38cce78ac08317899dc4152ae55a5)
|
||
|
||
commit e18777ed6eb492e8421d53090b3c9af6e75bd792
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue Jul 15 14:50:33 2014 -0700
|
||
|
||
store_test: add long name collection_move_rename tests
|
||
|
||
Currently fails.
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
(cherry picked from commit 6aa48a485e03ca100f3d9ebec77cc06f99756cd7)
|
||
|
||
Conflicts:
|
||
src/test/objectstore/store_test.cc
|
||
|
||
commit 4e03d5b512c8d2f7fa51dda95c6132e676529f9b
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Sun Aug 3 08:40:57 2014 -0700
|
||
|
||
Revert "enforce rados put aligment"
|
||
|
||
This reverts commit 7a58da53ebfcaaf385c21403b654d1d2f1508e1a.
|
||
|
||
This was alread backported in dece65064d949b5afcc359cd408615883b5e002a.
|
||
|
||
Fixes: #8996
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
|
||
commit 6f1a54436c63a4cb63712936fccade3267d03db8
|
||
Author: Yehuda Sadeh <yehuda@redhat.com>
|
||
Date: Tue Jul 29 15:25:47 2014 -0700
|
||
|
||
rgw: fix crash in swift CORS preflight request
|
||
|
||
Fixes: #8586
|
||
|
||
This fixes error handling, in accordance with commit 6af5a537 that fixed
|
||
the same issue for the S3 case.
|
||
|
||
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
|
||
(cherry picked from commit 18ea2a869791b4894f93fdafde140285f2e4fb65)
|
||
|
||
commit dfcd99567e925bd6565ef4676c560f6c8c89e683
|
||
Author: devicenull <dn@devicenull.org>
|
||
Date: Fri Jul 18 10:25:51 2014 -0400
|
||
|
||
rgw: fix decoding + characters in URL
|
||
|
||
Fixes: #8702
|
||
Backport: firefly
|
||
|
||
Only decode + characters to spaces if we're in a query argument. The +
|
||
query argument. The + => ' ' translation is not correct for
|
||
file/directory names.
|
||
|
||
Resolves http://tracker.ceph.com/issues/8702
|
||
|
||
Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
|
||
Signed-off-by: Brian Rak <dn@devicenull.org>
|
||
(cherry picked from commit 4a63396ba1611ed36cccc8c6d0f5e6e3e13d83ee)
|
||
|
||
commit f9716214a35e3cddd3006f3839f9688c41f0c7ca
|
||
Author: Yehuda Sadeh <yehuda@redhat.com>
|
||
Date: Fri Jul 25 20:33:52 2014 -0700
|
||
|
||
rgw: call processor->handle_data() again if needed
|
||
|
||
Fixes: #8937
|
||
|
||
Following the fix to #8928 we end up accumulating pending data that
|
||
needs to be written. Beforehand it was working fine because we were
|
||
feeding it with the exact amount of bytes we were writing.
|
||
|
||
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
|
||
(cherry picked from commit 0553890e79b43414cc0ef97ceb694c1cb5f06bbb)
|
||
|
||
Conflicts:
|
||
src/rgw/rgw_rados.h
|
||
|
||
commit 4cd1b60c043089358ea8e70a51310005d5b68383
|
||
Author: Yehuda Sadeh <yehuda@redhat.com>
|
||
Date: Thu Jul 24 15:30:27 2014 -0700
|
||
|
||
rgw: object write should not exceed part size
|
||
|
||
Fixes: #8928
|
||
|
||
This can happen if the stripe size is not a multiple of the chunk size.
|
||
|
||
Backport: firefly
|
||
|
||
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
|
||
(cherry picked from commit 14cad5ece7d1de9d93e72acca6d4c3b4a9cfcfa2)
|
||
|
||
commit f68720a6a61364f72f4e0c62aabea65eabe33f98
|
||
Author: Yehuda Sadeh <yehuda@redhat.com>
|
||
Date: Tue Jul 22 15:30:11 2014 -0700
|
||
|
||
rgw: align object chunk size with pool alignment
|
||
|
||
Fixes: #8442
|
||
Backport: firefly
|
||
Data pools might have strict write alignment requirements. Use pool
|
||
alignment info when setting the max_chunk_size for the write.
|
||
|
||
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
|
||
(cherry picked from commit fc83e197ab85355e385c13f2a64957cad7481298)
|
||
|
||
Conflicts:
|
||
src/rgw/rgw_rados.cc
|
||
|
||
commit 67d73451c893b58634f06ed141792da1bf0fa77c
|
||
Author: Yehuda Sadeh <yehuda@redhat.com>
|
||
Date: Wed Jul 30 11:53:16 2014 -0700
|
||
|
||
cls_rgw: fix object name of objects removed on object creation
|
||
|
||
Fixes: #8972
|
||
Backport: firefly, dumpling
|
||
|
||
Reported-by: Patrycja Szabłowska <szablowska.patrycja@gmail.com>
|
||
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
|
||
(cherry picked from commit 0f8929a68aed9bc3e50cf15765143a9c55826cd2)
|
||
|
||
commit d90148da293b4a3e2a44d4486a6b48e27d35b79b
|
||
Merge: 223a0a9 d48a737
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Sat Aug 2 11:28:14 2014 -0700
|
||
|
||
Merge remote-tracking branch 'origin/wip-8438' into firefly-next
|
||
|
||
Backport of c5b8d8105d965da852c79add607b69d5ae79a4d4
|
||
|
||
commit 223a0a9e7ed76fbc114c2f058d3aff93556244e9
|
||
Merge: 84bd3cd d72eec0
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Sat Aug 2 11:22:47 2014 -0700
|
||
|
||
Merge remote-tracking branch 'origin/wip-7999' into firefly-next
|
||
|
||
Backport of 830940bf242a73403ec1882a489e31f7694b7f7e
|
||
|
||
commit 84bd3cd79961d1ddce12048f9ae980fc197e6be4
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Mon Jul 28 17:17:23 2014 -0700
|
||
|
||
unittest_crush_wrapper: fix build
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit f36cffc986c973014c89aa37ca73740b2fc194ca)
|
||
|
||
commit 4983aa32fe8c64c78957b921f5d31ab07be9f850
|
||
Merge: a2681c9 b6d8fea
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Fri Aug 1 19:26:44 2014 -0700
|
||
|
||
Merge pull request #2178 from dachary/wip-erasure-code-profile-default-firefly
|
||
|
||
erasure-code: create default profile if necessary (firefly)
|
||
|
||
commit d89a5a37f2515cc9af1322fd18357e445b94256f
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Jul 30 12:26:44 2014 -0700
|
||
|
||
mon: s/%%/%/
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit d700076a42a5a5ebe769a8311fd3b52bf2e98cd2)
|
||
|
||
commit da0de4ee973d9a9c8ee6f9a5c12eb37c83b4d453
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Jul 30 14:52:06 2014 -0700
|
||
|
||
atomic: fix read() on i386, clean up types
|
||
|
||
Among other things, fixes #8969
|
||
|
||
Backport: firefly
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 96863128e6668257f435c6962263caae0d7d10dd)
|
||
|
||
commit 1e3b927731104629cae9682b55b8d540ef8af12f
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Thu Jun 5 10:43:16 2014 -0700
|
||
|
||
include/atomic: make 32-bit atomic64_t unsigned
|
||
|
||
This fixes
|
||
|
||
In file included from test/perf_counters.cc:19:0:
|
||
./common/perf_counters.h: In member function ‘std::pair PerfCounters::perf_counter_data_any_d::read_avg() const’:
|
||
warning: ./common/perf_counters.h:156:36: comparison between signed and unsigned integer expressions [-Wsign-compare]
|
||
} while (avgcount2.read() != count);
|
||
^
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit 2081c992bbe3a83d711f465634d19c011d28ea3e)
|
||
|
||
commit 34ac3060d408604c7082c583641b90f330f12663
|
||
Author: Dmitry Smirnov <onlyjob@member.fsf.org>
|
||
Date: Wed May 21 07:56:43 2014 +1000
|
||
|
||
Define AO_REQUIRE_CAS (fixes FTBFS on 'hppa')
|
||
|
||
to fix FTBFS due to undeclared atomic functions.
|
||
|
||
As reported
|
||
|
||
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=748571
|
||
|
||
by John David Anglin <dave.anglin@bell.net>
|
||
|
||
~~~~
|
||
./include/atomic.h: In member function 'size_t ceph::atomic_t::inc()':
|
||
./include/atomic.h:42:36: error: 'AO_fetch_and_add1' was not declared in this scope
|
||
return AO_fetch_and_add1(&val) + 1;
|
||
^
|
||
./include/atomic.h: In member function 'size_t ceph::atomic_t::dec()':
|
||
./include/atomic.h:45:42: error: 'AO_fetch_and_sub1_write' was not declared in this scope
|
||
return AO_fetch_and_sub1_write(&val) - 1;
|
||
^
|
||
./include/atomic.h: In member function 'void ceph::atomic_t::add(size_t)':
|
||
./include/atomic.h:48:36: error: 'AO_fetch_and_add' was not declared in this scope
|
||
AO_fetch_and_add(&val, add_me);
|
||
^
|
||
./include/atomic.h: In member function 'void ceph::atomic_t::sub(int)':
|
||
./include/atomic.h:52:48: error: 'AO_fetch_and_add_write' was not declared in this scope
|
||
AO_fetch_and_add_write(&val, (AO_t)negsub);
|
||
^
|
||
./include/atomic.h: In member function 'size_t ceph::atomic_t::dec()':
|
||
./include/atomic.h:46:5: warning: control reaches end of non-void function [-Wreturn-type]
|
||
}
|
||
^
|
||
make[5]: *** [cls/user/cls_user_client.o] Error 1
|
||
~~~~
|
||
|
||
Signed-off-by: Dmitry Smirnov <onlyjob@member.fsf.org>
|
||
(cherry picked from commit 74218f3d6ca8ca9943ff9d08b7926e38fb13b329)
|
||
|
||
commit a0c12b70d93604cde59fc21b4d42cae6bd0f4f26
|
||
Author: Yehuda Sadeh <yehuda@inktank.com>
|
||
Date: Mon Mar 31 14:49:50 2014 -0700
|
||
|
||
atomic_t: add atomic64_t
|
||
|
||
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
|
||
(cherry picked from commit bf3ba6001c7b4cf37edfe6551d3ef298ebcbf421)
|
||
|
||
commit 5a8c8c01cac7f8ef8b898a88cac96af973350a3d
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Jul 30 13:40:33 2014 -0700
|
||
|
||
test/cli-integration/rbd: fix trailing space
|
||
|
||
Newer versions of json.tool remove the trailing ' ' after the comma. Add
|
||
it back in with sed so that the .t works on both old and new versions, and
|
||
so that we don't have to remove the trailing spaces from all of the test
|
||
cases.
|
||
|
||
Backport: firefly
|
||
Fixes: #8920
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 605064dc685aa25cc7d58ec18b6449a3ce476d01)
|
||
|
||
Conflicts:
|
||
src/test/cli-integration/rbd/defaults.t
|
||
|
||
commit 234b2d1933f7f403c094a3c65bf912fcee688181
|
||
Author: John Spray <jspray@redhat.com>
|
||
Date: Mon Jul 7 15:45:54 2014 +0100
|
||
|
||
tests: don't depend on 'data' pool in rbd test
|
||
|
||
Since we removed the default 'data' and 'metadata' pools,
|
||
tests which need a pool should create it themselves.
|
||
|
||
Signed-off-by: John Spray <john.spray@redhat.com>
|
||
(cherry picked from commit a7a631d1e284f151e305f770cef2042a1b9f86c0)
|
||
|
||
commit 751258db76d9f5288ff42e8e961a9ffea1d226de
|
||
Author: Xiaoxi Chen <xiaoxi.chen@intel.com>
|
||
Date: Mon Jul 28 16:54:48 2014 +0800
|
||
|
||
PGMonitor: fix bug in caculating pool avail space
|
||
|
||
Currently for pools with different rules, "ceph df" cannot report
|
||
right available space for them, respectively. For detail assisment
|
||
of the bug ,pls refer to bug report #8943
|
||
|
||
This patch fix this bug and make ceph df works correctlly.
|
||
|
||
Fixes Bug #8943
|
||
|
||
Signed-off-by: Xiaoxi Chen <xiaoxi.chen@intel.com>
|
||
(cherry picked from commit 04d0526718ccfc220b4fe0c9046ac58899d9dafc)
|
||
|
||
commit 7b1546cc5c361a1af7f724e3c3b7ca9436bad76f
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Wed May 28 13:59:47 2014 -0700
|
||
|
||
mon: set min_size to data chunk count for erasure pools
|
||
|
||
Make the min_size value meaningful for erasure pools.
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit e06c58c9b8f585d2fe7c97d010aa0aa61c09d609)
|
||
|
||
commit e859587911edddd3a5b7fd96ee2f6a7ed77478dc
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Sun May 11 13:36:03 2014 -0700
|
||
|
||
mon: include 'max avail' in df output
|
||
|
||
Include an estimate of the maximum writeable space for each pool. Note
|
||
that this value is a conservative estimate for that pool based on the
|
||
most-full OSD. It is also potentially misleading as it is the available
|
||
space if *all* new data were written to this pool; one cannot (generally)
|
||
add up the available space for all pools.
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit 7a9652b58ea70f9a484a135bde20d872616c5947)
|
||
|
||
commit a5e0ebc36ccbdf36e733e5eab926e4446a48fbd8
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Sun May 11 13:31:14 2014 -0700
|
||
|
||
mon: right justify df values
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit 2f63a309df4b7086725949bc0a532595cf927edf)
|
||
|
||
commit 3d578479420f4b0c153dffe96605bf413070ad45
|
||
Author: John Spray <john.spray@inktank.com>
|
||
Date: Thu May 8 11:04:46 2014 +0100
|
||
|
||
mon: Fix % escaping (\% should be %%)
|
||
|
||
Clang's -Wpedantic points this out.
|
||
|
||
Signed-off-by: John Spray <john.spray@inktank.com>
|
||
(cherry picked from commit f0231ef364d531eb60351598c4a0f5fa6efad23c)
|
||
|
||
Conflicts:
|
||
src/mon/DataHealthService.cc
|
||
|
||
commit 6164c3ef8d9ced38d878c191e4de3d84a8bda45e
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Wed May 28 13:49:52 2014 -0700
|
||
|
||
crush: add get_rule_weight_map
|
||
|
||
Calculate a weight map of OSDs for a given rule.
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit 297f6169feecd20e121d102e1b63a505c8b3e74a)
|
||
|
||
commit 2f90bfdb854750990881f2f53492687a07b19546
|
||
Author: Guang Yang <yguang@yahoo-inc.com>
|
||
Date: Wed Jul 9 11:20:36 2014 +0000
|
||
|
||
Fix the PG listing issue which could miss objects for EC pool (where there is object shard and generation).
|
||
Backport: firefly
|
||
Signed-off-by: Guang Yang (yguang@yahoo-inc.com)
|
||
|
||
(cherry picked from commit 228760ce3a7109f50fc0f8e3c4a5697a423cb08f)
|
||
|
||
commit 61c90252c3a496e09962cfda2eb11e6bd112af8a
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Jul 25 14:48:10 2014 -0700
|
||
|
||
osd/ReplicatedPG: requeue cache full waiters if no longer writeback
|
||
|
||
If the cache is full, we block some requests, and then we change the
|
||
cache_mode to something else (say, forward), the full waiters don't get
|
||
requeued until the cache becomes un-full. In the meantime, however, later
|
||
requests will get processed and redirected, breaking the op ordering.
|
||
|
||
Fix this by requeueing any full waiters if we see that the cache_mode is
|
||
not writeback.
|
||
|
||
Fixes: #8931
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 8fb761b660c268e2264d375a4db2f659a5c3a107)
|
||
|
||
commit f701688a360fd977b5e1f59518622ab6d2299a08
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Fri Jul 25 14:43:48 2014 -0700
|
||
|
||
osd/ReplicatedPG: fix cache full -> not full requeueing when !active
|
||
|
||
We only want to do this if is_active(). Otherwise, the normal
|
||
requeueing code will do its thing, taking care to get the queue orders
|
||
correct.
|
||
|
||
Backport: firefly
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 36aaab9eee7ed41a46a4ac27376d630a29de5eb9)
|
||
|
||
commit a1ddce36ebf1ce479129def364328486fbcc5c86
|
||
Author: Dan Mick <dan.mick@inktank.com>
|
||
Date: Wed Jul 30 14:50:37 2014 -0700
|
||
|
||
qa/workunits/cephtool/test_daemon.sh: verify ceph -c works with daemon
|
||
|
||
Signed-off-by: Dan Mick <dan.mick@inktank.com>
|
||
(cherry picked from commit aa9ae1f270293778aa937e7f7e4bcaee3099b9b2)
|
||
|
||
commit 50a1c08e46eaedd3d81a52f64923228bc8a81c26
|
||
Author: Dan Mick <dan.mick@inktank.com>
|
||
Date: Wed Jul 30 14:49:02 2014 -0700
|
||
|
||
qa/workunits/cephtool/test_daemon.sh: typo
|
||
|
||
Signed-off-by: Dan Mick <dan.mick@inktank.com>
|
||
(cherry picked from commit 22d20f39b7355966554319d5a1aa888967607569)
|
||
|
||
commit 4cfb7dbc5c8fe1a28fb945fa12d9795943db1db5
|
||
Author: Dan Mick <dan.mick@inktank.com>
|
||
Date: Wed Jul 30 14:48:28 2014 -0700
|
||
|
||
qa/workunits/cephtool/test_daemon.sh: allow local ceph command
|
||
|
||
(cherry picked from commit 97a8d5a9fdbd3a25cc922c242ee57da58c57d0bc)
|
||
|
||
commit 120b5d5ad51fa47a2bb0a144821635f5f81b5a2e
|
||
Author: Dan Mick <dan.mick@inktank.com>
|
||
Date: Mon Jul 28 21:28:42 2014 -0700
|
||
|
||
ceph.in: Pass global args to ceph-conf for proper lookup
|
||
|
||
Fixes: #8944
|
||
Signed-off-by: Dan Mick <dan.mick@inktank.com>
|
||
(cherry picked from commit 6d89a99648630f81b85ad115fe7662dba6b08a55)
|
||
|
||
commit e0c27cd7fde84944fd350f7df89e79d9a39ace98
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Wed Jul 16 17:55:36 2014 -0700
|
||
|
||
qa/workunits/cephtool/test.sh: test osd pool get erasure_code_profile
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit ce9f12d7a2202948532fed9da4d763ed03f6b8fa)
|
||
|
||
Conflicts:
|
||
qa/workunits/cephtool/test.sh
|
||
|
||
commit cf22759cdf1c0a6d258e5c0a2d32268ce051c742
|
||
Author: Ma Jianpeng <jianpeng.ma@intel.com>
|
||
Date: Wed Jul 16 17:48:34 2014 -0700
|
||
|
||
mon: OSDMonitor: add "osd pool get <pool> erasure_code_profile" command
|
||
|
||
Enable us to obtain the erasure-code-profile for a given erasure-pool.
|
||
|
||
Signed-off-by: Ma Jianpeng <jianpeng.ma@intel.com>
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit e8ebcb79a462de29bcbabe40ac855634753bb2be)
|
||
|
||
commit b94d2f142db63bdf395d8288f8dcef1558d30eaf
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Jul 23 18:25:53 2014 -0700
|
||
|
||
osd/ReplicatedPG: observe INCOMPLETE_CLONES in is_present_clone()
|
||
|
||
We cannot assume that just because cache_mode is NONE that we will have
|
||
all clones present; check for the absense of the INCOMPLETE_CLONES flag
|
||
here too.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 63abf11390bb9b8dd604aae2b3e90596f9ab65ac)
|
||
|
||
commit 22cc1b643f83edbfc0475f6da89cf4bd4c89aae1
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Jul 23 18:24:51 2014 -0700
|
||
|
||
osd/ReplicatedPG: observed INCOMPLETE_CLONES when doing clone subsets
|
||
|
||
During recovery, we can clone subsets if we know that all clones will be
|
||
present. We skip this on caching pools because they may not be; do the
|
||
same when INCOMPLETE_CLONES is set.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 41364711a66c89ce2e94435fe0d54eeda6092614)
|
||
|
||
commit c42232e3539fc4682e8fec3e064b21acbcc996ed
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Jul 23 18:23:56 2014 -0700
|
||
|
||
osd/ReplicatedPG: do not complain about missing clones when INCOMPLETE_CLONES is set
|
||
|
||
When scrubbing, do not complain about missing cloens when we are in a
|
||
caching mode *or* when the INCOMPLETE_CLONES flag is set. Both are
|
||
indicators that we may be missing clones and that that is okay.
|
||
|
||
Fixes: #8882
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 956f28721dd98c5fb9eb410f4fe9e320b3f3eed3)
|
||
|
||
commit bde3a9f0f610e6af30066dd77949a1249cd658bf
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Wed Jul 23 18:21:38 2014 -0700
|
||
|
||
osd/osd_types: add pg_pool_t FLAG_COMPLETE_CLONES
|
||
|
||
Set a flag on the pg_pool_t when we change cache_mode NONE. This
|
||
is because object promotion may promote heads without all of the clones,
|
||
and when we switch the cache_mode back those objects may remain. Do
|
||
this on any cache_mode change (to or from NONE) to capture legacy
|
||
pools that were set up before this flag existed.
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 54bf055c5dadc55acf5731e08712d529b180ffc5)
|
||
|
||
commit f19aa8ef0a2cbad7af3135defc1fe3485d377409
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Fri Jul 11 00:40:47 2014 +0100
|
||
|
||
qa/workunits: cephtool: adjust pool name where missing as it has changed
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 50e93c2138978f7f7c2fbafacc1611c8705a8eab)
|
||
|
||
commit 163440a764a6fac8f2efbee6a8aee5cbc460dfe6
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Fri Jul 11 00:41:01 2014 +0100
|
||
|
||
qa/workunits: cephtool: cleanup after pool creation
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 6cd345732b15e84de17d743e06bc4d85569b79d4)
|
||
|
||
commit c71c99ff21063e26ebfef431f916463f5606aae2
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Tue Jul 8 19:22:49 2014 +0100
|
||
|
||
qa/workunits: cephtool: pool needs to be a tier to be used as such
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 704b0a33f2071eabeb8c5b000a6805ef6d498961)
|
||
|
||
commit ba0a9bf013e8d056a4126b6840621e5a3a8b37fc
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Tue Jul 8 19:22:01 2014 +0100
|
||
|
||
qa/workunits: cephtool: test erroneous 'tier remove'
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 49db6767152092d503ccf8ead6f7cb069e152a22)
|
||
|
||
commit ffec081a551817288303cf3fa00c016bbffe114a
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Thu Jul 3 15:32:46 2014 +0100
|
||
|
||
qa/workunits: cephtool: test get/set on both tier and non-tier pools
|
||
|
||
Make sure gets and sets of tiering-specific variables succeed on tier
|
||
pools and fail on non-tier pools.
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 9fea033f30aec44a3273c623ec6c93eb1d7dd26b)
|
||
|
||
commit 55166c3a098d8751ed6dafb3541e45a6439c5491
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Thu Jul 3 15:24:51 2014 +0100
|
||
|
||
qa/workunits: cephtool: split get/set on tier pools from get/set tests
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit df5944955d96c041e65964a13b802028e9700904)
|
||
|
||
commit 0425eb1dbd156d03a51e91c6f3079b8a687d62f3
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Fri Jun 27 22:20:51 2014 +0100
|
||
|
||
qa/workunits: cephtool: test for 'osd pool {get,set}-quota'
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit b927c0de7d5c7a78bf3c133be52cbc1d769974bb)
|
||
|
||
commit 68197bc28c8960db67c4246d50eb5146659593bd
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Mon Jun 30 17:51:47 2014 +0100
|
||
|
||
mon: OSDMonitor: 'osd pool' - if we can set it, we must be able to get it
|
||
|
||
Add support to get the values for the following variables:
|
||
- target_max_objects
|
||
- target_max_bytes
|
||
- cache_target_dirty_ratio
|
||
- cache_target_full_ratio
|
||
- cache_min_flush_age
|
||
- cache_min_evict_age
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit ddc04c83ff6842ca0b2f804b46099ea729b9fb6b)
|
||
|
||
commit 01498ce8c897f7e3b66c8054a8b144a505a33010
|
||
Author: Loic Dachary <loic@dachary.org>
|
||
Date: Tue Jul 1 08:42:58 2014 +0200
|
||
|
||
qa: support running under non privileged user
|
||
|
||
If the test is run against a cluster started with vstart.sh (which is
|
||
the case for make check), the --asok-does-not-need-root disables the use
|
||
of sudo and allows the test to run without requiring privileged user
|
||
permissions.
|
||
|
||
Signed-off-by: Loic Dachary <loic@dachary.org>
|
||
(cherry picked from commit 522174b066044e51a7019bd6cad81117e83c394e)
|
||
|
||
commit 99259dff5bad93dce928c1ec07a16b34e3dac3dc
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Mon Jun 30 16:38:10 2014 -0700
|
||
|
||
qa/workunits/cephtool/test.sh: sudo ceph daemon
|
||
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit bcc09f93761d46202742ca85cce498a352edd494)
|
||
|
||
commit 4f911d45632fd23c4124bf6b29287ece473d33b4
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Wed Jun 25 21:25:29 2014 +0100
|
||
|
||
qa/workunits: cephtool: fix 'osd bench' test
|
||
|
||
Commit 7dc93a9651f602d9c46311524fc6b54c2f1ac595 fixed an incorrect
|
||
behavior with the OSD's 'osd bench' value hard-caps. The test wasn't
|
||
appropriately modified unfortunately.
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 48e38ac6323f4a0e06b0dedd37ecd10dc339b1e3)
|
||
|
||
commit bad2f513c5bed4602005eaedff9384012103aaee
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Wed Jun 25 01:48:24 2014 +0100
|
||
|
||
qa/workunits: cephtool: only run heap profiler test if tcmalloc enabled
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 4b0809a13eb363a15e52a6a57372a0a31a64cef8)
|
||
|
||
commit 26f9860d19c38595bfced76fce864fe9ad9f3a27
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Tue Jun 24 23:16:17 2014 +0100
|
||
|
||
qa/workunits: cephtool: set +e for the tcmalloc tests
|
||
|
||
Avoids failing the tests when tcmalloc is not present
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 5c4616e100297ba8639919aca7a9cb59e4bda54a)
|
||
|
||
commit a0720b608db208ac766df8eea53bdbba31d79492
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Tue Jun 24 22:47:31 2014 +0100
|
||
|
||
qa/workunits: cephtool: delete unnecessary function calls
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 67255435151627314cc2fc38732d4fb5efddc3cc)
|
||
|
||
commit 373224729e9ab2a46afb43b1388d37ff951cc42e
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Tue Jun 24 22:46:44 2014 +0100
|
||
|
||
qa/workunits: cephtool: disable bash debug when not running tests
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 946bd0dad4b027326b03c13405782b99ef0f91b2)
|
||
|
||
commit 52d733c7202b393b3b7da48e3aa6db275946757a
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Tue Jun 24 22:39:34 2014 +0100
|
||
|
||
qa/workunits: cephtool: allow running individual tests
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 5d26575ef2d31d745ec4aa69ca1501cd76e5e8db)
|
||
|
||
commit 96e58d6d38969ba8b47b1924205eb34850a24ed6
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Tue Jun 24 20:55:27 2014 +0100
|
||
|
||
qa/workunits: cephtool: cleanup state after erasure-code-profile test
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit f4184086d0d647e064e34308f678ef889e13c373)
|
||
|
||
commit 4cd5d179375c06a25f04ef8150e2a53aabf7427e
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Wed Jun 25 01:17:58 2014 +0100
|
||
|
||
qa/workunits: cephtool: add/remove comments
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 780424df3a107c7da57fc28d64f9e7a4bb47f8e8)
|
||
|
||
commit 5bcf690b1dbf5a2e4388661f9d280b5934db1c9c
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Thu Jun 26 00:55:46 2014 +0100
|
||
|
||
qa/workunits: cephtool: split into properly indented functions
|
||
|
||
The test was a big sequence of commands being run and it has been growing
|
||
organically for a while, even though it has maintained a sense of
|
||
locality with regard to the portions being tested.
|
||
|
||
This patch intends to split the commands into functions, allowing for a
|
||
better semantic context and easier expansion. On the other hand, this
|
||
will also allow us to implement mechanisms to run specific portions of
|
||
the test instead of always having to run the whole thing just to test a
|
||
couple of lines down at the bottom (or have to creatively edit the test).
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 3d14a96f4b2b7094d05ead1dec7547d165857e31)
|
||
|
||
Conflicts:
|
||
qa/workunits/cephtool/test.sh
|
||
|
||
commit 2af751807d1b51348302734c46d506db294303fd
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Wed Jun 25 01:12:55 2014 +0100
|
||
|
||
qa/workunits: cephtool: move test line to where it's more appropriate
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 04658b7b2b5f98ae81ffb3f77303745e6d46eb81)
|
||
|
||
commit 5bf9e3c7b59d7ce5996d4d05312b4a92f34bbcb6
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Wed Jun 25 01:11:52 2014 +0100
|
||
|
||
qa/workunits: cephtool: split into functions
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit db6cc133ba4bb38b3c11eb835fd3983dc2f6b00e)
|
||
|
||
Conflicts:
|
||
qa/workunits/cephtool/test.sh
|
||
|
||
commit c898c9736950437256b8c261106f2827fc160e01
|
||
Author: Loic Dachary <loic@dachary.org>
|
||
Date: Fri Jun 20 09:38:39 2014 +0200
|
||
|
||
mon: test that pools used in tiers cannot be removed
|
||
|
||
Signed-off-by: Loic Dachary <loic@dachary.org>
|
||
(cherry picked from commit 39a4b78177cb9896ff35ab05bcf8774bfc934f3a)
|
||
|
||
commit 5b72674238db80e62cf3d5cec1d94be5c0102388
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Fri May 23 17:02:23 2014 +0100
|
||
|
||
qa/workunits/cephtool: test setting options using SI units
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 38405d3554dfb0caf2b0a2c010b95a61bdb99349)
|
||
|
||
Conflicts:
|
||
qa/workunits/cephtool/test.sh
|
||
|
||
commit aacf67d13f81fcc88881091d175fee9ecb0f8954
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Wed Jul 2 20:19:19 2014 +0100
|
||
|
||
mon: OSDMonitor: be scary about inconsistent pool tier ids
|
||
|
||
We may not crash your cluster, but you'll know that this is not something
|
||
that should have happened. Big letters makes it obvious. We'd make them
|
||
red too if we bothered to look for the ANSI code.
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 8e5a8daf98052954f3880d2d3516841b5062466b)
|
||
|
||
commit af59cbf5854bd0fabeb0ef394d7d5b1207bbd6d3
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Wed Jul 2 19:47:52 2014 +0100
|
||
|
||
osd: pg_pool_t: clear tunables on clear_tier()
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit 64bdf6c92bc44adad5a49b9dc4f674789cee80b0)
|
||
|
||
commit 8f788e14d22c913479630bce9f9c502ac900328c
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Wed Jul 2 19:46:48 2014 +0100
|
||
|
||
mon: OSDMonitor: limit tier-specific pool set/get on non-tier pools
|
||
|
||
Fixes: 8696
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit f131dfbaedf6f451572e7aa3a83f653912122953)
|
||
|
||
commit 4b768a8fe9146e6ec033d4f6780e0ef373fcfd7a
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Jul 24 10:06:31 2014 -0700
|
||
|
||
mon/OSDMonitor: improve no-op cache_mode set check
|
||
|
||
If we have a pending pool value but the cache_mode hasn't changed, this is
|
||
still a no-op (and we don't need to block).
|
||
|
||
Backport: firefly
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 67d13d76f5692fa20649ea877f254c34094c11f6)
|
||
|
||
commit c3f403293c7f8d946f66a871aa015a558120ce78
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Sat May 3 03:42:19 2014 +0100
|
||
|
||
mon: OSDMonitor: disallow nonsensical cache-mode transitions
|
||
|
||
Fixes: 8155
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit fd970bbc95d89bf66c9551feca17ac0afbf4d1e2)
|
||
|
||
commit d9aacd96acfe24b15c4e3b2441838945de1ab720
|
||
Author: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
Date: Tue Apr 29 18:03:56 2014 +0100
|
||
|
||
mon: OSDMonitor: return immediately if 'osd tier cache-mode' is a no-op
|
||
|
||
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
|
||
(cherry picked from commit d01aa5bff30441eec1ffaa3e59a21187f8478475)
|
||
|
||
commit 981add9cad5f2db06a4932be228eb0ff30254a9b
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Jul 22 18:01:14 2014 -0700
|
||
|
||
osd/ReplicatedPG: debug obc locks
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 356af4bf46d6387e2f1a59646548f9a77e49e5f8)
|
||
|
||
commit e32e2559c8ff408fff81cce0f15d6601dcd4a2f7
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Jul 22 13:16:11 2014 -0700
|
||
|
||
osd/ReplicatedPG: greedily take write_lock for copyfrom finish, snapdir
|
||
|
||
In the cases where we are taking a write lock and are careful
|
||
enough that we know we should succeed (i.e, we assert(got)),
|
||
use the get_write_greedy() variant that skips the checks for
|
||
waiters (be they ops or backfill) that are normally necessary
|
||
to avoid starvation. We don't care about staration here
|
||
because our op is already in-progress and can't easily be
|
||
aborted, and new ops won't start because they do make those
|
||
checks.
|
||
|
||
Fixes: #8889
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 6fe27823b8459271bf0c0e807493bb7cf1e4559b)
|
||
|
||
commit 68651e9137df2b1034a5b470bbb2fc1d19d8debb
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Tue Jul 22 13:11:42 2014 -0700
|
||
|
||
osd: allow greedy get_write() for ObjectContext locks
|
||
|
||
There are several lockers that need to take a write lock
|
||
because there is an operation that is already in progress and
|
||
know it is safe to do so. In particular, they need to skip
|
||
the starvation checks (op waiters, backfill waiting).
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 09626501d7a0ff964027fd7a534465b76bad23cb)
|
||
|
||
commit a2681c93fb30b912f653b596e27eb8b1bc5c6b78
|
||
Author: Sage Weil <sage@inktank.com>
|
||
Date: Wed Jul 2 10:38:43 2014 -0700
|
||
|
||
qa/workunits/rest/test.py: make osd create test idempotent
|
||
|
||
Avoid possibility that we create multiple OSDs do to retries by passing in
|
||
the optional uuid arg. (A stray osd id will make the osd tell tests a
|
||
few lines down fail.)
|
||
|
||
Fixes: #8728
|
||
Signed-off-by: Sage Weil <sage@inktank.com>
|
||
(cherry picked from commit bb3e1c92b6682ed39968dc5085b69c117f43cbb0)
|
||
|
||
commit 7a58da53ebfcaaf385c21403b654d1d2f1508e1a
|
||
Author: Lluis Pamies-Juarez <lluis@pamies.cat>
|
||
Date: Wed Jun 18 10:00:09 2014 -0700
|
||
|
||
enforce rados put aligment
|
||
|
||
Signed-off-by: Lluis Pamies-Juarez <lluis.pamies-juarez@hgst.com>
|
||
(cherry picked from commit 304b08a23a3db57010078046955a786fe3589ef8)
|
||
(cherry picked from commit dece65064d949b5afcc359cd408615883b5e002a)
|
||
|
||
commit 7ae15549a795ffd9ffcd34ea1d5c101b90eee26d
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Jul 31 15:39:40 2014 -0700
|
||
|
||
use llrintl when converting double to micro
|
||
|
||
This avoids rounding error (noticeable on i386).
|
||
|
||
Backport: firefly
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 80911736bd61b6b88eac0974d24f21c15c5385a4)
|
||
|
||
Conflicts:
|
||
src/mon/OSDMonitor.cc
|
||
|
||
commit f5fc24368756c794d186a0990241e0dc0adfc03c
|
||
Author: Sage Weil <sage@redhat.com>
|
||
Date: Thu Jul 24 18:22:22 2014 -0700
|
||
|
||
msg/SimpleMessenger: drop local_conneciton priv link on shutdwon
|
||
|
||
This breaks ref cycles between the local_connection and session, and let's
|
||
us drop the explicit set_priv() calls in OSD::shutdown().
|
||
|
||
Signed-off-by: Sage Weil <sage@redhat.com>
|
||
(cherry picked from commit 63c1711a9e237c14d137131f56751970ad1567b1)
|
||
|
||
commit b6d8feab85fda97bf3a68980249a71846778a157
|
||
Author: Loic Dachary <loic@dachary.org>
|
||
Date: Thu Jun 19 00:49:13 2014 +0200
|
||
|
||
erasure-code: create default profile if necessary
|
||
|
||
After an upgrade to firefly, the existing Ceph clusters do not have the
|
||
default erasure code profile. Although it may be created with
|
||
|
||
ceph osd erasure-code-profile set default
|
||
|
||
it was not included in the release notes and is confusing for the
|
||
administrator.
|
||
|
||
The *osd pool create* and *osd crush rule create-erasure* commands are
|
||
modified to implicitly create the default erasure code profile if it is
|
||
not found.
|
||
|
||
In order to avoid code duplication, the default erasure code profile
|
||
code creation that happens when a new firefly ceph cluster is created is
|
||
encapsulated in the OSDMap::get_erasure_code_profile_default method.
|
||
|
||
Conversely, handling the pending change in OSDMonitor is not
|
||
encapsulated in a function but duplicated instead. If it was a function
|
||
the caller would need a switch to distinguish between the case when goto
|
||
wait is needed, or goto reply or proceed because nothing needs to be
|
||
done. It is unclear if having a function would lead to smaller or more
|
||
maintainable code.
|
||
|
||
http://tracker.ceph.com/issues/8601 Fixes: #8601
|
||
|
||
Backport: firefly
|
||
Signed-off-by: Loic Dachary <loic@dachary.org>
|
||
(cherry picked from commit 4e1405e7720eda71a872c991045ac8ead6f3e7d8)
|
||
|
||
commit 2fff5f031b2cc00b55bd1ada4f83e4838fe59ddd
|
||
Author: Loic Dachary <loic@dachary.org>
|
||
Date: Mon Jan 13 17:54:08 2014 +0100
|
||
|
||
common: s/stringstream/ostream/ in str_map
|
||
|
||
There is no need to specialize more than ostream : it only makes it
|
||
impossible to use cerr or cout as a parameter to str_map.
|
||
|
||
Reviewed-By: Christophe Courtaut <christophe.courtaut@gmail.com>
|
||
Signed-off-by: Loic Dachary <loic@dachary.org>
|
||
(cherry picked from commit 6aa45b133956b974a992b372496b90c908d94f12)
|
||
|
||
commit d48a737a6f8daa463ddf82106455b2efe7715a33
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Mon Jun 2 13:44:49 2014 -0700
|
||
|
||
osd/: in scrub, check for and remove obsolete rollback objs
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit 953c33edb640f6eb0c3f3a0d07c061c0d324242b
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Fri May 30 16:53:37 2014 -0700
|
||
|
||
osd/: plumb rollback_trim_to through interfaces and messages
|
||
|
||
We simply trim the roll back info up to min_last_complete_ondisk
|
||
since we cannot correctly rollback past that point anyway!
|
||
|
||
ReplicatedPG
|
||
-> PGBackend::submit_transaction
|
||
-> Backend messages
|
||
-> PGBackend::Listener::log_operation
|
||
-> append_log
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit ac11ca40b4f4525cbe9b1778b1c5d9472ecb9efa
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Fri May 30 16:27:32 2014 -0700
|
||
|
||
PGLog: add rollback_info_trimmed_to_riter to IndexedLog and use in PG
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit 2207ed12fa544afc48d6d28f199381ccf0367292
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Fri May 30 15:40:15 2014 -0700
|
||
|
||
PGLog: fix logging whitespace in trim
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit d72eec0341e02881229d0e4ffeafcae92eb33fb6
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Fri Jun 27 10:51:13 2014 -0700
|
||
|
||
PG: block outgoing peering messages until the last interval is durable
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit f9f89be38333d3817a0eafc52a961365e21e1f3a
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Wed May 21 13:09:33 2014 -0700
|
||
|
||
PG: add machinery to temporarily buffer outgoing recovery messages
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit f7498124325fe2269c33e45fae4c8181c8f7be14
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Mon Jun 9 11:00:32 2014 -0700
|
||
|
||
os/: add async flush_commit() method to Sequencer and implementations
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit 669b60571d6db9a9f74020e6a43b12b82edee41e
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Fri May 30 15:18:53 2014 -0700
|
||
|
||
PGLog: initialize complete_to
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit 8679cdbeea6350fd860a9419f54578a90482895c
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Thu May 29 12:10:31 2014 -0700
|
||
|
||
osd_types: add pg_log_t::rollback_info_trimmed_to
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|
||
|
||
commit 3bbe29eb5cca7cc42266a6c5561ce68feb4072de
|
||
Author: Samuel Just <sam.just@inktank.com>
|
||
Date: Tue May 20 16:05:01 2014 -0700
|
||
|
||
common/Finisher: add queue(list<Context*>&)
|
||
|
||
Signed-off-by: Samuel Just <sam.just@inktank.com>
|