Commit Graph

44887 Commits

Author SHA1 Message Date
Loic Dachary
7af863d3f8 Merge pull request #6113 from dachary/wip-13176-objectstore-tool
ceph-objectstore-tool: delete ObjectStore::Sequencer after umount

Reviewed-by: David Zafman <dzafman@redhat.com>
2015-09-30 02:21:58 +02:00
Samuel Just
bb55d6c0c3 Merge pull request #6036 from liewegas/wip-13116
osd: fix replay requeue when pg is activating

Reviewed-by: Samuel Just <sjust@redhat.com>
2015-09-29 17:19:12 -07:00
Sage Weil
41d59fcc3b Merge remote-tracking branch 'gh/infernalis' 2015-09-29 20:15:31 -04:00
Loic Dachary
47f4a03939 ceph-objectstore-tool: delete ObjectStore::Sequencer after umount
An ObjectStore::Sequencer provided to an ObjectStore must not be
deallocated before umount. The ObjectStore::Sequencer may hold a pointer
to the instance with no reference counting. If a Context completes after
the ObjectStore::Sequencer is deleted, it could try to use it and fail.

http://tracker.ceph.com/issues/13176 Fixes: #13176

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-30 00:54:27 +02:00
Sage Weil
de29da4973 Merge pull request #6101 from liewegas/wip-fs
os/fs: fix do loop

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-09-29 17:42:08 -04:00
branto1
8322a5c2a6 Merge pull request #6103 from SUSE/wip-re-redrop-fdupes
ceph.spec.in: re-re-drop fdupes

Reviewed-by: Boris Ranto <branto@redhat.com>
2015-09-29 12:57:32 +02:00
Nathan Cutler
e42c9aaec7 ceph.spec.in: re-re-drop fdupes
The %fdupes call was dropped by 53072b9019
Later, it got accidentally reinstated by ceb93e8e69

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2015-09-29 08:57:16 +02:00
Gregory Farnum
a467db1de5 Merge pull request #6025 from ukernel/wip-13167
journaler: detect unexpected holes in journal objects

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-09-28 22:21:34 -07:00
Gregory Farnum
119336fbf6 Merge pull request #5849 from ukernel/wip-32bits-ceph-fuse
Wip 32bits ceph fuse

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-09-28 22:19:11 -07:00
Gregory Farnum
e171984b9c Merge pull request #4791 from ceph/wip-11783
cephfs: detect completed cap flushes

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-09-28 22:14:52 -07:00
Yan, Zheng
ae62a9cf1e Merge pull request #6070 from jcsp/wip-reformat-subtreemaptest
Fix reformatting journals containing SUBTREEMAP_TEST events
2015-09-29 10:12:39 +08:00
Yan, Zheng
95cc1549be Merge pull request #6082 from jcsp/wip-client-quota-roots
Fix quota enforcement on subdir mounts
2015-09-29 10:02:28 +08:00
Sage Weil
566c8728b6 os/fs: fix aio submit method
continue in a do while(false) will always eval false and break
out.  To repeat, we need while (true) and an explicit break.

Reported-by: Danny Al-Gaaf <danny.al-gaaf@bisect.de>
Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-28 21:31:23 -04:00
Sage Weil
04f9ae5724 Merge pull request #6078 from H3C/wip-13208
Objecter: maybe access wild pointer(op) in _op_submit_with_budget.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-09-28 16:42:01 -04:00
Sage Weil
14a36a20ff Merge pull request #6064 from H3C/wip-rbd-bugfix1
Objecter: misc fix for segmentation fault.

Reviewed-by: Sage Weil <sage@redhat.com>
2015-09-28 16:41:44 -04:00
Sage Weil
8d97771c3c Merge pull request #6084 from liewegas/wip-revert-scrub
Revert "osd: new pool settings: scrub intervals"

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2015-09-28 16:40:31 -04:00
Ken Dreyer
d73ca4f597 Merge pull request #5832 from SUSE/wip-drop-dup-rcceph
ceph.spec.in: refrain from duplicating %{_sbindir}/rcceph

Reviewed-by: Ken Dreyer <kdreyer@redhat.com>
2015-09-28 13:09:38 -06:00
Samuel Just
405eef2f56 Merge pull request #6098 from liewegas/wip-crash-replay-interval
don't assume crash_replay_itnerval == 45

Reviewed-by: Samuel Just <sjust@redhat.com>
2015-09-28 10:17:41 -07:00
Sage Weil
80b7237e5e qa/workunits/cephtool/test.sh: don't assume crash_replay_interval=45
e.g., it's 5 in teuthology's ceph.conf.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-28 13:13:40 -04:00
Sage Weil
4ef8a0e1f7 Merge pull request #6076 from liewegas/wip-scrub-fix
osd/PG: compensate for sloppy hobject scrub bounds from hammer

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-09-28 11:44:46 -04:00
Loic Dachary
83e10f7e2d Merge pull request #6086 from stiopaa1/librados_missingsemicolon
examples/librados/hello_world.cc:missing semicolon

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-09-26 16:12:33 +02:00
Michal Jarzabek
2fea3a56a6 examples/librados/hello_world.cc:missing semicolon
Signed-off-by: Michal Jarzabek <stiopa@gmail.com>
2015-09-26 14:45:22 +01:00
Sage Weil
bee3bdf551 Merge pull request #6068 from dachary/wip-12936-shec
erasure-code: shec must compare for equality with epsilon

Reviewed-by: Sage Weil <sage@redhat.com>
2015-09-26 01:24:22 -04:00
Sage Weil
c571fd23d5 Merge pull request #6052 from liewegas/wip-13098
osd: fix full request handling

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-09-26 01:22:39 -04:00
Sage Weil
7ad2ac0f0f Merge pull request #6075 from liewegas/wip-osd-getmap
osd: avoid duplicate MMonGetOSDMap requests

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-09-26 01:22:10 -04:00
Dan Mick
0cdc8d3a41 Merge pull request #6077 from liewegas/wip-qa
qa: http://ceph.com/qa -> http://download.ceph.com/qa
also some ceph.com/git -> git.ceph.com and a few line-endings - dmick

Reviewed-by: Dan Mick <dmick@redhat.com>
2015-09-25 11:14:51 -07:00
Sage Weil
216eef53e9 Revert "osd: new pool settings: scrub intervals"
This reverts commit 30810da4b5.

After some discussion we have decided it is better to build a generic
dictionary in pg_pool_t to store infrequently used per-pool properties.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-25 14:01:19 -04:00
Gregory Farnum
9c9514f727 Merge pull request #6083 from jcsp/wip-mds-allow-star
ceph-create-keys: set mds "allow *"

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-09-25 08:40:51 -07:00
John Spray
c7e905e7e2 ceph-create-keys: set mds "allow *"
So that 'tell' works out of the box.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-09-25 16:09:00 +01:00
Loic Dachary
f1f14f18f9 erasure-code: shec must compare for equality with epsilon
When comparing two double for strict inequality, a test for equality
using epsilon must also be done to ensure the results do not vary cross
platform.

http://tracker.ceph.com/issues/12936 Fixes: #12936

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-09-25 17:04:10 +02:00
Kefu Chai
fe35ba3f97 Merge pull request #5959 from mslovy/wip-current-dev
mon: Fix unnecessary at/near max target warn in ceph -s

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-09-25 21:41:48 +08:00
Kefu Chai
139212217c Merge pull request #5356 from majianpeng/code-cleanup
osd: cleanup code when met crc error.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-09-25 21:39:20 +08:00
Kefu Chai
ae7512dc48 Merge pull request #5972 from Jerry7X/master
unsigned type is short for journal max_size,use uint64_t instead

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-09-25 21:31:38 +08:00
Sage Weil
a2d806363e Merge remote-tracking branch 'gh/infernalis' 2015-09-25 08:59:54 -04:00
Sage Weil
892a2adeb5 Merge pull request #6048 from XinzeChi/wip-filestore-qlock
filestore: fix peek_queue for OpSequencer

Reviewed-by: Sage Weil <sage@redhat.com>
2015-09-25 08:56:02 -04:00
Sage Weil
9619c4a351 Merge pull request #6040 from liewegas/wip-mon-kv
mon: some fixes for kv backend failures

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
2015-09-25 08:53:53 -04:00
Sage Weil
28339feff6 Merge pull request #6022 from jdurgin/wip-13032
msg: randomize client nonces

Reviewed-by: Sage Weil <sage@redhat.com>
2015-09-25 08:53:00 -04:00
Sage Weil
4742f5d472 Merge pull request #6012 from liewegas/wip-mon
mon: misc scaling fixes

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-09-25 08:52:29 -04:00
John Spray
e52204ccca client: fix quote enforcement on subdir mounts
While we don't allow setting quotas on the global
filesystem root, the inode which is root from the
client mount's point of view might have a quota.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-09-25 13:24:00 +01:00
John Spray
15e19a4a62 client: refactor quota check functions
Generalise the path traversal into check_quota_condition
and then call that from each of file_exceeded, bytes_exceeded,
bytes_approaching with the appropriate lambda function.

Motivated by fixing the path traversal and wanting to
only fix it in one place.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-09-25 13:24:00 +01:00
Kefu Chai
273b4706b2 Merge pull request #6027 from wido/mirror-docs
docs: Update docs to make it clear that there are mirrors worldwide

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-09-25 19:16:08 +08:00
Ruifeng Yang
f1d8a8f577 Objecter: repeated free op->ontimeout.
repeated free op->ontimeout in SafeTimer::timer_thread::callback->complete

Fixes: #13208
Signed-off-by: Ruifeng Yang <yangruifeng.09209@h3c.com>
2015-09-25 12:42:36 +08:00
Ruifeng Yang
0635b13583 Objecter: maybe access wild pointer(op) in _op_submit_with_budget.
look at "after giving up session lock it can be freed at any time by response handler" in _op_submit,
so the _op_submit_with_budget::op maybe is wild after call _op_submit.

Fixes: #13208
Signed-off-by: Ruifeng Yang <yangruifeng.09209@h3c.com>
2015-09-25 10:21:47 +08:00
Sage Weil
a1eb380c3d osd/ReplicatedPG: fix ENOSPC checking
1. We need to return ENOSPC *before* we apply our side-effects to the obc
cache in finish_ctx().

2. Consider object count changes too, not just bytes.

3. Consider cluster full flag, not just the pool flag.

4. Reply only if FULL_TRY; silently drop ops that were sent despite the
full flag.

Fixes: #13098
Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-24 19:27:16 -04:00
Sage Weil
da7f3adda4 osd/osd_types: remove [pool_]last_epoch_marked_full from OSDSuperblock
This is no longer used or needed.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-24 19:13:03 -04:00
Sage Weil
9c93ee3002 osd: remove buggy [pool_]last_map_marked_full tracking
This is buggy (we reset the pool epoch each time it remains full instead
of only on the initial transition from non-full to full) and now unused.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-24 19:13:03 -04:00
Sage Weil
8ffefecf23 osd: do full check in do_op
1. The current pool_last_map_marked_full tracking is buggy.
2. We need to recheck this each time we consider the op, not just when it
is received off the wire.  Otherwise, we might get a message, queue it
for some reason, get a map indicating the cluster or pool is full, and
then requeue and process the op instead of discarding it.
3. For now, silently drop ops when failsafe check fails. This will lead to
stalled client IO.  This needs a more robust fix.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-24 19:13:03 -04:00
Sage Weil
1f2274e2b4 osd/PG: set last_epoch_marked_full on map advance
This will get persisted and shared.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-24 19:13:03 -04:00
Sage Weil
79475d8e8f osd/osd_types: add last_epoch_marked_full to pg_history_t
Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-24 19:13:02 -04:00
Sage Weil
bf7e937a8b osdc/Objecter: set FULL_FORCE flag when honor_full is false
This currenty only applies to the MDS.  Eventually we can remove the
OSD MDS checks once we are confident all MDS instances are new enough
to set this flag.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-09-24 19:13:02 -04:00