Commit Graph

36034 Commits

Author SHA1 Message Date
Samuel Just
0f731ae580 Revert "ReplicatedPG: clean out completed trimmed objects as we go" 2014-10-01 13:18:46 -07:00
Sage Weil
da9ae5c92e ceph.spec: fix typo
Signed-off-by: Sage Weil <sage@redhat.com>
2014-10-01 12:33:38 -07:00
Sage Weil
b1d5dc6bc4 Merge pull request #2614 from ceph/wip-rpm-epoch
rpm: set epoch 1 to match fedora

Reviewed-by: Boris Ranto <branto@redhat.com>
2014-10-01 12:23:44 -07:00
Yehuda Sadeh
f26ba0461e Merge branch 'wip-9013' into giant 2014-10-01 10:28:38 -07:00
Yehuda Sadeh
63d0ec7b2c rgw: add civetweb as a default frontend
Fixes: #9013
Originally the configurable was empty, now setting explicitly both
fastcgi and civetweb (on port 7480).

Reviewed-by: Sage Weil <sage@redhat.com>
Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2014-10-01 10:27:51 -07:00
Sage Weil
8388836208 ceph.spec.: add epoch
This is done in fedora packaging.  Do it here too so that you can move
between upstream packages (from ceph.com) and fedora and other derivatives
will builds.

Backport: firefly, dumpling
Signed-off-by: Sage Weil <sage@redhat.com>
2014-10-01 06:02:02 -07:00
Sage Weil
17544a460a Merge pull request #2615 from ceph/wip-fsls-json
mon: fix JSON `fs ls` output

Reviewed-by: Sage Weil <sage@redhat.com>
2014-10-01 05:54:45 -07:00
John Spray
a470c96e6b mon: fix JSON fs ls output
A missing list terminator was causing unparseable output.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-10-01 12:09:16 +01:00
Josh Durgin
fd5af13949 Merge pull request #2564 from ceph/wip-8587
rgw: subuser creation fixes

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-09-30 17:24:02 -07:00
Sage Weil
544d8255c9 Merge pull request #2613 from ceph/wip-8822
osd: swap state spinlock for atomic_t

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-09-30 14:45:27 -07:00
Sage Weil
62e2bca8d8 osd: swap state spinlock for atomic_t
We are hitting a strange issue with valgrind and pthread spinlocks. Avoid
the issue by using an atomic_t here (which is simpler anyway).

Avoids: #8822
Backport: firefly
Signed-off-by: Sage Weil <sage@redhat.com>
2014-09-30 11:56:30 -07:00
Gregory Farnum
e30969b19e Merge pull request #2612 from ceph/wip-9562-backport
osdc/Filer: drop probe/purge locks before calling objecter

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-09-30 10:49:05 -07:00
John Spray
a8ac4b62a5 osdc/Filer: drop probe/purge locks before calling objecter
Fixes: #9562

Signed-off-by: John Spray <john.spray@redhat.com>
(cherry picked from commit 8dc94a2d8c)
2014-09-30 18:46:25 +01:00
Greg Farnum
0ea20a668c Locker: accept ctime updates from clients without dirty write caps
The ctime changes any time the inode does. That can happen even without
the file itself having changed, so we'd better accept the update whenever
the auth caps have dirtied, without worrying about the file caps!

Fixes: #9514
Backport: firefly

Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: John Spray <john.spray@redhat.com>
2014-09-30 10:24:51 -07:00
Loic Dachary
9c4616dcd2 Merge pull request #2556 from dachary/wip-9572-erasure-code-blaumroth
erasure-code: restore jerasure BlaumRoth default w

Reviewed-by: Sage Weil <sage@redhat.com>
2014-09-30 01:48:26 +02:00
Sage Weil
5281ac7aa9 Merge pull request #2601 from ceph/wip-python-flask
debian: python-flask is needed by ceph, not python-ceph

Reviewed-by: Loic Dachary <loic@dachary.org>
2014-09-29 16:24:50 -07:00
Sage Weil
fe3434f41c debian: move ceph_rest_api.py into ceph
Signed-off-by: Sage Weil <sage@redhat.com>
2014-09-29 14:28:32 -07:00
Sage Weil
8cda623e0b ceph.spec.in: move ceph_rest_api.py into ceph
Signed-off-by: Sage Weil <sage@redhat.com>
2014-09-29 14:24:01 -07:00
Sage Weil
0d1a4171c1 Merge pull request #2602 from athanatos/wip-9574
PG: check full ratio again post-reservation

Reviewed-by: Sage Weil <sage@redhat.com>
2014-09-29 14:14:40 -07:00
Sage Weil
acd49892df Merge pull request #2604 from athanatos/wip-9113
ReplicatedPG: clean out completed trimmed objects as we go

Reviewed-by: Sage Weil <sage@redhat.com>
2014-09-29 14:02:15 -07:00
Samuel Just
78fc7b8198 Merge pull request #2549 from ceph/wip-9545
os/FileJournal: do not request sync while shutting down

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-09-29 13:54:31 -07:00
Samuel Just
f91c571ef6 Merge pull request #2550 from ceph/wip-8629
osd: fix cache_evict vs make_writeable/finish_ctx snapdir bug #8629

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-09-29 13:52:21 -07:00
Samuel Just
ffda34c4be Merge pull request #2510 from somnathr/wip-obj-delete-fix
FileStore: Race condition during object delete is fixed

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-09-29 13:44:37 -07:00
Sage Weil
b2416240b8 ceph.spec: fix python-flask dependency
This is needed by ceph-rest-api, which is in ceph.rpm; it's not related to
python-ceph (except that ceph-rest-api happens to require that too).

Backport: firefly
Signed-off-by: Sage Weil <sage@redhat.com>
2014-09-29 13:44:03 -07:00
Sage Weil
e42424e777 debian: python-flask is needed by ceph, not python-ceph
It's used by ceph-rest-api which is in the 'ceph' (server) package.

Backport: firefly
Signed-off-by: Sage Weil <sage@redhat.com>
2014-09-29 13:40:18 -07:00
Sage Weil
614157c288 Merge pull request #2598 from ceph/wip-9582
librados: fix other timeout segfault

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-09-29 13:08:10 -07:00
Sage Weil
9af9df42f2 Merge pull request #2594 from dachary/wip-9620-test-mon-thrash
qa/workunits/cephtool/test.sh: fix thrash (ultimate)

Reviewed-by: Sage Weil <sage@redhat.com>
2014-09-29 08:18:36 -07:00
Loic Dachary
beade63a17 qa/workunits/cephtool/test.sh: fix thrash (ultimate)
Keep the osd trash test to ensure it is a valid command but make it a
noop by giving it a zero argument (meaning thrash 0 OSD maps).

Remove the loops that were added after the command in an attempt to wait
for the cluster to recover and not pollute the rest of the tests. Actual
testing of osd thrash would require a dedicated cluster because it the
side effects are random and it is unnecessarily difficult to ensure they
are finished.

http://tracker.ceph.com/issues/9620 Fixes: #9620

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-09-29 13:47:06 +02:00
Dan van der Ster
f8ac2248af ceph-disk: add Scientific Linux as a Redhat clone
Scientific Linux is a RHEL clone and needs to use partx.

Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
(cherry picked from commit 5ca7ea5b53)
2014-09-26 17:46:15 -07:00
Sage Weil
5c2984e6e1 Merge pull request #2531 from dachary/wip-9536-isa-alignment
erasure-code: isa plugin alignment fixes

Reviewed-by: Sage Weil <sage@redhat.com>
2014-09-25 14:05:57 -07:00
Sage Weil
d851c3f233 osd: improve debug output for do_{notifies,queries,infos}
Hunting #9389

Signed-off-by: Sage Weil <sage@redhat.com>
2014-09-25 13:51:46 -07:00
Sage Weil
2ba5ed57b3 Merge pull request #2540 from ceph/wip-giant-messenger-fixes
giant messenger fixes

Reviewed-by: Sage Weil <sage@redhat.com>
2014-09-25 13:01:38 -07:00
Sage Weil
126d0b30e9 osdc/Objecter: only post_rx_buffer if no op timeout
If we post an rx buffer and there is a timeout, the revocation can happen
while the reader has consumed the buffers but before it has decoded and
constructed the message.  In particular, we calculate a crc32c over the
data portion of the message after we've taken the buffers and dropped the
lock.

Instead of fixing this race (for example, by reverifying rx_buffers under
the lock while calculating the crc.. bleh), just skip the rx buffer
optimization entirely when a timeout is present.

Note that this doesn't cover the op_cancel() paths, but none of those users
provide static buffers to read into.

Fixes: #9582
Backport: firefly, dumpling
Signed-off-by: Sage Weil <sage@redhat.com>
2014-09-25 12:34:11 -07:00
Sage Weil
0115a55aa3 Merge pull request #2574 from ceph/wip-msgr-shutdown
msg: allow calling dtor immediately after ctor

Reviewed-by: Sage Weil <sage@redhat.com>
2014-09-25 09:26:18 -07:00
Loic Dachary
ba02a5e638 erasure-code: test isa encode/decode with various object sizes
Create an encode_decode() helper method to be called from the
encode_decode test function with various object size arguments. The
helper method is a copy/paste of the previous test that was using a
single object of a fixed size. The test is slightly adapted to
accommodate for different object sizes but the logic is not modified.

The object sizes being tested are chosen to be under the size of the
required size alignment or on multiple pages, size aligned or not.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-09-25 18:05:01 +02:00
Loic Dachary
eb8fdfa4f5 erasure-code: add test for isa chunk_size method
Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-09-25 18:04:58 +02:00
John Spray
7a468f358b msg: allow calling dtor immediately after ctor
Asserting on reaper_stop only made sense if the
messenger had ever been started: as it stood,
one couldn't create and destroy a messenger
without also starting and stopping it.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-09-25 17:01:10 +01:00
Loic Dachary
af07d29e27 erasure-code: isa encode tests adapted to per chunk alignment
The encode tests use the alignment constraints. It has been changed to
be aligned on a per chunk basis instead of computing a more expensive
object alignement constraint. The test function is modified to take the
change into account but the logic is otherwise unmodified.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-09-25 17:39:16 +02:00
Loic Dachary
aa9d70be38 erasure-code: isa test compare chunks with memcmp instead of strncmp
Because they may contain null characters.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-09-25 17:39:16 +02:00
Loic Dachary
ed77178e7d erasure-code: run isa tests via libtool and valgrind
Because running valgrind with no libtool does not test the binary but
the enclosing shell script.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-09-25 17:39:16 +02:00
Loic Dachary
668c352721 erasure-code: do not use typed tests for isa
Because there only is one type.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-09-25 17:39:16 +02:00
Loic Dachary
28c2b6e4f2 erasure-code: isa uses per chunk alignment constraints
Copy code from the jerasure plugin to enforce alignment constraints per
chunk instead of using the total object size. It is simpler and reduces
the size of the chunks. See
c7daaaf5e6
for more information.

Signed-off-by: Loic Dachary <loic-201408@dachary.org>
2014-09-25 17:39:10 +02:00
Andreas Peters
6f4909ae59 erasure-code: [ISA] modify get_alignment function to imply a platform/compiler independent alignment constraint of 32-byte aligned buffer addresses & length 2014-09-25 17:37:27 +02:00
Samuel Just
7f87cf1b1d ReplicatedPG: clean out completed trimmed objects as we go
Also, explicitely maintain a max number of concurrently trimming
objects.

Fixes: 9113
Backport: dumpling, firefly, giant
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-09-24 15:33:11 -07:00
Loic Dachary
468d245a02 Merge pull request #2506 from dachary/wip-9304-unintended-implicit-ruleset
erasure-code: pool create must not always create a ruleset

Reviewed-by: João Eduardo Luís <joao@redhat.com>
2014-09-24 13:35:55 +02:00
Samuel Just
4be53d5eeb PG: check full ratio again post-reservation
Otherwise, we might queue 30 pgs for backfill at 0.80 fullness
and then never check again filling the osd after pg 11.

Fixes: #9574
Backport: dumpling, firefly, giant
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-09-23 12:53:41 -07:00
Sage Weil
f711819df5 Merge pull request #2561 from athanatos/wip-9293
Wip 9293

Reviewed-by: Sage Weil <sage@redhat.com>
2014-09-23 11:40:13 -07:00
Loic Dachary
34e665867e Merge pull request #2557 from ceph/wip-mon-fix-checks
ceph-mon: check fs stats just before preforking

Reviewed-by: Loic Dachary <loic-201408@dachary.org>
2014-09-23 17:59:02 +02:00
Joao Eduardo Luis
7f71c11666 ceph-mon: check fs stats just before preforking
Otherwise statfs may fail if mkfs hasn't been run yet or if the monitor
data directory does not exist.  There are checks to account for the mon
data dir not existing and we should wait for them to clear before we go
ahead and check the fs stats.

Signed-off-by: Joao Eduardo Luis <joao@redhat.com>
2014-09-23 14:05:48 +01:00
Loic Dachary
9d3fbe92a8 Merge pull request #2551 from dachary/wip-9343-erasure-code-feature
erasure code feature

Reviewed-by: João Eduardo Luís <joao@redhat.com>
2014-09-23 13:37:27 +02:00