Commit Graph

34408 Commits

Author SHA1 Message Date
Greg Farnum
c15e524169 Revert "qa: add an fsx run which turns on kernel debugging"
This reverts commit 29c33f0c05.
We don't need the debugging any more, and having two separate fsx runners
already caused one update-in-the-wrong-place issue.

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-07-09 10:49:59 -07:00
Abhishek Lekshmanan
2217f2bd0a doc: fix a typo in quickstart doc
* doc/start/documenting-ceph.rst: s/along side/alongside

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2014-07-09 11:18:49 +05:30
Abhishek Lekshmanan
7a0ea798cf doc: fix a few typos in radosgw docs
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2014-07-09 11:18:09 +05:30
Abhishek Lekshmanan
d0892831f9 doc: fix a few typos in rados docs
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2014-07-09 11:15:08 +05:30
Abhishek Lekshmanan
cc5c33f566 doc: fix a few typos in the dev docs
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2014-07-09 11:05:46 +05:30
Abhishek Lekshmanan
e23ed9b7dc doc: fix a few typos in rbd docs
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2014-07-09 10:58:59 +05:30
Abhishek Lekshmanan
d693d7bf7b doc: Fix a few typos in the install docs
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2014-07-09 10:47:51 +05:30
Abhishek Lekshmanan
bb881e53da doc: fix a few typos in architecture page
Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2014-07-09 10:28:35 +05:30
Abhishek Lekshmanan
fcbdd2fe9f doc: Fix a typo in the rbd man page
's/specifially/specifically'

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2014-07-09 10:27:41 +05:30
Haomai Wang
ef117fef69 Use submit_transaction_sync to make change durable
submit_transaction will use asynchronous write operation, there is no journal
for keyvaluestore so we need to make it sync

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2014-07-09 10:53:10 +08:00
Haomai Wang
6ff5fedb30 Add random cache and replace SharedLRU in KeyValueStore
SharedLRU plays pool performance in KeyValueStore with large header cache size,
so a performance optimized RandomCache could improve it.

RandomCache will record the lookup frequency of key. When evictint element,
it will randomly compare several elements's frequency and evict the least
one.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2014-07-09 10:53:06 +08:00
Sage Weil
a2164e73c0 Merge pull request #2029 from ceph/wip-8523
mon: OSDMonitor: add 'osd pool get-quota' command

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-08 17:56:54 -07:00
Sage Weil
deed546e0f Merge pull request #2085 from ceph/wip-7891
osd: fix pg ref leaks on shutdown

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-08 16:25:56 -07:00
Sage Weil
c0dc245b66 osd: cancel agent_timer events on shutdown
We need to cancel all agent timer events on shutdown.  This also needs to
happen early so that any in-progress events will execute before we start
flushing and cleaning up PGs.

Backport: firefly
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-08 16:13:54 -07:00
Sage Weil
ef40737eee osd: s/applying repop/canceling repop/
The 'applying' language dates back to when we would wait for acks from
replicas before applying writes locally.  We don't do any of that any more;
now, this loop just cancels the repops with remove_repop() and some other
cleanup.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-08 16:12:25 -07:00
Sage Weil
cafceae6c2 osd: clear PGBackend state on shutdown
This was leaking state on shutdown whenever there were in-flight repops
that were canceled.

Fixes: #7891
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-08 16:12:25 -07:00
Sage Weil
e299357e2a osd: separate cleanup from PGBackend::on_change()
The generic portion of on_change() cleaned up temporary on-disk objects
and requires a Transaction.  The rest is clearing out in-memory state and
does not.  Separate the two.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-08 16:12:25 -07:00
Luis Pabón
b16b64eb08 Support for READFORWARD in the caching tier
READFORWARD caching policy uses writeback for writes
and redirects reads to the back end starage tier.

Signed-off-by: Luis Pabón <lpabon@redhat.com>
2014-07-08 16:00:20 -04:00
Sage Weil
7756a136d2 Merge remote-tracking branch 'gh/next' 2014-07-08 11:45:22 -07:00
Joao Eduardo Luis
b927c0de7d qa/workunits: cephtool: test for 'osd pool {get,set}-quota'
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-08 19:33:14 +01:00
Joao Eduardo Luis
714a9bb5a0 mon: OSDMonitor: add 'osd pool get-quota' command
Enables us to obtain current quotas for a given pool.

Fixes: #8523

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-08 19:33:14 +01:00
Samuel Just
abb59aced8 Merge pull request #2076 from cernceph/wip-wbthrottle-perfcounters
decrement WBThrottle perfcounters in clear_object

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-08 10:25:20 -07:00
Sage Weil
e553c3414b Merge pull request #2082 from ceph/wip-8727
messages: MForward: fix compat version

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-08 10:05:33 -07:00
Joao Eduardo Luis
c92feebb81 messages: MForward: fix compat version
A while ago we bumped the head version and reset the compat version to 0.
Doing this so happens to make the messenger assume that the message does
not support the compat versioning and sets the compat version to the head
version -- thus making compat = 2 when it should have been 1.

The nasty side-effect of this is that upgrading from emperor to firefly
will have emperor-leaders being unable to decode forwarded messages from
firefly-peons.

Fixes: #8727

Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-08 16:46:27 +01:00
Sage Weil
59379a4583 Merge pull request #2081 from ceph/wip-osd-leaks
osd: fix several memory leaks from fast dispatch

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-07 21:08:21 -07:00
Sage Weil
0bf4f652b7 osd: clear sessions_waiting_on_map on shutdown
Wake up these ops and drop the Session refs on shutdown.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-07 16:17:47 -07:00
Sage Weil
aefbac5e43 osd: fix session leak when waiting on map
We don't want to leak the Session if this Session is already waiting on
a map.

Introduced by eb30f88c94.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-07 16:17:47 -07:00
Gregory Farnum
ca1dc3c9dc Merge pull request #2037 from ceph/wip-async-log
MDS: Encode log events in a separate thread from main execution.

This is a first small step in multi-threading the MDS daemon.

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-07 15:37:13 -07:00
Sage Weil
17ad083145 osd: clear Sessions for loopback Connections on shutdown
Starting with the fast dispatch patches, we are calling the handle_connect
on loopback.  Make sure we zap them on shutdown to break the Session <->
Connection ref cycle.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-07 15:12:10 -07:00
Sage Weil
231fe1b685 Revert "OSD: move waiting_for_pg into Session"
This reverts commit ecda2fef8c.

This leaves Session* refs indefinitely in the map.

This was one source of #7995.

Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-07 15:11:30 -07:00
Sage Weil
083f9fe445 Merge pull request #2080 from ceph/wip-8306-rebase
Wip 8306 rebase

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Dan Mick <dan.mick@inktank.com>
2014-07-07 14:52:17 -07:00
Greg Farnum
aa1be2e306 OSD: fix debug logging output
The snapmapper and infos statements were backwards. Now they aren't.

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-07-07 14:10:07 -07:00
Sage Weil
0f74299543 Merge pull request #2078 from ceph/wip-8751
test: generalise default_pools in test_rados

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-07 13:23:25 -07:00
Dan Mick
b700963071 ceph.spec.in: add bash completion file for radosgw-admin
Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-07-07 13:12:41 -07:00
Dan Mick
235e4c7de8 ceph.spec.in: rhel7-related changes:
udev rules: /lib -> /usr/lib
/sbin binaries move to /usr/sbin or %{_sbindir}

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-07-07 13:12:41 -07:00
Dan Mick
7cf8132239 Fix/add missing dependencies:
- rbd-fuse depends on librados2/librbd1
- ceph-devel depends on specific releases of libs and libcephfs_jni1
- librbd1 depends on librados2
- python-ceph does not depend on libcephfs1

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-07-07 13:12:23 -07:00
Dan Mick
ec8af52a5e ceph.spec.in: whitespace fixes
Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-07-07 13:11:14 -07:00
Dan Mick
e131b9d5a5 ceph.spec.in: split out ceph-common as in Debian
Move files, postun scriptlet, and add dependencies on ceph-common
where appropriate

Signed-off-by: Sandon Van Ness <sandon@inktank.com>
2014-07-07 13:09:50 -07:00
John Spray
cca5841c40 test: generalise default_pools in test_rados
Instead of fragile assumptions about what pools
do or do not exist by default, simply use what
exists at test setup time as a baseline.

Fixes: #8751

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-07 18:19:46 +01:00
Sage Weil
768d48f6ef Merge pull request #2074 from onlyjob/docs
doc: mention kernel support for rbd format 2

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-07 09:07:04 -07:00
Sage Weil
a2337474f5 Merge pull request #2077 from ceph/wip-8754
tests: don't depend on 'data' pool in rbd test

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-07 09:04:57 -07:00
John Spray
a7a631d1e2 tests: don't depend on 'data' pool in rbd test
Since we removed the default 'data' and 'metadata' pools,
tests which need a pool should create it themselves.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-07 15:45:54 +01:00
Sage Weil
cf5f535125 doc/release-notes: clarify CRUSH notes about tunables
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-07 07:05:38 -07:00
Dan van der Ster
d84d7204a1 decrement WBThrottle perfcounters in clear_object
We observed that the WBThrottle perfcounters are leaking upwards
at a rate of around 50-100 ios_dirtied per day. The counters are
currently not decremented in clear_object, so that's the likely
explanation. Decrement them like elsewhere in WBThrottle.

Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
2014-07-07 16:02:05 +02:00
Sage Weil
7e3fb06a7e Merge pull request #2075 from ceph/wip-8745
mds: use client-provided time stamp for user-visible file metadata

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-07 06:54:49 -07:00
Yan, Zheng
16df4c3ed8 mds: use client-provided time stamp for user-visible file metadata
Fixes: #8745
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
2014-07-07 16:17:26 +08:00
Haomai Wang
73b2928acf Remove exclusive lock on GenericObjectMap
Now most of GenericObjectMap interfaces use header as argument not the union of
coll_t and ghobject_t. So caller should be responsible for maintain the
exclusive header.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2014-07-07 14:08:57 +08:00
Haomai Wang
d1049794bc Add Header cache to KeyValueStore
In the performance statistic recently, the header lookup becomes the main time
consuming for the read/write operations. Most of time it occur 50% to deal with
header lookup, decode/encode logics.

Now adding header cache using SharedLRU structure which will maintain the header
cache and caller will get the pointer to the real header. It also avoid too much
header copy operations overhead.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2014-07-07 14:08:43 +08:00
Dmitry Smirnov
c0806bbdcc doc: mention kernel support for rbd format 2
Signed-off-by: Dmitry Smirnov <onlyjob@member.fsf.org>
2014-07-05 19:27:24 +10:00
Sage Weil
dd5b60b4f1 Merge remote-tracking branch 'gh/next' 2014-07-04 21:18:55 -07:00