Commit Graph

34439 Commits

Author SHA1 Message Date
Sage Weil
ce9f12d7a2 qa/workunits/cephtool/test.sh: test osd pool get erasure_code_profile
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-16 17:55:36 -07:00
Ma Jianpeng
e8ebcb79a4 mon: OSDMonitor: add "osd pool get <pool> erasure_code_profile" command
Enable us to obtain the erasure-code-profile for a given erasure-pool.

Signed-off-by: Ma Jianpeng <jianpeng.ma@intel.com>
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-16 17:49:00 -07:00
Sage Weil
bf252c8df9 Merge remote-tracking branch 'gh/next' 2014-07-16 15:28:10 -07:00
Yehuda Sadeh
b89ab5f78d rgw: don't try to wait for pending if list is empty
Fixes: #8846
Backport: firefly, dumpling

This was broken at ea68b93723. We ended
up calling wait_pending_front() when pending list was empty.
This commit also moves the need_to_wait check to a different place,
where we actually throttle (and not just drain completed IOs).

Reported-by: Sylvain Munaut <s.munaut@whatever-company.com>
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
(cherry picked from commit f9f2417d7d)
2014-07-16 15:27:49 -07:00
Josh Durgin
512c7aad79 Merge pull request #2110 from ceph/wip-8846
rgw: don't try to wait for pending if list is empty

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-07-16 15:17:30 -07:00
Josh Durgin
ba7ad44fae Merge pull request #2095 from onlyjob/rbdmap
rbdmap: per-device post-map/pre-unmap hooks

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-07-16 14:58:33 -07:00
Gregory Farnum
1bf077246e Merge pull request #2107 from ceph/wip-set_layout
Wip set layout

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-16 14:10:40 -07:00
Yehuda Sadeh
f9f2417d7d rgw: don't try to wait for pending if list is empty
Fixes: #8846
Backport: firefly, dumpling

This was broken at ea68b93723. We ended
up calling wait_pending_front() when pending list was empty.
This commit also moves the need_to_wait check to a different place,
where we actually throttle (and not just drain completed IOs).

Reported-by: Sylvain Munaut <s.munaut@whatever-company.com>
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-07-16 13:33:26 -07:00
Sage Weil
834772354c Merge pull request #2106 from ceph/wip-8813
eat up the level from logging output when not using the `-v` flag

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-16 12:18:31 -07:00
Alfredo Deza
420f0a471a set the default log level to WARNING
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-07-16 11:11:01 -04:00
Sage Weil
3e0d980076 init-ceph: wrap daemon startup with systemd-run when running under systemd
We want to make sure the daemon runs in its own systemd environment.  Check
for systemd as pid 1 and, when present, use systemd-run -r <cmd> to do
this.

Probably fixes #7627

Signed-off-by: Sage Weil <sage@redhat.com>
Reviewed-by: Dan Mick <dan.mick@inktank.com>
Tested-by: Dan Mick <dan.mick@inktank.com>
2014-07-15 18:11:41 -07:00
Sage Weil
99dfaf7df4 doc/release-notes: v0.80.4
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-15 16:32:35 -07:00
Gregory Farnum
911038ecdb Merge pull request #2101 from ceph/wip-mds-session-asok-squash
Provide client session handling and information via the admin socket.

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-15 15:32:19 -07:00
John Spray
6c48d076ae doc: add cephfs layout documentation
This clarifies how to deal with layouts in CephFS
using vxattrs.  We can point people here if they
ask what they should use instead of the deprecated
`cephfs set_layout`.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 14:28:32 +01:00
John Spray
af740ecd49 cephfs: pool safety & print deprecation warning
Print a message indicating to users that this tool
is now deprecated in favour of vxattrs.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 12:45:34 +01:00
John Spray
cceab2b7cb qa: retire kclient-specific layout test
`cephfs set_layout` was broken and is now deprecated
in favour of using xattrs for layout.  Retire the
kclient-specific test.

Fixes: #8773

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 12:23:39 +01:00
João Eduardo Luís
aeaac69f41 Merge pull request #2098 from ceph/wip-dump-new-crush
crush: include CRUSH_V3, v2/v3 rules checks in dump_tunables()

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-14 23:41:38 +01:00
Sage Weil
ce72a3b527 Merge pull request #2103 from ceph/wip-8830
XfsFileStoreBackend: default to disabling extsize on xfs

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-14 15:38:59 -07:00
Samuel Just
01cd3cdc72 XfsFileStoreBackend: default to disabling extsize on xfs
This appears to be responsible for the deep scrub mismatches on some rbd
workloads.

Fixes: 8830
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-07-14 14:55:38 -07:00
Sage Weil
a560519c29 Merge pull request #2102 from ceph/wip-8823
ceph_test_rados_api_tier: fix [EC] HitSet{Read,Write,Trim} tests

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-14 10:43:35 -07:00
John Wilkins
a1b15674b1 Merge pull request #2097 from sjahl/master
doc: Fixes a broken link on the rados deploy osd page.

Reviewed-by: John Wilkins <john.wilkins@inktank.com>
2014-07-14 09:23:05 -07:00
Sage Weil
fc597e5e34 doc/release-notes: some additional warnings and recommendations against adjusting tunables
Several users are having troubles related to the overhead of the data
rebalance from adjusting tunables.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-14 09:14:32 -07:00
Sage Weil
e17e9d8577 ceph_test_rados_api_tier: fix [EC] HitSet{Read,Write,Trim} tests
The hit_set_ fields can only be set on tier pools as of
f131dfbaed.

Fixes: #8823
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-14 08:04:16 -07:00
John Spray
a4ed336650 mds: add session ls and session evict to asok
These commands are intended to help admins deal
with MDSs during recovery, to identify troublesome
clients which may need intervention (such as eviction).

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-14 14:15:27 +01:00
John Spray
0e0be07fe1 client: include ID in mds_sessions asok
So that an admin can map a ceph-fuse process
reliably to an entry in the MDS session list.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-14 14:12:36 +01:00
John Spray
52a2bc5f1a mon: remove unused attribute notified_global_id
Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-14 14:12:36 +01:00
John Spray
b120a488c4 common/admin_socket: remove dead code
Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-14 14:12:36 +01:00
Sage Weil
bb47ff34a6 osd: fix confusing debug output for op_applied
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-13 22:19:11 -07:00
Stephen Jahl
586d3ee32c doc: Fixes a broken link on the rados deploy osd page.
Signed-off-by: Stephen Jahl <stephenjahl@gmail.com>
2014-07-12 09:04:22 -04:00
Samuel Just
79f3f67491 Merge pull request #1999 from yuyuyu101/keyvaluestore-cache
Keyvaluestore cache

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-11 17:01:12 -07:00
Gregory Farnum
d24fa335e9 Merge pull request #2096 from ceph/wip-test-post-file
qa/workunits/post-file.sh

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-11 16:39:02 -07:00
Sage Weil
447f849fec doc/release-notes: v0.80.3
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-11 16:00:41 -07:00
Sage Weil
29f20b7e82 qa/workunits/post-file.sh
Test ceph-post-file.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-11 15:33:35 -07:00
Gregory Farnum
509578757f Merge pull request #2090 from ceph/wip-nuke-dlist
nuke dlist

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-11 15:07:54 -07:00
Sage Weil
96653bb27b Merge pull request #2089 from lpabon/lpabon_readforward
Support for READFORWARD in the caching tier

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 15:06:53 -07:00
Sage Weil
50c6b83aba Merge pull request #2093 from theanalyst/doc/format-fix
doc: minor format fix for radosgw admin docs
2014-07-11 15:06:33 -07:00
Sage Weil
94d40b5e4f Merge pull request #2042 from ceph/wip-port-fixes
Portability updates

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 15:02:39 -07:00
Sage Weil
1fd89cead2 Merge pull request #2086 from ceph/wip-8696
mon: OSDMonitor: limit tier-specific pool set/get on non-tier pools

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 15:00:51 -07:00
Sage Weil
636a899fe0 Merge pull request #2091 from ceph/wip-kinetic-os
prototype kinetic osd backend

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 14:59:19 -07:00
Sage Weil
49e5c8ec88 Merge remote-tracking branch 'gh/next' 2014-07-11 14:56:40 -07:00
Samuel Just
e1fc96f713 Merge pull request #2071 from somnathr/wip-sd-cpu-optimized
Wip sd cpu optimized

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-11 14:42:48 -07:00
Dmitry Smirnov
c9e1e82d3f rbdmap: per-device post-map/pre-unmap hooks
There are cases when automatic (un-)mounting of file system on RBD is not
enough. Some services may need to be started when RBD device becomes
available (mapped) as well as it may be desirable to stop services in order
to release file system before unmapping RBD device.

File system(s) on RBD is not the only use case scenario. RBD devices may be
used as block devices in which case `/etc/fstab` is not sufficient to
perform action upon mapping RBD device. A handler script (hook) can be
useful to properly release RBD device before unmapping, etc.

Pre-unmap hooks can be important for clean shut down and for re-exporting
RBD device(s) as (iSCSI,AoE,DRBD) etc.

This commit introduces support for per-device hooks to perform per-device
post-map/pre-unmap actions. If hook named like "poolname/imagename" (same
as in `/etc/ceph/rbdmap` file) is found in

    /etc/ceph/rbd.d/poolname/imagename

it is executed as

    /etc/ceph/rbd.d/poolname/imagename map poolname/imagename

following after attempt to mount file system (if relevant `fstab` entry
exist) following mapping of corresponding RBD device.

Before un-mounting file system and un-mapping RBD device hook is called as
follows:

    /etc/ceph/rbd.d/poolname/imagename unmap poolname/imagename

Second argument is intentional to allow multiple RBD devices to share the
same hook (symlinked under different names).

Sample hook to use RBD device as "mdadm" hot spare may look like this:

~~~~
DEV="$2"
case "$1" in
    "map")
        mdadm /dev/md2 --add --write-mostly "${DEV}"
    ;;
    "unmap")
        mdadm /dev/md2 --fail "${DEV}"
        sleep 2
        mdadm /dev/md2 --remove "${DEV}"
    ;;
esac
~~~~

Signed-off-by: Dmitry Smirnov <onlyjob@member.fsf.org>
2014-07-12 06:17:22 +10:00
Gregory Farnum
fb7d5a3a75 Merge pull request #2094 from ceph/wip-8815
mon: avoid scrub noise due to divering OSDMap encoding versions

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-11 13:13:31 -07:00
Sage Weil
c93da05bd3 osd/osd_types: be pedantic about encoding last_force_op_resend without feature bit
The addition of the value is completely backward compatible, but if the
mon feature bits don't match it can cause monitor scrub noice (due to the
parallel OSDMap encoding).  Avoid that by only adding the new field if the
feature (which was added 2 patches after the encoding, see
3152faf79f and
45e79a17a9.

Fixes: #8815
Backport: firefly
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-11 11:31:22 -07:00
Sage Weil
712d5d1e29 osd/osd_types: remove useless encode_compat local var for pg_pool_t::encode
This is left over from db3fd1152a
when we made the HitSet stuff incompat, but that behavior was reverted by
dc3ce58add, leaving this cruft behind.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-11 11:29:05 -07:00
Samuel Just
f9d0e8ff10 Merge pull request #2088 from guangyy/wip-8733
Fix the PG listing issue which could miss objects for EC pool

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-11 10:20:04 -07:00
Sage Weil
bf048976f5 Merge pull request #2092 from onlyjob/rbdmap
rbdmap: per-device mount (Closes: #8538)

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 09:03:03 -07:00
Joao Eduardo Luis
50e93c2138 qa/workunits: cephtool: adjust pool name where missing as it has changed
Signed-off-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-11 15:22:43 +01:00
Sage Weil
cf94cf3531 crush: include CRUSH_V3, v2/v3 rules checks in dump_tunables()
Backport: firefly
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-11 06:58:57 -07:00
Abhishek Lekshmanan
daadff4cd0 doc: minor format fix for radosgw admin docs
Missing backtick fixed

Signed-off-by: Abhishek Lekshmanan <abhishek.lekshmanan@gmail.com>
2014-07-11 18:03:54 +05:30