Commit Graph

34700 Commits

Author SHA1 Message Date
John Spray
fe8c04f482 Merge pull request #2113 from ceph/wip-8857
mon/MDSMonitor: make legacy 'newfs' command idempotent

Reviewed-by: John Spray <john.spray@redhat.com>
2014-07-17 14:20:47 +01:00
Sage Weil
ce9f12d7a2 qa/workunits/cephtool/test.sh: test osd pool get erasure_code_profile
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-16 17:55:36 -07:00
Ma Jianpeng
e8ebcb79a4 mon: OSDMonitor: add "osd pool get <pool> erasure_code_profile" command
Enable us to obtain the erasure-code-profile for a given erasure-pool.

Signed-off-by: Ma Jianpeng <jianpeng.ma@intel.com>
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-16 17:49:00 -07:00
Sage Weil
5ccfd37b19 vstart.sh: default to 3 osds
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-16 17:46:11 -07:00
Sage Weil
5f6b11a6ad mon/MDSMonitor: make legacy 'newfs' command idempotent
We need to return success if we get a dup command.  Simply check whether
the fs is already enabled with the same pools and name.

Fixes: #8857
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-16 17:24:36 -07:00
Sage Weil
bf252c8df9 Merge remote-tracking branch 'gh/next' 2014-07-16 15:28:10 -07:00
Yehuda Sadeh
b89ab5f78d rgw: don't try to wait for pending if list is empty
Fixes: #8846
Backport: firefly, dumpling

This was broken at ea68b93723. We ended
up calling wait_pending_front() when pending list was empty.
This commit also moves the need_to_wait check to a different place,
where we actually throttle (and not just drain completed IOs).

Reported-by: Sylvain Munaut <s.munaut@whatever-company.com>
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
(cherry picked from commit f9f2417d7d)
2014-07-16 15:27:49 -07:00
Josh Durgin
512c7aad79 Merge pull request #2110 from ceph/wip-8846
rgw: don't try to wait for pending if list is empty

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-07-16 15:17:30 -07:00
Josh Durgin
ba7ad44fae Merge pull request #2095 from onlyjob/rbdmap
rbdmap: per-device post-map/pre-unmap hooks

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-07-16 14:58:33 -07:00
Josh Durgin
19e68ac5c3 rbd: respect rbd_default_* parameters
Treat rbd_default_{format,order,stripe_unit,stripe_count} as defaults for
the usual arguments for specifying those properties.

librbd::create() is affected by rbd_default_format, so we need to
explicitly override it if --image-format is set. The rest of the
parameters are passed explicitly when they are used, so their rbd_default
equivalents don't matter.

Fixes: #8821
Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-07-16 14:34:15 -07:00
Josh Durgin
e891a93711 rbd: remove accidental repeated option
--stripe-count is already parsed above this

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-07-16 14:34:14 -07:00
Josh Durgin
0f87c55355 librbd: use order-agnostic default stripe parameters
This way the default striping style of splitting into
object-sized chunks still works with non-default orders
specified.

Signed-off-by: Josh Durgin <josh.durgin@inktank.com>
2014-07-16 14:34:14 -07:00
Gregory Farnum
1bf077246e Merge pull request #2107 from ceph/wip-set_layout
Wip set layout

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-16 14:10:40 -07:00
Yehuda Sadeh
f9f2417d7d rgw: don't try to wait for pending if list is empty
Fixes: #8846
Backport: firefly, dumpling

This was broken at ea68b93723. We ended
up calling wait_pending_front() when pending list was empty.
This commit also moves the need_to_wait check to a different place,
where we actually throttle (and not just drain completed IOs).

Reported-by: Sylvain Munaut <s.munaut@whatever-company.com>
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-07-16 13:33:26 -07:00
Sage Weil
834772354c Merge pull request #2106 from ceph/wip-8813
eat up the level from logging output when not using the `-v` flag

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-16 12:18:31 -07:00
Alfredo Deza
420f0a471a set the default log level to WARNING
Signed-off-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-07-16 11:11:01 -04:00
Sage Weil
3e0d980076 init-ceph: wrap daemon startup with systemd-run when running under systemd
We want to make sure the daemon runs in its own systemd environment.  Check
for systemd as pid 1 and, when present, use systemd-run -r <cmd> to do
this.

Probably fixes #7627

Signed-off-by: Sage Weil <sage@redhat.com>
Reviewed-by: Dan Mick <dan.mick@inktank.com>
Tested-by: Dan Mick <dan.mick@inktank.com>
2014-07-15 18:11:41 -07:00
Sage Weil
99dfaf7df4 doc/release-notes: v0.80.4
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-15 16:32:35 -07:00
Gregory Farnum
911038ecdb Merge pull request #2101 from ceph/wip-mds-session-asok-squash
Provide client session handling and information via the admin socket.

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-15 15:32:19 -07:00
Kevin Cox
80ea6067f7 Fix size of network protocol intergers.
This fixes the size of some integers that are visible in the network
protocol.  There should be no change for machines where sizeof(int) ==
4.

Signed-Of-By: Kevin Cox <kevincox@kevincox.ca>
2014-07-15 16:56:18 -04:00
John Spray
6c48d076ae doc: add cephfs layout documentation
This clarifies how to deal with layouts in CephFS
using vxattrs.  We can point people here if they
ask what they should use instead of the deprecated
`cephfs set_layout`.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 14:28:32 +01:00
John Spray
af740ecd49 cephfs: pool safety & print deprecation warning
Print a message indicating to users that this tool
is now deprecated in favour of vxattrs.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 12:45:34 +01:00
rootfs
d915ceb0a9 update hadoop-wordcount test to be able to run on hadoop 2.x. The hadoop and mapreduce library are no longer hard coded so they can be specified to point to the right path. The relative paths hdfs are changed to absolute paths.
A sample command to run the test on hadoop 2.x is
TESTDIR=/home/test HADOOP_HOME=/usr/lib/hadoop HADOOP_MR_HOME=/usr/lib/hadoop-mapreduce sh workunits/hadoop-wordcount/test.sh starting hadoop-wordcount test

Signed-off-by: rootfs <hchen@redhat.com>
2014-07-15 07:44:01 -04:00
John Spray
cceab2b7cb qa: retire kclient-specific layout test
`cephfs set_layout` was broken and is now deprecated
in favour of using xattrs for layout.  Retire the
kclient-specific test.

Fixes: #8773

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-15 12:23:39 +01:00
Sage Weil
95f5a448b5 ceph.spec: move ceph-dencoder to ceph from ceph-common
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-14 17:02:05 -07:00
Sage Weil
b37e3bde3b debian: move ceph-dencoder to ceph from ceph-common
It links against the world currently (notably leveldb).  Not nice for the
client-side lib.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-14 17:00:55 -07:00
João Eduardo Luís
aeaac69f41 Merge pull request #2098 from ceph/wip-dump-new-crush
crush: include CRUSH_V3, v2/v3 rules checks in dump_tunables()

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-14 23:41:38 +01:00
Sage Weil
ce72a3b527 Merge pull request #2103 from ceph/wip-8830
XfsFileStoreBackend: default to disabling extsize on xfs

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-14 15:38:59 -07:00
Samuel Just
01cd3cdc72 XfsFileStoreBackend: default to disabling extsize on xfs
This appears to be responsible for the deep scrub mismatches on some rbd
workloads.

Fixes: 8830
Signed-off-by: Samuel Just <sam.just@inktank.com>
2014-07-14 14:55:38 -07:00
Sage Weil
a560519c29 Merge pull request #2102 from ceph/wip-8823
ceph_test_rados_api_tier: fix [EC] HitSet{Read,Write,Trim} tests

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-07-14 10:43:35 -07:00
John Wilkins
a1b15674b1 Merge pull request #2097 from sjahl/master
doc: Fixes a broken link on the rados deploy osd page.

Reviewed-by: John Wilkins <john.wilkins@inktank.com>
2014-07-14 09:23:05 -07:00
Sage Weil
fc597e5e34 doc/release-notes: some additional warnings and recommendations against adjusting tunables
Several users are having troubles related to the overhead of the data
rebalance from adjusting tunables.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-14 09:14:32 -07:00
Sage Weil
e17e9d8577 ceph_test_rados_api_tier: fix [EC] HitSet{Read,Write,Trim} tests
The hit_set_ fields can only be set on tier pools as of
f131dfbaed.

Fixes: #8823
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-14 08:04:16 -07:00
John Spray
a4ed336650 mds: add session ls and session evict to asok
These commands are intended to help admins deal
with MDSs during recovery, to identify troublesome
clients which may need intervention (such as eviction).

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-14 14:15:27 +01:00
John Spray
0e0be07fe1 client: include ID in mds_sessions asok
So that an admin can map a ceph-fuse process
reliably to an entry in the MDS session list.

Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-14 14:12:36 +01:00
John Spray
52a2bc5f1a mon: remove unused attribute notified_global_id
Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-14 14:12:36 +01:00
John Spray
b120a488c4 common/admin_socket: remove dead code
Signed-off-by: John Spray <john.spray@redhat.com>
2014-07-14 14:12:36 +01:00
Sage Weil
bb47ff34a6 osd: fix confusing debug output for op_applied
Signed-off-by: Sage Weil <sage@inktank.com>
2014-07-13 22:19:11 -07:00
Stephen Jahl
586d3ee32c doc: Fixes a broken link on the rados deploy osd page.
Signed-off-by: Stephen Jahl <stephenjahl@gmail.com>
2014-07-12 09:04:22 -04:00
Samuel Just
79f3f67491 Merge pull request #1999 from yuyuyu101/keyvaluestore-cache
Keyvaluestore cache

Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-07-11 17:01:12 -07:00
Gregory Farnum
d24fa335e9 Merge pull request #2096 from ceph/wip-test-post-file
qa/workunits/post-file.sh

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-11 16:39:02 -07:00
Sage Weil
447f849fec doc/release-notes: v0.80.3
Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-11 16:00:41 -07:00
Sage Weil
29f20b7e82 qa/workunits/post-file.sh
Test ceph-post-file.

Signed-off-by: Sage Weil <sage@redhat.com>
2014-07-11 15:33:35 -07:00
Gregory Farnum
509578757f Merge pull request #2090 from ceph/wip-nuke-dlist
nuke dlist

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-07-11 15:07:54 -07:00
Sage Weil
96653bb27b Merge pull request #2089 from lpabon/lpabon_readforward
Support for READFORWARD in the caching tier

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 15:06:53 -07:00
Sage Weil
50c6b83aba Merge pull request #2093 from theanalyst/doc/format-fix
doc: minor format fix for radosgw admin docs
2014-07-11 15:06:33 -07:00
Sage Weil
94d40b5e4f Merge pull request #2042 from ceph/wip-port-fixes
Portability updates

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 15:02:39 -07:00
Sage Weil
1fd89cead2 Merge pull request #2086 from ceph/wip-8696
mon: OSDMonitor: limit tier-specific pool set/get on non-tier pools

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 15:00:51 -07:00
Sage Weil
636a899fe0 Merge pull request #2091 from ceph/wip-kinetic-os
prototype kinetic osd backend

Reviewed-by: Sage Weil <sage@redhat.com>
2014-07-11 14:59:19 -07:00
Sage Weil
49e5c8ec88 Merge remote-tracking branch 'gh/next' 2014-07-11 14:56:40 -07:00