Commit Graph

34020 Commits

Author SHA1 Message Date
John Spray
ac057999eb tools/cephfs: error handling in journal_export
Was failing on unreadable journal even if
only trying to do an import.

Was calling messenger destructor without init
on early failures due to early instantiation
of Dumper.

Signed-off-by: John Spray <john.spray@inktank.com>
2014-06-13 11:39:17 +01:00
John Spray
381163c284 tools/cephfs: Clean up waits in Dumper
Remove some LOC by using C_SaferCond.

Signed-off-by: John Spray <john.spray@inktank.com>
2014-06-13 11:39:17 +01:00
Josh Durgin
1781e7f11d Merge pull request #1955 from ceph/wip-8585
rgw: set a default data extra pool name

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-06-12 18:02:46 -07:00
Sage Weil
da2c72a86d Merge pull request #1933 from ceph/wip-8556
osd: do not require EC feature bit from clients.

Reviewed-by: Greg Farnum <greg@inktank.com>
2014-06-12 16:45:31 -07:00
Sage Weil
3fe1699f96 osd/OSDMap: do not require ERASURE_CODE feature of clients
Just because an EC pool exists in the cluster does not mean tha tthe client
has to support the feature:

1) The way client IO is initiated is no different for EC pools than for
   replicated pools.
2) People may add an EC pool to an existing cluster with old clients and
   locking those old clients out is very rude when they are not using the
   new pool.
3) The only direct client user of EC pools right now is rgw, and the new
   versions already need to support various other features like CRUSH_V2
   in order to work.  These features are present in new kernels.

Fixes: #8556
Backport: firefly
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-12 16:45:00 -07:00
Sage Weil
250677c965 osd/OSDMap: make get_features() take an entity type
Make the helper that returns what features are required of the OSDMap take
an entity type argument, as the required features may vary between
components in the cluster.

Backport: firefly
Signed-off-by: Sage Weil <sage@inktank.com>
2014-06-12 16:44:53 -07:00
Josh Durgin
894f37248c Merge pull request #1957 from ceph/wip-doc-os-recommendations
doc: Updated the OS Recommendations for Firefly.

Reviewed-by: Josh Durgin <josh.durgin@inktank.com>
2014-06-12 13:14:13 -07:00
John Wilkins
e720314aa6 doc: Updated the OS Recommendations for Firefly.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-06-12 12:48:29 -07:00
John Wilkins
2e3302cc3e doc: Updated the example configuration.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-06-12 11:35:27 -07:00
John Wilkins
5a31df214f doc: Updated doc for more recent versions.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-06-12 11:34:41 -07:00
Sage Weil
1e18d85b27 Merge pull request #1939 from ceph/wip-mon
mon: a few basic perfcounter guages

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-06-12 10:37:15 -07:00
Sage Weil
a5857e3d4a Merge pull request #1956 from ceph/wip-fsx-sizeof
test_librbd_fsx: fix sign-compare gcc warning

Reviewed-by: Sage Weil <sage@inktank.com>
2014-06-12 09:57:02 -07:00
Alfredo Deza
87650d430f Merge pull request #1948 from steveftaylor/6700
Fix for bug #6700

Reviewed-by: Alfredo Deza <alfredo.deza@inktank.com>
2014-06-12 08:23:22 -04:00
Ilya Dryomov
a290d3490f test_librbd_fsx: fix sign-compare gcc warning
{read,write}bdy are signed, sizeof returns unsigned, gcc complains.

Signed-off-by: Ilya Dryomov <ilya.dryomov@inktank.com>
2014-06-12 14:37:03 +04:00
Sage Weil
e287f02a0b Merge pull request #1937 from yuyuyu101/keyvaluestore-strip-size
Add strip size and set_alloc_hint op support for KeyValueStore

Reviewed-by: Sage Weil <sage@inktank.com>
2014-06-11 20:24:04 -07:00
Yehuda Sadeh
b2542f8e88 rgw: set a default data extra pool name
Fixes: #8585
Have a default name for the data extra pool, otherwise it would be empty
which means that it'd default to the data pool name (which is a problem
with ec backends).

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-06-11 16:50:41 -07:00
John Wilkins
94c8f70ea6 doc: Made mention of "incomplete" status.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-06-11 16:11:47 -07:00
Gregory Farnum
027e75cbd7 Merge pull request #1953 from ceph/wip-xattr-spillout
Enable and fix the existing xattr spillout code.

Reviewed-by: Sage Weil <sage@inktank.com>
2014-06-11 14:59:25 -07:00
Gregory Farnum
b8709ec0ad Merge pull request #1897 from somnathr/wip-sharded-threadpool
Reviewed-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Samuel Just <sam.just@inktank.com>
2014-06-11 14:29:55 -07:00
Greg Farnum
29c33f0c05 qa: add an fsx run which turns on kernel debugging
Signed-off-by: Greg Farnum <greg@inktank.com>
2014-06-11 13:40:48 -07:00
Greg Farnum
f9787224ba FileStore: remove the user_only param from _fgetattrs
Nobody sets it to true, so remove it!

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-06-11 10:48:59 -07:00
Greg Farnum
bb4e3a9fbc FileStore: remove user_only options from getattrs through the ObjectStore stack
This sort of awareness belongs at a higher level in the stack -- as
evidenced by nobody using the option at this level. Remove it from the
implementations and the interface

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-06-11 10:48:59 -07:00
Greg Farnum
fbe6009f22 FileStore: do not use user_only in collection_getattrs
There's no particular reason why any of the callers of collection_getattrs
want to avoid looking at Ceph's internal xattrs.
It looks like this flag (set in 1862ddd885) was
set this way by mistake.
And finally, we don't actually set xattrs on collections anymore, anyway.

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-06-11 10:48:59 -07:00
Greg Farnum
7267a37d03 FileStore: remove dead code
This case wasn't reachable when it was introduced, and it's still not.

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-06-11 10:48:59 -07:00
Greg Farnum
e3b995e156 FileStore: set XATTR_NO_SPILL_OUT when creating new files.
Fixes: #8205
Backport: firefly

Signed-off-by: Greg Farnum <greg@inktank.com>
2014-06-11 10:48:59 -07:00
Haomai Wang
239476a928 FileStore: make _clone() copy spill out marker
Previously we were not doing so, and that resulted in unpredictable loss
of xattrs from the client's perspective.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2014-06-11 10:47:40 -07:00
Haomai Wang
af8052bddb Add xattr test to ceph_test_objectstore
Add xattr synthetic test to test ObjectStore xattr related interfaces.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2014-06-11 10:47:26 -07:00
Yehuda Sadeh
d9fac9c655 rgw: chain to multiple cache entries in one call
This ensures that chained cache entries that depend on more than one raw
cache entry (bucket info cache depends on both the bucket entry point
and on the bucket info object), are chained and created atomically.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-06-10 23:08:58 -07:00
Yehuda Sadeh
c616358fe0 rgw: chain binfo_cache to multiple cache entries
Need to chain it to both the entry point and to the instance.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-06-10 23:08:58 -07:00
Yehuda Sadeh
7e81185b06 rgw: bucket info uses cache chaining
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-06-10 23:08:57 -07:00
Yehuda Sadeh
a2f6709fd8 rgw: user info uses cache chaining
Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-06-10 23:08:57 -07:00
Yehuda Sadeh
ab764f38c1 rgw: an infrastructure for hooking into the raw cache
Extend the RGWCache so that we can chain other caches to it so that when
data is invalidated it notifies them.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-06-10 23:08:57 -07:00
Yehuda Sadeh
7fb6a3d68f rgw: cache bucket info
This is really a partial implementation, so should only be used for
testing.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-06-10 23:08:56 -07:00
Yehuda Sadeh
eaff42f3e9 rgw: cache decoded user info
Instead of accessing the raw user info data, cache the decoded
structure.

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2014-06-10 23:08:56 -07:00
Somnath Roy
0bbeeee3b4 PG: Added a const spg_t member to the PG class
The const spg_t member is been insantiated from constructor
and now get_pgid() can reference this to return a spg_t instance
without the need of pg_info (thus not requiring to acquire pg_lock).

Signed-off-by: Somnath Roy <somnath.roy@sandisk.com>
2014-06-10 18:10:30 -07:00
John Wilkins
85e491fb77 doc: Added a tip to install NTP when running multiple monitors.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-06-10 17:45:18 -07:00
John Wilkins
d37ef6ab7f doc: Added additional background to address additional states.
Covers 1-node cluster issues, fewer OSDs than replicas, and
active + clean + inconsistent states in greater detail.

Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-06-10 17:44:02 -07:00
John Wilkins
b7f6147c36 doc: Added background discussion to clock settings.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-06-10 17:42:21 -07:00
Somnath Roy
ecbb0056f9 OSD: The thread pool variable name changed
The variable names are more meaningful now. op_tp -> osd_tp and
op_sharded_tp -> osd_op_tp

Signed-off-by: Somnath Roy <somnath.roy@sandisk.com>
2014-06-10 16:43:26 -07:00
Somnath Roy
2a5d83d2d5 ShardedTP: The config option changed
The config option for sharded threadpool is changed to
osd_op_num_threads_per_shard instead of osd_op_num_sharded_pool_threads.
Along with osd_op_num_shards this will be much more user friendly while
configuring the number of op threads for the osd.

Signed-off-by: Somnath Roy <somnath.roy@sandisk.com>
2014-06-10 16:02:52 -07:00
Somnath Roy
a0e48b8b6e ShardedTP: Changes related to conforming to Ceph coding guidelines
Signed-off-by: Somnath Roy <somnath.roy@sandisk.com>
2014-06-10 15:24:47 -07:00
John Wilkins
2e3f4bc62b doc: Fixed typo.
Signed-off-by: John Wilkins <john.wilkins@inktank.com>
2014-06-10 12:20:43 -07:00
Steve Taylor
673394702b Fix for bug #6700
When preparing OSD disks with colocated journals, the intialization process
fails when using dmcrypt. The kernel fails to re-read the partition table after
the storage partition is created because the journal partition is already in use
by dmcrypt. This fix unmaps the journal partition from dmcrypt and allows the
partition table to be read.

Signed-off-by: Stephen F Taylor <steveftaylor@gmail.com>
2014-06-10 12:42:55 -06:00
Loic Dachary
6c4c1b71f1 Merge pull request #1945 from dachary/wip-warnings
tests: fix signess warning

Reviewed-By: Christophe Courtaut <christophe.courtaut@gmail.com>
2014-06-10 10:31:07 +02:00
Loic Dachary
a4923f5bc3 fix compilation warnings
Signed-off-by: Loic Dachary <loic@dachary.org>
2014-06-10 01:06:50 +02:00
Sage Weil
47028874e2 Merge pull request #1872 from ceph/wip-reweight-tree
mon: add 'osd crush reweight-tree ...'

Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2014-06-09 05:29:20 -07:00
Haomai Wang
63cc7f9790 Add test for objectstore
Add remove then write object in a transaction.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2014-06-09 19:30:52 +08:00
Haomai Wang
50c8fee8fd Fix write operation on a deleted object in the same transaction
If the following op happened:
touch obj
delete obj
write obj

KeyValueStore will fail at "write" operation.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2014-06-09 19:20:38 +08:00
Haomai Wang
737c13e19d Remove SequencerPosition from KeyValueStore
Now KeyValueStore expects kv backend to ensure consistency and there is unusable
for KeyValueStore to store a SequencerPosition.

Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2014-06-09 19:20:31 +08:00
Loic Dachary
2fe1a0573a Merge pull request #1940 from vshankar/doc-fix
doc: fix typo in erasure coding section

Reviewed-by: Loic Dachary <loic@dachary.org>
2014-06-09 13:16:46 +02:00