Commit Graph

30049 Commits

Author SHA1 Message Date
Sage Weil
d5ac73658d Merge remote-tracking branch 'gh/next' 2013-12-13 09:58:10 -08:00
Yan, Zheng
5bb04763de test/libcephfs: release resources before umount
Fixes: #6742
Signed-off-by: Yan, Zheng <zheng.z.yan@intel.com>
Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-13 09:57:50 -08:00
Sage Weil
31b0823deb Merge pull request #934 from cernceph/wip-rgw-ulimit
radosgw: increase nofiles ulimit on sysvinit machines
2013-12-12 09:42:21 -08:00
Sage Weil
500de8b241 Merge pull request #935 from ceph/wip-vstart-memstore
vstart.sh: add --memstore option
2013-12-12 09:41:40 -08:00
Yehuda Sadeh
bcde2003af vstart.sh: add --memstore option
for setting memstore backed osds

Signed-off-by: Yehuda Sadeh <yehuda@inktank.com>
2013-12-12 09:31:53 -08:00
Dan van der Ster
a33c95f125 radosgw: increase nofiles ulimit on sysvinit machines
Clusters with many OSDs require a higher nofiles ulimit than the RHEL default. Increase it.

Tested-by: Dan van der Ster <daniel.vanderster@cern.ch>
Signed-off-by: Dan van der Ster <daniel.vanderster@cern.ch>
2013-12-12 14:53:13 +01:00
Sage Weil
71cefc2927 doc/release-notes: sort
meh

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-11 16:13:51 -08:00
Sage Weil
ee3173d900 doc/release-notes: fix indentation; sigh
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-11 16:11:00 -08:00
Sage Weil
3abc189454 doc/release-notes: v0.73
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-11 15:59:45 -08:00
Sage Weil
03429d1e4d PendingReleaseNotes: note CRUSH and hashpspool default changes
Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-11 15:39:37 -08:00
Sage Weil
1504b961a9 Merge pull request #930 from ceph/wip-hashpspool
enable hashpspool by default

Reviewed-by: Samuel Just <sam.just@inktank.com>
2013-12-11 15:37:46 -08:00
Greg Farnum
bb50276f2f Revert "Partial revert "mon: osd pool set syntax relaxed, modify unit tests""
This reverts commit e80ab94bf44e102fcd87d16dc11e38ca4c0eeadb.

We accept non-CephInt arguments again, now that we've got the monitors
handling differing APIs intelligently.

Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-12-11 15:29:53 -08:00
Sage Weil
0cd36e0587 mon/OSDMonitor: take 'osd pool set ...' value as a string again
We ran into problems before when we made this a string because a mixed
cluster of mons might forward a client request with the wrong schema.
To make this work, we make the new code understand both the new and
old schema, and also backport a change to emperor and dumpling to
handle the new schema.

For the previous attempt to do this, see:
 337195f046
 2fe0d0d97a

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Greg Farnum <greg@inktank.com>
2013-12-11 15:29:42 -08:00
Gregory Farnum
72a304acb0 Merge pull request #925 from ceph/wip-mon-api
Merge in changes to unify the API presented by the monitors and handle changes gracefully.

(Upgrade tests) Tested-by: Tamil Muthamizhan <tamil.muthamizhan@inktank.com>

Reviewed-by: Sage Weil <sage@inktank.com>
Reviewed-by: Joao Eduardo Luis <joao.luis@inktank.com>
2013-12-11 13:27:03 -08:00
Sage Weil
4b6d721434 osd: enable HASHPSPOOL by default
Much like the CRUSH tunables, this first appears in kernel v3.9.

Unlike the CRUSH tunables, it does not appear in Ceph until v0.64
(post cuttlefish, pre dumpling).

Signed-off-by: Sage Weil <sage@inktank.com>
2013-12-11 11:19:37 -08:00
Greg Farnum
fb47d54044 mon: if we're the leader, don't validate command matching
Classic-format commands never match our leader command set!

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-11 10:12:56 -08:00
Greg Farnum
2bfd34ac95 mon: by default, warn if some members of the quorum are "classic"
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-11 10:12:56 -08:00
Greg Farnum
b8884e01a0 MemStore: update for the new ObjectStore interface
68fdcfa1cc changed the ObjectStore
interface in the 'next' branch, which was merged into master by
e5a02c33e2. Unfortunately the
Memstore (added via the master branch) was not corrected for this
interface change.

Signed-off-by: Greg Farnum <greg@inktank.com>
Reviewed-by: David Zafman <david.zafman@inktank.com>
2013-12-10 17:08:21 -08:00
Gary Lowell
e5a02c33e2 Merge branch 'next' 2013-12-10 21:00:14 +00:00
Gregory Farnum
b66902b64e Merge pull request #927 from dachary/wip-crush-test
crush: remove crushtool test leftover
2013-12-10 12:25:07 -08:00
Loic Dachary
8ac1da8e35 crush: remove crushtool test leftover
Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-10 20:35:34 +01:00
Sage Weil
6bd63a1ec1 Merge pull request #920 from dachary/wip-man
man: Ceph is also an object store

Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-10 11:10:41 -08:00
Greg Farnum
ec609cacde Elector: use monitor's encoded command sets instead of our own
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-10 10:23:03 -08:00
scuttlemonkey
85a024a6bd Merge pull request #865 from ceph/wip-doc-build-cluster
Wip doc build cluster
2013-12-10 10:14:59 -08:00
Greg Farnum
e223e5348d Monitor: encode and expose mon command sets
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-10 10:09:24 -08:00
Loic Dachary
420a2f15a5 man: update man/ from doc/man/8
As explained in admin/manpage-howto.txt

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-10 18:34:16 +01:00
Loic Dachary
8d60cd1ac2 man: Ceph is also an object store
Replace

   Ceph distributed file system

with

   Ceph distributed storage system

to help reduce the idea that Ceph is just a file system.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-10 18:33:05 +01:00
Sage Weil
d650474059 Merge pull request #923 from dachary/wip-crush-test
CrushTester patches and documentation

Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-10 09:06:31 -08:00
Sage Weil
faaf546303 os/MemStore: do on_apply_sync callback synchronously
We can easily deadlock if we put this in the Finisher thread behind other
work; do it synchronously!

Signed-off-by: Sage Weil <sage@inktank.com>
Reviewed-by: Yehuda Sadeh <yehuda@inktank.com>
2013-12-10 08:56:35 -08:00
Gary Lowell
d8ad51ee8a v0.73 2013-12-10 04:55:36 +00:00
Greg Farnum
a6f4d71c65 Elector: keep a list of classic mons instead of each mon's commands
We aren't actually using the sets, so don't bother keeping them.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-09 15:34:34 -08:00
Loic Dachary
a888a57f79 crush: implement --show-bad-mappings for indep
Support the presence of ITEM_NONE device numbers in the indep mapping as
proof of a bad mapping. Implement the associated unit tests.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-09 21:10:29 +01:00
Loic Dachary
20263dd30e crush: add unitest for crushtool --show-bad-mappings
Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-09 21:10:29 +01:00
Loic Dachary
fbc4f99080 crush: remove scary message string
The string is no longer used and can be removed.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-09 21:10:29 +01:00
Loic Dachary
472f495e40 crush: document the --test mode of operations
Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-09 21:10:23 +01:00
Greg Farnum
ea86444fb3 Monitor: Elector: share the classic command set if we have a classic mon
The leader now checks to see if any monitors did not provide their
command set, and if so, shares the list of "classic" commands instead
of his own set. This will prevent users from seeing different commands
(depending on whether they connect to an old or new mon) while
performing upgrades, and will make it really obvious if they forgot
to upgrade one of the monitors!

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-09 11:26:04 -08:00
Greg Farnum
f1ccdb418b Elector: share local command set when deferring
We're about to use this at a basic level, to identify when we have
"classic" monitors in-quorum, but could also do something more
sophisticated like a set intersection on the commands.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-09 11:26:04 -08:00
Greg Farnum
ba673be3e6 Monitor: import MonCommands.h from original Dumpling and expose it
If the Elector doesn't receive a set of commands from the elected leader, it
assumes the monitor is "classic" and uses the Dumpling command set as
the leader set.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-09 11:26:04 -08:00
Greg Farnum
3cb58f7406 Monitor: validate incoming commands against the leader's set too
Then check against our own, and forward if we don't recognize it
or for some reason don't match.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-09 11:26:04 -08:00
Greg Farnum
cb51b1ed1a Monitor: disseminate leader's command set instead of our own
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-09 11:26:04 -08:00
Greg Farnum
d33df28c2b Elector: transmit local api on election win, accept leader's on loss
If we're the leader, just point to our local set. Disseminating these
will let peons advertise the full command set supported by the leader.
INCOMPLETE: does not yet handle winning Electors who do not send a command set.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-09 11:26:04 -08:00
Greg Farnum
8025fb33ad messages: make room for passing supported monitor commands in MMonElection
We're going to use this space to let leader tell everybody what
commands it supports.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-09 11:26:03 -08:00
Greg Farnum
f932903646 Monitor: pull command mapping out of _allowed_command()
We want to be able to validate commands against both the leader and
local command sets, so make that functionality generic.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-09 11:26:03 -08:00
Sage Weil
7d000e3411 Merge pull request #918 from ceph/port/misc
Misc portability patches

Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-09 11:16:49 -08:00
Sage Weil
4c5f7ba8ba Merge pull request #922 from dachary/wip-crush-choose-tries
crush: fix map->choose_tries boundary test

Reviewed-by: Sage Weil <sage@inktank.com>
2013-12-09 08:28:43 -08:00
Loic Dachary
41152a6317 crush: --show-utilization* implies --show-statistics
--show-utilization* outputs only if --show-statistics is set, which is
confusing. Instead of failing, set --show-statistics to avoid the
confusion.

Signed-off-by: Loic Dachary <loic@dachary.org>
2013-12-09 10:57:17 +01:00
Greg Farnum
dcb0a4f3bb Monitor: add a separate leader_supported_commands
This isn't used yet, but will be shortly.

Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-08 22:21:41 -08:00
Greg Farnum
4cd5c3bf3f Monitor: expose local monitor commands to other compilation units
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-08 22:21:41 -08:00
Greg Farnum
dca5383f2e MonCommand: add operator== and operator!=
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-08 22:21:41 -08:00
Greg Farnum
ac69a0122b MonCommand: support encode/decode
Signed-off-by: Greg Farnum <greg@inktank.com>
2013-12-08 22:21:41 -08:00