Commit Graph

42244 Commits

Author SHA1 Message Date
John Spray
e3ddcb894a tools: chunk reads in Dumper
Previously tried to read entire journal
into memory in one go, which was problematic
for large journals.

Fixes: #11746
Signed-off-by: John Spray <john.spray@redhat.com>
2015-06-03 10:04:26 +01:00
Loic Dachary
3ca1b50975 Merge pull request #4712 from dachary/wip-11663-verify-erasure-code-profile
normalize and verify the erasure code profile

Reviewed-by: Andreas Peters <andreas.joachim.peters@cern.ch>
2015-06-03 10:47:50 +02:00
Gregory Farnum
b7eec9ab68 Merge pull request #4590 from ceph/wip-da-SCA-20150427
SCA and Coverity fixes

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2015-06-02 23:21:41 -07:00
Kefu Chai
f00ecb8b3d mon/MDSMonitor: rename labels to a better name
* s/ignore/reply/
* s/out/ignore/

Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-06-02 23:20:23 -07:00
Kefu Chai
72a37b3a8e mon: send no_reply() to peon to drop ignored mdsbeacon
so the peon can remove the ignored mdsbeacon request from the
routed_requets at seeing this reply, and hence no longer resend the
request.

Fixes: #11590
Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-06-02 23:14:23 -07:00
Kefu Chai
323918a3d6 Merge pull request #4823 from liewegas/wip-ceph-post-file
ceph-post-file: behave when sftp doesn't take -i

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-06-03 11:30:45 +08:00
David Zafman
17f73fafc4 Merge pull request #4816 from dachary/wip-11624-cephtools-test
tests: cephtool/test.sh wait_for_clean after PG (re)mapping 

Reviewed-by: David Zafman <dzafman@redhat.com>
2015-06-02 17:28:37 -07:00
Sage Weil
fdcc0072dd arm: fix build on older kernels
that don't define HWCAP_CRC32

Fixes: #11461
Signed-off-by: Sage Weil <sage@redhat.com>
2015-06-02 14:33:36 -07:00
Sage Weil
e9e68655d7 init-ceph, ceph-osd-prestart: set osd weight with more precision
Our fixed point weights can go down to .0001 -- allow that.

Fixes: #11500
Signed-off-by: Sage Weil <sage@redhat.com>
2015-06-02 14:20:31 -07:00
Josh Durgin
eb92254099 Merge pull request #4827 from ceph/wip-librbd-aio-submission
librbd: new config option for legacy blocking aio behavior

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2015-06-02 14:18:47 -07:00
John Spray
0de68ebbe5 qa: fix multiple_rsync.sh to avoid using /usr/ directly
While we're at it, take only /usr/lib instead of all of /usr
to keep the overall file count more modest.

Fixes: #11807
Signed-off-by: John Spray <john.spray@redhat.com>
2015-06-02 18:53:14 +01:00
Jason Dillaman
3d39a9bc69 Merge pull request #4701 from jdurgin/wip-nova-rbd-cache
doc: add rbd cache settings to nova.conf

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2015-06-02 11:34:45 -04:00
Jason Dillaman
4cf41486e9 tests: verify librbd blocking aio code path
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-06-02 10:33:35 -04:00
Jason Dillaman
008a9c4f6f librbd: add rbd_non_blocking_aio option to image metadata
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-06-02 10:32:41 -04:00
Kefu Chai
c2b06ab372 Merge pull request #4643 from tchaikov/wip-fix-11569
fix "pg ls" with states of "recovering" and/or "repair"

Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2015-06-02 20:43:26 +08:00
Kefu Chai
aa3d2693d3 Merge pull request #4760 from ketor/fix_mutex_memory_leak
Mutex: fix memory leak in lockdep _register

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-06-02 20:37:10 +08:00
Loic Dachary
ddfc589975 Merge pull request #4802 from isserrano/master
doc: Fixed example sintax in Absolute Sizing

Reviewed-by: Loic Dachary <ldachary@redhat.com>
2015-06-02 14:36:35 +02:00
Ismael
de14093fe2 doc: s/osd pool hot-storage/osd pool set hot-storage/
Signed-off-by: Ismael Serrano <ismael.serrano@gmail.com>
2015-06-02 13:30:15 +01:00
Kefu Chai
16e8e2cc82 mon: remove unnecessary error handling
msg.get_session() should always return a non-zero pointer in
Monitor.dispatch()

Signed-off-by: Kefu Chai <kchai@redhat.com>
2015-06-02 13:02:39 +08:00
Greg Farnum
64ec79f0d9 Put new variable initialization in its own block
Signed-off-by: Greg Farnum <gfarnum@redhat.com>
2015-06-01 21:31:47 -07:00
Jason Dillaman
769cad1271 librbd: new rbd_non_blocking_aio config option
Setting this option to false reverts librbd to legacy behavior
where AIO operations could potentially block.

Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2015-06-01 22:56:11 -04:00
David Zafman
d7858c6645 test/ceph-objectstore-tool: Don't need stderr noise
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-06-01 17:41:18 -07:00
David Zafman
23551deea6 test/ceph-objectstore-tool: Show command that should have failed
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-06-01 17:41:18 -07:00
David Zafman
ce76f88777 test/ceph_objectstore_tool: Improve dump-journal testing
Fix false failure when journal has no entries
Test dump-journal on all osds in 2 places

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-06-01 17:41:13 -07:00
David Zafman
90202a70f8 ceph-objectstore-tool: Allow --pgid specified on import (for post split)
Revamp split import testing to use --pgid option post split

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-06-01 17:41:11 -07:00
Sage Weil
106a1c3081 Makefile: install ceph-post-file keys with mode 600
Otherwise ssh (may) prompt for a password.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-06-01 15:38:07 -07:00
Joseph McDonald
ee170eadcd ceph-post-file: improve check for a source install
Signed-off-by: Joseph McDonald <joseph.mcdonald@alcatel-lucent.com>
2015-06-01 15:38:07 -07:00
Joseph McDonald
b84031ed5e ceph-post-file: behave when sftp doesn't take -i
Fixes: #11836
Signed-off-by: Joseph McDonald <joseph.mcdonald@alcatel-lucent.com>
2015-06-01 15:37:58 -07:00
David Zafman
51e27984ec ceph-objectstore-tool: Invalidate pg stats when objects were skipped during pg import
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-06-01 13:19:00 -07:00
David Zafman
70316541bb ceph-objectstore-tool, osd: Fix import handling
Use same_interval_since set to zero to communicate that an import has happened
and the correct value needs to be computed.

Fixes: #10794

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-06-01 13:19:00 -07:00
David Zafman
99d7663f87 ceph-objectstore-tool: Add dump-super to show OSDSuperblock in format specified
Signed-off-by: David Zafman <dzafman@redhat.com>
2015-06-01 13:19:00 -07:00
David Zafman
f1520061bb mds, include: Fix dump() numeric char array to include additional alpha chars
Caused by: c87f55b5a8

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-06-01 13:19:00 -07:00
David Zafman
bd2f62445b ceph-objectstore-tool: Add dump-journal as not requiring --pgid in usage
Additional comment describes --pgid requirement checking

Signed-off-by: David Zafman <dzafman@redhat.com>
2015-06-01 13:19:00 -07:00
Loic Dachary
e2e1f35feb erasure-code: verify the profile content matches get_profile()
The profile stored by the plugin may be different from the one set by
the user: it includes defaults. When the plugin is initialized, the
profile is modified to include the default values. Verify that the
modified profile matches what the get_profile() method returns, to guard
against inconsistencies from the erasure code plugin implementation.

http://tracker.ceph.com/issues/11663 Fixes: #11663

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-06-01 21:52:14 +02:00
Loic Dachary
8e61a99d0d mon: normalize erasure-code profile for storage and comparison
An erasure-code profile set by the user may be modified by the erasure
code plugin, most of the time to add default values for domain failure,
techniques etc.

Whenever the monitor gets an erasure code profile from the user or the
configuration file, it uses it to initialize the corresponding erasure
code plugin and:

 * validate the profile and get an error if it is invalid

 * get a normalized profile

The normalized profile is stored in the OSDMap. Should the user try
to set the same erasure code profile with the different values that lead
to the same normalized form, the modification will be accepted as a
noop, as if the same values were given. For instance:

   ceph osd erasure-code-profile set myprofile k=2

   ceph osd erasure-code-profile set myprofile k=2 m=1

are the same because the default value for m is 1 for the default
jerasure plugin.

If the normalized form is not used for storage and comparison, the
second call with m=1 will fail and require --force to override
myprofile, although the user can read from the documentation that it
matches the default value.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-06-01 21:52:14 +02:00
Loic Dachary
77e5330da1 erasure-code: implement get_profile for every plugins
The ErasureCode::init function is implemented to store the profile and
is called by the init method of each plugin. The
ErasureCode::get_profile function is implemented to return the profile
that was stored. A specialized ostream<< function is implemented to
facilitate the display of the profile.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-06-01 21:52:09 +02:00
Sage Weil
ab30921a07 make_dist.sh: bz2 only
faster and smaler.  caller can convert to gz or xz if they need it.

Signed-off-by: Sage Weil <sage@redhat.com>
2015-06-01 11:20:03 -07:00
Sage Weil
44f8bbb512 make_dist.sh: improve version calc
Signed-off-by: Sage Weil <sage@redhat.com>
2015-06-01 11:19:46 -07:00
Samuel Just
0f99796076 osd/: convert scrub to use the OpWQ
Fixes: 8635
Signed-off-by: Samuel Just <sjust@redhat.com>
2015-06-01 11:11:37 -07:00
Loic Dachary
0f2c556796 erasure-code: expect all plugins to implement get_profile
Add the get_profile method to the interface and make it a pure virtual.
Each plugin is expected to return the profile currently in use. Although
the profile is also stored in the OSDMap, it provides a convenient
introspection method to validate that the profile being set is indeed
the profile being used.

Signed-off-by: Loic Dachary <ldachary@redhat.com>
2015-06-01 19:52:48 +02:00
Ken Dreyer
a1de1fc20e Merge pull request #4729 from SUSE/wip_suse_builddeps_and_deps
ceph.spec.in: Forward port suse build deps and recomends
2015-06-01 10:12:00 -06:00
Kefu Chai
e5222b7ff0 Merge pull request #4822 from SUSE/wip_rpm_summary_ended_with_dot
ceph.spec.in summary-ended-with-dot

Reviewed-by: Kefu Chai <kchai@redhat.com>
2015-06-01 22:28:23 +08:00
Owen Synge
042e8ff4dc ceph.spec.in summary-ended-with-dot
RPM spec files summary should not end with a dot.
This was inconsistent across the ceph rpm packages
and creates errors with rpm lint.

Signed-off-by: Owen Synge <osynge@suse.com>
2015-06-01 15:57:03 +02:00
John Spray
f9b11b0abe qa: update cephtool test for CephFS tier cases
1. Creating a filesystem using a
   readonly tier on an EC pool (should be forbidden)
2. Removing a tier from a replicated base pool (should
   be permitted)

Signed-off-by: John Spray <john.spray@redhat.com>
2015-06-01 14:16:15 +01:00
John Spray
11e5faf3c1 mon: forbid readonly cache tiers for CephFS
For EC pools, we need a tier that is not just forwarding
writes, in order to provide the ops required
by CephFS.

Signed-off-by: John Spray <john.spray@redhat.com>
2015-06-01 14:16:15 +01:00
John Spray
a50c8f1f2a mon: refine check_remove_tier checks
Fixes: #11504
Signed-off-by: John Spray <john.spray@redhat.com>
2015-06-01 14:16:14 +01:00
Loic Dachary
8b7a6fdeaa Merge pull request #4710 from dachary/wip-9589-default-erasure-code-profile
erasure-code: query plugin for erasure-code-profile defaults

Reviewed-by: Andreas Peters <andreas.joachim.peters@cern.ch>
2015-06-01 15:00:04 +02:00
Owen Synge
0742d82b55 ceph.spec.in libcephfs_jni1 has no %post and %postun
/usr/lib64/libcephfs_jni.so.1.0.0 requires /sbin/ldconfig to be
run after installing and after removing.

Signed-off-by: Owen Synge <osynge@suse.com>
2015-06-01 14:58:31 +02:00
Haomai Wang
0be8c67456 AsyncConnection: Remove unusable status check
Signed-off-by: Haomai Wang <haomaiwang@gmail.com>
2015-06-01 15:48:20 +08:00
Kefu Chai
0f024602bd Merge pull request #4820 from ceph/wip-fix-ceph-perf-local
tools: fix ceph perf local build on i386

Reviewed-by: Haomai Wang <haomaiwang@gmail.com>
2015-06-01 15:33:15 +08:00