Commit Graph

56918 Commits

Author SHA1 Message Date
David Galloway
ecd02bf3f1 ceph-post-file: migrate to RSA SSH keys
DSA keys are being deprecated: http://www.openssh.com/legacy.html

drop.ceph.com will continue to allow the old DSA key but eventually,
users submitting logs using ceph-post-file will run into issues when
OpenSSH completely drops support for the algorithm.

Fixes: http://tracker.ceph.com/issues/14267

Signed-off-by: David Galloway <dgallowa@redhat.com>
2016-08-22 10:27:36 -04:00
Sage Weil
20186b2485 Merge pull request #10766 from liewegas/wip-bluestore-trivial
os/bluestore/BlueFS: disable buffered io
2016-08-19 12:21:46 -05:00
Sage Weil
5422527e92 Merge pull request #10773 from xiexingguo/xxg-wip-bluestore-2016-08-18
os/bluestore: fix decoding hash of bnode

Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-19 12:17:06 -05:00
Sage Weil
d8f9c5913b Merge pull request #10780 from liewegas/wip-bluestore-finishers
os/bluestore: add multiple finishers to bluestore

Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-19 12:15:17 -05:00
Nathan Cutler
fc7e398f1b Merge pull request #10592 from michelmno/forpull
LTTng-UST disabled for openSUSE

Reviewed-by: Nathan Cutler <ncutler@suse.com>
2016-08-19 17:36:58 +02:00
Kefu Chai
58b47a61b1 Merge pull request #10788 from ceph/wip-cmake
debian and cmake cleanups

Reviewed-by: Oleh Prypin <oleh@pryp.in>
2016-08-19 23:22:02 +08:00
Mykola Golub
549812338e Merge pull request #10762 from dillaman/wip-16654
librbd: cache was not switching to writeback after first flush

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-08-19 16:01:45 +03:00
Kefu Chai
2bc985f5a0 Merge pull request #10741 from minshenglin/remove_non_exists_options
doc: remove the description of deleted options

Reviewed-by: Nathan Cutler <ncutler@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-19 17:38:42 +08:00
Kefu Chai
190dba3c8d Merge pull request #10591 from xiexingguo/xxg-wip-osdmon-2016-08-05
mon: misc cleanups

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-19 11:58:42 +08:00
Kefu Chai
44bcd269d0 Merge pull request #10516 from wjwithagen/wip-wjw-freebsd-pidfile
src/global/pidfile.cc: Assign elements in structures individually

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-19 11:58:15 +08:00
Kefu Chai
87b5028811 Merge pull request #10451 from songbaisen/c0
tools: fix the core dump when get the crushmap do not exist

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-19 11:57:37 +08:00
Kefu Chai
34a80e8bb6 Merge pull request #9694 from renhwztetecs/renhw-wip-librados-iotest
test: add the necessary judgment

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-08-19 11:57:07 +08:00
Kefu Chai
2e3b23a7f4 debian: drop python-argparse dependency
and bump up the dependency of python version to 2.7.
py2.6 support was only necessary for older (now unsupported) distro
versions.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-08-19 10:43:51 +08:00
Kefu Chai
f140a8c2b2 debian: exclude python3* packages in dh_shlibdeps
since we are not using subvar of ${shlibs:Depends} in python3-* packages,
just exclude them in dh_shlibdeps.
this silences warnings like
```
warning: dpkg-gencontrol: package python3-cephfs: unused substitution
variable ${shlibs:Depends}
```

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-08-19 10:33:13 +08:00
Kefu Chai
49a4bd92f2 debian: enable dh_python3 for python3 packages
so we can use subvars like ${python3:Depends} in debian/control.
this silences the warnings like:
```
warning: dpkg-gencontrol: Depends field of package python3-cephfs:
unknown substitution variable ${python3:Depends}
```

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-08-19 10:31:43 +08:00
Kefu Chai
ab3db4e8ec cmake: fix unmatched endforeach
Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-08-19 09:51:11 +08:00
xie xingguo
434b18a61e os/bluestore: fix decoding hash of bnode
We encode reversed bits of hash and then write it onto disk,
therefore we shall decode and then reserse to get it back.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-08-19 06:30:16 +08:00
Josh Durgin
ee4d094690 Merge pull request #10782 from BlaXpirit/rados-test-py3
qa/workunits/rados/test_python.sh: Allow specifying Python executable

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2016-08-18 14:19:45 -07:00
Oleh Prypin
20c5bcf592 qa/workunits/rados/test_python.sh: Allow specifying Python executable
(through an environment variable)

Signed-off-by: Oleh Prypin <oleh@pryp.in>
2016-08-18 23:36:32 +03:00
Casey Bodley
94d813779a Merge pull request #10777 from linuxbox2/rgw-token-base64
rgw ldap:  protect rgw::from_base64 from non-base64 input

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-08-18 15:09:30 -04:00
Casey Bodley
4c33fa52d0 Merge pull request #10772 from ceph/wip-cmake
cmake: recompile erasure src for different variants

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-08-18 14:48:10 -04:00
Ilsoo Byun
028471899e os/bluestore: add multiple finishers to bluestore
- The single finisher of a bluestore can be a bottleneck
when using an SSD as a backend device. If too much load
is given to the single finisher, client-side IO latency
increases. So we add multiple finishers to the
bluestore, which shows better performance.

- 'bluestore_shard_finishers' option is added to
be able to configure wheather finsihers is multiple or
not.

- a finisher is selected according to the shard id of a
sequencer.

- the number of finishers is decided by
osd_op_num_shards.

Signed-off-by: Ilsoo Byun <ilsoo.byun@sk.com>
2016-08-18 14:29:44 -04:00
Sage Weil
6af2ed75e8 os/bluestore/BlueFS: rename buffered_io option
This is not a bluestore option.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-08-18 14:23:50 -04:00
Sage Weil
7f568fa1dd os/bluestore/BlueFS: do direct io by default (not buffered)
Somnath is doing this in his testing with good results.

Signed-off-by: Sage Weil <sage@redhat.com>
2016-08-18 14:23:20 -04:00
Sage Weil
8a54076ca2 os/bluestore: break down onode vs bnode_map size in log
Signed-off-by: Sage Weil <sage@redhat.com>
2016-08-18 14:23:20 -04:00
Sage Weil
9181c3d0a5 Merge pull request #10717 from liewegas/wip-bluefs-async-compaction
os/bluestore/BlueFS: async compaction

Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-18 13:21:40 -05:00
Sage Weil
a37357873d Merge pull request #10698 from liewegas/wip-bluestore-bluefs-allocation
bluestore: do not use freelist to track bluefs_extents
2016-08-18 11:27:53 -05:00
Sage Weil
8c39bb08c1 Merge pull request #10550 from tanghaodong25/in-memory-db
kv: fix some bugs in memdb

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Ramesh Chander <Ramesh.Chander@sandisk.com>
2016-08-18 11:14:13 -05:00
Sage Weil
cae06afbf0 Merge pull request #10775 from xiexingguo/xxg-wip-clean-storetest
test/store_test: tidy-up SyntheticWorkloadState class 

Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-18 11:11:24 -05:00
Matt Benjamin
0a4c91ec76 rgw ldap: protect rgw::from_base64 from non-base64 input
Also adds unit tests for:
1. empty output from from_base64 (turns out to be harmless)
2. random and specific non-base64 and sort strings

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-08-18 10:54:16 -04:00
Kefu Chai
b89e2b8ee6 cmake: recompile erasure src for different variants
* instead of reusing the object libraries, we should recompile jerasure
  code for different plugin flavors like neon, sse3, sse4.
* do not version plugin so, as they are not supposed to be used by
  user directly.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2016-08-18 17:43:21 +08:00
xie xingguo
df949d53bb test/store_test: avoid dynamic allocation of trans
For the sake of performance.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-08-18 15:50:10 +08:00
xie xingguo
e080e35c9f test/store_test: drop redundant transaction of callbacks
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-08-18 15:50:10 +08:00
xie xingguo
dd57e9ee18 test/store_test: fix incorrect prompt given by stash callback
"clone finish" belongs to C_SyntheticOnClone instead.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2016-08-18 15:50:10 +08:00
haodong
f5a320c218 kv: fix iterator bug in prev
Signed-off-by: Haodong Tang <haodong.tang@intel.com>
2016-08-18 15:17:41 +08:00
haodong
7e72a090c5 kv: fill 'm_key_value' after 'seek_to_first' or 'seek_to_last'
Signed-off-by: Haodong Tang <haodong.tang@intel.com>
2016-08-18 15:17:41 +08:00
haodong
00289b2a00 kv: fix iterator invalidation in memdb.
Signed-off-by: Haodong Tang <haodong.tang@intel.com>
2016-08-18 15:17:40 +08:00
haodong
cbca389d82 kv: delete store after pg destructor is called in OSD shutdown.
Using memdb for bluestore kvbackend, we will hit segfault when we use
'kill' command to shut down osd process. After destructing pg, some
reference to bluestore will be release, but bluestore has been deleted
at this time.

Signed-off-by: Haodong Tang <haodong.tang@intel.com>
2016-08-18 15:17:40 +08:00
Ilya Dryomov
0c9ada8ec6 Merge pull request #10481 from dillaman/wip-16171
librbd: request exclusive lock if current owner cannot execute op

Reviewed-off-by: Ilya Dryomov <idryomov@gmail.com>
2016-08-17 21:03:45 +02:00
Casey Bodley
c63a467d67 Merge pull request #10737 from weiqiaomiao/wqm-wip-rgw-core
rgw: fix radosgw daemon core when reopen logs

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2016-08-17 14:39:47 -04:00
Sage Weil
2634bcf853 Merge pull request #10728 from xiexingguo/xxg-wip-kill-bs-warn
bluestore: initialize csum_order properly

Reviewed-by: Sage Weil <sage@redhat.com>
2016-08-17 12:13:50 -04:00
Jason Dillaman
2d9840af39 librbd: cache was not switching to writeback after first flush
Fixes: http://tracker.ceph.com/issues/16654
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2016-08-17 12:08:37 -04:00
Mykola Golub
f7ae584db5 Merge pull request #10703 from dillaman/wip-16855
rbd-mirror: improve split-brain detection logic

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2016-08-17 18:16:17 +03:00
Orit Wasserman
8f535baace Merge pull request #10756 from linuxbox2/fix_gc_interval
rgw_file: restore local definition of RGWLibFS gc interval
Reviewed-by: Orit Wasserman <owasserm@redhat.com>
2016-08-17 17:03:44 +02:00
Sage Weil
2611cdca8a Merge pull request #10686 from liewegas/wip-bluefs-remove
os/bluestore/BlueFS: do not op_file_update deleted files

Tested-by: Somnath Roy <somnath.roy@sandisk.com>
2016-08-17 10:33:05 -04:00
Matt Benjamin
31936caa09 rgw_file: restore local definition of RGWLibFS gc interval
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2016-08-17 10:28:48 -04:00
Kefu Chai
810f660a7b Merge pull request #10755 from SUSE/wip-cmake-use-pie
cmake: Add -pie to CMAKE_EXE_LINKER_FLAGS

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-17 21:46:19 +08:00
Kefu Chai
aaacd3ef90 Merge pull request #10754 from SUSE/wip-cmake-fix-rgw-soversion
cmake: Fix mismatched librgw VERSION / SOVERSION

Reviewed-by: Kefu Chai <kchai@redhat.com>
2016-08-17 21:42:43 +08:00
Tim Serong
9e705be686 cmake: Add -pie to CMAKE_EXE_LINKER_FLAGS
Without this, rpmlint (on openSUSE Tumbleweed) fails with:

ceph-radosgw.x86_64: E: non-position-independent-executable
(Badness: 10000) /usr/bin/radosgw
This executable must be position independent.  Check that it
is built with -fPIE/-fpie in compiler flags and -pie in linker
flags.

Signed-off-by: Tim Serong <tserong@suse.com>
2016-08-17 22:27:19 +10:00
Tim Serong
c8885d4a9e cmake: Fix mismatched librgw VERSION / SOVERSION
Without this, rpmlint (on openSUSE Tumbleweed) fails with:

librgw2.x86_64: E: shlib-policy-name-error (Badness: 10000) librgw1
Your package contains a single shared library but is not named
after its SONAME.

It seems that the VERSION/SOVERSION mismatch results in the
creation of librgw.so.1 and librgw.so.2.0.0, whereas it should
be librgw.so.2 and librgw.so.2.0.0.

Signed-off-by: Tim Serong <tserong@suse.com>
2016-08-17 22:21:59 +10:00