Commit Graph

67887 Commits

Author SHA1 Message Date
Sage Weil
9602a34525 os/bluestore: do read io via aio in parallel
Dispatch all blob reads in parallel via aio.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-27 10:27:03 -05:00
Sage Weil
393747a698 os/bluestore/KernelDevice: avoid possible use-after-free for ioc->priv
If aio_wake() triggers destruction, ioc->priv might be a
use-after-free (this is the case for the BlueStore read path).

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-27 10:26:16 -05:00
Sage Weil
dbaa2b056e os/bluestore/NVMEDevice: implement aio_read
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-27 10:26:16 -05:00
Sage Weil
4aeaaabb67 os/bluestore/BlockDevice: add aio_read API
NVMEDevice not implemented yet.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-27 10:26:15 -05:00
John Spray
5f67cf97f9 Merge pull request #13088 from jcsp/wip-16397-unpin
qa: unpin knfs from ubuntu

Reviewed-by: Jeff Layton <jlayton@redhat.com>
2017-01-27 15:39:41 +01:00
Dan Mick
24abb20695 Merge pull request #13148 from tchaikov/wip-18692
packaging: install libceph-common.so* not libceph-common.so.*

Reviewed-by: Dan Mick <dmick@redhat.com>
2017-01-26 19:43:34 -08:00
Kefu Chai
b641135cf8 packaging: install libceph-common.so* not libceph-common.so.*
Fixes: http://tracker.ceph.com/issues/18692
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-01-27 10:43:42 +08:00
Josh Durgin
fa0311ee52 Merge pull request #13087 from athanatos/wip-17831-18583
osd/PrimaryLogPG::try_lock_for_read: give up if missing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-01-26 15:50:53 -08:00
Josh Durgin
2ebea511ed Merge pull request #12934 from athanatos/wip-18529
test/pybind/test_rados.py: tolerate TimedOut in test_ping_monitor

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-01-26 15:14:45 -08:00
Mykola Golub
c720e348d4 Merge pull request #13110 from dillaman/wip-18666
librbd: prevent self-blacklisting during break lock

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-26 23:44:01 +02:00
Marcus Watts
5f229d6a33 radosgw/swift: clean up flush / newline behavior.
The current code emits a newline after swift errors, but fails
to account for it when it calculates 'content-length'.  This results in
some clients (go github.com/ncw/swift) producing complaints about the
unsolicited newline such as this,
	Unsolicited response received on idle HTTP channel starting with "\n"; err=<nil>

This logic eliminates the newline on flush.  This makes the content length
calculation correct and eliminates the stray newline.

There was already existing separator logic in the rgw plain formatter
that can emit a newline at the correct point.  It had been checking
"len" to decide if previous data had been emitted, but that's reset to 0
by flush().  So, this logic adds a new per-instance variable to separately
track state that it emitted a previous item (and should emit a newline).

Fixes: http://tracker.ceph.com/issues/18473
Signed-off-by: Marcus Watts <mwatts@redhat.com>
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-01-26 14:58:29 -05:00
Samuel Just
43e677dded test/pybind/test_rados.py: tolerate empty output from mon ping
Fixes: http://tracker.ceph.com/issues/18529
Signed-off-by: Samuel Just <sjust@redhat.com>
2017-01-26 11:46:36 -08:00
Yehuda Sadeh
b6f1ba8a81 Merge pull request #13007 from Werkov/rgw-fix-tempurl-url-encoding-master
rgw: Use decoded URI when verifying TempURL

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-01-26 11:34:38 -08:00
Yehuda Sadeh
10a7ff0a75 Merge pull request #12444 from oritwas/wip-rgw-fix-secondary_versioning
rgw: complete versioning enablement after sending it to meta master

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-01-26 10:49:41 -08:00
Sage Weil
05e4aaa830 Merge pull request #13074 from liewegas/wip-bluestore-crc-error
os/bluestore: include logical object offset in crc error

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-01-26 11:21:15 -06:00
Kefu Chai
8a86a3fd85 Merge pull request #12878 from tchaikov/wip-cmake
cmake: link ceph-{mgr,mon,mds,osd} against libcommon statically

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-01-26 23:59:36 +08:00
Kefu Chai
4755086f8f Merge pull request #13122 from orendu/fix-rdma-compilation
cmake: Fix broken async/rdma compilation since move to libceph-common

Reviewed-by: Adir Lev <adirl@mellanox.com>
Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Amir Vadai <amir@vadai.me>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-26 19:23:09 +08:00
Haomai Wang
8548eda47b Merge pull request #13101 from Adirl/fix_mem_leak
msg/async/rdma: Fix memory leak of OSD

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-26 18:25:54 +08:00
Oren Duer
80473bf310 cmake: Fix broken async/rdma compilation since move to libceph-common
Was broken since merge of pull request #12840

Signed-off-by: Oren Duer <oren@mellanox.com>
2017-01-26 09:43:26 +00:00
Kefu Chai
c443c2c7e4 Merge pull request #13075 from tchaikov/wip-zstd
compressor/zstd: add zstd compression plugin

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-01-26 15:28:01 +08:00
Jason Dillaman
5c590acaec librbd: prevent self-blacklisting during break lock
Fixes: http://tracker.ceph.com/issues/18666
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-25 14:45:56 -05:00
Mykola Golub
cd2ab329fc Merge pull request #13086 from dillaman/wip-librbd-lock-init-race
librbd: race initializing exclusive lock and configuring IO path

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-25 19:08:47 +02:00
Sage Weil
4dd38b923b compressor/zstd: add zstd compressor
Build/link of zstd itself is maybe not ideal, but it works fine.

Signed-off-by: Sage Weil <sage@redhat.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-01-26 00:37:23 +08:00
Sage Weil
46b3849fc4 add src/zstd submodule
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-26 00:37:23 +08:00
Sarit Zubakov
82377aaae9 msg/async/rdma: Fix memory leak of OSD
We can delete qp only in RDMADispatcher::handle_async_event() which call
"erase_qpn" to enable deletion.

issue: 959004

Change-Id: Iab69cb365b37a09e9608d4b3c595e05278bbe021
Signed-off-by: Sarit Zubakov <saritz@mellanox.com>
2017-01-25 16:53:20 +02:00
Kefu Chai
61b345eb65 Merge pull request #13090 from dzafman/wip-18624
Revert "PrimaryLogPG::failed_push: update missing as well"

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-25 22:32:13 +08:00
Haomai Wang
2e6ba82496 Merge pull request #13096 from amirv/new_connect_arg
msg/RDMA: Fix broken compilation due to new argument in net.connect()

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-25 22:22:22 +08:00
Sage Weil
9080596335 Merge pull request #9348 from LiumxNL/fix-mksnap
mon/OSDMonitor: make snaps on tier pool should not be allowed
2017-01-25 06:35:36 -06:00
Sage Weil
84ae7d2f86 Merge pull request #12937 from chendave/auth_method
auth: Enhancement for the supported auth methods

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-25 06:35:10 -06:00
Sage Weil
07cb98e45e Merge pull request #12992 from tchaikov/wip-demangle-on-freebsd
common/BackTrace: demangle on FreeBSD also

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2017-01-25 06:34:52 -06:00
Sage Weil
801fd3c25c Merge pull request #12620 from varadakari/wip-rocksdb-histogram
os/bluestore: kvdb histogram

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-25 06:34:24 -06:00
Sage Weil
a35a8ecfcb Merge pull request #13031 from dzafman/wip-calc-stats
osd: Calculate degraded and misplaced more accurately

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-25 06:33:48 -06:00
Sage Weil
3c5928091b Merge pull request #13032 from liewegas/wip-bluefs-append
os/bluestore/BlueFS: tune flushing of writes

Tested-by: Chagam, Anjaneya <anjaneya.chagam@intel.com>
2017-01-25 06:24:30 -06:00
Sage Weil
2947cf3c6d Merge pull request #13072 from wido/issue-18638
osd: Return correct osd_objectstore in OSD metadata

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-01-25 06:22:41 -06:00
Sage Weil
c5663a78d5 Merge pull request #13018 from songbaisen/s11
global: we need to handle the init_on_startup return value when global_init.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-25 06:22:15 -06:00
Amir Vadai
a579329333 msg/RDMA: Fix broken compilation due to new argument in net.connect()
Fixes: 6e4ed291af ("msg: add ms_bind_before_connect to bind before connect")
Change-Id: Ia45f215b5d59dfc8545017518e5162404059829e
Signed-off-by: Amir Vadai <amir@vadai.me>
2017-01-25 10:39:11 +02:00
David Zafman
1642adda32 Revert "PrimaryLogPG::failed_push: update missing as well"
This reverts commit dd48b972af.

Fixes: http://tracker.ceph.com/issues/18624

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-01-24 16:31:59 -08:00
John Spray
4dd3666b2d qa: unpin knfs from ubuntu
We have an updated nfs-utils that is no longer
generating spurious selinux warnings on CentOS.

Fixes: http://tracker.ceph.com/issues/16397
Signed-off-by: John Spray <john.spray@redhat.com>
2017-01-24 22:06:29 +00:00
Adam C. Emerson
5ce40363ae Merge pull request #12445 from pritha-srivastava/wip_glob_func
rgw: Added a globbing method for AWS Policies.
2017-01-24 15:16:44 -05:00
Matt Benjamin
3534595021 Merge pull request #13084 from linuxbox2/wip-librgw-parentref
rgw_file:  interned RGWFileHandle objects need parent refs
2017-01-24 14:58:58 -05:00
Sage Weil
3140a52f58 Merge pull request #13083 from dachary/wip-15653-crush-weights
crush: verify weights is influenced by the number of replicas

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-24 13:52:52 -06:00
Mykola Golub
d4932a7c96 Merge pull request #13076 from dillaman/wip-18617
test: use librados API to retrieve config params

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-24 21:32:13 +02:00
David Zafman
2c7de6c5dd Merge pull request #12866 from dzafman/wip-18471
qa/workunits/ceph-helpers: wait_for_clean() races with pg creation

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-24 11:02:38 -08:00
Matt Benjamin
0e5299f3f4 rgw_file: interned RGWFileHandle objects need parent refs
RGW NFS fhcache/RGWFileHandle operators assume existence of the
full chain of parents from any object to the its fs_root--this is
a consequence of the weakly-connected namespace design goal, and
not a defect.

This change ensures the invariant by taking a parent ref when
objects are interned (when a parent ref is guaranteed).  Parent
refs are returned when objects are destroyed--essentially by the
invariant, such a ref must exist.

The extra ref is omitted when parent->is_root(), as that node is
not in the LRU cache.

Fixes: http://tracker.ceph.com/issues/18650

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-01-24 12:57:11 -05:00
Matt Benjamin
748f0a6fb9 Merge pull request #13038 from linuxbox2/wip-librgw-invalidate
rgw_file: add timed namespace invalidation
2017-01-24 12:15:12 -05:00
Jason Dillaman
f83aa24e8d librbd: race initializing exclusive lock and configuring IO path
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-24 10:34:05 -05:00
Kefu Chai
47c59be6e1 Merge pull request #12916 from Liuchang0812/xmlformatter-fix
common/xmlformatter: turn on underscored and add unittest

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-24 23:20:16 +08:00
Jason Dillaman
d934aa2942 librbd: improve debug logging for lock / watch state machines
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-24 09:48:43 -05:00
Jason Dillaman
2ed02f3cd5 test: use librados API to retrieve config params
The CephContext object is not ABI-stable, so it is necessary to
use the "conf_get" librados methods to safely retrieve a setting.

Fixes: http://tracker.ceph.com/issues/18617
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-24 09:29:59 -05:00
Loic Dachary
24cb06a96d crush: verify weights is influenced by the number of replicas
Refs: http://tracker.ceph.com/issues/15653

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
Signed-off-by: Loic Dachary <loic@dachary.org>
2017-01-24 15:14:45 +01:00