Commit Graph

67876 Commits

Author SHA1 Message Date
Jason Dillaman
deaaba8fcf qa/suites/rbd: OpenStack devstack tempest full suite
This mimics the OpenStack tempest gate tests that OpenStack
Zuul executes as a gate test.

Fixes: http://tracker.ceph.com/issues/18594
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-27 14:22:48 -05:00
Jason Dillaman
ce675383b3 qa/tasks/qemu: allow tests to customize the number of CPUs
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-26 14:18:48 -05:00
Jason Dillaman
42e967f0bb qa/tasks/qemu: copy ceph configuration to VM image
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-26 14:17:43 -05:00
Jason Dillaman
d98aa1a39a qa/tasks/qemu: attach all disks as rbd block devices
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-26 14:17:30 -05:00
Jason Dillaman
67a4a6c519 qa/tasks/qemu: support overriding the cloud image
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-26 14:16:16 -05:00
Jason Dillaman
454348004b qa/tasks/qemu: support arbitrary additions to cloud-init-archive
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-26 14:16:10 -05:00
Yehuda Sadeh
10a7ff0a75 Merge pull request #12444 from oritwas/wip-rgw-fix-secondary_versioning
rgw: complete versioning enablement after sending it to meta master

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-01-26 10:49:41 -08:00
Sage Weil
05e4aaa830 Merge pull request #13074 from liewegas/wip-bluestore-crc-error
os/bluestore: include logical object offset in crc error

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-01-26 11:21:15 -06:00
Kefu Chai
8a86a3fd85 Merge pull request #12878 from tchaikov/wip-cmake
cmake: link ceph-{mgr,mon,mds,osd} against libcommon statically

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-01-26 23:59:36 +08:00
Kefu Chai
4755086f8f Merge pull request #13122 from orendu/fix-rdma-compilation
cmake: Fix broken async/rdma compilation since move to libceph-common

Reviewed-by: Adir Lev <adirl@mellanox.com>
Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Amir Vadai <amir@vadai.me>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-26 19:23:09 +08:00
Haomai Wang
8548eda47b Merge pull request #13101 from Adirl/fix_mem_leak
msg/async/rdma: Fix memory leak of OSD

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-26 18:25:54 +08:00
Oren Duer
80473bf310 cmake: Fix broken async/rdma compilation since move to libceph-common
Was broken since merge of pull request #12840

Signed-off-by: Oren Duer <oren@mellanox.com>
2017-01-26 09:43:26 +00:00
Kefu Chai
c443c2c7e4 Merge pull request #13075 from tchaikov/wip-zstd
compressor/zstd: add zstd compression plugin

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-01-26 15:28:01 +08:00
Mykola Golub
cd2ab329fc Merge pull request #13086 from dillaman/wip-librbd-lock-init-race
librbd: race initializing exclusive lock and configuring IO path

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-25 19:08:47 +02:00
Sage Weil
4dd38b923b compressor/zstd: add zstd compressor
Build/link of zstd itself is maybe not ideal, but it works fine.

Signed-off-by: Sage Weil <sage@redhat.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-01-26 00:37:23 +08:00
Sage Weil
46b3849fc4 add src/zstd submodule
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-26 00:37:23 +08:00
Sarit Zubakov
82377aaae9 msg/async/rdma: Fix memory leak of OSD
We can delete qp only in RDMADispatcher::handle_async_event() which call
"erase_qpn" to enable deletion.

issue: 959004

Change-Id: Iab69cb365b37a09e9608d4b3c595e05278bbe021
Signed-off-by: Sarit Zubakov <saritz@mellanox.com>
2017-01-25 16:53:20 +02:00
Kefu Chai
61b345eb65 Merge pull request #13090 from dzafman/wip-18624
Revert "PrimaryLogPG::failed_push: update missing as well"

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-25 22:32:13 +08:00
Haomai Wang
2e6ba82496 Merge pull request #13096 from amirv/new_connect_arg
msg/RDMA: Fix broken compilation due to new argument in net.connect()

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-25 22:22:22 +08:00
Sage Weil
9080596335 Merge pull request #9348 from LiumxNL/fix-mksnap
mon/OSDMonitor: make snaps on tier pool should not be allowed
2017-01-25 06:35:36 -06:00
Sage Weil
84ae7d2f86 Merge pull request #12937 from chendave/auth_method
auth: Enhancement for the supported auth methods

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-25 06:35:10 -06:00
Sage Weil
07cb98e45e Merge pull request #12992 from tchaikov/wip-demangle-on-freebsd
common/BackTrace: demangle on FreeBSD also

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2017-01-25 06:34:52 -06:00
Sage Weil
801fd3c25c Merge pull request #12620 from varadakari/wip-rocksdb-histogram
os/bluestore: kvdb histogram

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-25 06:34:24 -06:00
Sage Weil
a35a8ecfcb Merge pull request #13031 from dzafman/wip-calc-stats
osd: Calculate degraded and misplaced more accurately

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-25 06:33:48 -06:00
Sage Weil
3c5928091b Merge pull request #13032 from liewegas/wip-bluefs-append
os/bluestore/BlueFS: tune flushing of writes

Tested-by: Chagam, Anjaneya <anjaneya.chagam@intel.com>
2017-01-25 06:24:30 -06:00
Sage Weil
2947cf3c6d Merge pull request #13072 from wido/issue-18638
osd: Return correct osd_objectstore in OSD metadata

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-01-25 06:22:41 -06:00
Sage Weil
c5663a78d5 Merge pull request #13018 from songbaisen/s11
global: we need to handle the init_on_startup return value when global_init.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-25 06:22:15 -06:00
Amir Vadai
a579329333 msg/RDMA: Fix broken compilation due to new argument in net.connect()
Fixes: 6e4ed291af ("msg: add ms_bind_before_connect to bind before connect")
Change-Id: Ia45f215b5d59dfc8545017518e5162404059829e
Signed-off-by: Amir Vadai <amir@vadai.me>
2017-01-25 10:39:11 +02:00
David Zafman
1642adda32 Revert "PrimaryLogPG::failed_push: update missing as well"
This reverts commit dd48b972af.

Fixes: http://tracker.ceph.com/issues/18624

Signed-off-by: David Zafman <dzafman@redhat.com>
2017-01-24 16:31:59 -08:00
Adam C. Emerson
5ce40363ae Merge pull request #12445 from pritha-srivastava/wip_glob_func
rgw: Added a globbing method for AWS Policies.
2017-01-24 15:16:44 -05:00
Matt Benjamin
3534595021 Merge pull request #13084 from linuxbox2/wip-librgw-parentref
rgw_file:  interned RGWFileHandle objects need parent refs
2017-01-24 14:58:58 -05:00
Sage Weil
3140a52f58 Merge pull request #13083 from dachary/wip-15653-crush-weights
crush: verify weights is influenced by the number of replicas

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-24 13:52:52 -06:00
Mykola Golub
d4932a7c96 Merge pull request #13076 from dillaman/wip-18617
test: use librados API to retrieve config params

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-24 21:32:13 +02:00
David Zafman
2c7de6c5dd Merge pull request #12866 from dzafman/wip-18471
qa/workunits/ceph-helpers: wait_for_clean() races with pg creation

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-24 11:02:38 -08:00
Matt Benjamin
0e5299f3f4 rgw_file: interned RGWFileHandle objects need parent refs
RGW NFS fhcache/RGWFileHandle operators assume existence of the
full chain of parents from any object to the its fs_root--this is
a consequence of the weakly-connected namespace design goal, and
not a defect.

This change ensures the invariant by taking a parent ref when
objects are interned (when a parent ref is guaranteed).  Parent
refs are returned when objects are destroyed--essentially by the
invariant, such a ref must exist.

The extra ref is omitted when parent->is_root(), as that node is
not in the LRU cache.

Fixes: http://tracker.ceph.com/issues/18650

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-01-24 12:57:11 -05:00
Matt Benjamin
748f0a6fb9 Merge pull request #13038 from linuxbox2/wip-librgw-invalidate
rgw_file: add timed namespace invalidation
2017-01-24 12:15:12 -05:00
Jason Dillaman
f83aa24e8d librbd: race initializing exclusive lock and configuring IO path
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-24 10:34:05 -05:00
Kefu Chai
47c59be6e1 Merge pull request #12916 from Liuchang0812/xmlformatter-fix
common/xmlformatter: turn on underscored and add unittest

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-24 23:20:16 +08:00
Jason Dillaman
d934aa2942 librbd: improve debug logging for lock / watch state machines
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-24 09:48:43 -05:00
Jason Dillaman
2ed02f3cd5 test: use librados API to retrieve config params
The CephContext object is not ABI-stable, so it is necessary to
use the "conf_get" librados methods to safely retrieve a setting.

Fixes: http://tracker.ceph.com/issues/18617
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-24 09:29:59 -05:00
Loic Dachary
24cb06a96d crush: verify weights is influenced by the number of replicas
Refs: http://tracker.ceph.com/issues/15653

Signed-off-by: Adam C. Emerson <aemerson@redhat.com>
Signed-off-by: Loic Dachary <loic@dachary.org>
2017-01-24 15:14:45 +01:00
Matt Benjamin
deb2c1ea98 rgw_file: add timed namespace invalidation
With change, librgw/rgw_file consumers can provide an invalidation
callback, which is used by the library to invalidate directories
whose contents should be forgotten.

The existing RGWLib GC mechanism is being used to drive this.  New
configuration params have been added.  The main configurable is
rgw_nfs_namespace_expire_secs, the expire timeout.

Updated post Yehuda review.

Fixes: http://tracker.ceph.com/issues/18651

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-01-24 08:21:33 -05:00
Haomai Wang
b2df030a50 Merge pull request #12956 from liuhongtong/wip-nvmedevice
os/bluestore: fix NVMEDevice::open failure if serial number ends with a …

Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Pan liu <liupan1111@gmail.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-24 18:07:05 +08:00
Wido den Hollander
8fe6a0303b
osd: Return correct osd_objectstore in OSD metadata
Do not simply read the configuration value as it might have changed
during OSD startup by reading the type from disk.

Fixes: http://tracker.ceph.com/issues/18638

Signed-off-by: Wido den Hollander <wido@42on.com>
2017-01-24 08:22:34 +01:00
Haomai Wang
8558a0fe52 Merge pull request #13055 from optimistyzy/2017123_random_read
os/bluestore/NVMEDevice.cc: fix the random read issue.

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-24 12:01:27 +08:00
optimistyzy
c02e3e5266 os/bluestore/NVMEDevice.cc: use aio_wake in both read and read_random
There are some issues with random read, it seems that
we did not call aio_wake.

Signed-off-by: optimistyzy <optimistyzy@gmail.com>
2017-01-24 11:35:45 +08:00
Sage Weil
7eddf919b4 Merge pull request #12929 from wjwithagen/wip-wjw-empty-cluster_network
common/pick_address.cc: Copy public_netw to cluster_netw if cluster empty

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-23 21:16:21 -06:00
Sage Weil
d0740a3514 Merge branch 'master' into wip-wjw-empty-cluster_network 2017-01-23 21:16:09 -06:00
Sage Weil
6390ea7312 os/bluestore: include logical object offset in crc error message
This is more useful to the user.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-23 18:51:06 -06:00
Yuri Weinstein
f9f9b63e09 Merge pull request #12901 from yuyuyu101/wip-msgr-client-bind
msg: client bind

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-23 15:00:26 -08:00