Commit Graph

68141 Commits

Author SHA1 Message Date
Kefu Chai
ff1fd4b4b6 mon: assert on CEPH_FEATURE_MON_STATEFUL_SUB
this feature was introduced in jewel. and we are targeting luminous in
master. so it's safe to assume that all OSDs in the cluster have this
feature.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-01-27 12:17:38 +08:00
Dan Mick
24abb20695 Merge pull request #13148 from tchaikov/wip-18692
packaging: install libceph-common.so* not libceph-common.so.*

Reviewed-by: Dan Mick <dmick@redhat.com>
2017-01-26 19:43:34 -08:00
Kefu Chai
b641135cf8 packaging: install libceph-common.so* not libceph-common.so.*
Fixes: http://tracker.ceph.com/issues/18692
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-01-27 10:43:42 +08:00
Josh Durgin
fa0311ee52 Merge pull request #13087 from athanatos/wip-17831-18583
osd/PrimaryLogPG::try_lock_for_read: give up if missing

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-01-26 15:50:53 -08:00
Igor Fedotov
c7c7540c13 os/bluestore: fix miscalculation in bluestore_extent_ref_map_t::bound_encode
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-26 23:37:44 +00:00
Igor Fedotov
047eb43a3c os/bluestore: get rid off unused SharedBlob::hash_value function.
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-26 23:37:44 +00:00
Igor Fedotov
a7f8e231e3 os/bluestore: optimize SharedBlob::sbid in-mem representation.
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-26 23:37:44 +00:00
Igor Fedotov
ef46b4878d os/store_test: extend Onode in-mem size estimation with cached data presence case.
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-26 23:37:44 +00:00
Igor Fedotov
e1349ace2b os/bluestore: split SharedBlob into two-parts to improve in-mem footprint for non-shared blobs.
Signed-off-by: Igor Fedotov <ifedotor@mirantis.com>
2017-01-26 23:37:44 +00:00
Igor Fedotov
d9fd8af2b7 os/bluestore: add bluestore_blob_use_tracker_t to bluestore types 'sizeof' unittest.
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-26 23:37:44 +00:00
Igor Fedotov
c761c1bfec os/bluestore: raise ExtentMap/Blob encoding version to handle migration from ref_map to ref counting properly.
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-26 23:37:44 +00:00
Igor Fedotov
51a002f456 os/bluestore: replace Blob's ref_map with reference counting
Signed-off-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-26 23:37:44 +00:00
Josh Durgin
2ebea511ed Merge pull request #12934 from athanatos/wip-18529
test/pybind/test_rados.py: tolerate TimedOut in test_ping_monitor

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2017-01-26 15:14:45 -08:00
Mykola Golub
c720e348d4 Merge pull request #13110 from dillaman/wip-18666
librbd: prevent self-blacklisting during break lock

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-26 23:44:01 +02:00
Marcus Watts
5f229d6a33 radosgw/swift: clean up flush / newline behavior.
The current code emits a newline after swift errors, but fails
to account for it when it calculates 'content-length'.  This results in
some clients (go github.com/ncw/swift) producing complaints about the
unsolicited newline such as this,
	Unsolicited response received on idle HTTP channel starting with "\n"; err=<nil>

This logic eliminates the newline on flush.  This makes the content length
calculation correct and eliminates the stray newline.

There was already existing separator logic in the rgw plain formatter
that can emit a newline at the correct point.  It had been checking
"len" to decide if previous data had been emitted, but that's reset to 0
by flush().  So, this logic adds a new per-instance variable to separately
track state that it emitted a previous item (and should emit a newline).

Fixes: http://tracker.ceph.com/issues/18473
Signed-off-by: Marcus Watts <mwatts@redhat.com>
Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2017-01-26 14:58:29 -05:00
Samuel Just
43e677dded test/pybind/test_rados.py: tolerate empty output from mon ping
Fixes: http://tracker.ceph.com/issues/18529
Signed-off-by: Samuel Just <sjust@redhat.com>
2017-01-26 11:46:36 -08:00
Yehuda Sadeh
b6f1ba8a81 Merge pull request #13007 from Werkov/rgw-fix-tempurl-url-encoding-master
rgw: Use decoded URI when verifying TempURL

Reviewed-by: Radoslaw Zarzynski <rzarzynski@mirantis.com>
2017-01-26 11:34:38 -08:00
Sage Weil
c66d5babb1 os/bluestore: fix statfs to not include DB partition in free space
If we report the DB space as vailable, ceph thinks the OSD can store more
data and will not mark the cluster as full as easily.  And in reality, we
can't actually store data in this space--only metadata.  Avoid the problem
by not reporting it as available.

Fixes: http://tracker.ceph.com/issues/18599
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-26 14:22:53 -05:00
Jason Dillaman
ce675383b3 qa/tasks/qemu: allow tests to customize the number of CPUs
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-26 14:18:48 -05:00
Jason Dillaman
42e967f0bb qa/tasks/qemu: copy ceph configuration to VM image
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-26 14:17:43 -05:00
Jason Dillaman
d98aa1a39a qa/tasks/qemu: attach all disks as rbd block devices
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-26 14:17:30 -05:00
Jason Dillaman
67a4a6c519 qa/tasks/qemu: support overriding the cloud image
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-26 14:16:16 -05:00
Jason Dillaman
454348004b qa/tasks/qemu: support arbitrary additions to cloud-init-archive
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-26 14:16:10 -05:00
Sarit Zubakov
187c5cfa31 sync/rdma: Remove warning
Fixed warning - of sending unsigned short int to %x

issue: 944710

Change-Id: I2820e8da77467a4a645d9653b4964e7a2198656b
Signed-off-by: Sarit Zubakov <saritz@mellanox.com>
2017-01-26 21:12:03 +02:00
Yehuda Sadeh
10a7ff0a75 Merge pull request #12444 from oritwas/wip-rgw-fix-secondary_versioning
rgw: complete versioning enablement after sending it to meta master

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-01-26 10:49:41 -08:00
Orit Wasserman
125955e062 rgw: add check for update return value
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-01-26 19:45:40 +02:00
Orit Wasserman
5393077e07 rgw: fix init_zg_from_period when default zone is not set as default
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-01-26 19:45:40 +02:00
Orit Wasserman
ac9a7565dd rgw: we need to reinit the zonegroup after assignment to avoid invalid cct and store
Fixes: http://tracker.ceph.com/issues/18631
Signed-off-by: Orit Wasserman <owasserm@redhat.com>
2017-01-26 19:45:40 +02:00
Sage Weil
05e4aaa830 Merge pull request #13074 from liewegas/wip-bluestore-crc-error
os/bluestore: include logical object offset in crc error

Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2017-01-26 11:21:15 -06:00
Sage Weil
31721ea78c os/bluestore/KernelDevice: fix debug message
Not even sure why this compiles :/.

Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-26 11:02:06 -05:00
Kefu Chai
8a86a3fd85 Merge pull request #12878 from tchaikov/wip-cmake
cmake: link ceph-{mgr,mon,mds,osd} against libcommon statically

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-01-26 23:59:36 +08:00
Kefu Chai
4755086f8f Merge pull request #13122 from orendu/fix-rdma-compilation
cmake: Fix broken async/rdma compilation since move to libceph-common

Reviewed-by: Adir Lev <adirl@mellanox.com>
Reviewed-by: Haomai Wang <haomai@xsky.com>
Reviewed-by: Amir Vadai <amir@vadai.me>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-26 19:23:09 +08:00
Haomai Wang
8548eda47b Merge pull request #13101 from Adirl/fix_mem_leak
msg/async/rdma: Fix memory leak of OSD

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-26 18:25:54 +08:00
Oren Duer
80473bf310 cmake: Fix broken async/rdma compilation since move to libceph-common
Was broken since merge of pull request #12840

Signed-off-by: Oren Duer <oren@mellanox.com>
2017-01-26 09:43:26 +00:00
Yan, Zheng
7d120bb3f4 client: remove request from session->requests when handling forward
Client::handle_client_request_forward() reset request->mds to -1,
it should also remove request from session->requests. Otherwise
Client::kick_requests_closed() get confused.

Fixes: http://tracker.ceph.com/issues/18675
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-01-26 17:00:33 +08:00
Kefu Chai
c443c2c7e4 Merge pull request #13075 from tchaikov/wip-zstd
compressor/zstd: add zstd compression plugin

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2017-01-26 15:28:01 +08:00
Jing Wenjun
941dfad671 rgw: swift: The http referer should be parsed to compare in swift API
The http referer should be parsed to compare with the url set on the container read acl. If we set .r:www.example.com on container read acl, we should parse the hostname 'www.example.com' of the http referer like 'http://www.example.com' from the http request.

Fixes: http://tracker.ceph.com/issues/18685
Signed-off-by: Jing Wenjun <jingwenjun@cmss.chinamobile.com>
2017-01-26 13:04:59 +08:00
Yan, Zheng
c9ecea101f mds: pin base object of discover
make sure the base object is in the cache when handing MDiscoverReply

Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-01-26 10:52:25 +08:00
Yan, Zheng
e3ee0f12ed mds: handle case that there is no session for the importing caps
Fixes: http://tracker.ceph.com/issues/18646
Signed-off-by: "Yan, Zheng" <zyan@redhat.com>
2017-01-26 10:13:41 +08:00
Jason Dillaman
5c590acaec librbd: prevent self-blacklisting during break lock
Fixes: http://tracker.ceph.com/issues/18666
Signed-off-by: Jason Dillaman <dillaman@redhat.com>
2017-01-25 14:45:56 -05:00
Mykola Golub
cd2ab329fc Merge pull request #13086 from dillaman/wip-librbd-lock-init-race
librbd: race initializing exclusive lock and configuring IO path

Reviewed-by: Mykola Golub <mgolub@mirantis.com>
2017-01-25 19:08:47 +02:00
Sage Weil
4dd38b923b compressor/zstd: add zstd compressor
Build/link of zstd itself is maybe not ideal, but it works fine.

Signed-off-by: Sage Weil <sage@redhat.com>
Signed-off-by: Kefu Chai <kchai@redhat.com>
2017-01-26 00:37:23 +08:00
Sage Weil
46b3849fc4 add src/zstd submodule
Signed-off-by: Sage Weil <sage@redhat.com>
2017-01-26 00:37:23 +08:00
Sarit Zubakov
82377aaae9 msg/async/rdma: Fix memory leak of OSD
We can delete qp only in RDMADispatcher::handle_async_event() which call
"erase_qpn" to enable deletion.

issue: 959004

Change-Id: Iab69cb365b37a09e9608d4b3c595e05278bbe021
Signed-off-by: Sarit Zubakov <saritz@mellanox.com>
2017-01-25 16:53:20 +02:00
Kefu Chai
61b345eb65 Merge pull request #13090 from dzafman/wip-18624
Revert "PrimaryLogPG::failed_push: update missing as well"

Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2017-01-25 22:32:13 +08:00
Haomai Wang
2e6ba82496 Merge pull request #13096 from amirv/new_connect_arg
msg/RDMA: Fix broken compilation due to new argument in net.connect()

Reviewed-by: Haomai Wang <haomai@xsky.com>
2017-01-25 22:22:22 +08:00
Sage Weil
9080596335 Merge pull request #9348 from LiumxNL/fix-mksnap
mon/OSDMonitor: make snaps on tier pool should not be allowed
2017-01-25 06:35:36 -06:00
Sage Weil
84ae7d2f86 Merge pull request #12937 from chendave/auth_method
auth: Enhancement for the supported auth methods

Reviewed-by: Sage Weil <sage@redhat.com>
2017-01-25 06:35:10 -06:00
Sage Weil
07cb98e45e Merge pull request #12992 from tchaikov/wip-demangle-on-freebsd
common/BackTrace: demangle on FreeBSD also

Reviewed-by: Willem Jan Withagen <wjw@digiware.nl>
2017-01-25 06:34:52 -06:00
Sage Weil
801fd3c25c Merge pull request #12620 from varadakari/wip-rocksdb-histogram
os/bluestore: kvdb histogram

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Igor Fedotov <ifedotov@mirantis.com>
2017-01-25 06:34:24 -06:00