Commit Graph

96610 Commits

Author SHA1 Message Date
Yuan Zhou
736b758b13 tools: create local utils for object cache daemon
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
2019-03-22 00:16:25 +08:00
Yuan Zhou
1cf4ff41c6 tools: clean up immutable object cache
- drop "ceph_" prefix
- prefix all options with immutable_object_cache_
- adding configurable immutable_object_cache_max_inflight_ops

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
2019-03-22 00:16:25 +08:00
Yuan Zhou
9a7e5e0866 tools: adding ceph level immutable obj cache daemon
The daemon is built for future integration with both RBD and RGW cache.
The key components are:
- domain socket based simple IPC
- simple LRU policy based promotion/demotion for the cache
- simple file based caching store for RADOS objs with sync IO interface
- systemd service/target files for the daemon

Signed-off-by: Dehao Shang <dehao.shang@intel.com>
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
2019-03-22 00:16:25 +08:00
Kefu Chai
a13a5452ff
Merge pull request #27099 from tchaikov/wip-crimson-misc-logging
crimson/{net,mon,osd}: misc logging changes

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-03-22 00:14:01 +08:00
Volker Theile
c29e587007 mgr/dashboard/qa: Improve tasks.mgr.test_dashboard.TestDashboard.test_standby
The changes of this PR were done while trying to fix the failing test. The problem has been solved by another PR, but the changes are worth to be integrated because they help debugging and an additional test has been added (check if previously active manager is listed as standby).

Signed-off-by: Volker Theile <vtheile@suse.com>
2019-03-21 15:26:52 +01:00
Kefu Chai
085fdf57fd
Merge pull request #27089 from tchaikov/wip-cmake-with-ninja
cmake: do not assume ${CMAKE_GENERATOR} == make

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-03-21 22:05:54 +08:00
Casey Bodley
9663480f3b
Merge pull request #27100 from ddiss/trivial_rgw_auth_keystone_gcc_warning
[trivial] rgw: fix minor compiler warning in keystone auth

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-03-21 10:05:18 -04:00
Kefu Chai
613a4670af
Merge pull request #27094 from tchaikov/wip-cmake-cmake-ubsan
cmake: workaround of false alarm from ubsan

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-03-21 22:03:14 +08:00
Kefu Chai
01cd5fb72c
Merge pull request #27088 from tchaikov/wip-update-seastar
cmake,crimson: pick up latest seastar

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-03-21 21:59:28 +08:00
Kefu Chai
4bf14a13f7
Merge pull request #26731 from wjwithagen/wjw-fix-cmake-os-release
build: FreeBSD does not have /etc/os-release

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-03-21 21:53:23 +08:00
Kefu Chai
bb67400d15
Merge pull request #26607 from tchaikov/wip-cython-language_level
pybind: set language_level for cythonize explicitly

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-03-21 21:51:14 +08:00
David Disseldorp
d807d1916f rgw: fix minor compiler warning in keystone auth
Signed-off-by: David Disseldorp <ddiss@suse.de>
2019-03-21 14:10:15 +01:00
Kefu Chai
5eb349f4ae
Merge pull request #27093 from tchaikov/wip-crimson-test-alien-echo
test/crimson: update to accomodate Dispatcher changes

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-03-21 21:00:10 +08:00
Kefu Chai
ea4f15f92e crimson/osd: more verbose logging
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-21 20:46:22 +08:00
Kefu Chai
2625c2cb8d crimson/{mon,osd}: don't log ms_dispatch messages
msgr already logs them

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-21 20:44:26 +08:00
Kefu Chai
5f196a2a10 crimson/net: log tx/rx messages
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-21 20:44:26 +08:00
Sage Weil
eb5e39ea08 Merge PR #27092 into master
* refs/pull/27092/head:
	mailmap: sort entries
	mailmap: sort organizationmap
	mailmap: updates for nautilus
	doc: mailmap updates for mimic
	mailmap fixes for 12.2.0

Reviewed-by: Sage Weil <sage@redhat.com>
2019-03-21 07:22:06 -05:00
Sebastian Wagner
cee38745ea
Merge pull request #26404 from sebastian-philipp/orchestrator-error-handling
mgr/orchestrator: Add error handling to interface

Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2019-03-21 12:30:13 +01:00
Kefu Chai
77553040fc cmake: workaround of false alarm from ubsan
to workaround a GCC bug, see
https://gcc.gnu.org/bugzilla/show_bug.cgi?id=88684

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-21 18:57:27 +08:00
Kefu Chai
f0eb1a9f27 test/crimson: update to accomodate Dispatcher changes
Dispatcher::ms_get_authorizer() was changed in f22d433a, so update the
test accordingly

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-21 18:54:11 +08:00
Abhishek Lekshmanan
38f07b3522 mailmap: sort entries
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-03-21 10:46:10 +01:00
Abhishek Lekshmanan
bd643d5156 mailmap: sort organizationmap
since this will make it easier for editing entries in the future

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-03-21 10:43:21 +01:00
Abhishek Lekshmanan
bd806d310b mailmap: updates for nautilus
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-03-21 10:32:53 +01:00
Kefu Chai
80edd351bf cmake: disable -Werror when building seastar
when building seastar with a recent fmt, fmt complains:

src/fmt/include/fmt/time.h:13:2: error: #warning fmt/time.h is
deprecated, use fmt/chrono.h instead [-Werror=cpp]
 #warning fmt/time.h is deprecated, use fmt/chrono.h instead
  ^~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-21 17:04:38 +08:00
Kefu Chai
43d8d1962a seastar: pickup the latest seastar
for couple improvements

* dbf7b6b0: add fast path for small writes
* 2f357317: IPv6 support

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-21 17:04:38 +08:00
Kefu Chai
d1200b9b61 cmake: link against libfmt
Seastar::seastar does pull in libfmt library as a PUBLIC linkage. but we
should not depend on this. if we use fmt directly, we should link against it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-21 17:04:38 +08:00
Kefu Chai
0c60abf5ba crimson: include headers if necessary
we should not rely on seastar or other headers to do this. if we use
fmt or std functions, we should include corresponding header(s).

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-21 17:03:13 +08:00
Kefu Chai
a0c6fb9d40 cmake: do not assume ${CMAKE_GENERATOR} == make
* modules/BuildDPDK.cmake: always use "make"
* modules/BuildSPDK.cmake: always use "make"
  DPDK only support "make". if user wants to use other generator than
  "make", we will fail to build DPDK support. so we should always use
  "make" here. and before using "make", we need to detect it.
* cmake/modules/BuildRocksDB.cmake: use cmake for build
* src/compressor/zstd/CMakeLists.txt: use cmake for build
  just use whatever generator use specifies, and use ${CMAKE_COMMAND}
  for building the specified target, no need to repeat
  ${CMAKE_GENERATOR} for building the target.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-21 15:45:07 +08:00
Kefu Chai
ebb7f32482 cmake: build fmt submodule if libfmt is not found
the recent seastar dropped fmt submodule, so we need to build from our
own fmt submodule.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-21 15:11:33 +08:00
Kefu Chai
98fecbdeaf fmt: add fmt submodule back
seastar does not bring fmt as a submodule, so let's ready it by
ourselves.

This reverts commit 53a38bf57e.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-03-21 15:11:33 +08:00
Sage Weil
cc9a9142fd msg: remove XioMessenger
There is a lot of good stuff going on here, but nobody is investing in xio
and it is not expected to be the path forward for RDMA.  If that ever
changes, we can resurrect the code.  Until then, let's clean up the tree
and reduce friction for changes going forward.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-03-21 00:57:33 -05:00
Jianpeng Ma
4f527853a4 msg: remove unused header file in Messenger.h
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-03-21 12:38:54 +08:00
Neha Ojha
1432f5544f qa/objectstore: test with reduced value of osd_memory_target
This addresses Part 1 of https://tracker.ceph.com/issues/38635.

Fixes: https://tracker.ceph.com/issues/38635
Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-03-20 21:37:06 -07:00
Jianpeng Ma
eb38f964b8 msg/async: remove unused parameter in func _filter_addrs.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-03-21 10:02:54 +08:00
Jianpeng Ma
8131218860 msg/async V2: firstly check messenger->auth_client then print debug message.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-03-21 10:02:54 +08:00
Jianpeng Ma
697aafa2aa msg/async/ProtocolV2: remove unused parameter
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-03-21 10:02:54 +08:00
Jianpeng Ma
9192c71e4a msg/async: remove usless code.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-03-21 10:02:54 +08:00
Jianpeng Ma
2f3f8f1f42 msg/async: reduce one condition check.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-03-21 10:02:54 +08:00
Jianpeng Ma
cb54be4b8b msg/async: only call OID_EVENT when WTIH_EVENTRACE define.
Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-03-21 10:02:53 +08:00
Yuri Weinstein
33d929373e
Merge pull request #27057 from yuriw/wip-yuriw-crontab
qa/tests: reduced frequency for luminous and mimic runs...
2019-03-20 16:36:54 -07:00
Yuri Weinstein
afb47c6264 qa/tests: reduced frequency for luminous and mimic runs
added all suites for nauitlus

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2019-03-20 13:26:58 -07:00
Mykola Golub
21d6c03509 librbd: simple scheduler plugin for object dispatcher layer
Fixes: https://tracker.ceph.com/issues/37849
Signed-off-by: Mykola Golub <mgolub@suse.com>
2019-03-20 20:22:12 +00:00
Igor Fedotov
1337443e37 os/bluestore: unconditionally cap chunks returned by allocator to 2^31
Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-03-20 21:10:04 +03:00
Yuri Weinstein
5ebc2b756a
Merge pull request #26786 from aclamk/fix-rocksdb-compaction-ranges
common/kv/rocksdb: Fixed async compations.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-03-20 09:30:38 -07:00
Nathan Cutler
b0700f2b3f
Merge pull request #27046 from smithfarm/wip-38812
rpm: refrain from building ceph-resource-agents on SLE

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Tim Serong <tserong@suse.com>
2019-03-20 17:12:58 +01:00
Marius Schiffer
2065d470e6 mgr/balancer: Python 3 compatibility fix
Fixes: http://tracker.ceph.com/issues/38831
Signed-off-by: Marius Schiffer <marius@mschiffer.de>
2019-03-20 16:05:49 +01:00
Casey Bodley
507e97ae3c
Merge pull request #27054 from cbodley/wip-37770
doc/rgw: update civetweb rgw_frontends config example

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-03-20 10:07:31 -04:00
Casey Bodley
e0c07a74dd
Merge pull request #27035 from cbodley/wip-test-rgw-reshard-wait-clock
test/rgw: test_rgw_reshard_wait uses same clock for timing

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-03-20 09:57:01 -04:00
Lenz Grimmer
fe39cc4751
Merge pull request #26853 from nathan-weinberg/more-cluster-tests
mgr/dashboard: Added breadcrumb tests to Manager modules and Alerts menu

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-03-20 14:56:43 +01:00
Casey Bodley
9410736823
Merge pull request #27052 from rzarzynski/wip-rgw-drop_rgw_decode_pki_token
rgw: drop unused rgw_decode_pki_token().

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-03-20 09:55:55 -04:00