RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-01-21 02:31:19 +00:00
Code Issues Packages Projects Releases Wiki Activity
96,648 Commits 216 Branches 394 Tags 1.9 GiB
0e63fed768
Commit Graph

96648 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Yuan Zhou
275d828adc tools: format code and clean up 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:29 +08:00
Yuan Zhou
97991f6fc4 tools: adding signal handling for immutable obj cache daemon 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:29 +08:00
Yuan Zhou
cd836e90dc tests: reduce testing resources occupied for immutable obj cache 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:29 +08:00
shangdehao1
ceaefea63e tools: follow current codes to modify UT 
Signed-off-by: Dehao Shang <dehao.shang@intel.com>
 2019-03-22 00:16:29 +08:00
shangdehao1
b1105c437c tools: release dedicated thread resource 
Addtional, enable all UT

Signed-off-by: Dehao Shang <dehao.shang@intel.com>
 2019-03-22 00:16:29 +08:00
shangdehao1
a42ce41fd2 tools: add connect fails to fault 
Signed-off-by: Dehao Shang <dehao.shang@intel.com>
 2019-03-22 00:16:28 +08:00
Yuan Zhou
6b315dc441 tools: clean up object cache request struture 
adding version and compat_version info for serailization

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:28 +08:00
Yuan Zhou
5b6651afac common/buffer: assign error message to caller on short read in pread_file 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:28 +08:00
shangdehao1
71dba8bfd4 tools: add m_cache_path 
1) : enable ObjectCacheRequest.m_data.m_cache_path
2) : add generate_cache_file_path to create cache_path
    , which will be used by CacheClient.

Signed-off-by: Dehao Shang <dehao.shang@intel.com>
 2019-03-22 00:16:28 +08:00
Yuan Zhou
4edfcf7c6b tools: clean up dead code in immutable obj cache 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:28 +08:00
Yuan Zhou
7aaa3b6e47 tools: kill ObjectCacheFile in immutable obj cache 
instead we could use bufferlist::write_file/pread_file to write/read on cache

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:28 +08:00
Yuan Zhou
21bcc7598a tools: clean up immutable obj cache 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:28 +08:00
Yuan Zhou
a026bada86 common/options: move immutable obj cache options out of rbd section 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:28 +08:00
Yuan Zhou
e4214eea2c common/buffer: return 0 on short read in pread_file 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:28 +08:00
shangdehao1
7054d68990 tools: some modification at RO 
1) : add new data member to ObjectCacheRequest,
     including m_pool_namepace, m_pool_id, m_snap_id,
     m_cache_path
2) : add some log at CacheSession
3) : change pool name to pool_nspace + poo_id + snap_id
4) : change cache file name
5) : add generate_cache_file_name method
6) : modify UT interface

Signed-off-by: Dehao Shang <dehao.shang@intel.com>
 2019-03-22 00:16:27 +08:00
shangdehao1
59022ad43e tool: break down receive_message implements 
Also, enable fault at CacheClient side.

Signed-off-by: Dehao Shang <dehao.shang@intel.com>
 2019-03-22 00:16:27 +08:00
Yuan Zhou
b9b2813f31 common/buffer: fix pread_file to generate local bufferlist 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:27 +08:00
Yuan Zhou
262897b9f6 tools: clean up types for immutable obj cache daemon 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:27 +08:00
Yuan Zhou
2bab2dcac1 tools: refuse to start if obj cache daemon fail to initialize cache dir 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:27 +08:00
Yuan Zhou
50df1e1443 test: enable asio tests for immutable obj cache controller 
cleanups for immutable obj cache controller

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:27 +08:00
Yuan Zhou
db2f08db36 tools: immutable_object_cache code format cleanup 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:27 +08:00
Yuan Zhou
952116012f common/buffer: adding pread_file method 
pread_file allows to read length of contents at a given offset

using pread_file instead of read_file to reduce extra reads in ObjectCacheFile

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:27 +08:00
shangdehao1
342a678f36 tools: refactor asio domain socket of RO 
Signed-off-by: Dehao Shang <dehao.shang@intel.com>
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:27 +08:00
Yuan Zhou
32e3af9ce7 tools: fix redudent updates on cache metdata 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:26 +08:00
Yuan Zhou
9466d70985 build/ops: adding build spec for immutable object cache daemon 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:26 +08:00
shangdehao1
3b474707d2 test: add object cache message unite test 
Signed-off-by: Dehao Shang <dehao.shang@intel.com>
 2019-03-22 00:16:26 +08:00
shangdehao1
561780487b tools: add new object cache message 
Signed-off-by: Dehao Shang <dehao.shang@intel.com>
 2019-03-22 00:16:26 +08:00
shangdehao1
47c895c53f tools: use bufferlist to implement ObjectCacheFile 
1) : modify unite testing of object cache file
2) : remove open and create internface
3) : use bufferlist interface to read/write file

Signed-off-by: Dehao Shang <dehao.shang@intel.com>
 2019-03-22 00:16:26 +08:00
shangdehao1
53b00ac182 test: add ObjectCacheStore unit test 
Signed-off-by: Dehao Shang <dehao.shang@intel.com>
 2019-03-22 00:16:26 +08:00
shangdehao1
72a6fe86d7 test: add multi-session unit testing 
Signed-off-by: Dehao Shang <dehao.shang@intel.com>
 2019-03-22 00:16:26 +08:00
shangdehao1
62d3866e73 test: move WaitEvent class to test_common.h file 
Signed-off-by: Dehao Shang <dehao.shang@intel.com>
 2019-03-22 00:16:26 +08:00
Yuan Zhou
c4a3a3dba4 tools: fix immutable obj cache max size 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:26 +08:00
Yuan Zhou
c82f469824 tools: remove RBD specific logic in immutable obj cache 
Make the daemon more generic(pool name + object id) so it
can service both RBD and RGW.
Also supports caching partial object(even empty), the caller
needs to append_zero to read buffer if read on those objects.

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:26 +08:00
Yuan Zhou
b3b915737c tools: remove background eviction 
do eviction check in promotion callback simply

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:25 +08:00
Yuan Zhou
5b974e7c92 tools: format headers for object cache daemon 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:25 +08:00
Yuan Zhou
736b758b13 tools: create local utils for object cache daemon 
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:25 +08:00
Yuan Zhou
1cf4ff41c6 tools: clean up immutable object cache 
- drop "ceph_" prefix
- prefix all options with immutable_object_cache_
- adding configurable immutable_object_cache_max_inflight_ops

Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:25 +08:00
Yuan Zhou
9a7e5e0866 tools: adding ceph level immutable obj cache daemon 
The daemon is built for future integration with both RBD and RGW cache.
The key components are:
- domain socket based simple IPC
- simple LRU policy based promotion/demotion for the cache
- simple file based caching store for RADOS objs with sync IO interface
- systemd service/target files for the daemon

Signed-off-by: Dehao Shang <dehao.shang@intel.com>
Signed-off-by: Yuan Zhou <yuan.zhou@intel.com>
 2019-03-22 00:16:25 +08:00
Kefu Chai
a13a5452ff
Merge pull request #27099 from tchaikov/wip-crimson-misc-logging 
crimson/{net,mon,osd}: misc logging changes

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
 2019-03-22 00:14:01 +08:00
Volker Theile
c29e587007 mgr/dashboard/qa: Improve tasks.mgr.test_dashboard.TestDashboard.test_standby 
The changes of this PR were done while trying to fix the failing test. The problem has been solved by another PR, but the changes are worth to be integrated because they help debugging and an additional test has been added (check if previously active manager is listed as standby).

Signed-off-by: Volker Theile <vtheile@suse.com>
 2019-03-21 15:26:52 +01:00
Kefu Chai
085fdf57fd
Merge pull request #27089 from tchaikov/wip-cmake-with-ninja 
cmake: do not assume ${CMAKE_GENERATOR} == make

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2019-03-21 22:05:54 +08:00
Casey Bodley
9663480f3b
Merge pull request #27100 from ddiss/trivial_rgw_auth_keystone_gcc_warning 
[trivial] rgw: fix minor compiler warning in keystone auth

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2019-03-21 10:05:18 -04:00
Kefu Chai
613a4670af
Merge pull request #27094 from tchaikov/wip-cmake-cmake-ubsan 
cmake: workaround of false alarm from ubsan

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2019-03-21 22:03:14 +08:00
Kefu Chai
01cd5fb72c
Merge pull request #27088 from tchaikov/wip-update-seastar 
cmake,crimson: pick up latest seastar

Reviewed-by: Casey Bodley <cbodley@redhat.com>
 2019-03-21 21:59:28 +08:00
Kefu Chai
4bf14a13f7
Merge pull request #26731 from wjwithagen/wjw-fix-cmake-os-release 
build: FreeBSD does not have /etc/os-release

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-03-21 21:53:23 +08:00
Kefu Chai
bb67400d15
Merge pull request #26607 from tchaikov/wip-cython-language_level 
pybind: set language_level for cythonize explicitly

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-03-21 21:51:14 +08:00
David Disseldorp
d807d1916f rgw: fix minor compiler warning in keystone auth 
Signed-off-by: David Disseldorp <ddiss@suse.de>
 2019-03-21 14:10:15 +01:00
Kefu Chai
5eb349f4ae
Merge pull request #27093 from tchaikov/wip-crimson-test-alien-echo 
test/crimson: update to accomodate Dispatcher changes

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
 2019-03-21 21:00:10 +08:00
Kefu Chai
ea4f15f92e crimson/osd: more verbose logging 
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-03-21 20:46:22 +08:00
Kefu Chai
2625c2cb8d crimson/{mon,osd}: don't log ms_dispatch messages 
msgr already logs them

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-03-21 20:44:26 +08:00