Commit Graph

91731 Commits

Author SHA1 Message Date
Kefu Chai
a7bb772e11
Merge pull request #24616 from tchaikov/wip-wip-librados-3
librados: split C++ and C APIs into different source files

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
2018-11-02 10:44:04 +08:00
Patrick Donnelly
f981e10c5f
Merge PR #24555 into master
* refs/pull/24555/head:
	doc: document optional timeout argument for `cache drop`
	mds: make timeout parameter optional for "cache drop"

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-11-01 14:58:23 -07:00
Patrick Donnelly
e9fbb47150
Merge PR #24747 into master
* refs/pull/24747/head:
	client: add new routine to get fscid from a ceph_mount

Reviewed-by: John Spray <john.spray@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2018-11-01 14:53:25 -07:00
Josh Durgin
1d832401f4
Merge pull request #24868 from liewegas/wip-doc-fix
doc/rados/operations/crush-map-edits: fix 'take' syntax

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-11-01 14:52:24 -07:00
Kefu Chai
38db3ee6c5 rpm,deb: package libceph-common.so.* not libceph-common.so*
be more explicit on what we are packaging. because only
libceph-common.so.${soversion} will be packaged, since libceph-common.so
won't be installed by cmake anymore.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Kefu Chai
701136b1e2 cmake: do not create symlink for libceph-common.so.*
and bump up its soversion, so it won't conflict with libceph-common.so.0
offered by librados2.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Kefu Chai
b4a5f76243 qa: add librados3 to exclude list of pre-nautilus install tasks
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Kefu Chai
083b846198 qa: s/librados2/librados3/
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Kefu Chai
8c6ec85f43 doc: s/librados2/librados3/
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Kefu Chai
286ef1fe35 debian: s/librados2/librados3/
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Kefu Chai
842a57eb16 rpm: s/librados2/librados3/
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Kefu Chai
c680fb10f5 cmake: bump librados so version
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Kefu Chai
a0813bccc9 librados: bump version number
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Kefu Chai
0475dfdea3 qa: update test_envlibrados_for_rocksdb.sh for libradospp split
include a patch so rocksdb can use libradospp instead of librados. will
upstream the patch and make it work for both pre-nautilus librados and
nautilus libradospp

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Kefu Chai
dd0f43db7c rpm: add libradospp* packages
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Kefu Chai
d4857fef24 debian: add libradospp* packages
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:31 +08:00
Kefu Chai
3730d10623 librados: move C++ APIs into libradospp
the goal is to decouple C++ API from C API, and to version them
differently, as they are targeting different consumers.

this allows us to change the C++ API and bumping up its soversion
without requiring consumer to recompile the librados client for
using the new librados. in this way, C++ API can move faster than
C API. for example, if bufferlist interface is changed for better
performance, and this breaks existing API/ABI, we can bump up
the C++ library's soversion, and and the C library's version unchanged
but ship the new librados's C binding. so the librados client linked
against librados's C library will be able to take advantage of
the improvement in C++ library. while the librados client
linked against C++ library won't break at runtime due to unresolved
symbol or changed structure layout.

this is massive change, the genereal idea is to

* split librados.cc into two source files: librados_c.cc and
  librados_cxx.cc, the former for implementing C APIs, the later
  for C++ APIs.
* extract the C++ API in librados into librados-cxx, the library
  name will be libradospp. but we can change it before nautilus
  is released.
* link these librados libraries with static libraries which it
  depends on, so "-Wl,--exclude-libs,ALL" link flags can help
  hide the non-public symbols.
* extract the tests exercising librados' C++ API into a different
  source file named *_cxx.cc. for instance, to move the C++ tests
  in aio.cc into aio_cxx.cc
* extract the shared helper functions which do not use any librados
  or librados-cxx APIs into test_shared{.cc,h}. the "shared" here
  means, *shared* by C++ and C tests.
* extract the test fixtures, i.e., the subclasses of testing::Test,
  for testing C++ APIs into testcase_cxx.cc.
* update qa/workunits/rados/test.sh accordingly to add the splitted
  tests
* update the consumers of librados to link against librados-cxx
  instead, if they are using the C++ API.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:15:30 +08:00
Kefu Chai
9167c8381f librados: move get_inconsistent_pgs() into RadosClient
so we don't need parse the pg string and render it again for librados C
API.

the downside of this change is that, get_inconsistent_pgs() could be
implemented using RadosClient, instead be *in* it. but before we have
a place for the helper functions for these higher-level functions,
RadosClient is a good place for hosting them.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-11-02 00:09:17 +08:00
Casey Bodley
c0fd904b99
Merge pull request #24406 from ivancich/wip-rgw-renew-reshard-lock
rgw: renew resharding locks to prevent expiration

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-11-01 12:06:11 -04:00
Jason Dillaman
3f8ad2e3a7
Merge pull request #20598 from rishabh-d-dave/fix-rbdfuse-look-for-ceph-conf
rbd-fuse: look for ceph.conf in standard locations

Reviewed-by: Rishabh Dave <ridave@redhat.com>
Reviewed-by: Mykola Golub <mgolub@suse.com>
2018-11-01 09:55:58 -04:00
Lenz Grimmer
de72ece6cb
Merge pull request #24829 from p-na/pna-fix-docstring
mgr/dashboard: Fix links to external documentation

Reviewed-by: Laura Paduano <lpaduano@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2018-11-01 14:04:39 +01:00
Remy Zandwijk
ce8f531789 doc/rados/operations/crush-map-edits: fix 'take' syntax
Fixes: https://tracker.ceph.com/issues/21496
Signed-off-by: Remy Zandwijk <remy@luckyhands.nl>
Signed-off-by: Sage Weil <sage@redhat.com>
2018-10-31 15:42:27 -05:00
Matt Benjamin
1b57df1d51
Merge pull request #21767 from cfanz/wip-fix-rgw-race-condition
rgw: avoid race condition in RGWHTTPClient::wait()
2018-10-31 14:56:29 -04:00
Ricardo Marques
223a24eeae
Merge pull request #24810 from rhcs-dashboard/35691-landing-page-chart-improvements
mgr/dashboard: Landing Page: chart improvements

Reviewed-by: Lenz Grimmer <lgrimmer@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-10-31 18:36:36 +00:00
Matt Benjamin
1a9f304d2b
Merge pull request #20794 from ghost/wip-nfs-doc-err
doc: replace rgw_namespace_expire_secs with rgw_nfs_namespace_expire_secs
2018-10-31 14:30:02 -04:00
Matt Benjamin
fe43ba1558
Merge pull request #21599 from cfanz/wip-fix-rgw-build-error
rgw: fix radosgw-admin build error
2018-10-31 14:26:02 -04:00
Joao Eduardo Luis
d2fc458185
Merge pull request #19983 from gohighsec/validate_hitset
mon:validate hit_set values before set
2018-10-31 14:39:06 +00:00
Casey Bodley
5cbca655e9
Merge pull request #24848 from joke-lee/wip-doc-radosgw-admin
rgw: add --op-mask in radosgw-admin help info

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-10-31 08:04:23 -04:00
Alfredo Deza
7aaf02bbb9
Merge pull request #24840 from ceph/wip-rm36648
ceph-volume systemd import main so console_scripts work for executable

Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2018-10-31 07:06:02 -04:00
yuliyang
ec5489b591 rgw: add --op-mask in radosgw-admin help info
Signed-off-by: yuliyang <yuliyang@cmss.chinamobile.com>
2018-10-31 17:19:21 +08:00
Sage Weil
bf49b87ff9 Merge PR #19411 into master
* refs/pull/19411/head:
	osd: Step down RecoveryCtx from class to struct

Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-30 17:36:55 -05:00
Sage Weil
6ed0d5a2b7 Merge PR #19288 into master
* refs/pull/19288/head:
	bluestore/BlueRocksEnv: Object initialization after deletion

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
2018-10-30 17:32:25 -05:00
Sage Weil
860ad1f61c Merge PR #19142 into master
* refs/pull/19142/head:
	doc/dev/kernel-client-troubleshooting: Add kernel dynamic debuggin

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Amit Kumar <amitkuma@redhat.com>
2018-10-30 17:18:06 -05:00
Sage Weil
c71e993343 Merge PR #19146 into master
* refs/pull/19146/head:
	doc/dev/logs: Removes non-existence file path

Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-30 17:17:36 -05:00
Sage Weil
699198067a Merge PR #19726 into master
* refs/pull/19726/head:
	osd: Sanity check, if too full or not

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-10-30 16:09:06 -05:00
Sage Weil
9ab9dcfc0d Merge PR #24809 into master
* refs/pull/24809/head:
	os/bluestore: omit redundant '/' in OSD path for ceph-bluestore-tool if
	os/bluestore: improve error handling for migrate ops in
	qa/standtalone/osd-bluefs-volume-ops: remove redundant code.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-30 15:09:45 -05:00
Sage Weil
042e48f96d Merge PR #21009 into master
* refs/pull/21009/head:
	rados: fix error message for cache(-try)-flush-evict-all commands

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-10-30 15:08:00 -05:00
Sage Weil
b709b82897 Merge PR #24534 into master
* refs/pull/24534/head:
	librados: Copy buffer on AIO read

Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-10-30 15:07:44 -05:00
Sage Weil
964ee003df Merge PR #24545 into master
* refs/pull/24545/head:
	os/bluestore: debug_omit_block_device_write isn't always respected.

Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-30 15:06:45 -05:00
Sage Weil
68c9250e83 Merge PR #24548 into master
* refs/pull/24548/head:
	Objecter: add ignore cache flag if got redirect reply

Reviewed-by: Gregory Farnum <gfarnum@redhat.com>
2018-10-30 15:06:25 -05:00
Sage Weil
166c34a265 Merge PR #24599 into master
* refs/pull/24599/head:
	os/bluestore/KernelDevice: Honor discard_granularity

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-30 15:06:10 -05:00
Sage Weil
00a13c2d77 Merge PR #24742 into master
* refs/pull/24742/head:
	osd: slightly refactor PrimaryLogPG::do_op.
	osd: avoid unnecessary map lookups in PrimaryLogPG::do_op.

Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
2018-10-30 15:05:51 -05:00
Alfredo Deza
0bcda52566 ceph-volume systemd import main so console_scripts work for executable
Signed-off-by: Alfredo Deza <adeza@redhat.com>
2018-10-30 15:50:28 -04:00
Yehuda Sadeh
b5c14e512e
Merge pull request #22132 from yehudasa/wip-menv
ceph-menv: mrun shell environment

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2018-10-30 09:00:19 -07:00
Sage Weil
96dd773d13 Merge PR #24755 into master
* refs/pull/24755/head:
	mgr/diskprediction: use global device_failure_prediction_mode setting

Reviewed-by: John Spray <john.spray@redhat.com>
2018-10-30 10:20:02 -05:00
Lenz Grimmer
fbb9bfd71d
Merge pull request #24764 from tspmelo/wip-jest-ci
mgr/dashboard: Reduce Jest logs in CI

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2018-10-30 15:58:01 +01:00
Lenz Grimmer
105151089b
Merge pull request #24633 from Devp00l/wip-issue-36467
mgr/dashboard: Add a unit test form helper class

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2018-10-30 15:50:31 +01:00
Patrick Nawracay
823ffc30a6 mgr/dashboard: Cleanup imports
Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-10-30 14:58:37 +01:00
Patrick Nawracay
4c8c55ff67 mgr/dashboard: Fix links to documentations
- Added anchor to Grafana in URL of OSD, Overall Performance
- Fixed URL in Object Gateway, Buckets

Signed-off-by: Patrick Nawracay <pnawracay@suse.com>
2018-10-30 14:58:37 +01:00
Sage Weil
22d78ad402 Merge PR #24668 into master
* refs/pull/24668/head:
	mgr/DaemonState: fix get_config_defaults locking
	mgr: adjust DaemonState device index when daemon metadata is updated
	mgr/DaemonState: clear devices in set_metadata

Reviewed-by: Tim Serong <tserong@suse.com>
2018-10-30 08:47:54 -05:00