RepoMirrors/ceph
1
0
Fork 0
mirror of https://github.com/ceph/ceph synced 2025-01-18 09:02:08 +00:00
Code Issues Packages Projects Releases Wiki Activity
99,124 Commits 216 Branches 0 Tags 1.8 GiB
69055a85da
Commit Graph

99124 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Kefu Chai
b3cac157f5 cmake: silence GCC-9 warnings from rocksdb 
GCC-9 complains:

rocksdb/db/version_edit.h:86:8: warning: implicitly-declared ‘constexpr
rocksdb::FileDescriptor::FileDescriptor(const rocksdb::FileDescriptor&)’
is deprecated [-Wdeprecated-copy]
   86 | struct FileMetaData {
      |        ^~~~~~~~~~~~
/var/ssd/ceph/src/rocksdb/db/version_edit.h:55:19: note: because
‘rocksdb::FileDescriptor’ has user-provided ‘rocksdb::FileDescriptor&
rocksdb::FileDescriptor::operator=(const rocksdb::FileDescriptor&)’
   55 |   FileDescriptor& operator=(const FileDescriptor& fd) {
      |                   ^~~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-13 19:35:26 +08:00
Kefu Chai
485017a3ef cmake: set ccache for rocksdb 
should use launcher to set ccache

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-13 19:35:26 +08:00
Kefu Chai
423c28fb8d cmake: update built libs of SPDK and DPDK 
we need to link against these new libs for fulfilling the dependencies
required by new SPDK.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-13 19:35:26 +08:00
Kefu Chai
b2bdd3f9ee cmake: disable isal and vhost support of SPDK 
* isal needs nasm, which is a new dependency. so let's disable it
  at this moment.
* vhost requires DPDK compiled with vhost enabled. but it's disabled
  when we compile DPDK.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-13 19:35:23 +08:00
Kefu Chai
bc999e5f36 spdk: pick up latest spdk 
to silence the warnings reported by GCC-9

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-13 19:34:44 +08:00
Mykola Golub
340726ec89 journal: wait for in flight advance sets on stopping recorder 
Before object overflow detection optimization (83461c42b) the
overflow was detected when trying to send data, so when an object
set was advanced we always had some data and flush always
completed later. But now we detect overflow on client side, it
may happen when buffer is empty and flush may complete
when "advance object set" is still in flight.

Signed-off-by: Mykola Golub <mgolub@suse.com>
 2019-06-13 12:05:17 +01:00
Mark Kogan
ba4167c2f3 rgw: provide admin friendly reshard status output 
Signed-off-by: Mark Kogan <mkogan@redhat.com>
 2019-06-13 06:38:57 -04:00
Nathan Cutler
12ab3fcc6f
Merge pull request #28446 from tspmelo/wip-prepare-backport 
script/ceph-backport.sh: Add prepare function

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Nathan Cutler <ncutler@suse.com>
 2019-06-13 11:01:30 +02:00
Mykola Golub
92ee1c7b8b qa/workunits/rbd: fix compare_images and compare_image_snapshots 
Due to pipe, sdiff return code was ignored. Also the compare functions
spent most of time in xxd, which was normally unnecessary.

Signed-off-by: Mykola Golub <mgolub@suse.com>
 2019-06-13 08:26:29 +01:00
Kefu Chai
a28de7a157 common/options: make mon_clean_pg_upmaps_per_chunk unsigned 
we don't use a negative number for some different purpose, for instance,
for disabling this option. and this helps to silence following warning:

/home/jenkins-build/build/workspace/ceph-pull-requests/src/mon/OSDMonitor.cc:
In member function 'virtual void
OSDMonitor::encode_pending(MonitorDBStore::TransactionRef)':
/home/jenkins-build/build/workspace/ceph-pull-requests/src/mon/OSDMonitor.cc:1195:31:
warning: comparison of integer expressions of different signedness:
'std::vector<pg_t>::size_type' {aka 'long unsigned int'} and 'int64_t'
{aka 'long int'} [-Wsign-compare]
       if (pgs_to_check.size() < g_conf()->mon_clean_pg_upmaps_per_chunk
* 2) {
           ~~~~~~~~~~~~~~~~~~~~^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-13 13:40:49 +08:00
Kefu Chai
494d624997
Merge pull request #28515 from hvhaugwitz/mondb-recovery-script 
doc: update mondb recovery script

Reviewed-by: Kefu Chai <kchai@redhat.com>
 2019-06-13 08:36:16 +08:00
Neha Ojha
143c1da2d2 qa/tasks/cbt.py: add support for client_endpoints 
Note that this will only work for librbdfio for now.

Signed-off-by: Neha Ojha <nojha@redhat.com>
 2019-06-12 22:36:12 +00:00
Patrick Donnelly
2be64ebdee
Merge PR #28473 into master 
* refs/pull/28473/head:
	cephfs-shell: Catch OSError exceptions in lcd

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-12 14:30:45 -07:00
Patrick Donnelly
62ba1c01bf
Merge PR #28475 into master 
* refs/pull/28475/head:
	cephfs-shell: Fix 'lls' command errors

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-12 14:29:46 -07:00
Patrick Donnelly
4627f6edbc
Merge PR #28407 into master 
* refs/pull/28407/head:
	mgr/volumes: fix error message

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-12 14:27:53 -07:00
Patrick Donnelly
c28ae6970f
Merge PR #27856 into master 
* refs/pull/27856/head:
	test: remove fs/test-volume.sh workunit
	test: port fs/volume related tests to python

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-12 14:27:07 -07:00
Patrick Donnelly
2c8b4eaaa7
Merge PR #28196 into master 
* refs/pull/28196/head:
	ceph_volume_client: decode d_name before using it

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Ramana Raja <rraja@redhat.com>
 2019-06-12 14:16:31 -07:00
Patrick Donnelly
9e1771472b
Merge PR #28221 into master 
* refs/pull/28221/head:
	qa/tasks/cephfs/test_volume_client: print py2 or py3 which the test case runs

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Rishabh Dave <ridave@redhat.com>
 2019-06-12 14:15:30 -07:00
Patrick Donnelly
97e71e64df
Merge PR #26737 into master 
* refs/pull/26737/head:
	qa/cephfs: update tests for stale session handling
	mds: change how mds revoke stale caps
	mds: don't mark unresponsive sessions holding no caps stale

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
 2019-06-12 14:07:22 -07:00
Yuri Weinstein
0ff309adae
Merge pull request #28518 from yuriw/wip-yuriw-crontab-master 
qa/tests: removed upgrade/client-upgrade-hammer becasue ubuntu 14.04 …
 2019-06-12 13:49:41 -07:00
Neha Ojha
159ad969ce
Merge pull request #28466 from hoerup/update-releases 
Doc: update release schedule

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Noah Watkins <nwatkins@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
 2019-06-12 12:45:33 -07:00
Torben Hørup
42a04ff114 Doc: update release schedule 
Added nautilus + the latest releases from mimic and luminous
in order to keep dumpling column, ceph_releases is modified to allow 13 columns

Signed-off-by: Torben Hørup <th@synack.fo>
 2019-06-13 01:12:42 +08:00
Yuval Lifshitz
6c0ab56a51
Merge pull request #28470 from yuvalif/wip-yuval-sync-type-pubsub 
rgw/pubsub: use incremental sync for pubsub module by default
 2019-06-12 20:01:31 +03:00
Venky Shankar
0d044a97e9 test: remove fs/test-volume.sh workunit 
.. since its ported to python now.

Fixes: http://tracker.ceph.com/issues/39949
Signed-off-by: Venky Shankar <vshankar@redhat.com>
 2019-06-12 12:43:17 -04:00
Venky Shankar
d92840b59e test: port fs/volume related tests to python 
... and add subvolume related tests.

Signed-off-by: Venky Shankar <vshankar@redhat.com>
 2019-06-12 12:43:17 -04:00
Yuri Weinstein
524e339a9d qa/tests: removed upgrade/client-upgrade-hammer becasue ubuntu 14.04 is not supported 
Also removed ubuntu 14.04 filters

Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
 2019-06-12 09:13:15 -07:00
Sage Weil
f019fc094e qa/valgrind.supp: be slightly less specific on suppression 
I am seeing this trace, which matches except for the
'fun:_ZN15AsyncConnection7processEv' frame.

<error>
  <unique>0x2399</unique>
  <tid>11</tid>
  <threadname>msgr-worker-1</threadname>
  <kind>UninitCondition</kind>
  <what>Conditional jump or move depends on uninitialised value(s)</what>
  <stack>
    <frame>
      <ip>0x5366B18</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>ceph::crypto::onwire::AES128GCM_OnWireRxHandler::authenticated_decrypt_update_final(ceph::buffer::v14_2_0::list&amp;&amp;, unsigned int)</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>crypto_onwire.cc</file>
      <line>274</line>
    </frame>
    <frame>
      <ip>0x5355E60</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&lt;ceph::buffer::v14_2_0::ptr_node, ceph::buffer::v14_2_0::ptr_node::disposer&gt;&amp;&amp;, int)</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>ProtocolV2.cc</file>
      <line>1311</line>
    </frame>
    <frame>
      <ip>0x533E2A3</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>ProtocolV2::run_continuation(Ct&lt;ProtocolV2&gt;&amp;)</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>ProtocolV2.cc</file>
      <line>45</line>
    </frame>
    <frame>
      <ip>0x534FB1C</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>ProtocolV2::reuse_connection(boost::intrusive_ptr&lt;AsyncConnection&gt; const&amp;, ProtocolV2*)::{lambda(ConnectedSocket&amp;)#3}::operator()(ConnectedSocket&amp;)::{lambda()#2}::operator()()</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>ProtocolV2.cc</file>
      <line>2739</line>
    </frame>
    <frame>
      <ip>0x534FF57</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>ProtocolV2::reuse_connection(boost::intrusive_ptr&lt;AsyncConnection&gt; const&amp;, ProtocolV2*)::{lambda(ConnectedSocket&amp;)#3}::operator()(ConnectedSocket&amp;)</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>ProtocolV2.cc</file>
      <line>2745</line>
    </frame>
    <frame>
      <ip>0x535001E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>__invoke_impl&lt;void, ProtocolV2::reuse_connection(const AsyncConnectionRef&amp;, ProtocolV2*)::&lt;lambda(ConnectedSocket&amp;)&gt;&amp;, ConnectedSocket&amp;&gt;</fn>
      <dir>/opt/rh/devtoolset-8/root/usr/include/c++/8/bits</dir>
      <file>invoke.h</file>
      <line>60</line>
    </frame>
    <frame>
      <ip>0x535001E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>__invoke&lt;ProtocolV2::reuse_connection(const AsyncConnectionRef&amp;, ProtocolV2*)::&lt;lambda(ConnectedSocket&amp;)&gt;&amp;, ConnectedSocket&amp;&gt;</fn>
      <dir>/opt/rh/devtoolset-8/root/usr/include/c++/8/bits</dir>
      <file>invoke.h</file>
      <line>95</line>
    </frame>
    <frame>
      <ip>0x535001E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>__call&lt;void, 0&gt;</fn>
      <dir>/opt/rh/devtoolset-8/root/usr/include/c++/8</dir>
      <file>functional</file>
      <line>400</line>
    </frame>
    <frame>
      <ip>0x535001E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>operator()&lt;&gt;</fn>
      <dir>/opt/rh/devtoolset-8/root/usr/include/c++/8</dir>
      <file>functional</file>
      <line>484</line>
    </frame>
    <frame>
      <ip>0x535001E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>EventCenter::C_submit_event&lt;std::_Bind&lt;ProtocolV2::reuse_connection(boost::intrusive_ptr&lt;AsyncConnection&gt; const&amp;, ProtocolV2*)::{lambda(ConnectedSocket&amp;)#3} (ConnectedSocket)&gt; &gt;::do_request(unsigned long)</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>Event.h</file>
      <line>227</line>
    </frame>
    <frame>
      <ip>0x535FCD6</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>EventCenter::process_events(unsigned int, std::chrono::duration&lt;unsigned long, std::ratio&lt;1l, 1000000000l&gt; &gt;*)</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>Event.cc</file>
      <line>441</line>
    </frame>
    <frame>
      <ip>0x5365086</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>operator()</fn>
      <dir>/usr/src/debug/ceph-15.0.0-1717-g8d72af7/src/msg/async</dir>
      <file>Stack.cc</file>
      <line>53</line>
    </frame>
    <frame>
      <ip>0x5365086</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>std::_Function_handler&lt;void (), NetworkStack::add_thread(unsigned int)::{lambda()#1}&gt;::_M_invoke(std::_Any_data const&amp;)</fn>
      <dir>/opt/rh/devtoolset-8/root/usr/include/c++/8/bits</dir>
      <file>std_function.h</file>
      <line>297</line>
    </frame>
    <frame>
      <ip>0x55F519E</ip>
      <obj>/usr/lib64/ceph/libceph-common.so.0</obj>
      <fn>execute_native_thread_routine</fn>
    </frame>
    <frame>
      <ip>0x1076BDD4</ip>
      <obj>/usr/lib64/libpthread-2.17.so</obj>
      <fn>start_thread</fn>
    </frame>
    <frame>
      <ip>0x118E0EAC</ip>
      <obj>/usr/lib64/libc-2.17.so</obj>
      <fn>clone</fn>
    </frame>
  </stack>
</error>

Signed-off-by: Sage Weil <sage@redhat.com>
 2019-06-12 10:33:16 -05:00
Hannes von Haugwitz
65c6425489 doc: update mondb recovery script 
- be specific about stopped OSDs
- add missing '--no-mon-config' option
- fix indent of here script delimiting identifier
- use $host variable in for loop

Signed-off-by: Hannes von Haugwitz <hannes@vonhaugwitz.com>
 2019-06-12 17:16:25 +02:00
Kefu Chai
2c968353d5
Merge pull request #28508 from smithfarm/wip-40295 
cmake: set empty-string RPATH for ceph-osd

Reviewed-by: Ricardo Dias <rdias@suse.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
 2019-06-12 23:05:23 +08:00
Sage Weil
18eacb6ed8 Merge PR #22446 into master 
* refs/pull/22446/head:
	relicense LGPL-2.1 code as LGPL-2.1 or LGPL-3.0
	COPYING: add reference to a few Apache-2.0 licensed source files
	debian/copyright: sync with COPYING
	COPYING: LGPL2.1 -> LGPL-2.1
	COPYING: extra bits from debian/copyright

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
 2019-06-12 09:11:49 -05:00
Tiago Melo
40768c3688 script/ceph-backport.sh: Add prepare function 
Add a new flag, --prepare, that when used will fetch all necessary info and
cherrypick all original commits automatically.
It will also prevent the main code to be executed.

After running with --prepare, and if there were no conflicts, you can simply
remove the flag from the command and run the script again.
This time it will run the main code and create the PR and update the backport
issue.

p.e.:
ceph-backport.sh 19206 jewel --prepare
ceph-backport.sh 19206 jewel

Signed-off-by: Tiago Melo <tmelo@suse.com>
 2019-06-12 14:00:49 +02:00
Kefu Chai
ca4917842b
Merge pull request #28484 from tchaikov/wip-test_librados_build 
qa/workunits/rados/test_librados_build.sh: install build deps

Reviewed-by: Nathan Cutler <ncutler@suse.com>
 2019-06-12 19:47:46 +08:00
Kefu Chai
53cf43ad60
Merge pull request #28486 from tchaikov/wip-remove-digest-from-buffer.h 
buffer,crypto,tools: extract digest methods out of bufferlist

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Myoungwon Oh <omwmw@sk.com>
 2019-06-12 19:29:59 +08:00
Jason Dillaman
a87a365733
Merge pull request #28494 from ricardoasmarques/update-iscsi-dependencies-versions 
doc: Update 'python-rtslib' and 'tcmu-runner' min versions

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
 2019-06-12 07:21:30 -04:00
Nathan Cutler
b793c55bd9 cmake: set empty-string RPATH for ceph-osd 
Fixes: http://tracker.ceph.com/issues/40295
Signed-off-by: Nathan Cutler <ncutler@suse.com>
 2019-06-12 12:40:48 +02:00
Kefu Chai
b76a6c729f qa/workunits/rados/test_envlibrados_for_rocksdb: support SUSE distros 
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-12 17:46:46 +08:00
Kefu Chai
be89e66f74 qa/workunits/rados/test_librados_build.sh: install build deps 
to build helloworld of librados, we need to install the build
dependencies.

Fixes: https://tracker.ceph.com/issues/40155
Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-12 17:46:46 +08:00
Kefu Chai
0072d487aa qa/workunits/rados/test_envlibrados_for_rocksdb: use helper script 
instead of having its own copy of `install()`, try to leverage the
helper in ceph-helpers-root.sh.

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-12 17:46:46 +08:00
Kefu Chai
e8e72319aa qa/workunits/ceph-helpers-root: use /etc/os-release instead 
as lsb_release does not work on SUSE distros

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-12 17:32:38 +08:00
Kefu Chai
810b69d4c1
Merge pull request #28465 from tchaikov/wip-xio-cleanup 
include/config-h.in.cmake: remove HAVE_XIO

Reviewed-by: Xie Xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Neha Ojha <nojha@redhat.com>
 2019-06-12 17:16:03 +08:00
Kefu Chai
111d10df52 cmake: move boost patch to cmake/modules 
as it's used by cmake only

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-12 16:32:10 +08:00
Kefu Chai
b848bce504 cmake/modules/BuildDPDK.cmake: update to adapt upstream changes 
* update execenv to remove "app", the targets ending with "app" changed
  to the ones without "app" now.
* pass CC by make variables not env variables, otherwise the default
  `cc` is used

Signed-off-by: Kefu Chai <kchai@redhat.com>
 2019-06-12 15:43:05 +08:00
Kefu Chai
09c34095d7
Merge pull request #28495 from tchaikov/wip-dashboard-portal_ip_addresses 
mgr/dashboard: take portal_ip_addresses as a list

Reviewed-by: Ricardo Marques <rimarques@suse.com>
 2019-06-12 13:53:38 +08:00
zhang Shaowen
9fcea0c003 rgw: modify iam_policy unit test to support object lock. 
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2019-06-12 11:19:04 +08:00
zhang Shaowen
e323d41e76 rgw: remove namespace from header file. 
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2019-06-12 11:19:04 +08:00
zhang Shaowen
b61b2f65f5 rgw: add missing operation to iam_policy 
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2019-06-12 11:19:04 +08:00
zhang Shaowen
07f70d780c rgw: fix some bugs in object lock feature 
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2019-06-12 11:19:04 +08:00
zhang Shaowen
5789109290 rgw: fix some errors in params 
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2019-06-12 11:19:04 +08:00
zhang Shaowen
18949105ae rgw: add object lock doc. 
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2019-06-12 11:19:04 +08:00
zhang Shaowen
0c24ce5581 rgw: add object lock feature. 
Signed-off-by: zhang Shaowen <zhangshaowen@cmss.chinamobile.com>
 2019-06-12 11:19:04 +08:00