Commit Graph

98086 Commits

Author SHA1 Message Date
Willem Jan Withagen
3eb760580f common: Clang requires a default constructor, but it can be empty
Just do what the error messages ask for.

Error from Clang:
```
In file included from /home/jenkins/workspace/ceph-master/src/cls/rbd/cls_rbd.cc:28:
In file included from /home/jenkins/workspace/ceph-master/src/objclass/../include/types.h:21:
In file included from /home/jenkins/workspace/ceph-master/src/include/uuid.h:9:
In file included from /home/jenkins/workspace/ceph-master/src/include/encoding.h:17:
In file included from /usr/include/c++/v1/set:426:
In file included from /usr/include/c++/v1/__tree:16:
/usr/include/c++/v1/memory:2241:41: error: call to implicitly-deleted default constructor of '__compressed_pair_elem<ceph::BitVector<'\x02'>::NoInitAllocator, 1>'
      : _Base1(std::forward<_Tp>(__t)), _Base2() {}
                                        ^
/usr/include/c++/v1/vector:437:7: note: in instantiation of function template specialization 'std::__1::__compressed_pair<unsigned int *, ceph::BitVector<'\x02'>::NoInitAllocator>::__compressed_pair<nullptr_t, true>' requested here
      __end_cap_(nullptr)
      ^
/usr/include/c++/v1/vector:496:5: note: in instantiation of member function 'std::__1::__vector_base<unsigned int, ceph::BitVector<'\x02'>::NoInitAllocator>::__vector_base' requested here
    vector() _NOEXCEPT_(is_nothrow_default_constructible<allocator_type>::value)
    ^
/home/jenkins/workspace/ceph-master/src/common/bit_vector.hpp:163:3: note: in instantiation of member function 'std::__1::vector<unsigned int, ceph::BitVector<'\x02'>::NoInitAllocator>::vector' requested here
  BitVector();
  ^
/home/jenkins/workspace/ceph-master/src/cls/rbd/cls_rbd.cc:3289:16: note: in instantiation of member function 'ceph::BitVector<'\x02'>::BitVector' requested here
  BitVector<2> object_map;
               ^
/usr/include/c++/v1/memory:2179:39: note: explicitly defaulted function was implicitly deleted here
  _LIBCPP_INLINE_VISIBILITY constexpr __compressed_pair_elem() = default;
                                      ^
/usr/include/c++/v1/memory:2172:50: note: default constructor of '__compressed_pair_elem<ceph::BitVector<'\x02'>::NoInitAllocator, 1, true>' is implicitly deleted because base class 'ceph::BitVector<'\x02'>::NoInitAllocator' has no default constructor
struct __compressed_pair_elem<_Tp, _Idx, true> : private _Tp {
                                                 ^
1 error generated.

```

Fixes: http://tracker.ceph.com/issues/39561
Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2019-05-01 15:57:24 +02:00
Josh Durgin
e4ac0a054e
Merge pull request #21729 from badone/wip-add-ceph_dump_log.py
scripts: ceph_dump_log.py

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-04-30 16:29:06 -07:00
Sage Weil
876d01dd58 Merge PR #27802 into master
* refs/pull/27802/head:
	ceph_telemetry: accept older formats and transform

Reviewed-by: Wido den Hollander <wido@42on.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-30 14:04:54 -05:00
J. Eric Ivancich
edddca27fa rgw: add editor directive comments to rgw services source files
So that both vi and emacs help to correctly format the source files,
add the directives to each of the source files. In addition, use
`#pragma once` in the header files instead of the macro work-around.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2019-04-30 14:54:55 -04:00
Abhishek L
b8863264ec
Merge pull request #27793 from theanalyst/doc/releases/14.2.1
doc: release notes for 14.2.1

Reviewed-By: Sage Weil <sweil@redhat.com>
Reviewed-By: Nathan Cutler <nculter@suse.com>
2019-04-30 18:23:03 +02:00
Sage Weil
ccfb160628 Merge PR #27734 into master
* refs/pull/27734/head:
	msg/async: Don't miss record l_msgr_running_recv_time if "pendingReadLen != 0"

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2019-04-30 10:45:15 -05:00
Sage Weil
97bba5d52d Merge PR #27869 into master
* refs/pull/27869/head:
	tools/ceph-objectstore-tool: dump onode internal metadata.
	tools/ceph-objectstore-tool: add --no-superblock option.

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-30 10:44:36 -05:00
Abhishek Lekshmanan
5453a228c1 doc: changelog: drop redundant nautilus and component names
Also sort the entries

Signed-off-by: Abhishek Lekshmanan <alekshmanan@suse.com>
2019-04-30 17:29:58 +02:00
Kefu Chai
e5968ec38a mgr/DaemonServer: add a coefficient to improve the readability
to explain why we can compare pg number with object number

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-30 22:51:47 +08:00
Kefu Chai
14aacd2d19 mgr/DaemonServer: refactor pgp_num changes throttling
for better readability

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-30 22:45:08 +08:00
Lenz Grimmer
75902401df
mgr/dashboard: Queue notifications as default (#27274)
mgr/dashboard: Queue notifications as default

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-04-30 16:04:42 +02:00
Lenz Grimmer
b94c5edcc1
Merge pull request #27612 from Devp00l/wip-issue-39296
mgr/dashboard: KV-table transforms dates through pipe

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-04-30 16:03:06 +02:00
Lenz Grimmer
a55dd48a6d
mgr/dashboard: bucket modification time to local time (#27669)
mgr/dashboard: bucket modification time to local time

Reviewed-by: Stephan Müller <smueller@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-04-30 15:42:25 +02:00
Sage Weil
4933a0475b Merge PR #27875 into master
* refs/pull/27875/head:
	mgr/DaemonServer: Fix pgp_num throttling min
	mgr/DaemonServer: allow pgp_num increases to be fast if pool is empty(ish)
	mgr: fix pgp_num vs merge pacer

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-30 08:28:21 -05:00
Nathan Cutler
2ddb581a63 script/backport-create-issue: handle long Redmine issue names
Redmine issue names have a maximum length of 255 characters. When we prepend,
e.g., "nautilus: " to a very long issue name, we can end up with a string that
is over 255 characters long. Such a string will be refused by Redmine:

ValidationError: Subject is too long (maximum is 255 characters)

This patch avoids such an eventuality by truncating the post-prepend string to
255 characters.

Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-04-30 13:38:33 +02:00
Sebastian Wagner
f82013123f
Merge pull request #26185 from jmolmo/hosts_management_ls
mgr/ansible: Host ls implementation
2019-04-30 13:36:43 +02:00
Kefu Chai
0d1071bd1a
Merge pull request #27883 from majianpeng/crimson-compiler-error
test/crimson: fix a compiler error.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-30 19:36:24 +08:00
Boris Ranto
aaaef9146c restful: Expose perf counters
We currently do not expose perf counters in the restful module but this
is a useful piece of information to be exposed by the restful module.

Since we already have a function to gather all the information about the
perf counters, we can make this easily accessible through the restful
API.

This also supports filtering by daemons through regexps.

Signed-off-by: Boris Ranto <branto@redhat.com>
2019-04-30 13:30:14 +02:00
Sebastian Wagner
828241b675
Merge pull request #27607 from sebastian-philipp/test-orchestrator-id-race
mgr/test_orchestrator: Fix 'TestWriteCompletion' object has no attribute 'id'

Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
2019-04-30 13:29:37 +02:00
Yuval Lifshitz
d8d817a600 rgw/pubsub: add another zone for pubsub
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-04-30 11:51:16 +03:00
Stephan Müller
30aee04465 mgr/dashboard: Queue notifications as default
Every time "show" is triggers now the notification gets queued before
sending it out. The notification service will make sure not to send out
duplicated notifications and to combine notifications that have the same
title. The combination of notification is useful for error messages.

For example if the mgr goes down you will get a view toasties notifying
about a 500 error. With the new implementation you get only one with the
different API paths it couldn't get.

Fixes: https://tracker.ceph.com/issues/39034
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-04-30 10:15:36 +02:00
Nathan Cutler
8bce53fa72
Merge pull request #27614 from smithfarm/wip-39323
tests: mgr/tox: make run-tox.sh scripts more robust

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-04-30 10:13:00 +02:00
Lenz Grimmer
3ec1130719
Merge pull request #27613 from Devp00l/wip-issue-23858
mgr/dashboard: RBD snapshot name suggestion with local time suffix

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ricardo Marques <rimarques@suse.com>
2019-04-30 09:43:01 +02:00
Jianpeng Ma
13e04977ac test/crimson: fix a compiler error.
When with -DWITH_SEASTAR=ON, met the following bug:
/home/ceph/src/test/crimson/test_alien_echo.cc:164:13: error: ‘client’ was not declared in this scope
             client.msgr->set_require_authorizer(false);
             ^~~~~~
/home/ceph/src/test/crimson/test_alien_echo.cc:164:13: note: suggested alternative: ‘client_t’
             client.msgr->set_require_authorizer(false);
             ^~~~~~
             client_t
/home/ceph/src/test/crimson/test_alien_echo.cc: In instantiation of ‘seastar_echo(entity_addr_t, echo_role, unsigned int)::<lambda(auto:47)>::<lambda(auto:48&)> [with auto:48 = seastar_pingpong::Client; auto:47 = ceph::net::Messenger*]’:
/usr/include/c++/7/type_traits:2428:26:   required by substitution of ‘template<class _Fn, class ... _Args> static std::__result_of_success<decltype (declval<_Fn>()((declval<_Args>)()...)), std::__invoke_other> std::__result_of_other_impl::_S_test(int) [with _Fn = seastar_echo(entity_addr_t, echo_role, unsigned int)::<lambda(auto:47)> [with auto:47 = ceph::net::Messenger*]::<lambda(auto:48&)>; _Args = {seastar_pingpong::Client&}]’
/usr/include/c++/7/type_traits:2439:55:   required from ‘struct std::__result_of_impl<false, false, seastar_echo(entity_addr_t, echo_role, unsigned int)::<lambda(auto:47)> [with auto:47 = ceph::net::Messenger*]::<lambda(auto:48&)>, seastar_pingpong::Client&>’
/usr/include/c++/7/type_traits:2444:12:   required from ‘struct std::__invoke_result<seastar_echo(entity_addr_t, echo_role, unsigned int)::<lambda(auto:47)> [with auto:47 = ceph::net::Messenger*]::<lambda(auto:48&)>, seastar_pingpong::Client&>’
/usr/include/c++/7/type_traits:2457:12:   required from ‘class std::result_of<seastar_echo(entity_addr_t, echo_role, unsigned int)::<lambda(auto:47)> [with auto:47 = ceph::net::Messenger*]::<lambda(auto:48&)>(seastar_pingpong::Client&)>’
/home//ceph/src/seastar/include/seastar/core/do_with.hh:93:17:   required from ‘auto seastar::do_with(T&&, F&&) [with T = seastar_pingpong::Client; F = seastar_echo(entity_addr_t, echo_role, unsigned int)::<lambda(auto:47)> [with auto:47 = ceph::net::Messenger*]::<lambda(auto:48&)>]’
/home/ceph/src/test/crimson/test_alien_echo.cc:184:32:   required from ‘seastar_echo(entity_addr_t, echo_role, unsigned int)::<lambda(auto:47)> [with auto:47 = ceph::net::Messenger*]’
/usr/include/c++/7/type_traits:2428:26:   required by substitution of ‘template<class _Fn, class ... _Args> static std::__result_of_success<decltype (declval<_Fn>()((declval<_Args>)()...)), std::__invoke_other> std::__result_of_other_impl::_S_test(int) [with _Fn = seastar_echo(entity_addr_t, echo_role, unsigned int)::<lambda(auto:47)>; _Args = {ceph::net::Messenger*&&}]’
/usr/include/c++/7/type_traits:2439:55:   required from ‘struct std::__result_of_impl<false, false, seastar_echo(entity_addr_t, echo_role, unsigned int)::<lambda(auto:47)>, ceph::net::Messenger*&&>’
/usr/include/c++/7/type_traits:2444:12:   required from ‘struct std::__invoke_result<seastar_echo(entity_addr_t, echo_role, unsigned int)::<lambda(auto:47)>, ceph::net::Messenger*&&>’
/usr/include/c++/7/type_traits:2457:12:   required from ‘class std::result_of<seastar_echo(entity_addr_t, echo_role, unsigned int)::<lambda(auto:47)>(ceph::net::Messenger*&&)>’
/home//ceph/src/seastar/include/seastar/core/future.hh:980:30:   required by substitution of ‘template<class Func, class Result>  requires  CanApply<Func, ceph::net::Messenger*> Result seastar::future<ceph::net::Messenger*>::then<Func, Result>(Func&&) [with Func = seastar_echo(entity_addr_t, echo_role, unsigned int)::<lambda(auto:47)>; Result = <missing>]’
/home//ceph/src/test/crimson/test_alien_echo.cc:207:8:   required from here
/home/ceph/src/test/crimson/test_alien_echo.cc:190:13: error: base operand of ‘->’ has non-pointer type ‘ceph::net::Messenger’
             client.msgr->set_require_authorizer(false);
             ^~~~~~

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-04-30 15:29:08 +08:00
Kefu Chai
1f5bb0c200
Merge pull request #27880 from majianpeng/fio_ceph_messenger
test/fio: fix a compiler error.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-30 14:49:05 +08:00
Jianpeng Ma
c6a9e988f3 test/fio: fix a compiler error.
Met the following bug when -DWITH_FIO=ON:
/home/src/test/fio/fio_ceph_messenger.cc:217:5: error: ‘require_authorizer’ was not declared in this scope
     require_authorizer = false;
This bug introduce by f10660e84f which omit this.

Signed-off-by: Jianpeng Ma <jianpeng.ma@intel.com>
2019-04-30 13:48:47 +08:00
David Zafman
63c2060c2d osd: Don't include user changeable flag in snaptrim related assert
Caused by: a53ba7314c

Fixes: http://tracker.ceph.com/issues/38124

Signed-off-by: David Zafman <dzafman@redhat.com>
2019-04-29 20:20:18 -07:00
Dan Mick
0222d0d62b ceph_telemetry: accept older formats and transform
Turn crashes from dict into list, and add a datestamp
(either from the report or from received time) to the
Elasticsearch document ID, remove hostname from crashdumps

Also add test code and requirements.txt for the tests for
ease of virtualenv creation

Signed-off-by: Dan Mick <dan.mick@redhat.com>
2019-04-29 15:42:59 -07:00
Sage Weil
a0d63c1a1f mgr/DaemonServer: Fix pgp_num throttling min
This was meant to limit the size of any single change to 1/2 of the
max_misplaced (see the comment above!).

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-29 16:27:58 -05:00
Sage Weil
c7c2d18da5 mgr/DaemonServer: allow pgp_num increases to be fast if pool is empty(ish)
If we just created a new pool and it's basically empty, there is no reason
to throttle the pgp_num changes.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-29 16:17:40 -05:00
Sage Weil
e6113c1725 mgr: fix pgp_num vs merge pacer
This condition should only kick in for pgp_num reductions, or else we'll
end up jump to the end instead of slowing down merges.  (For splits, we
don't need to pace like this at all.)

Fixes 76503a1438

Signed-off-by: Sage Weil <sage@redhat.com>
2019-04-29 16:17:01 -05:00
Gregory Farnum
8cd1128157
Merge pull request #27867 from tchaikov/wip-ceph-object-corpus
ceph-object-corpus: pick up 15.0.0-539-g191ab33faf

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2019-04-29 13:45:16 -07:00
Abhishek Lekshmanan
272dd1fc2b doc: release notes for 14.2.1
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-04-29 20:26:40 +02:00
kungf
4d33114a40 os/bluestore: fix aio pwritev lost data problem.
On Linux, write() (and similar system calls) will transfer at most
0x7ffff000 (2,147,479,552) bytes, it will cap data if aio pwritev
more than 0x7ffff000, so we have the split the data to more aio submit.

Signed-off-by: kungf <yang.wang@easystack.cn>
2019-04-29 12:46:30 -05:00
Casey Bodley
f0a9719d2c
Merge pull request #27730 from cbodley/wip-rgw-boost-170
rgw: fix compile errors with boost 1.70

Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2019-04-29 13:06:47 -04:00
Igor Fedotov
c3968c4f03 tools/ceph-objectstore-tool: dump onode internal metadata.
Supported for BlueStore only.

Signed-off-by: Igor Fedotov <ifedotov@suse.com>
2019-04-29 19:43:56 +03:00
Kefu Chai
c99f7e1682
Merge pull request #27861 from tchaikov/wip-utime-cleanup
include/utime: do not cast sec to time_t

Reviewed-by: Samuel Just <sjust@redhat.com>
2019-04-30 00:17:08 +08:00
Kefu Chai
b1ed98a617 ceph-object-corpus: pick up 15.0.0-539-g191ab33faf
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-30 00:13:41 +08:00
Lenz Grimmer
f92638fe3d
Merge pull request #27784 from Devp00l/wip-39483
mgr/dashboard: Make all columns sortable
2019-04-29 18:05:26 +02:00
Sage Weil
f3f2490620 Merge PR #27590 into master
* refs/pull/27590/head:
	messages: #include necessary header

Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-04-29 11:04:31 -05:00
Sage Weil
5b1bbdfec1 Merge PR #27804 into master
* refs/pull/27804/head:
	common, osd: remove erroneous 'section' in dump functions
	dencoder: include some missed types
	common: make utime_t dencoder-compatible
	common: make uuid_d dencoder-compatible
	osd: make watch_item_t dencoder-compatible

Reviewed-by: Sage Weil <sage@redhat.com>
2019-04-29 11:04:15 -05:00
Sage Weil
0191a27579 Merge PR #27832 into master
* refs/pull/27832/head:
	qa/suites/upgrade/mimic-x-singleton: suppress legacy statfs warning
	osd: reenable authorizer on hb messenger for nautilus+
	mon/MonClient: do not crash on empty auth request buffer
	msg: set_require_authorizer on messenger, not dispatcher
	mon/Monitor: allow probe if MMonProbe::mon_release == 0
	mon: fix min_mon_release print

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-29 11:03:53 -05:00
Kefu Chai
519f417ef5
Merge pull request #27788 from cyx1231st/wip-seastar-msgr-batch-send
crimson/net: improve batching in the write path

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-04-29 23:38:16 +08:00
Stephan Müller
a23ec08795 mgr/dashboard: RBD snapshot name suggestion with local time suffix
The new suffix is still a time that follows the ISO standard as it can
be converted into any other time zone through the time zone prefix of
itself.

Fixes: https://tracker.ceph.com/issues/23858
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-04-29 16:49:28 +02:00
Stephan Müller
a4bd0b3cac mgr/dashboard: Update messages.xlf
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-04-29 16:44:27 +02:00
Stephan Müller
789f9352ab mgr/dashboard: Allow the decrease of pg's of an existing pool
Now it's possible to decrease the pg's of an existing pool. The decrease
will take place over time like the increase. As for both no notification
will be created when this is done (issue #39482).

Fixes: https://tracker.ceph.com/issues/35917
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-04-29 16:44:27 +02:00
Kefu Chai
41747f7d9e
Merge pull request #27776 from JunHe77/install-deps
install-deps.sh: add option to skip prebuilt boost-* pkgs installation

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-04-29 22:34:10 +08:00
Stephan Müller
ba6d0f96db mgr/dashboard: Make all columns sortable
Fixes: https://tracker.ceph.com/issues/39483
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-04-29 15:48:37 +02:00
Tatjana Dehler
8785242de2 mgr/dashboard/qa: Fix a few linting issues in dashboard backend tests
Signed-off-by: Tatjana Dehler <tdehler@suse.com>
2019-04-29 15:28:45 +02:00
Kefu Chai
50226ef63c include/utime: do not cast sec to time_t
strictly speaking, time_t is an opaque time, and in this context, we
need a uint32_t, so it is not necessary and wrong. let's remove it.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-04-29 21:11:52 +08:00