Commit Graph

94553 Commits

Author SHA1 Message Date
Kefu Chai
c901d7b65c
Merge pull request #26177 from liewegas/wip-stricter-osd-gate
osd: refuse to start if we're > N+2 from recorded require_osd_release

Reviewed-By: Neha Ojha <nojha@redhat.com>
2019-02-06 19:02:34 +08:00
Kefu Chai
305eb0ebfd
Merge pull request #26181 from iliul/fix-pybind-mgr-pep8
pybind/mgr: PEP 8 code clean and fix typo

Reviewed-by: Dan Mick <dmick@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-06 19:01:45 +08:00
Kefu Chai
200879a769
Merge pull request #26258 from liewegas/wip-disable-krb
build: disable kerberos for nautilus

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-06 19:00:01 +08:00
Kefu Chai
8e74823d6e
Merge pull request #26259 from rzarzynski/wip-bl-freeze-alloc-unit
common: make CEPH_BUFFER_ALLOC_UNIT known at compile-time.

Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-02-06 18:59:22 +08:00
Sebastian Wagner
c41e6a025c
Merge pull request #26094 from sebastian-philipp/orchestrator-cli-command
mgr/orchestrator: make use of @CLICommand

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
Reviewed-by: Juan Miguel Olmo Martínez <jolmomar@redhat.com>
Reviewed-by: Noah Watkins <noahwatkins@gmail.com>
2019-02-06 10:57:45 +01:00
David Zafman
f289816a66
Merge pull request #26178 from dzafman/wip-38070
mon: A PG with PG_STATE_REPAIR doesn't mean damaged data, PG_STATE_IN…

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-02-05 14:51:14 -08:00
Yehuda Sadeh
5be454f3d5
Merge pull request #26273 from yehudasa/wip-38174
vstart.sh: fix params generation for monmaptool

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-02-05 14:01:24 -08:00
Ilya Dryomov
442fcb9a4b
Merge pull request #26279 from idryomov/wip-krbd-bluestore
qa: objectstore snippets for krbd

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-02-05 19:44:36 +01:00
Lenz Grimmer
e0cc3d30ec
Merge pull request #25995 from tspmelo/wip-iscsi-ui
mgr/dashboard: iSCSI management UI

Reviewed-by: Ricardo Marques <rimarques@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-02-05 16:18:44 +01:00
Sebastian Wagner
38c664b4b9 mgr/orchestrator: fix broken device ls
* Added `InventoryDevice.from_ceph_volume_inventory`
* Improved documentation

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-05 15:23:35 +01:00
Tiago Melo
6ffaf6264e mgr/dashboard: Add iSCSI Form UI
Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-02-05 12:19:52 +00:00
Tiago Melo
b07ef4f856 mgr/dashboard: Add read-only UI for iSCSI
Signed-off-by: Ricardo Marques <rimarques@suse.com>
Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-02-05 12:19:52 +00:00
Tiago Melo
f718524ee7 mgr/dashboard: Fix TableComponent when changing columns afterViewInit
Angular was throwing an ExpressionChangedAfterItHasBeenCheckedError if you
changed columns information right after the table was initiated.

Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-02-05 12:02:33 +00:00
Tiago Melo
4f27371760 mgr/dashboard: Set CdModal max-height
Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-02-05 12:02:33 +00:00
Tiago Melo
4598bfb34b mgr/dashboard: Enhance CdValidators.validateIf method
Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-02-05 12:02:33 +00:00
Tiago Melo
7acdff9a0f mgr/dashboard: Add generic Select component
Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-02-05 12:02:33 +00:00
Kefu Chai
19691a7f06
Merge pull request #26202 from smithfarm/wip-fix-s390x-rpm-build
rpm: package crypto libraries for all archs

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-05 19:41:48 +08:00
Sebastian Wagner
d71a97b7fa mgr/orchestrator: make use of @CLICommand
Also Modified some command to allow multiple hosts
Also: Added more tests

Signed-off-by: Sebastian Wagner <sebastian.wagner@suse.com>
2019-02-05 11:27:47 +01:00
Ilya Dryomov
711df71790 qa: objectstore snippets for krbd
krbd was being tested with filestore, up until recently when the
default for osd_objectstore was changed to bluestore.  This broke
rbd_simple_big.yaml because bluestore_block_size defaults to 10G.
Pick up the sepia setting of 90G from bluestore-bitmap.yaml.

Run fsx subsuite with both filestore and bluestore.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-02-05 11:23:42 +01:00
Yehuda Sadeh
e883e7398b
Merge pull request #26106 from yehudasa/wip-rgw-es-fixes
rgw: multiple es related fixes and improvements

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-02-04 17:54:43 -08:00
Yehuda Sadeh
2ff5439c2b vstart.sh: fix params generation for monmaptool
Fixes: http://tracker.ceph.com/issues/38174

This broke in the msgr21 case, due to bash globbing in cases where
the generated string somehow matched names of certain files in local
directory. Also need to pass params to the prun function separately,
otherwise everything is quoted together.

Signed-off-by: Yehuda Sadeh <yehuda@redhat.com>
2019-02-04 16:41:34 -08:00
Patrick Donnelly
206bcbcc89
Merge PR #26111 into master
* refs/pull/26111/head:
	mds: broadcast quota message to client when disable quota

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-02-04 15:43:42 -08:00
Patrick Donnelly
e5a2964f55
Merge PR #26123 into master
* refs/pull/26123/head:
	mds: refactor MDSContext inheritance

Reviewed-by: Venky Shankar <vshankar@redhat.com>
Reviewed-by: Zheng Yan <zyan@redhat.com>
2019-02-04 15:39:52 -08:00
Sebastian Wagner
0e443b7f5a
Merge pull request #26023 from jmolmo/inventory_pb_updated
mgr/ansible: Replace Ansible playbook used to retrieve storage devices data

Reviewed-by: Sebastian Wagner <sebastian.wagner@suse.com>
Reviewed-by: Sébastien Han <seb@redhat.com>
2019-02-04 23:00:00 +01:00
Yuri Weinstein
460af8203a
Merge pull request #26170 from ifed01/wip-ifed-fix-fsck-read
os/bluestore: deep fsck fails on inspecting very large onodes

Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-02-04 12:51:15 -08:00
Yuri Weinstein
20ad73a1bb
Merge pull request #26223 from majianpeng/remove-unused-function
osd: remove unused function.

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-04 12:50:45 -08:00
Adam C. Emerson
81d1f3a6a7 Merge pull request #25278 from ZVampirEM77/wip-deleteobject-policy
rgw: fix obj can still be deleted even if deleteobject policy is set
rgw: cleanup for RGWDeleteObj::verify_permission(

Reviewed-by: Pritha Srivastava <prsrivas@redhat.com>
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-02-04 13:08:20 -05:00
Ilya Dryomov
1d94dcdb43
Merge pull request #26244 from idryomov/wip-krbd-alloc-size
krbd: alloc_size map option and tests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-02-04 15:13:18 +01:00
Nathan Cutler
3feca71d70 rpm: package crypto libraries for all archs
Since 318a8e3c07 we are now building at least the
openssl crypto plugin on all architectures, not just x86_64.

This fixes the non-x86_64 builds for master.

Fixes: 318a8e3c07
Signed-off-by: Nathan Cutler <ncutler@suse.com>
2019-02-04 12:43:02 +01:00
Tatjana Dehler
6116c96989
Merge pull request #25309 from Devp00l/wip-prometheus-alerting
mgr/dashboard: Prometheus integration

Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Tatjana Dehler <tdehler@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-02-04 11:32:41 +01:00
Sage Weil
4edb005ed7 Merge PR #26256 into master
* refs/pull/26256/head:
	msg/async/ProtocolV2: respect policy.resetcheck on cookie==0

Reviewed-by: Ricardo Dias <rdias@suse.com>
2019-02-03 23:59:54 -06:00
Radoslaw Zarzynski
5176ced98b common: make CEPH_BUFFER_ALLOC_UNIT known at compile-time.
It sounds extremely unlikely that any platform Ceph targets can have
PAGE_SIZE lower than 4k. However, to handle these corner cases,
`bufferlist` was rounding to `CEPH_PAGE_SIZE` known at run-time only.
As a result, compilers were enforced to generate pretty inefficient
code like in `ceph::buffer::list::refill_append_space` (self is 1,10%):

```
       │         min(const _Tp& __a, const _Tp& __b)
       │         {
       │           // concept requirements
       │           __glibcxx_function_requires(_LessThanComparableConcept<_Tp>)
       │           //return __b < __a ? __b : __a;
       │           if (__b < __a)
  5,44 │       mov    _DYNAMIC+0x14a0,%rax
       │     _Z11round_up_toImjENSt13make_unsignedINSt11common_typeIJT_T0_EE4typeEE4typeES2_S3_():
       │       mov    $0x1000,%ecx
       │     _ZN4ceph6buffer4list19refill_append_spaceEj():
       │         size_t alen = round_up_to(need, CEPH_BUFFER_ALLOC_UNIT) -
       │           sizeof(raw_combined);
       │         buffer::hangable_ptr& new_back = \
       │           hangable_ptr::create(raw_combined::create(alen, 0, get_mempool()));
       │       mov    %rbp,%rdi
       │     _Z11round_up_toImjENSt13make_unsignedINSt11common_typeIJT_T0_EE4typeEE4typeES2_S3_():
  6,21 │       cmpl   $0x1000,(%rax)
  0,78 │       cmovbe (%rax),%ecx
       │       mov    %r12,%rax
       │       xor    %edx,%edx
  0,78 │       mov    %ecx,%ecx
 45,59 │       div    %rcx
```

Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-03 22:54:10 +01:00
Sage Weil
9aaa354cad build: disable kerberos for nautilus
We can re-enable after we branch.  For N, though, there is no point in dragging
in the dependencies and implying there is something that works.

Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-03 14:27:49 -06:00
Kefu Chai
ff3386fd58
Merge pull request #26240 from votdev/improve_get_module_option
mgr: Use Py_BuildValue to create the argument tuple

Reviewed-by: Boris Ranto <branto@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-04 01:37:02 +08:00
Kefu Chai
2d4468c895
Merge pull request #26233 from liewegas/wip-bluestore-disable-csum
os/bluestore: add bluestore_ignore_data_csum option

Reviewed-by: Igor Fedotov <ifedotov@suse.com>
Reviewed By: Xie Xingguo <xie.xingguo@zte.com.cn>
2019-02-04 01:24:08 +08:00
Kefu Chai
be56801eb8
Merge pull request #25077 from rzarzynski/wip-bl-kill_append_buffer
common: drop append_buffer from bufferlist. Use simple carriage instead

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-02-04 01:22:11 +08:00
Kefu Chai
8805a28b0f
Merge pull request #26245 from liewegas/wip-38150
os/bluestore/KernelDevice: use flock(2) for block device lock

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Jeff Layton <jlayton@redhat.com>
2019-02-04 01:20:55 +08:00
Sage Weil
51067350ad msg/async/ProtocolV2: respect policy.resetcheck on cookie==0
It's possible the accepting end knows the cookie but the connecting end
does not if the fault happens before it receives server_ident.  If the
next connection attempt is in the other direction, we need to avoid a
reset or the queued messages at the first site will get lost.

Fixes: http://tracker.ceph.com/issues/38118
Signed-off-by: Sage Weil <sage@redhat.com>
2019-02-03 10:43:40 -06:00
Ilya Dryomov
04f5b343f9 qa: update krbd tests for zeroout
Discard no longer guarantees zeroing, use BLKZEROOUT and "fallocate -z"
instead (blkdiscard(8) in xenial doesn't support -z).

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-02-03 10:57:07 +01:00
Ilya Dryomov
031bbea739 qa: krbd discard with alloc_size vs zeroout tests
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2019-02-02 18:33:32 +01:00
Xie Xingguo
a4b1dc5a09
Merge pull request #26179 from xiexingguo/wip-37968
crush: fix upmap overkill

Reviewed-by: Sage Weil <sage@redhat.com>
2019-02-02 17:24:42 +08:00
Kefu Chai
434dc9e95e
Merge pull request #26222 from tchaikov/wip-crimson-heartbeat
crimson/osd: add heartbeat support

Reviewed-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-02-02 15:45:44 +08:00
Kefu Chai
4eff55d0f1 cmake: disable GCC-9 warnings
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
e9506e79ea crimson/osd: add heartbeat support
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
a88e89e777 crimson/osd: move "_preboot" log to where it belongs to
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
3ee0167266 crimson/osd: bind and listen
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
66826c86f4 crimson/net: add Messenger::try_bind()
in case the server is just fine with any unused local port number, and it
will report it to monitor.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
2d70d9e990 crimson/osd: s/client_msgr/public_msgr/
because this messenger also serves requests from librados clients.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
7a5469dd2e crimson/common: add pick_address.cc to crimson-common
crimson-osd needs pick_address() for initializing the listening
addresses.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00
Kefu Chai
41da38f21a common/pick_address: add necessary includes
* add needed forward declaration
* add necessary #includes
* move `#include "common/config.h"` to .cc, as it's not part of
interface.

Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-02-02 13:20:00 +08:00