Commit Graph

101780 Commits

Author SHA1 Message Date
Zhi Zhang
c28ec2dc15 test: remove useless ASSERT_XXX macros for rgw test
Signed-off-by: Zhi Zhang <zhangz.david@outlook.com>
2019-09-05 15:16:59 +08:00
Yingxin Cheng
6d5c6108dc crimson/test: implement v2 failover tests with crimson FailoverTestPeer
* Test framework which is able to bring up a local FailoverSuitePeer
  or connect to a remote FailoverSuitePeer;
* Implemented crimson FailoverSuitePeer;
* Test framework which can declare failure cases, messenger operations
  and introspect test results for different kinds of tests ;
* 47 test cases to cover combinations of policies and faults;

Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2019-09-05 13:06:26 +08:00
Kefu Chai
a72edfb4d7
Merge pull request #29981 from falcon78921/wip-ceph-conf-usage
ceph-conf: added --show-config-value to usage

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-05 11:46:27 +08:00
Yingxin Cheng
bcace8bce0 crimson/test: use make_message()
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2019-09-05 11:40:02 +08:00
Yingxin Cheng
389bd93f65 crimson/test: intercept V2 Protocol with Interceptor
Signed-off-by: Yingxin Cheng <yingxin.cheng@intel.com>
2019-09-05 11:40:02 +08:00
Paul Cuzner
2166676288 mgr/k8sevents: Initial ceph -> k8s events integration
Adds a mgr module to provide integration between
Ceph and the kubernetes events API within the rook-ceph
namespace. It provides several commands to view event
status including;

ceph k8sevents list .... show all k8s related events
ceph k8sevents ceph .... show events generated from this
                         module
ceph k8sevents status .. show status of the tracker threads
                         and counts of tracked events

Events sent to kubernetes are sourced from the
a) clog: ceph healtchecks and admin commands
b) explicit checks: hosts, pools and OSD states are checked
   every 'n' seconds

Signed-off-by: Paul Cuzner <pcuzner@redhat.com>
2019-09-05 14:45:52 +12:00
James McClune
2627c3527a ceph-conf: added --show-config-value to ceph-conf usage
--show-config-value is another way to lookup ceph.conf
values. Users may want to utilize --show-config-value instead of
--lookup because --show-config-value also shows global defaults.

Signed-off-by: James McClune <jmcclune@mcclunetechnologies.net>
2019-09-04 22:29:08 -04:00
David Zafman
71015b94ab doc: Document network performance monitoring
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-09-04 16:01:11 -07:00
Gregory Farnum
2499641c72
Merge pull request #29847 from iotcg/mon_doc
doc: set ceph_perf_msgr_server arguments

Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2019-09-04 14:43:51 -07:00
Yuval Lifshitz
1ba63aad2c
Merge pull request #30136 from yuvalif/build_docs_on_fedora30
build-doc: allow building docs on fedora 30
2019-09-04 22:40:46 +03:00
J. Eric Ivancich
851b1e1bdc
Merge pull request #26755 from cbodley/wip-rgw-bilog-complete
rgw multisite: avoid writing bilog entries on PREPARE and CANCEL

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-09-04 13:19:01 -04:00
David Zafman
5f83a6158b osd doc mon mgr: To milliseconds for config value, user input and threshold out
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-09-04 17:13:32 +00:00
J. Eric Ivancich
ab460e90f7
Merge pull request #29692 from mkogan1/wip-rgw-37615
rgw: fix cls_bucket_list_unordered() partial results

Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-09-04 13:12:55 -04:00
Stephan Müller
a1e81bb28e mgr/dashboard: Refactoring
I came across a yoda case and a test case that didn't use 'done' while
using an async call.

Fixes: https://tracker.ceph.com/issues/40828
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-09-04 16:22:33 +02:00
Stephan Müller
7406d5e02d mgr/dashboard: Use onCancel on any modal event
The problem was, that if 'onCancel' was provided, it wasn't used in all
modal exit cases. Only for the close buttons (the X and the labeled
one), but not if you clicked outside the modal or hit escape.

'onCancel' is currently only used inside the user management form, where
the problem caused, that the submit button was not longer click able if
the modal was hidden through clicking outside of it or hitting escape.

Fixes: https://tracker.ceph.com/issues/40828
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-09-04 16:22:33 +02:00
Stephan Müller
4685dcd450 mgr/dashboard: Add tests for confirmation modal
Fixes: https://tracker.ceph.com/issues/40828
Signed-off-by: Stephan Müller <smueller@suse.com>
2019-09-04 16:22:33 +02:00
Abhishek Lekshmanan
da2d40fa9a doc: releases: 14.2.3 dashboard note
The comment unfortunately got buried in a resolved blog

Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-09-04 16:02:17 +02:00
Abhishek L
c9863fbd7e
Merge pull request #29973 from theanalyst/doc/releases/14.2.3
doc: release notes for v14.2.3 nautilus

Reviewed-By: Nathan Cutler <nculter@suse.com>
Reviewed-By: Neha Ojha <nojha@redhat.com>
Reviewed-By: Josh Durgin <jdurgin@redhat.com>
Reviewed-By: Lenz Grimmer <lgrimmer@suse.com>
2019-09-04 15:50:18 +02:00
Abhishek Lekshmanan
3e2f2dcc39 doc: add a final set of notable changes to 14.2.3
Signed-off-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-09-04 15:32:34 +02:00
Yuval Lifshitz
e17e4bfcc0 build-doc: allow building docs on fedora 30
Signed-off-by: Yuval Lifshitz <yuvalif@yahoo.com>
2019-09-04 16:14:56 +03:00
xie xingguo
39f15bb2be mgr/DaemonServer: skip adjusting pgp_num when merging is in-progress
otherwise there is a possibility we might change the up set of the
merge participants and hence have to back off the merge process.
Also this will cause some other (racy) corner cases that are hard
to take care of.

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-04 20:26:52 +08:00
Kefu Chai
4275bc2330
Merge pull request #29882 from cyx1231st/wip-seastar-msgr-test-lossless-crimson
crimson/net: bug fixes from v2 failover tests

Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-09-04 19:51:55 +08:00
Lenz Grimmer
fc5249b99c
Merge pull request #30075 from rhcs-dashboard/fix-41600-master
mgr/dashboard: change warn_explicit to warn

Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-09-04 11:11:16 +00:00
Lenz Grimmer
79eba9d1d9
Merge pull request #29929 from tspmelo/wip-ng-analytics
mgr/dashboard: Prevent angular of getting stuck during installation

Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kiefer Chang <kiefer.chang@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
2019-09-04 10:05:27 +00:00
Volker Theile
b7a2576192
Merge pull request #29557 from Devp00l/wip-41166
mgr/dashboard: Fix CephFS chart

Reviewed-by: Ni-Feng Chang <kiefer.chang@suse.com>
Reviewed-by: Volker Theile <vtheile@suse.com>
Reviewed-by: Patrick Seidensal <pseidensal@suse.com>
2019-09-04 11:47:13 +02:00
Adam Kupczyk
ec783e629f bluestore/allocator: Aging test for bluestore allocators.
Tests performance and fragmentation for data accumulation
	and storage capacity extension scenario.

Signed-off-by: Adam Kupczyk <akupczyk@redhat.com>
2019-09-04 10:49:26 +02:00
Jan Fajerski
24220af4fa
Merge pull request #29996 from iliul/export-standby-metadata
mgr/prometheus: export standby mds metadata
2019-09-04 09:37:09 +02:00
Radoslaw Zarzynski
7261f83304 os/bluestore: introduce bluefs_layout_t.
Signed-off-by: Radoslaw Zarzynski <rzarzyns@redhat.com>
2019-09-04 08:49:35 +02:00
xie xingguo
22960192b0 osd: add objects_readv_sync
However, this is only meaningful for ReplicatedBackend
since ECBackend is already reading everything in asynchronous way.
Also the osd_verify_sparse_read_holes option could be reliably
dropped as it seems never (ever?) actually get a chance to be
exercised ?

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-04 13:20:53 +08:00
xie xingguo
74be30c8b7 osd/ReplicatedBackend: use readv to build push_op
Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-04 13:20:52 +08:00
xie xingguo
cbf36a0ff9 os: implement readv
Currently only works for bluestore.
The default version still reads each extent separately synchronously,
but I think that should not be a concern?

Signed-off-by: xie xingguo <xie.xingguo@zte.com.cn>
2019-09-04 13:20:52 +08:00
Kefu Chai
722dd0eb91
Merge pull request #30122 from tchaikov/wip-40646
install-deps: revert 47d4351d

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
2019-09-04 11:36:20 +08:00
Josh Durgin
11eb92846f
Merge pull request #30119 from neha-ojha/wip-41385
osd/MissingLoc, PeeringState: remove osd from missing loc in purge_strays()

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-09-03 18:58:16 -07:00
Jason Dillaman
154f3472f8
Merge pull request #30072 from wjwithagen/wjw-wip_split_run-rbd-unit-tests
test/librbd: allow parallel runs of run-rbd-unit-tests

Reviewed-by: Jason Dillaman <dillaman@redhat.com>
2019-09-03 21:18:54 -04:00
Kefu Chai
dfa6c5fcba install-deps: revert 47d4351d
this change reverts 47d4351d3a

see also 33dfffc8

Fixes: https://tracker.ceph.com/issues/40646
Signed-off-by: Kefu Chai <kchai@redhat.com>
2019-09-04 09:17:13 +08:00
Xie Xingguo
b6fca9a826
Merge pull request #30018 from xiexingguo/wip-38483
osd: prime splits/merges for any potential fabricated split/merge participant

Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-04 08:31:39 +08:00
Willem Jan Withagen
e2f2929838 test/librbd: allow parallel runs of run-rbd-unit-tests
Running all tests sequential makes it the longest test of
`make check`, with each partial test taking around 500 sec.
Running 6 tests thus takes almost an hour.

Cut this down if ctest runs tests in parallel

Default behaviour of src/test/run-rbd-unit-tests.sh is kept:
  Without parameters the tests are run in sequence

To run unitttest_librbd with RBD_FEATURES, use `N` as parameter

Signed-off-by: Willem Jan Withagen <wjw@digiware.nl>
2019-09-03 20:06:22 -04:00
Josh Durgin
7478b6cc97
Merge pull request #29990 from aclamk/fix-doc-ceph_kvstore_tool-stats
doc/ceph-kvstore-tool: add description for 'stats' command

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-09-03 15:48:57 -07:00
Josh Durgin
70621ae1a3
doc/man/ceph-kvstore-tool: fix typo
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2019-09-03 15:47:30 -07:00
Neha Ojha
624ade487e osd/MissingLoc, PeeringState: remove osd from missing loc in purge_strays()
We should always try to keep osds in missing_loc consistent with peer_missing
and peer_info. When we remove an osd from peer_missing and peer_info, we
should also remove it from missing_loc during purging strays.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2019-09-03 15:27:42 -07:00
Casey Bodley
103bf7634c
Merge pull request #29639 from baixueyu/wip-crypto-bug
rgw: get barbican secret key request maybe return error code

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-09-03 16:23:36 -04:00
Casey Bodley
15faeec07f
Merge pull request #29776 from cbodley/wip-rgw-beast-static-flat-buffer
rgw: increase beast parse buffer size to 64k

Reviewed-by: Abhishek Lekshmanan <abhishek@suse.com>
2019-09-03 16:22:39 -04:00
Casey Bodley
c404e1e3de
Merge pull request #29852 from cbodley/wip-41395
rgw: move bucket reshard checks out of write path

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-09-03 16:22:02 -04:00
Casey Bodley
10ba9eac7d
Merge pull request #29856 from cbodley/wip-41412
rgw: RGWCoroutine::call(nullptr) sets retcode=0

Reviewed-by: Yehuda Sadeh <yehuda@redhat.com>
2019-09-03 16:20:18 -04:00
Casey Bodley
49dc6c6051
Merge pull request #29894 from markhpc/wip-rgw-reshard-json
rgw/rgw_reshard: Don't dump RGWBucketReshard JSON in process_single_logshard

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2019-09-03 16:19:38 -04:00
Alfredo Deza
535c0fbd5d
Merge pull request #30088 from tchaikov/wip-40646
ceph.spec.in: use g++ >= 8.3.1-3.1

Reviewed-by: Alfredo Deza <adeza@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-09-03 15:36:19 -04:00
Casey Bodley
cc17681b47
Merge pull request #29742 from dang/push
rgw: make sure modelines are correct for all files

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-09-03 15:12:56 -04:00
Casey Bodley
560d8b1c58
Merge pull request #29199 from tianshan/fix_gc_tag_remove
rgw: gc remove tag after all sub io finish

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-09-03 15:11:22 -04:00
Casey Bodley
f242b7427a
Merge pull request #29628 from NancySu05/lihuanhuan
RGW: add bucket permission verify when copy obj

Reviewed-by: Casey Bodley <cbodley@redhat.com>
2019-09-03 14:24:54 -04:00
Casey Bodley
8c4d741055
Merge pull request #29943 from markhpc/wip-rgw-optimize-get_val2
rgw/rgw_op: Remove get_val from hotpath via legacy options

Reviewed-by: Casey Bodley <cbodley@redhat.com>
Reviewed-by: Matt Benjamin <mbenjamin@redhat.com>
2019-09-03 14:23:52 -04:00