David Zafman
5f83a6158b
osd doc mon mgr: To milliseconds for config value, user input and threshold out
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-09-04 17:13:32 +00:00
David Zafman
9d02e5d39d
osd mon mgr: Convert all network ping time output to milliseconds
...
To output milliseconds (usec / 1000), treat as fixed point integers
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:26:27 +00:00
David Zafman
8ac1562b49
common: Add support routines to generate strings for fixed point
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
4fb42ea27e
test: Add basic test for network ping tracking
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
573aea2bb1
osd: Add debug_heartbeat_testing_span to allow quicker testing
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
f2b26d88f0
osd: Add debug_disable_randomized_ping config for use in testing
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
048f809626
osd mgr: Add osd_mon_heartbeat_stat_stale option to time out ping info
...
after 1 hour
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
5ab145d640
mon: Indicate when an osd with slow ping time is down
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
ea20d3522a
osd mon: Add last_update to osd_stat_t heartbeat info
...
Ignore old heartbeat info which hasn't updated
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
6555699d28
osd: After first interval populate vectors so 5min/15min values aren't 0
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
3f846d7c80
osd mgr: Store last pingtime for possible graphing
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
297a0e7b1d
osd mgr: Add minimum and maximum tracking to network ping time
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
f4a0be2e87
doc: Add documentation and release notes
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
0d1bbd34e9
osd mgr mon: Add mon_warn_on_slow_ping_ratio config as 5% of osd_heartbeat_grace
...
Compute network ping threshold based on ratio (5% of 20 seconds is 1 second)
Make the threshold value used part of dump_osd_network for osd and mgr
Keep mon_warn_on_slow_ping_time (default 0) to optionally override the ratio
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
5d3c185641
mgr: Add "dump_osd_network" mgr admin request to get a sorted report
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
025b10a532
osd: Add "dump_osd_network" osd admin request to get a sorted report
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:34 +00:00
David Zafman
66d44e7f91
osd mon: Track heartbeat ping times and report health warning
...
Fixes: http://tracker.ceph.com/issues/40640
Signed-off-by: David Zafman <dzafman@redhat.com>
2019-08-26 15:25:32 +00:00
Patrick Donnelly
d30af45a54
Merge PR #29715 into master
...
* refs/pull/29715/head:
qa: fix broken ceph.restart marking of OSDs down
qa: add debugging failed osd-release setting
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-23 10:09:17 -07:00
Patrick Donnelly
b82e87bda4
Merge PR #29821 into master
...
* refs/pull/29821/head:
qa: stop DaemonWatchdog for each cluster in daemon roles
Reviewed-by: Jos Collin <jcollin@redhat.com>
2019-08-23 10:00:52 -07:00
Sage Weil
af4500be86
Merge PR #29575 into master
...
* refs/pull/29575/head:
objclass, osd: improve const-correctness of PGLSFilter.
common: add bl::contents_equal() override for void* + size_t.
osd: refactor manufacturing of PGLSFilter.
osd: don't carry PGLSFilter between multiple ops in MOSDOp.
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-23 11:26:28 -05:00
Sage Weil
1f39b36b8e
Merge PR #28727 into master
...
* refs/pull/28727/head:
test/crimson: resolve name collision
test: switch to ldout; let users specify mon debug level
test: add new ElectionLogic unit test framework
elector: const-ify a bunch of functions
elector: swap order of parameters in ElectionLogic::receive_propose
elector: Update Elector and ElectionLogic function documentation
elector: persist the epoch in bump_epoch()
elector: make some more ElectionLogic members private
elector: fix privacy and restore dout in Elector
elector: don't clear peer_info in bump_epoch()
elector: split ElectionLogic into its own compilation unit
elector: move all the elector callouts into the Elector
elector: make ElectionLogic private to Elector; undo most public shenanigans
elector: create declare_standlone_victory in Elector/Logic for Monitor
elector: make ElectionLogic::declare_victory private
elector: route _bump_epoch through the interface-to-be
elector: rename handle_propose_logic -> receive_propose
elector: hoist handle_victory into ElectionLogic
elector: hoist handle_ack into ElectionLogic
elector: hoist victory into ElectionLogic
elector: hoist expire into ElectionLogic
elector: hoist start into ElectionLogic
elector: hoist participating into ElectionLogic
elector: hoist init into ElectionLogic
elector: hoist defer into ElectionLogic
elector: split handle_propose in two and hoist into ElectionLogic
elector: hoist bump_epoch into ElectionLogic
elector: store accessors for ElectionLogic
elector: hoist Elector data bits out into a new ElectionLogic class
mon: Rearrange Paxos::dispatch to be a little cleaner
Reviewed-by: Brad Hubbard <bhubbard@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-23 11:25:28 -05:00
Sage Weil
8876cf36c2
Merge PR #15183 into master
...
* refs/pull/15183/head:
kv/rocksdb: support rmrange unconditionally
cls/rgw: rgw_bi_log_trim() uses cls_cxx_map_remove_range()
cls/log: cls_log_trim() uses cls_cxx_map_remove_range()
test/cls: add cls_log.trim_by_marker test
test/cls: test_cls_log doesn't allocate ObjectOperations
test/cls: test_cls_log uses fixture for temporary pool
test/cls: add cls_rgw.bi_log_trim test
cls/rgw: expose cls_rgw_bilog_list/trim() for single shard
test/cls: test_cls_rgw uses cls_rgw_obj_key
test/cls: test_cls_rgw doesn't allocate ObjectOperations
test/cls: test_cls_rgw uses fixture for temporary pool
objclass: add cls_cxx_map_remove_range()
librados: add rados_write_op_omap_rm_range2()
osdc: add Objecter omap_rm_range()
osd: add CEPH_OSD_OP_OMAPRMKEYRANGE to do_osd_ops()
osd: add omap_rmkeyrange() to PGTransaction
os: add bufferlist overload for omap_rmkeyrange()
tracing: add do_osd_op_pre_omaprmkeyrange
rados: add CEPH_OSD_OP_OMAPRMKEYRANGE
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-23 10:46:33 -05:00
Casey Bodley
6b0f3ce4cb
Merge pull request #29778 from cbodley/wip-41212
...
vstart: move [client.rgw] config into [client]
Reviewed-by: Adam C. Emerson <aemerson@redhat.com>
2019-08-23 10:24:41 -04:00
Lenz Grimmer
862876d900
mgr/dashboard: User Management E2E tests ( #29641 )
...
mgr/dashboard: User Management E2E tests
Reviewed-by: Tiago Melo <tmelo@suse.com>
Reviewed-by: Stephan Müller <smueller@suse.com>
2019-08-23 14:00:16 +00:00
Lenz Grimmer
d373178c43
mgr/dashboard: run-backend-api-tests.sh CI improvements ( #29504 )
...
mgr/dashboard: run-backend-api-tests.sh CI improvements
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
Reviewed-by: Sebastian Wagner <swagner@suse.com>
2019-08-23 09:11:39 +00:00
Kefu Chai
e909031d3c
Merge pull request #29590 from Aran85/fix_proc_replica_log
...
osd: merge replica log on primary need according to replica log's crt
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-23 14:59:02 +08:00
Kefu Chai
1116362118
Merge pull request #29747 from liewegas/wip-39546
...
osd/PeeringState: do not complain about past_intervals constrained by oldest epoch
Reviewed-by: Neha Ojha <nojha@redhat.com>
2019-08-23 13:28:52 +08:00
Kefu Chai
25ed83e14a
Merge pull request #29624 from NancySu05/osdmonitor_markmedown
...
mon:C_AckMarkedDown has not handled the Callback Arguments
Reviewed-by: Samuel Just <sjust@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-23 13:23:46 +08:00
Kefu Chai
5e5eca2834
Merge pull request #29738 from ifed01/wip-ifed-alloc-cleanup
...
os/bluestore: minor improvements/cleanup around allocator
Reviewed-by: Adam Kupczyk <akupczyk@redhat.com>
2019-08-23 13:22:52 +08:00
Kefu Chai
ed8a0fb3c6
Merge pull request #29614 from votdev/issue_41205
...
mgr/dashboard: Access control database does not restore disabled users correctly
Reviewed-by: Patrick Seidensal <pnawracay@suse.com>
2019-08-23 13:20:52 +08:00
Kefu Chai
4deb2b90b5
Merge pull request #29146 from badone/wip-tracker-40835-OSDCap.PoolClassRNS-abort
...
osd/OSDCap: Check for empty namespace
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-23 13:16:22 +08:00
Kefu Chai
263a78c3dd
Merge pull request #25697 from Aran85/fix-onode-trim
...
os/bluestore: more aggressive deferred submit when onode trim skipping
Reviewed-by: xie xingguo <xie.xingguo@zte.com.cn>
Reviewed-by: Igor Fedotov <ifedotov@suse.com>
2019-08-23 13:15:27 +08:00
Kefu Chai
b3c1c4c1cd
Merge pull request #28488 from liuchang0812/show-pool-id-in-pool-ls-cmd
...
mon: show pool id in pool ls command
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
Reviewed-by: Sage Weil <sage@redhat.com>
2019-08-23 13:13:32 +08:00
Kefu Chai
0bbaa185a5
Merge pull request #24636 from rzarzynski/wip-denc-container_base
...
denc: slightly optimize container_base::bound_encode
Reviewed-by: Kefu Chai <kchai@redhat.com>
2019-08-23 13:12:04 +08:00
Kefu Chai
bfce110511
Merge pull request #29756 from Aran85/fix-repair-object
...
osd: clear PG_STATE_CLEAN when repair object
Reviewed-by: David Zafman <dzafman@redhat.com>
2019-08-23 13:08:49 +08:00
Sage Weil
f61b0a21d6
Merge PR #29806 into master
...
* refs/pull/29806/head:
mgr/BaseMgrModule: tolerate Int or Long for health 'count'
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-22 14:07:49 -05:00
Ali Maredia
79eb107a14
Merge pull request #29298 from zhangsw/rgw-fix-bug-listobjv2-startafter
...
rgw: continuationToken or startAfter shouldn't be returned if not specified
2019-08-22 14:12:30 -04:00
Sage Weil
d850edf0f9
Merge PR #29780 into master
...
* refs/pull/29780/head:
osd/PeeringState: semi-colon after DECLARE_LOCALS
osd/PeeringState: on_new_interval on child PG after split
Reviewed-by: Samuel Just <sjust@redhat.com>
2019-08-22 12:52:16 -05:00
Sage Weil
2dca76ac84
Merge PR #29774 into master
...
* refs/pull/29774/head:
qa/standalone/scrub/osd-scrub-snaps: snapmapper omap is now 'm'
Reviewed-by: David Zafman <dzafman@redhat.com>
2019-08-22 12:27:26 -05:00
Sage Weil
b7134f4ea9
Merge PR #29807 into master
...
* refs/pull/29807/head:
mgr/pg_autoscaler: fix race with pool deletion
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-22 12:26:11 -05:00
Patrick Donnelly
231f79030b
qa: stop DaemonWatchdog for each cluster in daemon roles
...
Fixes: https://tracker.ceph.com/issues/41398
Introduced-by: 08b99eef27
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-22 09:00:49 -07:00
Patrick Donnelly
73c7d14eab
qa: fix broken ceph.restart marking of OSDs down
...
Sage noticed `osd down` was not being performed. Bug was that the role
format had changed so splitting no longer worked correctly.
Fixes: https://tracker.ceph.com/issues/40773
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-22 08:55:52 -07:00
Casey Bodley
e131d6f496
Merge pull request #17719 from mikulely/fix-usage-stats
...
rgw: distinguish different get_usage for usage log
Reviewed-by: Robin H. Johnson <rjohnson@digitalocean.com>
2019-08-22 11:04:38 -04:00
Patrick Donnelly
aba296aab8
qa: add debugging failed osd-release setting
...
See-also: https://tracker.ceph.com/issues/40773
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2019-08-22 07:19:51 -07:00
alfonsomthd
7563f8b6d6
mgr/dashboard: run-backend-api-tests.sh CI improvements
...
As there is now a jenkins job to run this script
(see https://github.com/ceph/ceph-build/pull/1351 ),
this refactoring adapt the script to be run in a jenkins job as well as locally.
Signed-off-by: alfonsomthd <almartin@redhat.com>
2019-08-22 15:33:02 +02:00
Kefu Chai
aab5c451e1
Merge pull request #29544 from tchaikov/wip-doc-search-CSP
...
doc: always load resources via HTTPS
Reviewed-by: Tiago Melo <tmelo@suse.com>
2019-08-22 17:56:58 +08:00
Kefu Chai
eb247c943a
doc: always load resources via HTTPS
...
Signed-off-by: Tiago Melo <tmelo@suse.com>
2019-08-22 16:19:17 +08:00
Xie Xingguo
ea216e52f6
Merge pull request #29755 from xiexingguo/wip-inc-recovery-4
...
osd: do not invalidate clear_regions of missing item at boot
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2019-08-22 13:48:15 +08:00
Sage Weil
69a712ad4b
mgr/BaseMgrModule: tolerate Int or Long for health 'count'
...
Signed-off-by: Sage Weil <sage@redhat.com>
2019-08-21 17:06:32 -05:00
Andrew Schoen
f0e2c59e8c
Merge pull request #29804 from alfredodeza/wip-rm41378
...
ceph-volume tests set the noninteractive flag for Debian
Reviewed-by: Andrew Schoen <aschoen@redhat.com>
2019-08-21 16:59:18 -05:00