David Zafman
458babe7ee
test: Use jq in a compatible way and for easier diff analysis
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-16 08:11:24 -07:00
David Zafman
c6207d21a8
Merge pull request #21362 from dzafman/wip-hex-digest
...
osd: Change shard digests to hex like object info digests
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-12 16:07:36 -07:00
David Zafman
22ddc6da5f
osd: Change shard digests to hex like object info digests
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-12 07:59:21 -07:00
Kefu Chai
4cc3dab070
Merge pull request #21318 from badone/wip-qa-mon-misc-add-osdmap-prune-tests
...
qa/standalone/mon/misc.sh: Add osdmap-prune tests
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-11 23:08:33 +08:00
David Zafman
9c5ef19f93
test: Be smarter about when jsonschema can be used
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:52:10 -07:00
David Zafman
60ae2b8eb3
osd rados command: Show snapset in list-inconsistent-snapset
...
Add SnapSet bufferlist to inconsistent_snapset_t
Partial fix for http://tracker.ceph.com/issues/23428
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:51:48 -07:00
David Zafman
1b1d45bf51
test: Add getjson variable to save output
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
007cb45fe5
osd rados command: Change error name snapset_mismatch to snapset_error
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
0c7ac9db3b
test: Clean-up test and use local values for number of objects and osds
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
982509514c
osd rados command: list-inconsistent-obj attribute improvements
...
System attributes shown as "object_info", "snapset" and "hashinfo"
Only output user attributes as "attrs"
Drop leading undescore "_" for user attribute keys
Improve logic as to when to show user attributes or specific system attributes
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
01687b052f
osd rados command: Change "oi" to "info" in scrub handling errors
...
data_digest_mismatch_oi -> data_digest_mismatch_info
omap_digest_mismatch_oi -> omap_digest_mismatch_info
size_mismatch_oi -> size_mismatch_info
obj_size_oi_mismatch -> obj_size_info_mismatch
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
273f6213ea
osd rados command: Change "oi_attr" to "info" in scrub handling errors
...
oi_attr_missing -> info_missing
oi_attr_corrupted -> info_corrupted
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
bec67e3d40
osd rados command: Rename ss_attr_missing/ss_attr_corrupted to snapset_missing/snapset_corrupted
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
d713c7dad0
osd rados command: Improve scrub handling of HashInfo (hinfo_key xattr)
...
Fixes: http://tracker.ceph.com/issues/23364
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
David Zafman
be815f9b2b
test: Remove check that masks differences (let diff fail)
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-10 13:26:08 -07:00
Brad Hubbard
c0dac8ecd2
qa/standalone/mon/misc.sh: Add osdmap-prune tests
...
Fixes: http://tracker.ceph.com/issues/23621
Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2018-04-10 14:26:53 +10:00
Kefu Chai
9e840c4382
Merge pull request #21274 from dzafman/wip-cot-config
...
tools: Use --no-mon-config so ceph_objectstore_tool.py test doesn't hang
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-07 11:59:28 +08:00
David Zafman
a8d26122dc
tools: Use --no-mon-config so ceph_objectstore_tool.py test doesn't hang
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-06 11:52:10 -07:00
Joao Eduardo Luis
940dd941ef
Merge pull request #19331 from jecluis/wip-mon-osdmap-prune
...
mon: osdmap prune
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-04-06 15:22:28 +01:00
Joao Eduardo Luis
2ffed4c98f
qa: mon: osdmap pruning standalone/workunit
...
Keep a standalone wrapper for the workunit, so we can test it locally,
leveraging the ceph-helpers to do the setup. Keep a workunit to be
exercised by teuthology.
Signed-off-by: Joao Eduardo Luis <joao@suse.de>
2018-04-06 04:18:23 +01:00
David Zafman
5cfb8241f4
osd: Fix stale scrub stats when a primary takes over
...
Fixes: http://tracker.ceph.com/issues/23267
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-04-03 12:51:06 -07:00
David Zafman
ce9c029858
test: Eliminate use of bc (use awk) in get_timeout_delays()
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-28 10:24:33 -07:00
David Zafman
293ac9895f
test: Replace bc command with printf command
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-22 17:19:56 -07:00
Sage Weil
038afcbc2a
Merge remote-tracking branch 'gh/mimic-dev2'
2018-03-18 18:39:46 -05:00
Sage Weil
b1c045cf33
wa/standalong/mon/osd-pool-create: debug and increase delay
...
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-16 10:35:32 -05:00
Neha Ojha
7f6f4f90fe
qa: modify TEST_recovery_sizeup() to handle async recovery
...
Signed-off-by: Neha Ojha <nojha@redhat.com>
2018-03-15 11:13:34 -07:00
Sage Weil
69765a788e
qa/standalone/osd/repro_long_log: no-mon-config for cot
...
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-15 08:42:14 -05:00
David Zafman
8a7e6c2349
Merge pull request #20220 from dzafman/wip-calc-stats3
...
osd: Improve recovery stat handling by using peer_missing and missing_loc info
Reviewed-by: Sage Weil <sage@redhat.com>
2018-03-14 11:07:44 -07:00
David Zafman
af85f3cc48
test: osd-backfill-stats.sh parallel osd-recovery-stats.sh check() changes
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
acc1f80684
test: Use "(est)" in log message when an osd doesn't have peer_missing
...
Consolidate check() code and common script code
TEST_recovery_multi() wasn't reliable due to delayed peer_missing
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
12e331b742
test: osd-recovery-stats.sh: New test with different missing objs on multiple OSDs
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
09b5697ba2
test: Correction for better degraded/misplaced handling
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:11 -07:00
David Zafman
d7fd9174b9
osd: Fix for handling more than 1 missing target
...
Fix test case to test more than 1 target
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-14 10:07:03 -07:00
David Zafman
51b740ad41
test: Fail upon flush_pg_stats timeout
...
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-11 16:26:11 -07:00
Josh Durgin
1c15458a00
PrimaryLogPG: only trim up to osd_pg_log_trim_max entries at once
...
This prevents the fix for http://tracker.ceph.com/issues/22050 or
potential future bugs from causing too much latency by trimming too
many log entries at once.
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2018-03-09 19:14:28 -05:00
Josh Durgin
b50186bfe6
PG, PrimaryLogPG: trim log and rollback info for error log entries
...
Regular updates piggyback some osd state for this purpose with
MOSDRepOp[Reply]. Do the same thing for pure log entry updates (write
errors and lost/revert additions) via MOSDPGUpdateLogMissing[Reply].
Fixes: http://tracker.ceph.com/issues/22050
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2018-03-09 17:54:08 -05:00
Josh Durgin
2067f7c679
Merge pull request #20786 from dzafman/wip-zafman-log-trim
...
tools/ceph-objectstore-tool: command to trim the pg log
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-03-08 16:42:31 -08:00
Josh Durgin
b01e4ea5e2
tools: Add pg log trim command to ceph-objectstore-tool
...
Add test script that verifies the command in qa/standalone/osd
Fixes: http://tracker.ceph.com/issues/23242
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-08 15:58:55 -08:00
David Zafman
317b3d3b36
Merge pull request #20759 from dzafman/wip-cleanup
...
test: Make clearer by moving code out of loop
Reviewed-by: Greg Farnum <gfarnum@redhat.com>
2018-03-08 10:45:38 -08:00
Sage Weil
c9e974800f
qa: --no-mon-config for ceph-objectstore-tool --op mkfs ..
...
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:50 -06:00
Sage Weil
5ee5bbace1
qa/standalone: drop CEPH_LIB hacks
...
Signed-off-by: Sage Weil <sage@redhat.com>
2018-03-06 14:44:49 -06:00
David Zafman
fa5e75d046
test: Make code clearer by moving code out of loop
...
Caused by 33e747724a
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-03-06 11:30:08 -08:00
Kefu Chai
fc43ae1724
qa/standalone: s/delete_erasure_pool/delete_erasure_coded_pool/
...
it's a regression introduced by ac56a202
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-03-01 19:09:31 +08:00
Kefu Chai
ac56a202fd
qa/standalone: extract delete_pool()
...
some tests, like osd-backfill-stats.sh are using delete_pool(), but
they don't have this function defined. and this function is defined
in standalone tests separately, so would be simpler if we can
consolidate them in ceph-helper.sh.
Signed-off-by: Kefu Chai <kchai@redhat.com>
2018-02-28 15:40:28 +08:00
Josh Durgin
d1ca620698
mon/OSDMonitor: fix min_size default for replicated pools
...
This was accidentally changed to 0 by using the config value
directly in 582e567c93
Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2018-02-23 00:39:13 -05:00
David Zafman
33e747724a
osd: Add new snapset_inconsistency error check
...
Includes new test case
Caused by: 5f58301a13
This changed attr consistency checking to exclude system keys,
which required snapset to be handled just like object info.
Fixes: http://tracker.ceph.com/issues/22996
Signed-off-by: David Zafman <dzafman@redhat.com>
2018-02-15 09:03:49 -08:00
Patrick Donnelly
46c25abd1c
test/encoding: refactor to avoid escaping shell magic
...
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2018-02-07 18:03:05 -08:00
Kefu Chai
4233cc02d4
Merge pull request #19651 from yanghonggang/master
...
mon/OSDMonitor.cc: fix expected_num_objects interpret error
Reviewed-by: Joao Eduardo Luis <joao@suse.de>
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Kefu Chai <kchai@redhat.com>
2018-01-26 14:34:11 +08:00
Yang Honggang
c24f2baec9
mon/OSDMonitor.cc: fix expected_num_objects interpret error
...
Fixes: http://tracker.ceph.com/issues/22530
Signed-off-by: Yang Honggang <joseph.yang@xtaotech.com>
2018-01-21 21:00:17 -05:00
David Zafman
7ccb7b7023
Merge pull request #19850 from dzafman/wip-calc-stats
...
osd/PG: re-write of _update_calc_stats and improve pg degraded state
Fixes: http://tracker.ceph.com/issues/20059
Reviewed-by: Sage Weil <sage@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2018-01-16 11:58:49 -08:00