Commit Graph

21 Commits

Author SHA1 Message Date
myoungwon oh
5b06232b13 qa/workunits: adjust the existing dedup test based on ceph-dedup-daemon
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2024-03-14 05:30:19 +00:00
myoungwon oh
c4275c9842 tools/ceph_dedup_tool: add a test to check the memory limit works correctly
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2023-11-03 04:18:39 +00:00
myoungwon oh
0da2318e70 qa/workunits/test_dedup_tool.sh: add snapshot test during sample dedup
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2023-10-15 03:26:05 +00:00
myoungwon oh
b2534d90ec qa/workunits/rados/test_dedup_tool.sh: reset dedup tier during tests
Dedup_tier option needs to be reset whenever every test begins,
because dedup_tier(dedup_chunk_pool) is deleted at the end of each
test---if not, this causes error in case dedup_tier's pool id is
changed.
This commit adds a set command to refresh newly added dedup_tier
pool id.

fixes: https://tracker.ceph.com/issues/58587

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2023-01-30 11:10:15 +09:00
JinyongHa
4e0add1b9a qa: add test case for sample_dedup operation of dedup_tool
Signed-off-by: JinyongHa <jy200.ha@samsung.com>
2022-08-26 00:52:01 +00:00
myoungwon oh
ea749df517 osd/,rados/: modify TIER_FLUSH to implicitly make an object a manifest object
Existing object-dedup command always creates temporary object and
perform set-chunk to make the input object manifest---this is because
current tier-flush, which is called by object-dedup, works only if
the target object is manifest, otherwise it just return 0.

So, object-dedup may not work if the target is already manifest.
Moreover, it causes unnecessary overhead if the target object is not manifest.

To solve these, this commit makes existing tier-flush to
change object's state to manifest implicitly.

With this change, the only required operation when calling object-dedup
is a tier-flush and object-dedup can work with the manifest object.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-07-28 10:22:11 +09:00
myoungwon oh
565320f04d tool/ceph-dedup-tool: add performing dedup option on cloned object
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2022-06-22 14:47:23 +09:00
myoungwon oh
16e7d5578c qa: add object-dedup test
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-12-14 13:49:45 +09:00
myoungwon oh
e7e875c547 qa: add chunk-dedup test
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-12-14 12:27:43 +09:00
myoungwon oh
dd1d563ff2 qa/test_dedup_tool: fix test cases for ceph-dedup-tool
1. add a delay after pool creation
2. fix checking output due to changed output format
3. fix wrong variable to test chunk-repair

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-11-12 13:22:48 +09:00
myoungwon oh
c1d2119d5e qa: add a test for chunk-repair command
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-10-16 01:49:30 +09:00
myoungwon oh
ed24df159c qa/workuints: add ceph_dedup_tool test for scrub refcount
Based on CDC flush, a test, which calls get/put reference,
is added.

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-03-29 17:13:28 +09:00
myoungwon oh
7217a6c00e osd, test: remove all things related to manifest_flush
Due to a plan to re-work based on CDC-based flush,
remove manifest_flush()

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsumg.com>
2020-08-26 21:05:14 +09:00
Sage Weil
84f9603d8d ceph-dedup-tool: get-chunk-ref -> dump-chunk-refs
Signed-off-by: Sage Weil <sage@newdream.net>
2020-05-27 10:44:31 -05:00
Sage Weil
a92fa51b9b ceph-dedup-tool: --add-chunk-ref -> --chunk-get-ref (and -put-ref)
Signed-off-by: Sage Weil <sage@newdream.net>
2020-05-27 10:44:31 -05:00
Sage Weil
c828e5d77c common/rabin: remove
The implementation is buggy, and slower than FastCDC.

Signed-off-by: Sage Weil <sage@newdream.net>
2020-05-27 07:48:18 -05:00
myoungwon oh
c2c29293cd src/tools: fix chunk_scrub
This commit makes chunk_scrub as a chunk_pool-based operation.
chunk_scrub procedure:
1. find references in the chunk_pool
2. check whether the reference exists in a base_pool
3. fix references

Signed-off-by: Myoungwon Oh <omwmw@sk.com>
2019-06-27 22:39:06 +09:00
myoungwon oh
8a8d5e89bb src/test: remove unused objects to calculate accurate dedup ratio.
Signed-off-by: Myoungwon Oh <ommw@sk.com>
2019-04-24 18:22:37 +09:00
myoungwon oh
d72cc5a0ee src/tools: fix dedup tool's name
Signed-off-by: Myoungwon Oh <ommw@sk.com>
2019-04-08 19:19:09 +09:00
myoungwon oh
a095765f2f qa/workunit: add rabin chunk test
Signed-off-by: Myoungwon Oh <ommw@sk.com>
2019-04-04 23:58:57 +09:00
myoungwon oh
e11fb7ce4d src/tools: add stats (fixed objects,total objects)
Signed-off-by: Myoungwon Oh <omwmw@sk.com>
2019-01-26 12:11:51 +09:00