Commit Graph

2579 Commits

Author SHA1 Message Date
Ilya Dryomov
4ba375ea2b
Merge pull request #45149 from sunnyku/wip-fix-schedule-status
mgr/rbd_support: cast pool_id from int to str when collecting LevelSpec

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-03-07 12:14:36 +01:00
Ilya Dryomov
08df6e0fd0 qa/workunits/rbd: expand LevelSpec parsing coverage
Invoke "rbd mirror snapshot schedule ls -R" and "rbd mirror snapshot
schedule status" commands on all levels, consistently.  In particular,
make sure that an image level schedule is listed for a recursive query
at the pool level both before and after the schedule kicks in:

  $ rbd create --size 1G --mirror-image-mode snapshot -p foo bar
  $ rbd mirror snapshot schedule add -p foo --image bar 1m
  $ rbd mirror snapshot schedule ls -p foo -R
  POOL  NAMESPACE  IMAGE  SCHEDULE
  foo              bar    every 1m
  <wait for schedule to become visible in status>
  $ rbd mirror snapshot schedule ls -p foo -R
  POOL  NAMESPACE  IMAGE  SCHEDULE
  foo              bar    every 1m

Also, make sure that pool and image level status queries work:

  $ rbd mirror snapshot schedule status -p foo
  SCHEDULE TIME        IMAGE
  2022-03-04 07:14:00  foo/bar
  $ rbd mirror snapshot schedule status -p foo --image bar
  SCHEDULE TIME        IMAGE
  2022-03-04 07:14:00  foo/bar

Both of these issues are fixed by the previous commit.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-03-05 11:20:33 +01:00
Yuri Weinstein
1a684be89d
Merge pull request #44656 from NitzanMordhai/fix_44092_config_get
mon/ConfigMonitor: fix config get key with whitespace

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-03-02 08:02:05 -08:00
Ilya Dryomov
bad21fa497
Merge pull request #44842 from idryomov/wip-krbd-rxbounce-option
rbd: recognize rxbounce map option

Reviewed-by: Deepika Upadhyay <dupadhya@redhat.com>
2022-02-06 20:37:31 +01:00
Ilya Dryomov
512f8da720
Merge pull request #43910 from sunnyku/wip-rbd-snap-sched
mgr/rbd_support: fix schedule remove

Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-06 20:32:09 +01:00
Casey Bodley
ca8e0a64b1
Merge pull request #44386 from ivancich/wip-reshard-tentative-goal
rgw: in bucket reshard list, clarify new num shards is tentative

Reviewed-by: Matt Benjamin <mbenjami@redhat.com>
2022-02-04 14:54:36 -05:00
Ilya Dryomov
95d30b534e qa: krbd rxbounce test
Lives in its own directory since ms_mode doesn't need to be permuted
here.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-04 19:04:37 +01:00
Sunny Kumar
a9312d4777 qa/workunits/rbd: improve schedule add/remove cli test
This patch adds few tests to cover schedule add/remove with invalid
inputs.

Signed-off-by: Sunny Kumar <sunkumar@redhat.com>
2022-02-04 16:16:03 +00:00
Ilya Dryomov
a5eef01e92 mgr/rbd_support: level_spec is optional for schedule list/status
Commit fea6fdff4c ("mgr/rbd_support: level_spec passed to some
commands is not optional") is wrong.  While it is true that a valid
level_spec is needed to create a LevelSpec instance, an empty string
is very much a valid level spec -- it signifies "all levels".

This wasn't caught because within Ceph these commands are wrapped by
rbd CLI which injects an empty string in get_level_spec_args().

Fixes: https://tracker.ceph.com/issues/54058
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-01-30 14:22:35 +01:00
J. Eric Ivancich
aa0071ce8b rgw: in bucket reshard list, clarify new num shards is tentative
With dynamic bucket index resharding, when the average number of
objects per shard exceeds the configured value, that bucket is
scheduled for reshard. That bucket may receive more new objects before
the resharding takes place. As a result, the existing code
re-calculates the number of new shards just prior to resharding,
rather than waste a resharding opportunity with too low a value.

The same holds true for a user-scheduled resharding.

A user reported confusion that the number reported in `radosgw-admin
reshard list` wasn't the number that the reshard operation ultimately
used. This commit makes it clear that the new number of shards is
"tentative". And test_rgw_reshard.py is updated to reflect this
altered output.

Additionally this commit adds some modernization and efficiency to the
"reshard list" subcommand.

Signed-off-by: J. Eric Ivancich <ivancich@redhat.com>
2022-01-28 12:05:54 -05:00
Nitzan Mordechai
674489490f qa/workunit: Adding whitespace unit test for config set,get,rm
Update the workunit/mon/config.sh to include set/get/rm commands with and without whitespaces

Fixes: https://tracker.ceph.com/issues/44092
Signed-off-by: Nitzan Mordechai <nmordech@redhat.com>
2022-01-25 11:45:50 +02:00
Ernesto Puerta
7225b68e46
qa/dashboard: ensure node 16 is installed
For Ubuntu: https://github.com/nodesource/distributions#manual-installation

Fixes: https://tracker.ceph.com/issues/53843
Signed-off-by: Ernesto Puerta <epuertat@redhat.com>
2022-01-14 18:08:25 +01:00
Sage Weil
d2265e81fb Merge PR #44054 into master
* refs/pull/44054/head:
	doc/rados/operations: document pg_num_max
	mgr: set max of 32 pgs for .mgr pool
	mgr/dashboard: expect pg_num_max property for pools
	mon/OSDMonitor: add option --pg-num_max arg for create pool
	mon/OSDMonitor: disallow setting pg_num < min or > max
	mgr/pg_autoscaler: apply pg_num_max
	mon: add pg_num_max pool property

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-01-06 08:54:45 -05:00
Alfonso Martínez
bb56e84c71
Merge pull request #44388 from rhcs-dashboard/02-host-inventory-fix
mgr/dashboard: fix orchestrator/02-hosts-inventory.e2e failure

Reviewed-by: Waad Alkhoury <walkhour@redhat.com>
Reviewed-by: Aashish Sharma <aasharma@redhat.com>
Reviewed-by: Alfonso Martínez <almartin@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
2022-01-05 11:32:22 +01:00
Sage Weil
2d8753f4fe mon/OSDMonitor: disallow setting pg_num < min or > max
Signed-off-by: Sage Weil <sage@newdream.net>
2022-01-03 14:12:54 -05:00
Sage Weil
4439035c32 mon: add pg_num_max pool property
Signed-off-by: Sage Weil <sage@newdream.net>
2022-01-03 14:11:14 -05:00
Nizamudeen A
7b9fb258c4 mgr/dashboard: fix orchestrator/02-hosts-inventory.e2e failed.
I removed the `02-hosts-inventory.e2e` file because it is a duplicate
test of one of the test in the `01-hosts.e2e` file and fixed the error
from that file.

Also, in the inventory Identify test, we test for an element to be not
visible. According to the latest cypress docs, this should be not.exist
instead of not.visible since the cd-modal will not even be present in
the DOM

Fixes: https://tracker.ceph.com/issues/53499
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-12-31 12:56:12 +05:30
Kamoltat
bb42c71e7e qa: Added workunit test for noautoscale flag
set and unset the noautoscale flag,
evaluate if the results are what
we expected. As well as, evaluate
if the flag is correct when we
create new pools.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-22 21:42:28 +00:00
Neha Ojha
9d09a8191c
Merge pull request #44241 from kamoltat/wip-ksirivad-pool-bulk-flag
mon: osd pool create <pool-name> with --bulk flag

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2021-12-22 10:06:28 -08:00
Yuri Weinstein
7c326866e8
Merge pull request #43686 from myoungwon/wip-ceph-dedup-tool-make-dedup-obj
tool: add  chunk/object-dedup command

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-12-21 10:03:10 -08:00
Kamoltat
b218335dcc qa/workunits/cephtool: modified test.sh
Included bulk flag in the test script
such it tests the `get` and `set` of
the flag

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-20 21:46:37 +00:00
Kamoltat
c194f4a3eb qa/workunits/mon/pg_autoscaler: modified test script
Modified test scrtipt to include `bulk` and
remove all `profile` options.

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-12-20 21:46:37 +00:00
myoungwon oh
16e7d5578c qa: add object-dedup test
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-12-14 13:49:45 +09:00
myoungwon oh
e7e875c547 qa: add chunk-dedup test
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-12-14 12:27:43 +09:00
Casey Bodley
f70d24997e qa/rgw: run ceph_test_cls_rgw_gc in rgw/verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-12-09 11:07:03 -05:00
Venky Shankar
4441450a38
Merge pull request #43297 from yongseokoh/test-dir-max-entries
qa: add mds_dir_max_entries workunit test case

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2021-12-01 09:34:54 +05:30
Samuel Just
81d7403a7a
Merge pull request #43481 from myoungwon/wip-dedup-tool-repair
tool: add repair command to ceph-dedup-tool

Reviewed-by: Samuel Just <sjust@redhat.com>
2021-11-28 16:10:46 -08:00
Neha Ojha
892c3de851
Merge pull request #43875 from liewegas/ceph-cli-better-help
ceph: make -h/--help show match when some args are supplied

Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2021-11-24 09:17:11 -08:00
Casey Bodley
1f8bdd2ddf
Merge pull request #43843 from cbodley/wip-test-cls-rgw-stats
test/cls/rgw: add index transaction simulator to model bucket stats

Reviewed-by: J. Eric Ivancich <ivancich@redhat.com>
2021-11-22 10:59:39 -05:00
Kamoltat
a9f9f7b3fd pybind/mgr/pg_autoscale: revert to default profile scale-up
pg_autoscale module will now start out all the pools
with a scale-up profile by default.

Added tests in workunits/mon/pg_autoscaler.sh
to evaluate if the default pool creation is
a scale-up profile

Updated documentation and release notes to
reflect the change in the default behavior
of the pg_autoscale profile.

Fixes: https://tracker.ceph.com/issues/53309

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2021-11-19 18:55:36 +00:00
Casey Bodley
2ed55af056 qa/rgw: run ceph_test_cls_rgw_stats in rgw/verify suite
Signed-off-by: Casey Bodley <cbodley@redhat.com>
2021-11-19 12:13:38 -05:00
myoungwon oh
dd1d563ff2 qa/test_dedup_tool: fix test cases for ceph-dedup-tool
1. add a delay after pool creation
2. fix checking output due to changed output format
3. fix wrong variable to test chunk-repair

Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-11-12 13:22:48 +09:00
Sage Weil
f988b2a833 ceph: make -h/--help show match when some args are supplied
Currently,

 # ceph orch ls -h
 ...
 orch ls [<service_type>] [<service_name>] [--export] [--  List services known to orchestrator
  format {plain|json|json-pretty|yaml}] [--refresh]
 # ceph orch ls osd -h
 ... nothing ...

because the CLI is provided more arguments than the command prefix.  Make
-h drop right-hand args until we get at least one prefix match.  This
means we can have a partial command written with some args and add -h to
get a usage for that command.

Signed-off-by: Sage Weil <sage@newdream.net>
2021-11-10 16:30:47 -05:00
Venky Shankar
e7bdf7fb35 test: add cephfs-mirror HA active/active workunit and test yamls
Fixes: http://tracker.ceph.com/issues/50372
Signed-off-by: Venky Shankar <vshankar@redhat.com>
2021-11-09 02:03:32 -05:00
Yongseok Oh
1bb9abbe5d qa: add mds_dir_max_entries workunit test case
Fixes: https://tracker.ceph.com/issues/52725

Signed-off-by: Yongseok Oh <yongseok.oh@linecorp.com>
2021-11-03 12:37:04 +00:00
Prasanna Kumar Kalever
2adfe55bcc qa/workunits/rbd: test map/attach with --show-cookie/--cookie options
Signed-off-by: Prasanna Kumar Kalever <prasanna.kalever@redhat.com>
2021-10-26 19:24:13 +05:30
Mykola Golub
8c646721c2
Merge pull request #41696 from MrFreezeex/fix-rbd-mirror-remove
rbd-mirror: fix mirror image removal

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-10-25 18:12:38 +03:00
myoungwon oh
c1d2119d5e qa: add a test for chunk-repair command
Signed-off-by: Myoungwon Oh <myoungwon.oh@samsung.com>
2021-10-16 01:49:30 +09:00
Ernesto Puerta
f947e6ec67
Merge pull request #42821 from rhcs-dashboard/force-maintenance-workflow
mgr/dashboard: Move force maintenance test to the workflow test suite 

Reviewed-by: Avan Thakkar <athakkar@redhat.com>
Reviewed-by: Ernesto Puerta <epuertat@redhat.com>
Reviewed-by: Nizamudeen A <nia@redhat.com>
Reviewed-by: Pere Diaz Bou <pdiazbou@redhat.com>
2021-09-29 13:36:45 +02:00
Nizamudeen A
e33d9e15b9 mgr/dashboard: Move force maintenance test to the workflow test suite
Fixes: https://tracker.ceph.com/issues/52276
Signed-off-by: Nizamudeen A <nia@redhat.com>
2021-09-28 14:17:20 +05:30
Adam King
35f895aa45 mgr/cephadm: remove cephadm exporter code
It's functionality has been effectively replaced by the cephadm agent

Signed-off-by: Adam King <adking@redhat.com>
2021-09-27 12:11:55 -04:00
Ilya Dryomov
75824a113b
Merge pull request #43228 from idryomov/wip-rbd-mirror-snapshot-rx-only
rbd-mirror: unbreak one-way snapshot-based mirroring

Reviewed-by: Mykola Golub <mgolub@suse.com>
2021-09-25 10:58:17 +02:00
Ilya Dryomov
366e9c51a8 qa/suites/rbd: test case for one-way snapshot-based mirroring
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2021-09-24 12:30:14 +02:00
Matt Benjamin
221fdb858b workunits/rgw: semicolon terminates perl statements
Fixes a lexical error in one line of code added in
90e9307ab0, removing the dependency
on lsb_release, on 8/16/2021.

Fixes: https://tracker.ceph.com/issues/52613

Signed-off-by: Matt Benjamin <mbenjamin@redhat.com>
2021-09-14 17:13:49 -04:00
Neha Ojha
de8a68b768
Merge pull request #41912 from trociny/wip-crushdiff
tools/crushdiff: new tool to test crushmap change

Reviewed-by: Neha Ojha <nojha@redhat.com>
2021-08-31 14:18:37 -07:00
Mykola Golub
7311f6656f qa/suites/rados: add crushdiff test
Signed-off-by: Mykola Golub <mykola.golub@clyso.com>
2021-08-27 17:45:40 +03:00
Ken Dreyer
65f4d6eb36 workunits/rbd: remove lsb_release
The lsb_release utility brings in a lot of other dependencies. Remove
it from the RBD workunit script.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2021-08-18 13:08:24 -04:00
Ken Dreyer
db66f6f357 workunits/rgw: remove lsb_release
The lsb_release utility brings in a lot of other dependencies. Remove
it from the RGW workunit Perl scripts.

Signed-off-by: Ken Dreyer <kdreyer@redhat.com>
2021-08-18 13:08:24 -04:00
Arthur Outhenin-Chalandre
e135403c73
rbd-mirror: add image_map cleanup in LoadRequest
In the LoadRequest in the ImageMap class add initial cleanup to remove
stale entries. To cleanup the LoadRequest will query the mirror image
list and remove all the image_map that are notin the list.

Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
2021-08-18 18:52:37 +02:00
Arthur Outhenin-Chalandre
4db66da512
qa/rbd-mirror: add OMAP cleanup checks
This make sure that all images are deleted in the existing qa scripts
and checks if all rbd-mirror metadata in OMAP are correctly deleted.

Signed-off-by: Arthur Outhenin-Chalandre <arthur.outhenin-chalandre@cern.ch>
2021-08-18 18:50:44 +02:00