Commit Graph

9107 Commits

Author SHA1 Message Date
Adam King
6e4dd0e082
Merge pull request #45361 from adk3798/mds-upgrade-test
qa/suites/fs: stop looping in mds upgrade test if upgrade failed

Reviewed-by: Kotresh HR <khiremat@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-03-30 18:56:45 -04:00
Sridhar Seshasayee
3aa2df2e0f qa/standalone: Fix test_activate_osd() test in ceph-helpers.sh
Modify test_activate_osd() to get the type of scheduler in use and then
verify the value of osd_max_backfills. This is because mclock scheduler
overrides this option to 1000 upon OSD initialization.

The test earlier used to pass because the OSD daemon was killed but not
marked down and upon being brought up, the wait for OSD up check was
passing quickly. But the OSD still didn't have the latest config values.

But now upon killing the OSD, the osd_fast_shutdown sequence notifies the
mon (see PR: https://github.com/ceph/ceph/pull/44807) and is marked down
and dead. Upon bringing it up, the wait for OSD up check takes a longer
time and this is sufficient for the config values to be updated. This
results in the correct values being read from the config 'Values' map.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-03-25 22:10:31 +05:30
Milind Changire
ac6c7240d3 qa: test snap_schedule with mgr restart
Scheduled snaps should follow the created schedule even across mgr
restart.

Signed-off-by: Milind Changire <mchangir@redhat.com>
2022-03-24 18:01:44 +05:30
Ilya Dryomov
f0ade57458 qa/suites/orch/cephadm: restrict test_iscsi_pids_limit to CentOS
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-03-22 21:42:41 +01:00
Teoman ONAY
de8b3c2676 cephadm: remove containers pids-limit
The default pids-limit (docker 4096/podman 2048) prevent some
customization from working (http threads on RGW) or limits the number
of luns per iscsi target.

Fixes: https://tracker.ceph.com/issues/52898
Signed-off-by: Teoman ONAY <tonay@redhat.com>
2022-03-22 21:41:26 +01:00
Adam King
37019aad80 qa/suites/fs: stop looping in mds upgrade test if upgrade failed
Signed-off-by: Adam King <adking@redhat.com>
2022-03-22 08:05:31 -04:00
Venky Shankar
88ddf3350e
Merge pull request #44491 from nmshelke/fix-46075
ceph-fuse: ignore fuse mount failure if path is already mounted

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-03-21 18:39:35 +05:30
Ilya Dryomov
90a90ad47d qa/workunits/rbd/cli_generic.sh: relax trash purge schedule status assert
Commit 08df6e0fd0 ("qa/workunits/rbd: expand LevelSpec parsing
coverage") didn't account for images with a separate data pool.  This
was missed because of small-cache-pool.yaml breakage.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-03-19 14:54:00 +01:00
Yuri Weinstein
53df8bafed
Merge pull request #45392 from sseshasa/wip-snaptrim-qos-with-mclock
mon, osd: Add snaptrim stats to the existing PG stats.

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-03-17 09:48:12 -07:00
Venky Shankar
69da8a88c0
Merge pull request #44795 from ajarr/dynamic-update-cephfs-nfs-export
mgr/nfs: allow dynamic update of cephfs nfs export

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-03-17 18:45:08 +05:30
Samuel Just
987465eea0
Merge pull request #45176 from liu-chunmei/crimson-teuthology
crimson: teuthology suite for seastore

Reviewed-by: Samuel Just <sjust@redhat.com>
2022-03-16 12:06:04 -07:00
Yuri Weinstein
531e0bb816
Merge pull request #45402 from ceph/wip-yuri-master-crontab
qa/tests: fixed typo

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-03-16 08:25:51 -07:00
Venky Shankar
8938a12542
Merge pull request #45290 from nmshelke/fix-54375
mgr/volumes: the 'mode' should honor idempotent subvolume creation

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-03-16 09:23:25 +05:30
Yuri Weinstein
600c1e18c9 qa/tests: fixed typo
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2022-03-15 16:00:20 -07:00
Ramana Raja
d7904e78d1 cephfs/test_nfs: Add test for dynamic update export
Add test to verify that the NFS servers don't restart when the
access type of a CephFS NFS export is updated.

And check the NFS servers are restarted when the pseudo path of
a CephFS NFS export is updated.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-03-15 18:27:10 -04:00
Josh Durgin
3c928d9ec3
Merge pull request #45380 from ceph/wip-yuri-master-crontab
qa/tests: added client upgrade suites to the crontab

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-03-15 14:22:54 -07:00
Sridhar Seshasayee
a86ead953d osd: Add snaptrim duration to pg dump stats.
Add the snaptrim duration to the json formatted output of the pg dump
stats. Define methods for a PG to set the snaptrim begin time and then to
calculate the total time spent to trim all the objects for the snaps in
the snap_trimq for the PG.

Tests:
  - Librados C and C++ API tests to verify the time spent for a snaptrim
    operation on a PG. These tests use the self-managed snaps APIs.
  - Standalone tests to verify snaptrim duration using rados pool snaps.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-03-16 00:33:24 +05:30
Sridhar Seshasayee
00249dc0cc mon, osd: Add objects trimmed to pg dump stats.
Add a new column, OBJECTS_TRIMMED, to the pg dump stats that shows the
number of objects trimmed when a snap is removed.

When a pg splits, the stats from the parent pg is copied to the child
pg. In such a case, reset objects_trimmed to 0 for the child pg
(see PeeringState::split_into()). Otherwise, this will result in incorrect
stats to be shown for a child pg after the split operation.

Tests:
 - Librados C and C++ API tests to verify the number of objects trimmed
   during snaptrim operation. These tests use the self-managed snaps APIs.
 - Standalone tests to verify objects trimmed using rados pool snaps.

Signed-off-by: Sridhar Seshasayee <sseshasa@redhat.com>
2022-03-16 00:30:56 +05:30
Yuri Weinstein
7bd2450f11
Merge pull request #45078 from kamoltat/wip-ksirivad-fix-target-size-ratio-bound
mon/MonCommands.h: fix target_size_ratio range

Reviewed-by: Neha Ojha <nojha@redhat.com>
2022-03-15 09:22:58 -07:00
Yuri Weinstein
1572be9b8f qa/tests: added client upgrade suites to the crontab
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2022-03-14 08:28:37 -07:00
Ramana Raja
3c22f6eb71 cephfs/test_nfs: fix _write_to_read_only_export()
... to fail the test if write to read only export succeeded.

Signed-off-by: Ramana Raja <rraja@redhat.com>
2022-03-13 20:14:50 -04:00
Yuri Weinstein
ad7a527c34
Merge pull request #44827 from ceph/wip-yuriw-crontab-master2
qa/tests: added quincy and removed master runs

Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Adam King adking@redhat.com
2022-03-13 09:10:27 -07:00
Zack Cerza
e39304dcd6
Merge pull request #45034 from ceph/cephadm-conditional-hostname
qa/tasks/cephadm: Make hostname change idempotent
2022-03-10 19:07:17 -07:00
Kamoltat Sirivadhna
5bfc71e85d
Merge pull request #45200 from kamoltat/wip-ksirivad-pg-num-max-reorder
osd/osd_types: pg_num_max reordering
Reviewed-by: Neha Ojha <nojha@redhat.com>
Reviewed-by: Josh Durgin <jdurgin@redhat.com>
2022-03-10 12:01:27 -05:00
Nikhilkumar Shelke
cc64c57c5c qa: verify idempotent subvolume creation for 'mode' argument
Fixes: https://tracker.ceph.com/issues/54375
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-03-09 11:55:14 +05:30
chunmei-liu
3cca3ed552 qa/suites/crimson-rados: add fixed-1 for seastore
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-03-08 21:29:04 -08:00
Adam King
03a0c3b384
Merge pull request #45039 from Matan-B/wip-matanb-nfs-timeout
qa/tasks/cephfs: increase timeout in test_nfs.py

Reviewed-by: Adam King <adking@redhat.com>
Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-03-08 13:31:40 -05:00
Ilya Dryomov
4ba375ea2b
Merge pull request #45149 from sunnyku/wip-fix-schedule-status
mgr/rbd_support: cast pool_id from int to str when collecting LevelSpec

Reviewed-by: Mykola Golub <mgolub@suse.com>
Reviewed-by: Ilya Dryomov <idryomov@gmail.com>
2022-03-07 12:14:36 +01:00
chunmei-liu
815300a5bd qa/suites/crimson-rados: add seastore test case
Signed-off-by: chunmei-liu <chunmei.liu@intel.com>
2022-03-07 01:35:08 -08:00
Nikhilkumar Shelke
34cf3ec723 qa: test ceph-fuse mount on already mounted path
Fixes: https://tracker.ceph.com/issues/46075
Signed-off-by: Nikhilkumar Shelke <nshelke@redhat.com>
2022-03-07 14:13:42 +05:30
Venky Shankar
c0c05efaf3
Merge pull request #42098 from joscollin/wip-B50033-rank0-stale-perf-stats
mgr/stats: be resilient to offline rank0 MDS

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-03-07 10:37:23 +05:30
Ilya Dryomov
08df6e0fd0 qa/workunits/rbd: expand LevelSpec parsing coverage
Invoke "rbd mirror snapshot schedule ls -R" and "rbd mirror snapshot
schedule status" commands on all levels, consistently.  In particular,
make sure that an image level schedule is listed for a recursive query
at the pool level both before and after the schedule kicks in:

  $ rbd create --size 1G --mirror-image-mode snapshot -p foo bar
  $ rbd mirror snapshot schedule add -p foo --image bar 1m
  $ rbd mirror snapshot schedule ls -p foo -R
  POOL  NAMESPACE  IMAGE  SCHEDULE
  foo              bar    every 1m
  <wait for schedule to become visible in status>
  $ rbd mirror snapshot schedule ls -p foo -R
  POOL  NAMESPACE  IMAGE  SCHEDULE
  foo              bar    every 1m

Also, make sure that pool and image level status queries work:

  $ rbd mirror snapshot schedule status -p foo
  SCHEDULE TIME        IMAGE
  2022-03-04 07:14:00  foo/bar
  $ rbd mirror snapshot schedule status -p foo --image bar
  SCHEDULE TIME        IMAGE
  2022-03-04 07:14:00  foo/bar

Both of these issues are fixed by the previous commit.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-03-05 11:20:33 +01:00
Kamoltat
4add5feff6 qa/workunits/mon/pg_autoscaler.sh: clean up white space
remove white space and weird indentations

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2022-03-04 16:40:07 +00:00
Kamoltat
09785475f1 qa/workunits/cephtool/test.sh: added test cases for target_size_ratio
Test the commands:

`osd pool create` <pool> --target_size_ratio <float>

`osd pool set` <pool> target_size_ratio <float>

`osd pool get` <pool> target_size_ratio

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2022-03-04 16:38:44 +00:00
Ronen Friedman
d654839222 test: osd-scrub-snaps.sh: fix expected 'missing snaps' log string
Fix the expected log message to match the scrub code, by removing
the redundant part.

Fixes: https://tracker.ceph.com/issues/54458

Signed-off-by: Ronen Friedman <rfriedma@redhat.com>
2022-03-03 08:03:00 +00:00
Kamoltat
1bc51f057f upgrade/pacific-x/parallel: Added mds.a and mds.b
Added mds daemons so that it can create
cephFS pools and set options using
`do_set_pool()` in FSCommand.cc. Such that
we can cover corner cases like that in

https://tracker.ceph.com/issues/54263

Signed-off-by: Kamoltat <ksirivad@redhat.com>
2022-03-02 22:34:21 +00:00
Yuri Weinstein
1a684be89d
Merge pull request #44656 from NitzanMordhai/fix_44092_config_get
mon/ConfigMonitor: fix config get key with whitespace

Reviewed-by: Ronen Friedman <rfriedma@redhat.com>
Reviewed-by: Patrick Donnelly <pdonnell@redhat.com>
2022-03-02 08:02:05 -08:00
Venky Shankar
fe3d543a0d
Merge pull request #44873 from kotreshhr/clone-inherit-quota-files
mgr/volumes: Inherit file quota attr to clone

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-21 14:37:44 +05:30
Venky Shankar
b8afe74b49
Merge pull request #44854 from kotreshhr/subvolumegroup_ls
mgr/volumes: Fix subvolumegroup ls

Reviewed-by: Venky Shankar <vshankar@redhat.com>
2022-02-21 14:37:03 +05:30
Christopher Hoffman
19d46b9181 qa/suites/krbd: add rbd_default_map_options override coverage
Add coverage to test precedence, override, and option merge on rbd map.

Signed-off-by: Christopher Hoffman <choffman@redhat.com>
2022-02-18 17:19:45 +01:00
Ilya Dryomov
7f391c5688 qa/suites/krbd: rename rxbounce subsuite
A new job that doesn't want ms_mode to be set underneath it is about to
be added.  Rename rxbounce to ms_modeless to make this purpose obvious.

Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-18 17:19:45 +01:00
Yuri Weinstein
7f4292a914 qa/tests: replaced master wth quincy runs
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2022-02-16 11:36:32 -08:00
Zack Cerza
0f1118e228 cephadm: Make hostname change idempotent
Inside a container, we may already have a short hostname - and also lack
the privileges to change it.

Signed-off-by: Zack Cerza <zack@redhat.com>
2022-02-16 12:13:05 -07:00
Ilya Dryomov
8f0fd0af3d qa/suites/rbd: make sure block-rbd.so is installed
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-16 12:20:44 +01:00
Kotresh HR
95a83efcbe qa: Add test for subvolumegroup ls filter
Fixes: https://tracker.ceph.com/issues/54099
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-02-16 11:49:47 +05:30
Jos Collin
116e89a2f2
qa: test ceph fs perf stats doesn't output stale metrics
That `ceph fs perf stats` doesn't output stale metrics
after the rank0 MDS failover.

Fixes: https://tracker.ceph.com/issues/50033
Signed-off-by: Jos Collin <jcollin@redhat.com>
2022-02-16 11:18:45 +05:30
Ilya Dryomov
525ff61cfc qa/tasks/qemu: make sure block-rbd.so is installed
Fixes: https://tracker.ceph.com/issues/54286
Signed-off-by: Ilya Dryomov <idryomov@gmail.com>
2022-02-15 14:57:51 +01:00
Matan Breizman
44ad552093 qa/tasks/cephfs: increase timeout in test_nfs.py
Signed-off-by: Matan Breizman <mbreizma@redhat.com>
2022-02-15 10:47:43 +00:00
Kotresh HR
96c7963404 qa: Validate file quota attrs on clone subvolume
Fixes: https://tracker.ceph.com/issues/54121
Signed-off-by: Kotresh HR <khiremat@redhat.com>
2022-02-15 13:40:17 +05:30
Adam King
c1b48ce400
Merge pull request #44917 from guits/fix_rook_smoke_nvme_loop
qa/orch: use hwe kernel in rook/smoke tests (ubuntu 20.04)

Reviewed-by: Neha Ojha nojha@redhat.com
Reviewed-by: Yuri Weinstein yweinste@redhat.com
2022-02-14 10:55:36 -05:00