Commit Graph

132 Commits

Author SHA1 Message Date
Patrick Donnelly
416c079d45
qa/crontab: use historically normal priorities for nightlies
Stop using --force-priority except when necessary.

Squid still gets elevated priority due to the increased attention with the
imminent release.

I've differentiated the priorities some in that release branches should get
higher priority than the main branch and that older release branches should be
prioritized over newer ones. Finally, upgrade tests should be prioritized over
other nightlies.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-03-14 15:01:53 -04:00
Patrick Donnelly
acbc26ec12
qa/crontab: simplify and minimize argument specification
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-03-11 13:46:22 -04:00
Patrick Donnelly
941eace0fc
qa/crontab: correct script paths and environment
At some point the links to the shell scripts in ceph.git were broken in the
$HOME for [1]. Unless a run was done manually with `teuthology-suite` in the
crontab, the job was basically skipped. This is probably one of the reasons
nightlies fell out of use.

I've updated the home directory according to the document (comments) in this
change. The teuthology user now has persistent clones of ceph.git and
teuthology.git. The clones are updated daily by this same crontab.

Instead of using a link in teuthology's $HOME/bin to the scripts used in this
crontab, we just have a cron variable referencing where the script should be in
the ceph.git/teuthology.git clone. Adding to this, the .bash_environment file
sources the virtualenv activate script instead of adding the teuthology binary
directory to its $PATH.

I've updated the hour for these jobs to actually be done "nightly". The first
set of jobs will be scheduled around 4pm EST. Additionally, it was necessary to
include --force-priority as some jobs are below the priority thresholds.

[1] teuthology@teuthology.front.sepia.ceph.com.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-03-11 13:45:52 -04:00
Patrick Donnelly
c8c698978e
qa: fix syntax bug with invalid 60 minute specification
Use 8 minute cycles instead.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-03-08 14:39:17 -05:00
Patrick Donnelly
81ff12566e
qa/crontab: bring back nightlies of release branches
Including squid.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-02-29 12:05:12 -05:00
Patrick Donnelly
529377b3d7
qa/crontab: update upgrade runs for squid/main
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-02-28 21:14:38 -05:00
Patrick Donnelly
176f8c52c9
qa/crontab: update reef upgrade tests
- use lower priority (higher than quincy)
- schedule around the same time weekly

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-02-28 21:14:38 -05:00
Patrick Donnelly
3a222ee2ba
qa/crontab: update quincy upgrade tests
- use lower priority
- use schedule_subset
- schedule all tests around the same time

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-02-28 21:08:01 -05:00
Patrick Donnelly
3dbb32ce15
qa/crontab: remove EOL branches
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-02-28 21:08:01 -05:00
Patrick Donnelly
8ec9e79661
qa/crontab: add spacing
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-02-28 21:08:01 -05:00
Patrick Donnelly
9f94e080cb
qa/crontab: update smoke tests for releases
Always schedule a series on Sunday at midnight + 1 hour per release (for
ordering).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2024-02-28 21:08:01 -05:00
Yuri Weinstein
060e1239dd qa/tests: enabled smoke tests on main, quincy and reef
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2023-10-19 10:26:55 -07:00
Yuri Weinstein
163f79a810 qa/tests: fixed typo and added --force-priority in missing places
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2023-10-11 15:07:02 -07:00
Yuri Weinstein
5457b5aa3e qa/tests: Added upgrade/reef-x to the mix
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2023-10-10 12:00:12 -07:00
Laura Flores
7f6c3f393e qa/crontab: check older builds on teuthology/nop when necessary
Today's scheduled run failed since the newest build of main
had failed. If we add `-n 10` to the command, this will
make it so we start at the newest build and backtrack
up to 10 older builds if necessary.

A higher number than that is not necessary, as the suite
failing to run will signal to us that more than the last
10 main builds are broken in Shaman.

Signed-off-by: Laura Flores <lflores@redhat.com>
2023-03-30 10:38:14 -05:00
Laura Flores
9fbedc6c9b qa/crontab: add reef upgrade tests and teuthology/nop
Signed-off-by: Laura Flores <lflores@redhat.com>
2023-03-24 11:15:13 -05:00
Laura Flores
39df3b8827 qa/crontab: temporarily disable teuthology cronjobs
Temporarily disable teuthology cron jobs before
the Reef dev freeze. This commit is intended to
lessen the load on the teuthology queue as we
test final patches for Reef, but should be reverted
after the dev freeze.

Signed-off-by: Laura Flores <lflores@redhat.com>
2023-02-22 23:17:19 +00:00
Yuri Weinstein
0583d631a3 qa/tests: added quincy-p2p tp the mix
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2022-12-12 11:31:52 -08:00
Brad Hubbard
532f7c9765 qa/tests: Remove octopus ceph-ansible tests
Ceph-ansible is no longer supported and octopus is EOL.

Signed-off-by: Brad Hubbard <bhubbard@redhat.com>
2022-11-11 12:05:12 +10:00
Yuri Weinstein
f3c76e0274 qa/testing: added pacific-x and quincy-x for reef release
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2022-10-05 10:20:06 -07:00
Neha Ojha
db02b786ab qa/crontab: run crimson-rados on the main branch
It isn't useful to run the crimson suite on Quincy because we don't
backport crimson fixes.

Signed-off-by: Neha Ojha <nojha@redhat.com>
2022-09-29 17:44:56 +00:00
David Galloway
c714ee5449 qa/tests: Typos and spacing
Signed-off-by: David Galloway <dgallowa@redhat.com>
2022-07-01 16:40:20 -04:00
Gabriella
99c4e068c0
teuthology-cronjobs: master->main
Signed-off-by: Gabriella Roman <gsroman@bu.edu>
2022-05-25 08:01:11 -04:00
Ionut Balutoiu
d8113881a2 qa/crontab/teuthology-cronjobs: add windows suite
Signed-off-by: Ionut Balutoiu <ibalutoiu@cloudbasesolutions.com>
2022-04-20 19:56:23 +03:00
Yuri Weinstein
600c1e18c9 qa/tests: fixed typo
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2022-03-15 16:00:20 -07:00
Yuri Weinstein
1572be9b8f qa/tests: added client upgrade suites to the crontab
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2022-03-14 08:28:37 -07:00
Yuri Weinstein
7f4292a914 qa/tests: replaced master wth quincy runs
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2022-02-16 11:36:32 -08:00
Yuri Weinstein
095f970710 qa/tests: run upgrades on quincy
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2022-01-17 10:18:04 -08:00
Yuri Weinstein
880f5ab7f9 qa/tests: switch all gibba machines to smithi
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-12-02 11:10:47 -08:00
Yuri Weinstein
69567f16f3 qa/tests: added pacific-x suite to run on master
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-10-28 16:11:50 -07:00
Yuri Weinstein
e7cea80450 qa/tests: added back octopus-x run on master
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-10-28 15:13:04 -07:00
Yuri Weinstein
a97f57796d qa/tests: removed nautilus suites as EOL, kept kcephfs and krbd suites
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-07-07 14:17:01 -07:00
Yuri Weinstein
a63e60e5db qa/tests: added client-upgrade-nautilus-pacific tests
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-05-14 08:34:27 -07:00
Yuri Weinstein
0d624465cf qa/tests: added pacific-p2p
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-05-12 09:00:06 -07:00
Yuri Weinstein
ebb2ed96a7 qa/tests: removed most of runs for nautilus as it's almost EOL
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-05-11 08:59:33 -07:00
Patrick Donnelly
7aa9b79f01
qa/crontab: reduce frequency of pacific nightlies
To once a week.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-05-03 15:14:45 -07:00
Patrick Donnelly
1605af807d
qa/crontab: reduce pacific priority
Now that it is released, we can reduce its priority to be in line with
other nightlies (but still higher, for now).

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-04-16 09:15:05 -07:00
Yuri Weinstein
86e8949963 qa/tests: reduced octopus-x jobs on master and pacific (--subset 1/10)
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-03-15 11:48:21 -07:00
Patrick Donnelly
b89f585df3
Merge PR #39874 into master
* refs/pull/39874/head:
	qa/crontab: simplify pacific cronjob def

Reviewed-by: Josh Durgin <jdurgin@redhat.com>
Reviewed-by: Yuri Weinstein <yweins@redhat.com>
2021-03-05 14:06:48 -08:00
Patrick Donnelly
a161fb33fa
qa/crontab: simplify pacific cronjob def
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-05 10:19:07 -08:00
Patrick Donnelly
a172ff9e1c
qa/crontab: set teuthology envvars in crontab
These are magically set somewhere in teuthology's startup rc files.
Instead, define them here.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-05 09:52:32 -08:00
Patrick Donnelly
1ef08db575
qa: schedule random subset
Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-04 13:43:27 -08:00
Patrick Donnelly
6863d36213
qa: allow specifying partition size for nightlies
I did some visual cleanup too but mostly this changeset is to support
specifying subsets for each suite type. For now, only "fs" suite is
using partitions different from rados.

Signed-off-by: Patrick Donnelly <pdonnell@redhat.com>
2021-03-04 13:41:34 -08:00
Yuri Weinstein
4845755730 qa/tests: moved nautilus and octopus tests to run on gibba and -p 70 for smoke tests
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-03-04 10:57:56 -08:00
Josh Durgin
ebff8322f5 qa: use --newest 100 to find a recent build
master and stable branches are only built a couple times a day now, so
we need to backtrack further.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2021-02-23 00:37:53 +00:00
Josh Durgin
45d7a30be3 qa: deprioritize master and upgrade runs
Keep pacific at high for now. Since teuthology-dispatcher locks nodes
before starting jobs, the upgrade jobs no longer need high priority to
run on more machines than average.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2021-02-23 00:34:45 +00:00
Josh Durgin
01c8e8279e qa/crontab: adjust scheduled frequencies
smoke: 3x a week on master, weekly on other branches
pacific: every 2 days
master, octopus, nautilus, upgrades: weekly

This should be a net reduction in tests each week. Currently
we schedule far more than the lab can run in a given week.

Try to balance the scheduling over the course of the week.

Signed-off-by: Josh Durgin <jdurgin@redhat.com>
2021-02-22 21:34:49 +00:00
Yuri Weinstein
a51bc72fa5 qa/tests: removed ceph-ansible (master and pacific)
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-02-03 10:04:27 -08:00
Yuri Weinstein
5795442fd5 qa/tests: changed priority - master 100, pacific 80
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-01-27 08:45:19 -08:00
Yuri Weinstein
300c7312de qa/tests: reduced octopus, nautilus, master frequency
Signed-off-by: Yuri Weinstein <yweinste@redhat.com>
2021-01-27 08:31:19 -08:00