haproxy/reg-tests
Willy Tarreau 26ecceaadc REGTEST: remove unexpected "nbthread" statement from Lua test cases
Lua test files 2 and 3 fail when threads are disabled because of a
"nbthread" statement that seems to be a leftover from an ancient
configuration. One of them even mentions a commit message showing
a reproducer not involving threads. Let's clean this up so that
running the tests without threads also works.

This should be backported to 1.9 as the problem also exists there.
2019-03-27 14:15:33 +01:00
..
cache REGTEST: Add option to use HTX prefixed by the macro 'no-htx' 2018-12-20 10:37:32 +01:00
checks REGTEST: Add a reg test for health-checks over SSL/TLS. 2019-01-08 10:10:18 +01:00
compression BUG/MEDIUM: compression: Rewrite strong ETags 2019-01-29 20:26:06 +01:00
connection REGTEST: fix a spurious "nbthread 4" in the connection test 2019-03-01 17:38:08 +01:00
http-capture REGTEST: "capture (request|response)" regtest. 2019-01-09 10:06:10 +01:00
http-cookies REGTEST: Add option to use HTX prefixed by the macro 'no-htx' 2018-12-20 10:37:32 +01:00
http-messaging REGTEST: Enable again reg tests with HEAD HTTP method usage. 2019-03-26 11:54:05 +01:00
http-rules REGTESTS: Basic tests for using maps to redirect requests / select backend 2019-01-14 10:52:28 +01:00
log REGTEST/MINOR: remove health-check that can make the test fail 2018-12-09 00:11:09 +01:00
lua REGTEST: remove unexpected "nbthread" statement from Lua test cases 2019-03-27 14:15:33 +01:00
mailers REGTEST: mailers: add new test for 'mailers' section 2019-01-08 10:03:52 +01:00
peers REGTEST: Peers reg tests. 2019-03-06 15:36:02 +01:00
seamless-reload REGTEST: Missing enclosing quotes for ${tmpdir} macro. 2018-12-20 11:00:17 +01:00
server REGTEST: Add option to use HTX prefixed by the macro 'no-htx' 2018-12-20 10:37:32 +01:00
spoe REGTEST/MINOR: Add a new class of regression testing files. 2018-08-23 15:47:10 +02:00
ssl REGTEST: Add option to use HTX prefixed by the macro 'no-htx' 2018-12-20 10:37:32 +01:00
stick-table REGTEST: Add option to use HTX prefixed by the macro 'no-htx' 2018-12-20 10:37:32 +01:00
webstats REGTEST: checks basic stats webpage functionality 2019-01-17 11:32:12 +01:00
README REGTEST: Adapt reg test doc files to vtest. 2019-01-14 14:24:29 +01:00

                 * Regression testing for HAProxy with VTest *


This little README file is about how to compile and run vtest test case files (VTC files)
to test HAProxy for any regression.

To do so, you will have to compile vtest program sources which depends on
Varnish cache application sources. vtest, formerly varnishtest, is a very useful
program which has been developed to test Varnish cache application. vtest has been
modified in collaboration with Varnish cache conceptor Poul-Henning Kamp to support
HAProxy in addition to Varnish cache.

See also: doc/regression-testing.txt

* vtest compilation *

    $ git clone https://github.com/vtest/VTest

    $ cd VTest

    $ make vtest

  Then vtest program may be found at the root directory of vtest sources directory.
  The Varnish cache manuals are located in 'man' directory of Varnish cache sources
  directory. You will have to have a look at varnishtest(7) and vtc(7) manuals to
  use vtest.

  Some information may also be found in doc/regression-testing.txt in HAProxy
  sources.

  Note that VTC files for Varnish cache may be found in bin/varnishtest/tests directory
  of Varnish cache sources directory which may be found here:
  https://github.com/varnishcache/varnish-cache


* vtest execution *

  You must set HAPROXY_PROGRAM environment variable to give the location
  of the HAProxy program to test to vtest:

    $ HAPROXY_PROGRAM=<my haproxy program> vtest [-Dno-htx=] ...

  The HAProxy VTC files found in HAProxy sources may be run with the reg-tests
  Makefile target. You must set the VTEST_PROGRAM environment variable to
  give the location of the vtest program which has been previously compiled.

    $ VTEST_PROGRAM=<my vtest program> make reg-tests

  "reg-tests" Makefile target run scripts/run-regtest.sh script.
  To get more information about this script run it with --help option.

  Note that vtest is run with -t10 and -l option. -l option is to keep
  keep vtest temporary directory in case of failed test cases. core files
  may be found in this directory (if enabled by ulimit).


* vtest patches for HAProxy VTC files *

  When producing a patch to add a VTC regression testing file to reg-tests directory,
  please follow these simple rules:

    - If your VTC file needs others files, if possible, use the same basename as that
      of the VTC file,
    - Put these files in a directory with the same name as the code area concerned
      by the bug ('peers', 'lua', 'acl' etc).