RepoMirrors/haproxy
1
0
Fork 0
mirror of http://git.haproxy.org/git/haproxy.git/ synced 2024-12-20 10:40:13 +00:00
Code Issues Packages Projects Releases Wiki Activity
511ddd5785
haproxy/reg-tests/converter/json_query.vtc

101 lines
3.0 KiB
Plaintext
Raw Normal View History

MINOR: sample: converter: Add json_query converter With the json_query can a JSON value be extacted from a header or body of the request and saved to a variable. This converter makes it possible to handle some JSON workload to route requests to different backends.
2021-04-15 14:45:15 +00:00
varnishtest "JSON Query converters Test"
#REQUIRE_VERSION=2.4
feature ignore_unknown_macro
server s1 {
rxreq
txresp
} -repeat 8 -start
haproxy h1 -conf {
REGTESTS: disable inter-thread idle connection sharing on sensitive tests Some regtests involve multiple requests from multiple clients, which can be dispatched as multiple requests to a server. It turns out that the idle connection sharing works so well that very quickly few connections are used, and regularly some of the remaining idle server connections time out at the moment they were going to be reused, causing those random "HTTP header incomplete" traces in the logs that make them fail often. In the end this is only an artefact of the test environment. And indeed, some tests like normalize-uri which perform a lot of reuse fail very often, about 20-30% of the times in the CI, and 100% of the time in local when running 1000 tests in a row. Others like ubase64, sample_fetches or vary_* fail less often but still a lot in tests. This patch addresses this by adding "tune.idle-pool.shared off" to all tests which have at least twice as many requests as clients. It proves very effective as no single error happens on normalize-uri anymore after 10000 tests. Also 100 full runs of all tests yield no error anymore. One test is tricky, http_abortonclose, it used to fail ~10 times per 1000 runs and with this workaround still fails once every 1000 runs. But the test is complex and there's a warning in it mentioning a possible issue when run in parallel due to a port reuse.
2021-05-09 12:41:41 +00:00
global
# WT: limit false-positives causing "HTTP header incomplete" due to
# idle server connections being randomly used and randomly expiring
# under us.
tune.idle-pool.shared off
MINOR: sample: converter: Add json_query converter With the json_query can a JSON value be extacted from a header or body of the request and saved to a variable. This converter makes it possible to handle some JSON workload to route requests to different backends.
2021-04-15 14:45:15 +00:00
defaults
mode http
REGTESTS: extend the default I/O timeouts and make them overridable With the CI occasionally slowing down, we're starting to see again some spurious failures despite the long 1-second timeouts. This reports false positives that are disturbing and doesn't provide as much value as this could. However at this delay it already becomes a pain for developers to wait for the tests to complete. This commit adds support for the new environment variable HAPROXY_TEST_TIMEOUT that will allow anyone to modify the connect, client and server timeouts. It was set to 5 seconds by default, which should be plenty for quite some time in the CI. All relevant values that were 200ms or above were replaced by this one. A few larger values were left as they are special. One test for the set-timeout action that used to rely on a fixed 1-sec value was extended to a fixed 5-sec, as the timeout is normally not reached, but it needs to be known to compare the old and new values.
2021-11-18 16:46:22 +00:00
timeout connect "${HAPROXY_TEST_TIMEOUT-5s}"
timeout client "${HAPROXY_TEST_TIMEOUT-5s}"
timeout server "${HAPROXY_TEST_TIMEOUT-5s}"
MINOR: sample: converter: Add json_query converter With the json_query can a JSON value be extacted from a header or body of the request and saved to a variable. This converter makes it possible to handle some JSON workload to route requests to different backends.
2021-04-15 14:45:15 +00:00
option http-buffer-request
frontend fe
bind "fd@${fe}"
tcp-request inspect-delay 1s
http-request set-var(sess.header_json) req.hdr(Authorization),json_query('$.iss')
http-request set-var(sess.pay_json) req.body,json_query('$.iss')
http-request set-var(sess.pay_int) req.body,json_query('$.integer',"int"),add(1)
http-request set-var(sess.pay_neg_int) req.body,json_query('$.negativ-integer',"int"),add(1)
http-request set-var(sess.pay_double) req.body,json_query('$.double')
http-request set-var(sess.pay_boolean_true) req.body,json_query('$.boolean-true')
http-request set-var(sess.pay_boolean_false) req.body,json_query('$.boolean-false')
http-request set-var(sess.pay_mykey) req.body,json_query('$.my\\.key')
http-response set-header x-var_header %[var(sess.header_json)]
http-response set-header x-var_body %[var(sess.pay_json)]
http-response set-header x-var_body_int %[var(sess.pay_int)]
http-response set-header x-var_body_neg_int %[var(sess.pay_neg_int)]
http-response set-header x-var_body_double %[var(sess.pay_double)]
http-response set-header x-var_body_boolean_true %[var(sess.pay_boolean_true)]
http-response set-header x-var_body_boolean_false %[var(sess.pay_boolean_false)]
http-response set-header x-var_body_mykey %[var(sess.pay_mykey)]
default_backend be
backend be
server s1 ${s1_addr}:${s1_port}
} -start
client c1 -connect ${h1_fe_sock} {
txreq -url "/" \
-hdr "Authorization: {\"iss\":\"kubernetes.io/serviceaccount\"}"
rxresp
expect resp.status == 200
expect resp.http.x-var_header ~ "kubernetes.io/serviceaccount"
txreq -url "/" \
-body "{\"iss\":\"kubernetes.io/serviceaccount\"}"
rxresp
expect resp.status == 200
expect resp.http.x-var_body ~ "kubernetes.io/serviceaccount"
txreq -url "/" \
-body "{\"integer\":4}"
rxresp
expect resp.status == 200
expect resp.http.x-var_body_int ~ "5"
txreq -url "/" \
-body "{\"integer\":-4}"
rxresp
expect resp.status == 200
expect resp.http.x-var_body_int ~ "-3"
txreq -url "/" \
-body "{\"double\":4.5}"
rxresp
expect resp.status == 200
expect resp.http.x-var_body_double ~ "4.5"
txreq -url "/" \
-body "{\"boolean-true\":true}"
rxresp
expect resp.status == 200
expect resp.http.x-var_body_boolean_true == 1
txreq -url "/" \
-body "{\"boolean-false\":false}"
rxresp
expect resp.status == 200
expect resp.http.x-var_body_boolean_false == 0
txreq -url "/" \
-body "{\"my.key\":\"myvalue\"}"
rxresp
expect resp.status == 200
expect resp.http.x-var_body_mykey ~ "myvalue"
} -run
Reference in New Issue Copy Permalink