4
0
mirror of https://github.com/QuasarApp/openssl.git synced 2025-05-04 21:49:38 +00:00

test: document the random test ordering env variable

Reviewed-by: Tomas Mraz <tmraz@fedoraproject.org>
(Merged from https://github.com/openssl/openssl/pull/13672)
This commit is contained in:
Pauli 2020-12-12 21:38:17 +10:00
parent a21a1c23c9
commit c678f68a19

@ -148,3 +148,23 @@ for `TAP::Harness` to know more.
To run up to four tests in parallel at any given time:
$ make HARNESS_JOBS=4 test
Randomisation of Test Ordering
------------------------------
By default, the test harness will execute tests in the order they were added.
By setting the `OPENSSL_TEST_RAND_ORDER` environment variable to zero, the
test ordering will be randomised. If a randomly ordered test fails, the
seed value used will be reported. Setting the `OPENSSL_TEST_RAND_ORDER`
environment variable to this value will rerun the tests in the same
order. This assures repeatability of randomly ordered test runs.
This repeatability is independent of the operating system, processor or
platform used.
To randomise the test ordering:
$ make OPENSSL_TEST_RAND_ORDER=0 test
To run the tests using the order defined by the random seed `42`:
$ make OPENSSL_TEST_RAND_ORDER=42 test