openssl/test/run_tests.pl, branch dependabot/github_actions/actions/setup-python-7

test/run_tests.pl: return error if running a non-existent test

2026-06-26T16:38:15Z

Resolves: https://github.com/openssl/openssl/issues/15510 Assisted-by: Claude:claude-sonnet-4-6 Reviewed-by: Neil Horman Reviewed-by: Bob Beck Reviewed-by: Norbert Pocs Reviewed-by: Eugene Syromiatnikov MergeDate: Fri Jun 26 16:40:23 2026 (Merged from https://github.com/openssl/openssl/pull/31639)

test/run_tests.pl: Ensure that all HARNESS_VERBOSE values are respected

2025-12-19T14:55:34Z

... with perl truthiness in mind Most of all, this means not having undue expectations that its value is numerical (this is particularly true when HARNESS_VERBOSE isn't given by the user, and this script's default is "yes"). We do this by ensuring that $tap_verbosity is turned into an appropriate number if HARNESS_VERBOSE's value isn't numerical. Reviewed-by: Saša Nedvědický Reviewed-by: Tomas Mraz (Merged from https://github.com/openssl/openssl/pull/29443)

Make the test output show how long each test takes by default.

2025-12-17T12:09:52Z

Unless we have reduced the verbosity level, or overridden it with a HARNESS_TIMER setting. This makes it easier to realize when you are making a test that is starting to dominate testing time for developers, and makes it easier for developers to see it. For: https://github.com/openssl/project/issues/1767 Reviewed-by: Neil Horman Reviewed-by: Saša Nedvědický Reviewed-by: Paul Dale (Merged from https://github.com/openssl/openssl/pull/29408)

Additonal removals of engine references in tests/*

2025-12-04T12:31:06Z

Spotted by @andrewkdinh, some extra notes about/useages of engines that are now vestigial. Reviewed-by: Richard Levitte Reviewed-by: Tomas Mraz Reviewed-by: Saša Nedvědický Reviewed-by: Eugene Syromiatnikov Reviewed-by: Matt Caswell Reviewed-by: Norbert Pocs (Merged from https://github.com/openssl/openssl/pull/29305)

Make tests run faster on typical platforms.

2025-09-25T14:55:50Z

Sadly not doable in make as it is notoriously bad at telling you the parallelism being used by make -j. If the HARNESS_JOBS environment variable has not been set, this makes the perl script attempt to figure out how many cpu's are available on anything windows/linux/macos/bsd like, and if it can be successfully detected, we use that value. if not, we use 1 as before. Reviewed-by: Richard Levitte Reviewed-by: Tom Cosgrove (Merged from https://github.com/openssl/openssl/pull/28426)

Use GH action commands to group/collapse filtered output

2023-12-21T14:05:42Z

Reviewed-by: Tomas Mraz Reviewed-by: Matt Caswell (Merged from https://github.com/openssl/openssl/pull/22678)

augment test/run_tests.pl to filter indirect leaks

2023-12-21T14:05:42Z

When verbosity isn't set to 1 or higher, suppress indirect leaks (i.e. only print direct leaks) to make output more human-readable. Setting V=1 on make test produces all leaks (direct and indirect) Reviewed-by: Tomas Mraz Reviewed-by: Matt Caswell (Merged from https://github.com/openssl/openssl/pull/22678)

Update copyright year

2022-05-03T12:34:51Z

Reviewed-by: Tomas Mraz Release: yes

Fix test failure when testing with Test::Harness

2022-03-09T08:46:09Z

Fixes an issue where, when the test suite was being run with the older Test::Harness package, the test suite would not complete correctly due to evaluation of $harness->runtests()->has_errors, which is only available for the newer TAP::Parser::Aggregator code path. Fixes #17818. Reviewed-by: Paul Dale Reviewed-by: Richard Levitte Reviewed-by: Tomas Mraz (Merged from https://github.com/openssl/openssl/pull/17823)

Perturb the malloc output during tests

2022-03-03T13:36:21Z

Set the environment variable MALLOC_PERTURB_ during tests to perturb the output from OPENSSL_malloc() calls (see the mallopt man page for details about this environment variable). This could be a low cost way of spotting uninit reads in "make test" runs in some situations. In tests I have found it to be a little unreliable (sometimes it seemed to not perturb the output for inexplicable reasons) - but since this is easy to implement I think it is worthwhile. Reviewed-by: Tomas Mraz Reviewed-by: Paul Dale (Merged from https://github.com/openssl/openssl/pull/17768)