Commentator2.0
f7914e89e6
This creates a framework similar to the old lang.sh from functional. Some notable changes: - instead of having a .flags file, a test.toml can declare flags - additionally the test.toml can also declare extra files and multiple runners for the given input file. - there won't be any old tests hanging around anymore which weren't deleted properly in the installation - all files for a single test are defined decleratively and there won't be any residues Tests can be placed within the functional2/lang folder most migrations should be rather clean Implements: #825 Change-Id: I5f9149903ec5b078008969a4ae77305417c11475
36 lines
1.3 KiB
Meson
36 lines
1.3 KiB
Meson
xdist_opts = [
|
|
# auto number of workers, max 12 jobs
|
|
'-n', 'auto', '--maxprocesses=12',
|
|
# Distributes tests evenly at first and then, if workers run out of tests, they steal from a different worker
|
|
# This is useful here, due to differing durations of tests, especially when tests check timeout functionality
|
|
#
|
|
# grouping by module/file is disadventageous here too, as all lang tests are executed from the same module
|
|
# which would result in high run times for that single worker while everything else is bored
|
|
'--dist=worksteal',
|
|
]
|
|
|
|
# surprisingly, this actually works even if PATH is set to something before
|
|
# meson gets hold of it. neat!
|
|
functional2_env = environment()
|
|
functional2_env.prepend('PATH', bindir)
|
|
|
|
test(
|
|
'functional2',
|
|
python,
|
|
args : [
|
|
'-m', 'pytest',
|
|
'-v',
|
|
# Print out summaries of **f**ailed, **E**rrored and **s**kipped tests
|
|
'-r', 'fEs',
|
|
xdist_opts,
|
|
meson.current_source_dir()
|
|
],
|
|
env : functional2_env,
|
|
# FIXME: Although we can trivially use TAP here with pytest-tap, due to a meson bug, it is unusable.
|
|
# (failure output does not get displayed to the console. at all. someone should go fix it):
|
|
# https://github.com/mesonbuild/meson/issues/11185
|
|
# protocol : 'tap',
|
|
suite : 'installcheck',
|
|
timeout : 300,
|
|
)
|