Read-only mirror of https://github.com/MeteoSwiss-APN/cosmoperf_checktools — MeteoSchweiz. Issues & pull requests at the source.
  • Python 60.9%
  • Ruby 35.4%
  • Shell 3.7%
Find a file
Repository files (latest commit first)
Filename Latest commit message Latest commit date
2024-05-18 22:49:53 +02:00
tools Add parsing script for YUTIMING 2018-11-19 14:06:43 +01:00
checkrun.sh Added new checker yuspecif_owm_check.sh 2017-05-15 09:14:55 +02:00
checktimings.py Fixed checkrun 2015-09-22 17:20:27 +02:00
data_assimilation_check.rb Initial commit 2015-09-22 14:47:52 +02:00
existence_grib_out.sh Initial commit 2015-09-22 14:47:52 +02:00
identical_check.py Initial commit 2015-09-22 14:47:52 +02:00
LICENSE Create LICENSE 2024-05-18 22:49:53 +02:00
output_tolerance_check.py Initial commit 2015-09-22 14:47:52 +02:00
README Initial commit 2015-09-22 14:47:52 +02:00
run_success_check.py Initial commit 2015-09-22 14:47:52 +02:00
tolerance_check.py Initial commit 2015-09-22 14:47:52 +02:00
yu.rb Initial commit 2015-09-22 14:47:52 +02:00
yuspecif_owm_check.sh Update yuspecif_owm_check.sh 2018-11-28 11:56:52 +01:00

The checkers are scripts which are called from the main testsuite.py
program. They could be written in any language and should return one of the
following exit codes:

0    MATCH     results match bit-by-bit the reference
10   OK        results match the reference within defined thresholds
15   SKIP      test not applicable and thus skipped
20   FAIL      test failed, results are outside of thresholds
30   CRASH     test failed due to model crash

The scipts can access environment variables which are set by the main
testsuite.py program: 

TS_BASEDIR      main testsuite directory (containing the testsuite.py script)   
TS_REFOUTDIR    directory containing the reference output files
TS_RUNDIR       directory where the current test was executed    
TS_LOGFILE      file containing standard output of executable
TS_VERBOSE      verbosity level (default is 1)
TS_FORCEMATCH   force bit-reproducibility for all tests