6. Output files produced by the base of tests

NB: The following output files are not overwritten if the base of automatic tests is run a second or a third time. To run again the tests with blank files, you will need to suppress the output files manually before.

Two types of output files are produced :

Synthesis files:

• The tests are divided into 12 main categories: PGD_GRID, PGD_PHYSIO, PGD_ECOCLIMAP, PREP, SEA, WATER, FLAKE, ISBA, TEB, CSTS, OFFLINE, CAS_PARTS.
  • For each category, in the run directory, 3 files are produced :
    • INFO_[name of the category].txt :contains the ordinary screen output of the run, with names of the test cases included
    • PLANTE_[name of the category].txt : contains the list of the test cases that finished anormally
    • END_[name of the category].txt : contains the list of the test cases that finished correctly
  • In directory TESTS/PYTHON/results , 3 more synthesis files are written :
    expe2d_NEW_PREP_and_TRUNK_73_conf.nch / syno / synn
    (following upper example for the name of the file)
    • The NCH file, following the nomenclature of the LOG files, contains, for each test case, one line by case : listN, listO, listM, listnMN, listnMO (numbers only, without lists of fields).
    • The SYNO file contains the names of the test cases that give exactly the same results (for fields common to the old and new versions)
    • The SYNN file contains the names of the test cases that don’t give the same results, with the numbers of fields that give different results.

=> All these synthesis output files are updated at the end of each test case.

Detailed outputs for each test cases :

• for each part of PGD, PREP, OFFLINE, SURFOUT, 3 files are created in directory : TESTS/PYTHON/results
  • The names of these output files are composed of :
    [name of the last directory of the run path directory]_[name of the new version]_and_[name of the old version]_conf_[name of the test case].log / .nan / .rpt
    Example : PGD/PREP//OUT_expe2d_NEW_PREP_AND_TRUNK_73_conf_TEB_SIMPLE.log
  • The LOG file contains the comparison between the numbers of fields found in output NETCDF files for old and new versions :
    • listN : number of fields found in the new version output files
    • listO : number of fields found in the old version output files
    • listM : number of fields found in both versions
    • listnMN : fields found in the new version but not in the old one, with for each field the name of the file it is in
    • listnMO : fields found in the old version but not in the new one, with for each field the name fo the file it is in
  • The NAN file contains the list of the fields found in the two versions outputs, if they are constant or if naN values are present in the old or in the new ones. In this file, columns are :
    number of the field in the list, [ naN found in the new outputs ?, naN found in the old outputs ?, maximum value of the new output minus minimum value of the old one, [name of the field, name of the corresponding file]]
  • The RPT file contains, for each field found in both output lists, old and new :
    the number of the field in the list,
    [ the maximum percentage of error between the two versions, the maximum difference, the corresponding new value, the corresponding old value, the average of the differences,
    [the name of the field, the name of the associated file]]
    => In this RPT files, fields are ordered by decreasing percentages of error.

=> All these synthesis output files are updated at the end of each test case.