fluster – Testing framework for video decoder conformance

       fluster is developed by Pablo Marcos Oltra, Andoni Morales Alastruey and contributors.

       This manual page was written by Christopher Obbard <obbardc@debian.org> for the Debian  GNU/Linux  system
       (but may be used by others).

                                                                                                      FLUSTER(1)

fluster is a testing framework written in Python for video decoder conformance.  It is composed of a com‐
       mand-line application that runs a number of test suites with the supported decoders.  Its purpose  is  to
       check  different decoder implementations against known test suites with known and proven results.  It was
       originally designed to check the conformance of H.265/HEVC decoders,  but  it  also  supports  H.264/AVC,
       H.266/VVC, VP8, VP9, AV1 and AAC.

list(l)
              Show a list of available test suites and decoders.

       run(r)
              Run test suites for decoders.

              Options:

              -jJOBS, --jobsJOBS
                     Number of parallel jobs to use.  1x logical cores by default.  0 means all logical cores.

              -tTIMEOUT, --timeoutTIMEOUT
                     Timeout in secs for each decoding.  Defaults to 30 secs.

              -ff, --failfast
                     Stop after first fail.

              -q, --quiet
                     Don’t show every test run.

              -tsTESTSUITES, --testsuitesTESTSUITES
                     Run only the specific test suites.

              -tvTESTVECTORS, --testvectorsTESTVECTORS
                     Run only the specific test vectors.

              -dDECODERS, --decodersDECODERS
                     Run only the specific decoders.

              -s, --summary
                     Generate a summary in Markdown format for each test suite.

              -soSUMMARY_OUTPUT, --summary-outputSUMMARY_OUTPUT
                     Dump summary output to file.

              -f{md,csv,junitxml}, --format{md,csv,junitxml}
                     Specify the format for the summary file.

              -k, --keep
                     Keep output files generated during the test.

              -thTHRESHOLD, --thresholdTHRESHOLD
                     Set exit code to 2 if threshold tests are not success.  Exit code is 0 otherwise.

              -tthTIME_THRESHOLD, --time-thresholdTIME_THRESHOLD
                     Set  exit code to 3 if test suite takes longer than threshold seconds.  Exit code is 0 oth‐
                     erwise.

              -v, --verbose
                     Show stdout and stderr of commands executed.

       download(d)testsuites
              Downloads test suites resources.

              Arguments:
                     testsuites List of testsuites to download.  Defaults to all.

              Options:

              -jJOBS, --jobsJOBS
                     Number of parallel jobs to use.  2x logical cores by default.  0 means all logical cores.

              -k, --keep
                     Keep original downloaded file after extracting.  Only applicable to compressed  files  such
                     as .zip, .tar.gz, etc

       reference(r)
              Use a specific decoder to set its results for the test suites given.

              Options:

              -jJOBS, --jobsJOBS
                     Number of parallel jobs to use.  1x logical cores by default.  0 means all logical cores.

              -tTIMEOUT, --timeoutTIMEOUT
                     Timeout in secs for each decoding.  Defaults to 30 secs.

              -ff, --failfast
                     Stop after first fail.

              -q, --quiet
                     Don’t show every test run.

              -tsTESTSUITES, --testsuitesTESTSUITES
                     Run only the specific test suites.

              -tvTESTVECTORS, --testvectorsTESTVECTORS
                     Run only the specific test vectors.

              -dDECODERS, --decodersDECODERS
                     Run only the specific decoders.

              -s, --summary
                     Generate a summary in Markdown format for each test suite.

              -soSUMMARY_OUTPUT, --summary-outputSUMMARY_OUTPUT
                     Dump summary output to file.

              -f{md,csv,junitxml}, --format{md,csv,junitxml}
                     Specify the format for the summary file.

              -k, --keep
                     Keep output files generated during the test.

              -thTHRESHOLD, --thresholdTHRESHOLD
                     Set exit code to 2 if threshold tests are not success.  Exit code is 0 otherwise.

              -tthTIME_THRESHOLD, --time-thresholdTIME_THRESHOLD
                     Set  exit code to 3 if test suite takes longer than threshold seconds.  Exit code is 0 oth‐
                     erwise.

              -v, --verbose
                     Show stdout and stderr of commands executed.

       fluster – Testing framework for video decoder conformance

-h, --help
              Show help message and exit.

       -rRESOURCES, --resourcesRESOURCES
              Set the directory where resources are taken from.

       -oOUTPUT, --outputOUTPUT
              Set the directory where test results will be stored.

       -neOUTPUT, --no-emoji
              Set to use plain text instead of emojis.

       -tsdTEST_SUITES_DIR, --test-suites-dirTEST_SUITES_DIR
              Set the directory where test suite will be read from.

fluster  [-h]  [-rRESOURCES]  [-oOUTPUT] [-ne] [-tsdTEST_SUITES_DIR] {list,l,run,r,download,d,refer‐ence,f}