libisoburn/releng
George Danchev 7d4aac4a84 use self basename; sort numerically to get minimal determinism 2011-06-27 19:23:14 +00:00
..
README.releng add prescription of running tests 2011-06-27 17:45:00 +00:00
TODO Added rules to releng/TODO, new options -keep, -clean_up, deprecated -clean 2011-06-27 12:06:41 +00:00
releng_build_isojigdo use basename for self 2011-06-27 18:06:29 +00:00
releng_build_isojigdo.conf.template added few comments 2011-06-25 16:18:39 +00:00
releng_check_isocontent added sketch sample, formatting 2011-06-26 20:51:16 +00:00
releng_check_isocontent.conf.template isocontent emplty confing file 2011-06-25 16:59:07 +00:00
run_all_releng use self basename; sort numerically to get minimal determinism 2011-06-27 19:23:14 +00:00
template_new_releng add -cleanup to the template script accordingly 2011-06-27 14:56:36 +00:00
test_hardlinks Polished hardlink test 2011-06-27 16:55:37 +00:00

README.releng

Release Engineering Che[at|ck] List
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
* SOFTWARE TO TEST
 Use latest libraries code base from svn and bzr
 (see README for aditional and autodetected library dependencies)
 Alternatively, use latest all-in-one development tarball from:
 http://www.gnu.org/software/xorriso/

* SETUP THE TEST ENVIRONMENT
 + Not all TESTs are scripts (e.g. cppcheck, valgrind)
 + Copy all FILE.conf.template to $HOME/FILE.conf
 + Read the configuration files and set up accordingly

* DELIVERING A NEW TEST SCRIPT
 + start a new test over the top of template_new_releng
 + file name starts with releng_
 + any generated data to be stored in ./$0.result directory
 + test data generation options -rc [-keep]
 + test data removal options -cleanup
 + well documented configuration file test.conf{.template}
 + throw FAIL string to stdout if any failure is detected
 + exit code 0 on success, non-zero on failure
 + use different exit codes for any failure (10, 20, ... 100)

* RUNNING TESTS
 + All tests have to be run from the releng/ directory, within
   libisoburn source tree.

* TESTS LIST

 TEST: releng_build_os
 FILE: libburn/releng/releng_build_os
 WHO:  george, thomas

 TEST: releng_build_isojigdo
 FILE: libisoburn/releng/releng_build_isojigdo
 WHO:  george, thomas

 TEST: releng_check_isocontent
 FILE: libisoburn/releng/releng_check_isocontent
 WHO:  george, thomas

 TEST: valgrind
 FILE:
 WHO:  george, thomas

 TEST: cppcheck
 FILE: http://people.debian.org/~danchev/xorriso/sclogs/
 WHO:  george, thomas

 TEST: buildd_logs
 FILE: http://buildd.debian.org (others are also welcome)
 FILE: (err/warn from prev. builds for several h/w architectures and kernels: linux, kfreebsd, hurd)
 WHO:  george, thomas

 TEST: medistimator (dialog mode, size estimation, processing large trees)
       requires some specific knowledge of how the tool works, to interpret
       the results and compare them previous runs (see comments in the source).
 FILE: http://anonscm.debian.org/gitweb/?p=users/danchev/medistimator.git;a=summary
 FILE: http://people.debian.org/~danchev/medistimator/log/
 WHO:  george, thomas

 TEST: gprof
 FILE: CFLAGS=-pg ./configure && make
 FILE: run resulting executable; gmon.out to be created in current cirectory
 FILE: gprof path/to/xorriso gmon.out  > gprof.out
 WHO:  george, thomas