2011-06-23 13:43:06 +00:00
|
|
|
Release Engineering Che[at|ck] List
|
|
|
|
|
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
|
2011-06-26 11:12:16 +00:00
|
|
|
* SOFTWARE TO TEST
|
2011-06-26 21:06:32 +00:00
|
|
|
Use latest libraries code base from svn and bzr
|
|
|
|
|
(see README for aditional and autodetected library dependencies)
|
|
|
|
|
Alternatively, use latest all-in-one development tarball from:
|
|
|
|
|
http://www.gnu.org/software/xorriso/
|
2011-06-26 11:12:16 +00:00
|
|
|
|
|
|
|
|
* SETUP THE TEST ENVIRONMENT
|
2011-06-26 14:47:46 +00:00
|
|
|
+ Not all TESTs are scripts (e.g. cppcheck, valgrind)
|
2011-06-26 13:10:07 +00:00
|
|
|
+ Copy all FILE.conf.template to $HOME/FILE.conf
|
|
|
|
|
+ Read the configuration files and set up accordingly
|
2011-06-26 11:12:16 +00:00
|
|
|
|
2011-06-26 14:47:46 +00:00
|
|
|
* DELIVERING A NEW TEST SCRIPT
|
2011-06-26 23:44:51 +00:00
|
|
|
+ start a new test over the top of template_new_releng
|
2011-06-26 15:26:15 +00:00
|
|
|
+ file name starts with releng_
|
2011-06-27 14:23:50 +00:00
|
|
|
+ any generated data to be stored in ./$0.result directory
|
2011-06-27 14:50:50 +00:00
|
|
|
+ test data generation options -rc [-keep]
|
|
|
|
|
+ test data removal options -cleanup
|
2011-06-26 14:47:46 +00:00
|
|
|
+ well documented configuration file test.conf{.template}
|
2011-06-26 15:52:42 +00:00
|
|
|
+ throw FAIL string to stdout if any failure is detected
|
2011-06-26 14:47:46 +00:00
|
|
|
+ exit code 0 on success, non-zero on failure
|
2011-06-26 21:06:32 +00:00
|
|
|
+ use different exit codes for any failure (10, 20, ... 100)
|
2011-06-26 11:12:16 +00:00
|
|
|
|
|
|
|
|
* TESTS LIST
|
|
|
|
|
|
2011-06-26 21:06:32 +00:00
|
|
|
TEST: releng_build_os
|
|
|
|
|
FILE: libburn/releng/releng_build_os
|
|
|
|
|
WHO: george, thomas
|
|
|
|
|
|
|
|
|
|
TEST: releng_build_isojigdo
|
|
|
|
|
FILE: libisoburn/releng/releng_build_isojigdo
|
|
|
|
|
WHO: george, thomas
|
|
|
|
|
|
|
|
|
|
TEST: releng_check_isocontent
|
|
|
|
|
FILE: libisoburn/releng/releng_check_isocontent
|
|
|
|
|
WHO: george, thomas
|
|
|
|
|
|
|
|
|
|
TEST: valgrind
|
|
|
|
|
FILE:
|
|
|
|
|
WHO: george, thomas
|
|
|
|
|
|
|
|
|
|
TEST: cppcheck
|
|
|
|
|
FILE: http://people.debian.org/~danchev/xorriso/sclogs/
|
|
|
|
|
WHO: george, thomas
|
|
|
|
|
|
|
|
|
|
TEST: buildd_logs
|
|
|
|
|
FILE: http://buildd.debian.org (others are also welcome)
|
|
|
|
|
FILE: (err/warn from prev. builds for several h/w architectures and kernels: linux, kfreebsd, hurd)
|
|
|
|
|
WHO: george, thomas
|
|
|
|
|
|
|
|
|
|
TEST: medistimator (dialog mode, size estimation, processing large trees)
|
|
|
|
|
requires some specific knowledge of how the tool works, to interpret
|
|
|
|
|
the results and compare them previous runs (see comments in the source).
|
|
|
|
|
FILE: http://anonscm.debian.org/gitweb/?p=users/danchev/medistimator.git;a=summary
|
|
|
|
|
FILE: http://people.debian.org/~danchev/medistimator/log/
|
|
|
|
|
WHO: george, thomas
|
|
|
|
|
|
|
|
|
|
TEST: gprof
|
|
|
|
|
FILE: CFLAGS=-pg ./configure && make
|
|
|
|
|
FILE: run resulting executable; gmon.out to be created in current cirectory
|
|
|
|
|
FILE: gprof path/to/xorriso gmon.out > gprof.out
|
|
|
|
|
WHO: george, thomas
|
