Beginning to create a test suite for libisoburn and xorriso

libisoburn/trunk/releng/README.releng

@@ -0,0 +1,74 @@
+From danchev@spnet.net Tue Jun 21 18:33:30 2011
+Date: Tue, 21 Jun 2011 19:22:08 +0300
+From: George Danchev <danchev@spnet.net>
+To:  <libburn-hackers@pykix.org>
+Subject: [Libburn-hackers] cheat tests proposal
+
+Hi,
+
+Here is a cheat list of performance tests I have in my mind for testing the 
+whole thing, for instance before release. This list does not depreciate the 
+practical use case pattern of a potential user or developer might happen to 
+have. The are put together to second-guess he potential testers, and anyone 
+can perform them at will (even partially) on a best effort fashion. I won't go 
+that deep to assign them artificial weights or priority.
+
+1) Various compilation tests, like:
+export CPPFLAGS=-DLibburn_use_sg_dummY; ./configure
+repeat for the adapters of the all target OSes, there should be other 
+interesting macros, static check logs can easily reveal them:-)
+This can be scripted of course.
+
+2) Inspect the static check logs:
+(revision numbers are well indicated)
+http://people.debian.org/~danchev/xorriso/sclogs/
+
+3) Inspect previous versions build daemon logs (various architectures, three 
+kernels: linux, kfreebsd, hurd) for interesting compiler warnings or errors:
+http://buildd.debian.org
+I'm sure I've seen FreeBSD public build logs before, but my searching fails so 
+far!
+
+4) Testing xorriso in dialog mode:
+perhaps this 'proof of concept' toy could be helpful:
+http://anonscm.debian.org/gitweb/?p=users/danchev/medistimator.git;a=summary
+this requires some specific knowledge of how the tool works (there are 
+hopefully very helpful comments in the source), to interpret the results and 
+compare them with the previous runs; my logs could be found at:
+http://people.debian.org/~danchev/medistimator/log/
+the aim is to catch speed performace hits, corectness of results, crashes, etc 
+when working on various input data trees, like very large BD-sized ones.
+
+5) Profiling tests with gprof. We did that once :-)
+
+Each of these tests has already caught a flaw or another, so they are stolen 
+from the past experience we already had. The list of course if open for adding 
+more interesting checks, like real burning ones for instance. I'm sure I 
+forgot at least one, since I had 6 in mind... Alois....
+
+6) jigdo production.
+
+I'll try to simplify a run like that one:
+
+xorriso -as mkisofs -r
+ -checksum_algorithm_iso md5,sha1,sha256,sha512
+ -V 'Debian testing amd64 1'
+ -o /org/cdbuilder.debian.org/dst/deb-cd/out/sidamd64/debian-testing-amd64-CD-1.iso
+ -jigdo-jigdo /org/cdbuilder.debian.org/dst/deb-cd/out/sidamd64/debian-testing-amd64-CD-1.jigdo
+ -jigdo-template /org/cdbuilder.debian.org/dst/deb-cd/out/sidamd64/debian-testing-amd64-CD-1.template
+ -jigdo-map Debian=/org/cdbuilder.debian.org/src/ftp/debian/
+ -jigdo-exclude boot1 -md5-list /org/cdbuilder.debian.org/src/deb-cd/tmp/sidamd64/wheezy/md5-check
+ -jigdo-min-file-size 1024
+ -jigdo-exclude 'README*' -jigdo-exclude /doc/
+ -jigdo-exclude /md5sum.txt -jigdo-exclude /.disk/
+ -jigdo-exclude /pics/
+ -jigdo-exclude 'Release*'
+ -jigdo-exclude 'Packages*'
+ -jigdo-exclude 'Sources*'
+ -J -isohybrid-mbr syslinux/usr/lib/syslinux/isohdpfx.bin
+ -partition_offset 16
+ -J -joliet-long
+ -cache-inodes -b isolinux/isolinux.bin -c isolinux/boot.cat
+ -no-emul-boot -boot-load-size 4 -boot-info-table
+ boot1 CD1
+

libisoburn/trunk/releng/releng_build_jigdo

@@ -0,0 +1,34 @@
+#!/bin/sh
+
+set -e
+
+DIR=${1}
+IMG=${2}
+
+jigdo-gen-md5-list ${DIR} > ${IMG}.md5
+
+xorriso \
+   -as mkisofs \
+   -o ${IMG}.iso \
+   -R -V 'TEST_1' \
+   -partition_offset 16 \
+   -J -joliet-long \
+   \
+   -jigdo-template-compress gzip \
+   -checksum_algorithm_iso md5,sha512 \
+   -checksum_algorithm_template md5,sha512 \
+   -jigdo-jigdo ${IMG}.jigdo \
+   -jigdo-template ${IMG}.template \
+   -jigdo-map Debian=${DIR} \
+   -md5-list  ${IMG}.md5 \
+   -jigdo-min-file-size 1024 \
+   \
+   ${DIR}
+
+jigit-mkimage \
+   -t ${IMG}.template \
+   -j ${IMG}.jigdo \
+   -m Debian=${DIR} \
+   -o ${IMG}.bak
+
+diff ${IMG}.iso ${IMG}.bak