[comp.arch] A highly-recommended article on benchmarking

mash@mips.COM (John Mashey) (01/04/89)

Jack Worlton, "What is the Right Benchmark for Your System",
Supercomputing Review, Nov/Dec 1988, 16-23.
(8445 Camino Santa Fe, San Diego, CA 92121; 619-452-4242)

This is a clearly-written exposition, aimed more at scientific/technical
benchmarking.  Offers many cautions, especially regarding single
benchmarks and peak performance numbers.
Includes nice hierarchy of workload characterization:

hardware demos	put a few statements in a loop
kernels		inner loops of real program (a la Livermore Fortran Kernels))
basic routines	such as FFT or LINPACK
stripped applications	small version of full application, as most CAD
			vendors often supply as tests
full applications	best, but ponderous
composite workloads	combination of above

Thanx to Cleve Moler of Ardent for pointing this article out to me.
-- 
-john mashey	DISCLAIMER: <generic disclaimer, I speak for me only, etc>
UUCP: 	{ames,decwrl,prls,pyramid}!mips!mash  OR  mash@mips.com
DDD:  	408-991-0253 or 408-720-1700, x253
USPS: 	MIPS Computer Systems, 930 E. Arques, Sunnyvale, CA 94086