guru@ut-emx.uucp (chen liehgong) (11/18/90)
I have a few queries regarding benchmark performance ratios. 1. If the benchmark consists of a set of programs (eg. the livermore loops) is the overall performance ratio of the architecture under test (as compared to a standard one) calculated as the harmonic mean of the performance ratios (say speed-ups) obtained for each program (or livermore loop)? If so, Why is the harmonic mean used instead of the arithmetic or geometric means? 2. If different kinds of benchmarks (eg. integer performance, floating- point performance or livermore loops, whetstones and dhrystones) are used, how is the overall performance ratio (speed-up) calculated? i.e., Which mean (AM, GM or HM) should be used? 3. If the performance ratio is changed (say from speed-up to percentage decrease in execution time - in clock cycles) do the answers to 1 and 2 above, remain the same? 4. What are some of the performance ratios that are used in comparing two architectures? I can think of only two, viz., speed-up and percentage decrease in execution time. -guru@emx.utexas.edu