[comp.windows.x] X benchmarks

dunwoody@cascade.STANFORD.EDU (Craig Dunwoody) (05/18/88)

Since there have been a couple of inquiries recently about X benchmarks,
I thought there might be some interest in a benchmarking tool that I recently
put together:

gbench Version 1.0

Gbench is a graphics benchmark tool.  It currently supports 2D immediate-mode
graphics and runs on top of the X Window System (both Version 10 and Version
11) and Unix.  It is written in C and it directly calls the low-level window
system client library; no toolkit is used.  It is being developed by Craig
Dunwoody and Mark Linton at Stanford University's Computer Systems Lab under
the Quantum project, through a gift from Digital Equipment Corporation.  It may
be freely distributed under the conditions listed in the accompanying copyright
notice.

Gbench is not a graphics benchmark.  Rather, it is a tool that lets you
construct and run your own benchmarks.  When gbench starts up, it creates an X
window and reads commands from standard input, one per line.  Each command
directs gbench to repeatedly perform a particular drawing operation.  Gbench
copies the command line to standard output, executes the command, and prints on
standard output the host load average, the time for each iteration, and the
number of iterations per second.  All times are measured in real (wall-clock)
time.

You can use gbench either interactively, by typing commands and viewing
the results immediately, or in batch mode, with standard input redirected
to a script file and output redirected to a log file.  If you don't want to
create your own script file, there is a built-in default script.

Gbench is primarily intended as a benchmarking tool.  You may also find it
useful as a graphics system exerciser.  If you are developing an application
program, and some graphics operation isn't behaving properly, you may be able
to use gbench to find out if the underlying graphics system implementation is
doing the right thing.  Gbench is NOT, however, intended as a graphics system
verification tool.  It allows you to exercise most of the drawing functions
supported by the graphics server, but for any given function, the only
parameters that gbench lets you vary are those (such as size) that we
consider to be likely to affect performance.

In the future, we hope to extend gbench and provide tools for combining and
formatting raw log files.  Proposed extensions include 3D graphics and
integration with a more comprehensive set of workstation benchmarks.  If there
is interest, we are willing to act as a clearinghouse for benchmark scripts and
results.

Version 1.0 of gbench represents our first attempt to address the problem of
characterizing graphics performance in a distributed environment.  There are
many complex issues in this area that remain unresolved, and we expect that we
will be able to substantially improve gbench as we learn more.  By making
gbench widely available, we hope to hasten the process of making it as
portable, bug-free, complete, and fair as possible.

Gbench source code is available in compressed and uncompressed shar and tar
formats through anonymous FTP to lurch.stanford.edu (36.22.0.14).  If
there is sufficient interest, I will post the source to the net.

Craig Dunwoody
Internet:   dunwoody@horizon.stanford.edu
USEnet:     {ucbvax,decvax}!decwrl!horizon.stanford.edu!dunwoody
Phone:      (415) 725-3733

rzahavi@gateway.mitre.org (Ron Zahavi) (04/05/89)

I assume (or hope) that this has been discussed before, and that someone
has a list that can be mailed to me.  I am looking for a list of X 
implementations and various hardware they run on (Suns, Vaxs, PCs, etc.)

Any benchmarks (even if only company claims) would be very helpful.
 
  Thanks,
 
 -- Ron --


==============================================================================
      Ron Zahavi  (703) 883-5637                 Mitre Corporation
      rzahavi@gateway.mitre.org                  7525 Colshire Drive
                                                 McLean, VA  22102
==============================================================================

P88036@BARILVM.BITNET (Ephraim Vider) (10/18/90)

Hi, as I need to compare and evaluate X terminals, I would like to know if:

1. A place where I can find benchmark programs for X performance. (I remember
   seeing the name xbench somewhere, but that is all I can say about it).
   Any ftp site will be fine.

2. There was such a discussion in some magazine so I can see what other
   people have to say on the subject.

Any information will help.
                            Ephraim.

stepl@tubkom.UUCP ( Stefan Platzek) (10/26/90)

In article <90291.154637P88036@BARILVM.BITNET> P88036@BARILVM.BITNET (Ephraim Vider) writes:
>Hi, as I need to compare and evaluate X terminals, .........
Same with me. Like to know ftp-able xbench source code. Please email answers

Thanks.
+++++++++++++++++++++++++++++++++
stepl@tubkom.prz.tu-berlin.de
..!pyramid!unido!tubkom!stepl
+++++++++++++++++++++++++++++++++

mk@bilbo.informatik.uni-dortmund.de (Michael Kuschke) (10/30/90)

stepl@tubkom.UUCP ( Stefan Platzek) writes:

>In article <90291.154637P88036@BARILVM.BITNET> P88036@BARILVM.BITNET (Ephraim Vider) writes:
>>Hi, as I need to compare and evaluate X terminals, .........
>Same with me. Like to know ftp-able xbench source code. Please email answers

In germany you can find the source on unido.informatik.uni-dortmund.de
(129.217.64.60) as /pub/windows/X/News-Sourcen+Diffs/xbench/*.

	Ciao,
	  -Mic
	  
  Michael Kuschke				  uucp: mk@unido.uucp
  Computer Science Department - IRB		  BITNET: MK@DDOINF6.BITNET
  University of Dortmund			  FAX:    +49 231 755 2386
  D-4600 Dortmund 50,PO-Box 500500, W.-Germany	  voice:  +49 231 755 5135

rayb@altos86.Altos.COM ( Ray Barbieri) (05/10/91)

So, what is the latest in the X benchmark wars?  Who's is the best and
most widely accepted?

What ever happend to xbench and xstones?  Are they still around?

Ray Barbieri

rayb@altos.com

tonyr@tekadg.ADG.TEK.COM (Tony Rick) (05/11/91)

In article <307@altos86.Altos.COM> rayb@altos86.Altos.COM ( Ray Barbieri) writes:
>
>So, what is the latest in the X benchmark wars?  Who's is the best and
>most widely accepted?
>
>What ever happend to xbench and xstones?  Are they still around?

I attended an HP Technology conference here this week where one of the
presenters used something called 'x11perf' to compare his box (730?)
with other boxes (Sun, Mips, Dec...).  Does anyone know what this is?
Where it comes from? How to get it?

Tony Rick
Tektronix, Inc.   Beaverton, OR
voice:(503) 627-2942
email:tonyr@tekadg.adg.tek.com

HELMUT@scs.slac.stanford.EDU (Helmut Hissen) (06/13/91)

can somebody tell me where I could find a copy of xbench ?  we are
trying to measure performance on various vendors' X terminals, and
management would love to see a single number for each device we test.

what other useful performance measuring tools are there ?  (we already
have x11perf.)

Helmut Hissen
Stanford Linear Accellerator Center
helmut@slacvx.slac.stanford.edu

jta@locus.com (JT Anderson) (06/13/91)

In article <36A4869A602034F9@SCS.SLAC.STANFORD.EDU> HELMUT@scs.slac.stanford.EDU (Helmut Hissen) writes:
>
>
>can somebody tell me where I could find a copy of xbench ?  we are
>trying to measure performance on various vendors' X terminals, and
>management would love to see a single number for each device we test.
 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
I'd get new management if I were you.

trhv@huldra.UUCP (Trond Hvoslef) (06/15/91)

They are available at uunet.uu.net in the directories unix-today/benchmarks/*,
together with a shell script called x11perfcompDR which can be used
to compare results from two runs and present them graphically like this:

     GENERAL GRAPHICS|================================|======================
   TERMINAL EMULATION|================================|======                
    WINDOW MANAGEMENT|================================|=                     
X-SPECIFIC OPERATIONS|================================|===========           
            1 OVERALL|================================|=================     
          500 OVERALL|================================|==========            

This might be what you are looking for.

Trond Hvoslef
Tandberg Data A/S
trhv@tdata.no