[comp.windows.x.motif] X test tools for OPEN LOOK or MOTIF Applications

rooster@pyuxe.UUCP (Robins Mills) (04/05/91)

An accumulation of the following test tools are listed below.  I purposely
provided only companies and/or contacts so that users can get ahold of the 
specifics themselves. Users are encouraged to contact the software developers 
and discuss their needs directly with them.  Most products are in the 
infancy stage so we all can play a part in getting the product that suites 
our needs by providing this valuable information to desiners and developers. 

Thanks for the responses I received from my original posting.

rooster

bellcore!pyuxe!rooster

P.S. Please don't hesitate to post more products as they become known.
thank you.  

Product - CAPBAK/X\tm
Company - Software Research, Inc.
Address - 625 Third St.
          San Fransisco, CA, 94107-1997
Phone   - (415)-957-1441
          (800)-942-SOFT

Product - preVue-X\tm    X-based remote terminal emulator (RTE)
Company - Performance Awareness
Address - 8521 Six Forks Road -Suite 200
          Raleigh, NC 27615              
Phone   - (919)-870-8800
FAX     - (919)-870-7416
UUCP    - uunet!prevue!kds
          (Kent Siefkes - Director)

Product - X-Master\tm (RTE) and Benchmaster\tm (ascii terminals)  
Company - A&T Systems, Inc.
Address - 12520 Prosperity Dr., Suite 300
          Silver Spring, MD 20904
Phone   - (301)-384-1425
FAX     - (301)-384-1405
Contact - Marcus Rogerson

Product - Xtrap
Company - Public Domain 
An X11 server extension that captures mouse and keyboard input events
A Remote User Emulator (RUE)
Anonymous ftp site - gatekeeper.dec.com  pub/X11/contrib/XTrap_v31.tar.Z
                     expo.lcs.mit.edu    contrib/Xtrap_v31.tar.Z

Product - Xtm  (X Testing Monitor - record/playback tool) 
Company - Public Domain - MIT X Consortium
Only works on X11,R3 no support in site for X11,R4 protocol
Contact - Jason Su, Hewlett-Packard ITO
Address - 1000 NE Circle BLVD.
          Corvallis, OR 97330
Internet - hpcvlx.cv.hp.com!jason

evans@decvax.DEC.COM (Marc Evans) (04/05/91)

In article <1144@pyuxe.UUCP>, rooster@pyuxe.UUCP (Robins Mills) writes:
|> 
|> An accumulation of the following test tools are listed below.  I purposely
|> provided only companies and/or contacts so that users can get ahold of the 
|> specifics themselves. Users are encouraged to contact the software developers 
|> and discuss their needs directly with them.  Most products are in the 
|> infancy stage so we all can play a part in getting the product that suites 
|> our needs by providing this valuable information to desiners and developers. 
|>
|> [...]
|>
|> Product - XTrap
|> Company - Public Domain 
|> An X11 server extension that captures mouse and keyboard input events
|> A Remote User Emulator (RUE)
|> Anonymous ftp site - gatekeeper.dec.com  pub/X11/contrib/XTrap_v31.tar.Z
|>                      expo.lcs.mit.edu    contrib/Xtrap_v31.tar.Z

Contacts for specifics on XTrap is:

	coutu@decvax.dec.com
	kmiller@decvax.dec.com

I don't mind answering questions either, but will yield to the *official* contact
people as needed.

- Marc
-- 
===========================================================================
Marc Evans - WB1GRH - evans@decvax.DEC.COM  | Synergytics     (603)635-8876
      Unix and X Software Consultant        | 21 Hinds Ln, Pelham, NH 03076
===========================================================================

evans@decvax.DEC.COM (Marc Evans) (04/05/91)

In article <1144@pyuxe.UUCP>, rooster@pyuxe.UUCP (Robins Mills) writes:
|> Product - Xtm  (X Testing Monitor - record/playback tool) 
|> Company - Public Domain - MIT X Consortium
|> Only works on X11,R3 no support in site for X11,R4 protocol
|> Contact - Jason Su, Hewlett-Packard ITO
|> Address - 1000 NE Circle BLVD.
|>           Corvallis, OR 97330
|> Internet - hpcvlx.cv.hp.com!jason

I have implemented the Xtm server extension for the DS3100 servers
(X[cm]fbpmax) for R4 patchlevel 18. I believe that HP also has Xtm working
on their servers, as do some other vendors. Adding support into the server
to support this extension isn't necessarily trivial, especially if your\
server isn't MIT based, but there is little reason to think that it doesn't
work for R4 (or R5 for that matter).

- Marc
-- 
===========================================================================
Marc Evans - WB1GRH - evans@decvax.DEC.COM  | Synergytics     (603)635-8876
      Unix and X Software Consultant        | 21 Hinds Ln, Pelham, NH 03076
===========================================================================

jason@hpcvlx.cv.hp.com (Jason Su) (04/09/91)

In hopes of reducing my email traffic, here is the scoop on Xtm as I know it
currently.
				-Jay Su
				jason@hpcvlx.cv.hp.com

During the X11R2/R3 time frame, an X Testing Consortium existed headed by
Larry Woestman from HP, Corvallis.  One of HP's contributions was the X Test
Monitor record/playback tool.  Their goal was to generate a test suite that
could verify a vendor's server.  After the X Testing Consortium completed
the suite, they handed it off to the MIT X Consortium.  Xtm was referred to 
as the "Client Exerciser Tools" because "xtm" was somebody's trademark.
The source appeared on an "Alpha" test suite tape that was released at about
the same time as R4.  The Input synthesis extension source was part of the 
X11R3 release tape.

Recently, MIT has announced that a similar contrib tool called XTrap is
available via anonymous ftp.  I believe DEC was the original contributor.
My personal advice is to contact your server vendor since the majority of
record/playback tools require a server extension.  If your server is worth a
spit, the chances are the vendor utilized some sort of test tools.

Here is HP's official word on Xtm as passed on to me by our test manager,
Ken Bronstein:

Dear People interested in Xtm,

   There is a public domain sample implementation of Xtm called
the "client exerciser" available from MIT.  This was an early
implementation.  I encourage anyone interested in this to grab
the client exerciser.  The following attached memo describes
how to access this technology.

   Internally inside HP we are now using a greatly improved
X client based on the Input Synthesis Extension  we call
Synergy.  Synergy replays test scripts hundreds of times
faster than they are recorded and provides more robust
results than Xtm.  Synergy is not available outside HP.

  -Ken Bronstein
--------------------------------------------

Hi Ken,

Here is a note on how to fetch the ClientExerciser
from the MIT export machine.

The "Client Exerciser" (also known as xtm in HP) is available
as part of the T7 X Test Consortium test suite.  The test suite
is available on "export.lcs.mit.edu" as described below.  It used
to be on "expo" at MIT; however the MIT folks have moved
all of the expo stuff to "export".

I have excerpted the relevant files you need to ftp and listed them
below.  The T7 test suite has been split into .5 Megabyte chunks.
You need to ftp all of them and then cat them together, then
uncompress the result.  You can then use tar to unpack the 
archive.  


---- from comp.windows.x -------
MIT X Consortium anonymous ftp repository has moved!           No responses
rws@expo.lcs.mit.EDU                              Bob Scheifler at The Internet

We have moved our anonymous ftp repository to export.lcs.mit.edu (address
18.30.0.238).  I'm sure this will cause some confusion at first, but the
move was made to lessen the load on expo.  No other changes have been
made; the xstuff mail daemon and mailing lists still reside on expo.
-------------------------------

./pub/XTEST
total 12894
-r--r--r--  1 root          675 Aug  7  1989 CHECKSUMS.BSD
-r--r--r--  1 root          647 Aug  7  1989 CHECKSUMS.SYSV
-r--r--r--  1 root         3117 Aug  7  1989 README
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.aa
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.ab
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.ac
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.ad
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.ae
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.af
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.ag
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.ah
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.ai
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.aj
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.ak
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.al
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.am
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.an
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.ao
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.ap
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.aq
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.ar
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.as
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.at
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.au
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.av
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.aw
-r--r--r--  1 root       524288 Aug  7  1989 suite.tar.Z.ax
-r--r--r--  1 root       511845 Aug  7  1989 suite.tar.Z.ay

----------------------------------------
==================
./pub/XTEST/README
==================
The Alpha release of the X Testing Consortium's X Test Suite is now available
via anonymous ftp to expo.lcs.mit.edu (18.30.0.212), in the directory
/pub/XTEST/, as a split compressed tar file.  The distribution is
approximately 36Mb uncompressed.

The X Testing Consortium was formed (prior to the formation of the MIT X
Consortium) to develop code suitable for testing the correctness and
robustness of vendor implementations of the X Window System.  This release of
the test suite contains the following components:

1. Protocol Sanity Tests.  These test the server's basic ability to accept all
   legal message types and respond appropriately, test aspects which cannot be
   tested adequately from Xlib, and test basic server functionality that the
   Xlib tests depend on.

2. Xlib Tests.  Comprehensive tests for most routines and macros in the Xlib
   interface, testing both Xlib and the server.  Includes pixel validation
   of graphics requests.

3. Xlib Test Specifications.  Informal written specifications of what the Xlib
   Tests should do.

4. Volume/Stress Tests.  Tests server robustness with high data load and high
   computational load sustained over both short and long periods of time, and
   provides a framework for adding additional tests.

5. Client Exerciser.  Utilities for recording and playing back scripts of user
   actions (keyboard and pointer events), for the purpose of testing clients.
   The utilities make use of the Input Synthesis Extension (distributed as part
   of X11 Release 3 from MIT).

6. Graphics Benchmark.  Yet another graphics benchmark tool.

7. Interactive Xlib.  A test program which will read and execute Xlib functions
   and macros, both interactively and from input control files.

8. Gbench.  A graphics benchmark tool from Stanford.  This was not developed
   by the X Testing Consortium, it is simply included here as another utility.

We are attempting to arrange for the MIT Software Center to distribute the
test suite on mag tape for the cost of distribution.  Once the arrangements
are in place, information will be posted to this list.

This is an ALPHA release of the test suite.  It is not complete, and there is
no particular guarantee that any problems reported by this suite are really
bugs in your Xlib or server implementation, they may well be bugs in the test
suite itself.  The contents of this tape are not endorsed as any form of
standard by the X Consortium.

This test suite is the result of considerable work by numerous people in the
companies making up the X Testing Consortium, and we are indebted to them.
MIT was not directly involved in the development of the test suite, but did
meet with the X Testing Consortium on a regular basis.  This release of the
test suite has not gone through MIT's configuration and build process, so it
may take some effort to build the suite on your machine.

Although there is much work left to be done, this test suite represents an
excellent beginning.  With this release, the X Testing Consortium is
disbanding, but the MIT X Consortium will continue the development of X
testing software.