jason@hpcvlx.cv.hp.com (Jason Su) (04/19/91)
Archive-name: x11/testing/xtest/1991-04-08 Archive-directory: export.lcs.mit.edu:/pub/XTEST/ [18.30.0.238] Original-posting-by: jason@hpcvlx.cv.hp.com (Jason Su) Original-subject: Re: X test tools for OPEN LOOK or MOTIF Applications Reposted-by: emv@msen.com (Edward Vielmetti, MSEN) In hopes of reducing my email traffic, here is the scoop on Xtm as I know it currently. -Jay Su jason@hpcvlx.cv.hp.com During the X11R2/R3 time frame, an X Testing Consortium existed headed by Larry Woestman from HP, Corvallis. One of HP's contributions was the X Test Monitor record/playback tool. Their goal was to generate a test suite that could verify a vendor's server. After the X Testing Consortium completed the suite, they handed it off to the MIT X Consortium. Xtm was referred to as the "Client Exerciser Tools" because "xtm" was somebody's trademark. The source appeared on an "Alpha" test suite tape that was released at about the same time as R4. The Input synthesis extension source was part of the X11R3 release tape. Recently, MIT has announced that a similar contrib tool called XTrap is available via anonymous ftp. I believe DEC was the original contributor. My personal advice is to contact your server vendor since the majority of record/playback tools require a server extension. If your server is worth a spit, the chances are the vendor utilized some sort of test tools. Here is HP's official word on Xtm as passed on to me by our test manager, Ken Bronstein: Dear People interested in Xtm, There is a public domain sample implementation of Xtm called the "client exerciser" available from MIT. This was an early implementation. I encourage anyone interested in this to grab the client exerciser. The following attached memo describes how to access this technology. Internally inside HP we are now using a greatly improved X client based on the Input Synthesis Extension we call Synergy. Synergy replays test scripts hundreds of times faster than they are recorded and provides more robust results than Xtm. Synergy is not available outside HP. -Ken Bronstein -------------------------------------------- Hi Ken, Here is a note on how to fetch the ClientExerciser from the MIT export machine. The "Client Exerciser" (also known as xtm in HP) is available as part of the T7 X Test Consortium test suite. The test suite is available on "export.lcs.mit.edu" as described below. It used to be on "expo" at MIT; however the MIT folks have moved all of the expo stuff to "export". I have excerpted the relevant files you need to ftp and listed them below. The T7 test suite has been split into .5 Megabyte chunks. You need to ftp all of them and then cat them together, then uncompress the result. You can then use tar to unpack the archive. ---- from comp.windows.x ------- MIT X Consortium anonymous ftp repository has moved! No responses rws@expo.lcs.mit.EDU Bob Scheifler at The Internet We have moved our anonymous ftp repository to export.lcs.mit.edu (address 18.30.0.238). I'm sure this will cause some confusion at first, but the move was made to lessen the load on expo. No other changes have been made; the xstuff mail daemon and mailing lists still reside on expo. ------------------------------- ./pub/XTEST total 12894 -r--r--r-- 1 root 675 Aug 7 1989 CHECKSUMS.BSD -r--r--r-- 1 root 647 Aug 7 1989 CHECKSUMS.SYSV -r--r--r-- 1 root 3117 Aug 7 1989 README -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.aa -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.ab -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.ac -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.ad -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.ae -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.af -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.ag -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.ah -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.ai -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.aj -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.ak -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.al -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.am -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.an -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.ao -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.ap -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.aq -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.ar -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.as -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.at -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.au -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.av -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.aw -r--r--r-- 1 root 524288 Aug 7 1989 suite.tar.Z.ax -r--r--r-- 1 root 511845 Aug 7 1989 suite.tar.Z.ay ---------------------------------------- ================== ./pub/XTEST/README ================== The Alpha release of the X Testing Consortium's X Test Suite is now available via anonymous ftp to expo.lcs.mit.edu (18.30.0.212), in the directory /pub/XTEST/, as a split compressed tar file. The distribution is approximately 36Mb uncompressed. The X Testing Consortium was formed (prior to the formation of the MIT X Consortium) to develop code suitable for testing the correctness and robustness of vendor implementations of the X Window System. This release of the test suite contains the following components: 1. Protocol Sanity Tests. These test the server's basic ability to accept all legal message types and respond appropriately, test aspects which cannot be tested adequately from Xlib, and test basic server functionality that the Xlib tests depend on. 2. Xlib Tests. Comprehensive tests for most routines and macros in the Xlib interface, testing both Xlib and the server. Includes pixel validation of graphics requests. 3. Xlib Test Specifications. Informal written specifications of what the Xlib Tests should do. 4. Volume/Stress Tests. Tests server robustness with high data load and high computational load sustained over both short and long periods of time, and provides a framework for adding additional tests. 5. Client Exerciser. Utilities for recording and playing back scripts of user actions (keyboard and pointer events), for the purpose of testing clients. The utilities make use of the Input Synthesis Extension (distributed as part of X11 Release 3 from MIT). 6. Graphics Benchmark. Yet another graphics benchmark tool. 7. Interactive Xlib. A test program which will read and execute Xlib functions and macros, both interactively and from input control files. 8. Gbench. A graphics benchmark tool from Stanford. This was not developed by the X Testing Consortium, it is simply included here as another utility. We are attempting to arrange for the MIT Software Center to distribute the test suite on mag tape for the cost of distribution. Once the arrangements are in place, information will be posted to this list. This is an ALPHA release of the test suite. It is not complete, and there is no particular guarantee that any problems reported by this suite are really bugs in your Xlib or server implementation, they may well be bugs in the test suite itself. The contents of this tape are not endorsed as any form of standard by the X Consortium. This test suite is the result of considerable work by numerous people in the companies making up the X Testing Consortium, and we are indebted to them. MIT was not directly involved in the development of the test suite, but did meet with the X Testing Consortium on a regular basis. This release of the test suite has not gone through MIT's configuration and build process, so it may take some effort to build the suite on your machine. Although there is much work left to be done, this test suite represents an excellent beginning. With this release, the X Testing Consortium is disbanding, but the MIT X Consortium will continue the development of X testing software. -- comp.archives file verification export.lcs.mit.edu total 12894 -r--r--r-- 1 root 0 675 Aug 7 1989 CHECKSUMS.BSD -r--r--r-- 1 root 0 647 Aug 7 1989 CHECKSUMS.SYSV -r--r--r-- 1 root 0 3117 Aug 7 1989 README -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.aa -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.ab -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.ac -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.ad -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.ae -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.af -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.ag -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.ah -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.ai -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.aj -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.ak -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.al -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.am -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.an -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.ao -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.ap -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.aq -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.ar -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.as -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.at -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.au -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.av -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.aw -r--r--r-- 1 root 0 524288 Aug 7 1989 suite.tar.Z.ax -r--r--r-- 1 root 0 511845 Aug 7 1989 suite.tar.Z.ay found xtest ok export.lcs.mit.edu:/pub/XTEST/