[comp.windows.x.motif] X Testing Consortium

ajm@seqp4.ORG (A.J.Madison) (12/05/90)

i am but a poor communications engineer, suddenly thrown onto doing the
qualification effort for a Motif portation onto our platform; alas, the 
dictates of working for a small company.  i am completely ignorant about
athena sets, writing scrollable arrow label widgets ( that's a joke :-),
etc. so please bear with me.

i do know about the test suite that comes with the source tape for 
Motif, and that will be the majority of my qualification effort.  there
are a couple of pieces of information that could greatly aid my efforts,
though.

a. there is mention made of a program called xtm, produced by the X
   Testing Consortium.  is this program available?  how can i contact
   the X Testing Consortium?  or, have i missed something along the
   way?

b. while the accompanying OSF documentation describes HOW to test Motif,
   it does not describe WHAT it is testing in Motif.  Has anyone out
   there already figured out What is being tested?  A test plan that 
   has one sentence in it: *run accompanying test suite* is not acceptable
   by my manager, the product assurance department, nor me.  When i say
   What, it can even be somewhat vague, such as: *running Xm Section 1
   tests will cover 90% of the widget functions* or riduculously 
   detailed, such as: *running Xm Section 1 InitSet test Scale_S1 exercises
   functions abc 3 times, bcd 2 times, and cde 4 times.  anyway, you
   get the idea.

any suggestions or answers would be greatly appreciated.

uunet!m2c.m2c.org!seqp4!ajm     A.J. Madison

evans@decvax.DEC.COM (Marc Evans) (12/06/90)

In article <676@seqp4.UUCP>, ajm@seqp4.ORG (A.J.Madison) writes:
|> a. there is mention made of a program called xtm, produced by the X
|>    Testing Consortium.  is this program available?  how can i contact
|>    the X Testing Consortium?  or, have i missed something along the
|>    way?

The X Testing Consortium no longer exists (at least officially). The programs and
tools created by this consortium are publically available, such as from your
favorite FTP site (expo.lcs.mit.edu is a good choice). The xtm program and its
friends require that the server being used supports the XTESTEXT1 server extension.
If your server doesn't support this, then you either can't benefit from the tests,
or you will have to add it to your server (not necessarily an easy task; I added
this to the X[cm]fbpmax X11R4 servers for OSF many months ago. It took about 4
days to get everything working the way we wanted).

If you have access to version 1.1.1 of Motif, a very different test suite is supplied
which does not use xtm, nor the XTESTEXT1 server extension (e.g., it may not be
worth your time to add the extension to your server). Version 1.1.1, and the
associated tests are still being developed, but should be available soon...
 
|> b. while the accompanying OSF documentation describes HOW to test Motif,
|>    it does not describe WHAT it is testing in Motif.  Has anyone out
|>    there already figured out What is being tested?  A test plan that 
|>    has one sentence in it: *run accompanying test suite* is not acceptable
|>    by my manager, the product assurance department, nor me.  When i say
|>    What, it can even be somewhat vague, such as: *running Xm Section 1
|>    tests will cover 90% of the widget functions* or riduculously 
|>    detailed, such as: *running Xm Section 1 InitSet test Scale_S1 exercises
|>    functions abc 3 times, bcd 2 times, and cde 4 times.  anyway, you
|>    get the idea.

I think that I'll defer this question to OSF, just to be sure that I don't answer
it improperly. However, the bottom line is that currently, the only tests that
are available to test Motif are those supplied by the OSF. Therefore, reguardless
of what they test, you should make use of them as much as possible (unless of
course, you want to build your own test suite 8-)).

- Marc
-- 
===========================================================================
Marc Evans - WB1GRH - evans@decvax.DEC.COM  | Synergytics     (603)635-8876
      Unix and X Software Contractor        | 21 Hinds Ln, Pelham, NH 03076
===========================================================================