[comp.sys.ibm.pc.misc] SIMTEL20 archives info for Internet FTP users

w8sdz@WSMR-SIMTEL20.ARMY.MIL (Keith Petersen) (06/10/91)

[File: SIMTEL20.INF                    Last revised: May 9, 1991]

   [Note: Due to disk space limitations the PC-Blue collection
   is temporarily off-line.  We are sorry for the inconvenience
   to our users.]

                     THE SIMTEL20 ARCHIVES

OVERVIEW

There is a colossal amount of free public domain and shareware
software for the CP/M, PCDOS/MSDOS, Macintosh, and UNIX operating
systems, and for the DoD standard programming language, Ada, in
several archives on WSMR-SIMTEL20.ARMY.MIL (IP host 192.88.110.20),
a DECSYSTEM-20 running the TOPS-20 operating system at White Sands
Missile Range, New Mexico.  Archives of correspondence for several
mailing lists are also available.

    [SIMTEL20 is a contraction of SIMulation and TELeprocessing, the
    name of the branch that originally purchased the machine and in
    whose building the system still resides, and the "20" in
    DECSYSTEM-20.  The convention of including the "20" in some form
    or another was popular with other DECSYSTEM-20 systems at the time
    SIMTEL20 was named, such as MIT-XX at MIT and SCORE at Stanford.]

You can obtain these files using the InterNet file transfer protocol,
FTP (described in a following paragraph), with user-name "anonymous".
For a login password, use "guest", your host-name, or any other string
of printing characters.  Throughout this message, FTP examples are
given in a GENERIC syntax.  You will have to consult either local
documentation or your friendly system wizard to learn the actual
syntax used with your local mainframe operating system.  For the sake
of brevity, the full host name "WSMR-SIMTEL20.ARMY.MIL" will be
dropped from further references to SIMTEL20 in this discussion.  Also
please note that square brackets may be used in place of angle brackets
in referring to directory names.  For example, pd1:[msdos.filedocs]
is the same as pd1:<msdos.filedocs>

There are many helpful files in the default ANONYMOUS ftp directory.
Please look at these if you have need for further information on
specific collections.

To obtain directory listings, connect to SIMTEL20 via FTP and get
these files:

  pd1:<msdos>msdos.crclst
  pd1:<pc-blue>pc-blue.crclst
  pd2:<cpm>cpm.crclst
  pd2:<cpmug>cpmug.crclst
  pd2:<sigm>sigm.crclst
  pd8:<hz100>hz100.crclst
  pd5:<macintosh>macintosh.crclst
  pd8:<misc>misc.crclst
  pd6:<unix-c>unix-c.crclst
  pd2:<ada>ada.crc

There is also a comma-delimited directory listing in each top-level
directory, FILES.IDX, which is suitable for importing into a database
program.  This file may be of greater use than the crclst files
because it can be compared against an earlier version of the same file
to produce a complete list of files added and deleted from the
archives.  Using the comma-delimited fields it is possible to build a
script for FTP to maintain a parallel archive.  FILES.IDX can be
printed or displayed with a simple BASIC program.  For more information
see PD1:<MSDOS.FILEDOCS>AAAREAD.ME.

The <CPM>, <MSDOS>, and <MACINTOSH> archives are the ones to watch for
the very latest offerings, as they are updated frequently.

The <CPMUG>, <SIGM> and <PC-BLUE> archives contain software distributed
by the CP/M Users Group, the SIG/M Users Group and the PC-Blue Users
Group respectively.  This software is available on diskettes from the
associated user groups, and the archives are updated as new volumes
are issued.  The <PC-BLUE> archive contains software for the IBM-PC
and similar machines.

The <MSDOS> archives also contain software for the MSDOS and PCDOS
operating systems; but these archives are locally managed, and
therefore are updated more frequently than the <PC-BLUE> archive.

The <UNIX-C> archive contains a variety of UNIX tools.  Those which
apply specifically to CP/M are in the directory <UNIX-C.CPM>.

The <ADA> archive is growing rapidly. Information about this archive
is in directory PD2:<ADA.GENERAL>.  In general, the archived software
is very good, having been worked-over and refined by many users.  The
documentation and comments tend to be complete and informative.

Files in all of these archives can be obtained using the FTP procedures
described in this message.

PLEASE NOTE:  Due to the large number of files available, the archive
maintainers cannot possibly attempt to validate the proper operation of
the various programs.  When a program bug is reported, immediate action
is taken to either correct the error or remove the offending program
from the archives.  Still, users must understand that all archive
programs are offered AS IS, and the archive maintainers specifically
disclaim any liability should these programs malfunction or cause
damage, incidental or otherwise.  When testing ANY new software, be
certain that all information stored on disk is backed-up before you
start, so that you can recover if files are damaged or erased.  This is
particularly true if you have a hard disk, in which case malfunctions
can be spectacularly disasterous.

FILE TYPES

Files are stored in two formats: Text files such as those with names
that end with DOC, HEX, INF and ASM are sometimes stored as ASCII
files, but sometimes these files are stored in binary compressed
form.  Binary storage is also used for executable (COM and EXE) and
library/archive files  (LBR and ARC).  All binary data are stored as
four 8-bit bytes per 36-bit SIMTEL20 word, with the low-order four
bits of each word filled with zeros.  If such a file is interpreted
as a contiguous string, as will happen if a straight binary transfer
is made to a 16 or 32-bit UNIX machine, the four zero filler-bits per
36-bit group will cause rather bizarre and frustrating results.

For information on ARC, ARK, LZH, ZIP, ZOO, LBR, squeezed and crunched files,
get PD2:<CPM.STARTER-KIT>00-FILES.DOC and/or PD1:<MSDOS.STARTER>00-FILES.DOC.

Although the type of storage used for a particular file can usually be
inferred from the file-name, this is not always true.  It is a good idea
to check the appropriate "crclst" of "idx" file to ascertain the storage
format used for each file of interest.  Now, and for the foreseeable
future, storage formats for files in the <SIGM>, <CPMUG> and <PC-BLUE>
archives can be determined from their "generation numbers", as shown by
the FTP directory command.  For example, the FTP command:

  dir pd1:<pc-blue.vol001>

will yield results of the form:

  -CATALOG.001.2
  ABSTRACT.001.2
  BW.ASM.2
  BW.BAS.1
  BW.EXE.1
  COLOR.ASM.2
  COLOR.BAS.1
  COLOR.EXE.1
  ...and so on

All files with names ending in ".1" are stored in binary format, and
those with names ending in ".2" are stored in ASCII.  This relationship
will continue to apply for files in the <SIGM>, <CPMUG> and <PC-BLUE>
archives until further notice.

WARNING: Because the public domain archives on SIMTEL20 consume a huge
amount of disk space, storage capacity will be conserved by the
greatest practical use of libraries, archives, crunched and squeezed
files, all of which are stored in binary format.  If you cannot
properly transfer binary files, you are going to be VERY FRUSTRATED!
If you need help, please contact your local system wizard and provide
him/her with a copy of this message.  Having done that, if you are
still unable to make things work correctly, send a message to
Action@WSMR-SIMTEL20.ARMY.MIL and someone will try to help you.
Please provide the following information:

 1. Machine and operating system  (e.g., VAX-11/780, 4.3 BSD UNIX)
 2. Network software in use  (e.g., 3-Com UNET)
 3. Complete list of available FTP commands  (e.g., GET, PUT, etc.)

Important files in the <CPMUG> and <PC-BLUE> archives are the
CATALOG files. These files, which are stored in ASCII, contain the
"-CATALOG.nnn" files from all the volumes of their respective archives.
To obtain these composite catalog files, connect to SIMTEL20 via FTP
and get these files:

  pd2:<cpmug>cpmug.cat
  pd1:<pc-blue.vol000>pcblue.cat

Similar files exist for the <SIGM> archive, but they are stored in
squeezed form.  These files, when unsqueezed, yields SIG0.CAT and
SIG1.CAT (the catalog).

  pd2:<sigm.vol000>sig0.cqt
  pd2:<sigm.vol000>sig1.cqt

(NOTE: That's "L-and-three-zeros" in "vol000")

FILE TRANSFER VIA FTP

FTP stands for File Transfer Protocol, a formalized procedure for
moving files among machines on the Defense Data Network (DDN) and other
networks that connect with the DDN.  The protocol is implemented by a
program often called FTP.  The different mainframe operating systems
implement FTP with variations in command syntax.  Some systems have the
remote-file-name precede the local-file-name in the command.  Others
reverse this order.  Some versions have the whole command on a single
input line, while others use multiple lines.  Read the documentation
for your local system, or consult a friendly system wizard for the
details of your local FTP command syntax.

UNIX users can do something like "man ftp" for on-line instructions.
However, not all UNIX FTP programs are called "ftp", so you may have
to snoop around in the system directories or ask a system wizard for
the correct local name to use with the "man" command.  ITS users can
do ":INFO FTP", and "HELP FTP" works on TOPS-20 and some other
operating systems.  I will be happy to update this message with
pointers to other sources of on-line documentation if they are sent
to w8sdz@WSMR-SIMTEL20.ARMY.MIL.

FTP transfers from SIMTEL20 can be made with user-name "anonymous".
Use GUEST for the password.  For anonymous logins, SIMTEL20 supports
the FTP "change working directory" command.  (Your local syntax may
be something like CD, or CWD).  Ignore the message which may appear
that prompts you to enter a password.  This command allows you to
specify a default SIMTEL20 directory to be used for all file
retrievals, and thereby relieves you from having to repeatedly type
"pdx:<whatever>" as part of each filename.  For example, you can do
something like this:

  cd pd1:<msdos.goodstuff>
  get filename-1
  get filename-2
  ...and so on

instead of using the longer filename forms shown in previous examples.

Users of TOPS-10, TENEX, or TOPS-20 systems can use "image" or "paged"
mode for ALL transfers.  UNIX and other users must use "ascii" mode for
ASCII files, and "type tenex" or "type L 8" mode for binary files.

All aspects of the FTP process for UNIX machines have been automated
to a high degree by two programs in directory PD8:<MISC.UNIX>. With
these programs, a simple command like "sh autoftp30.sh mylist &" can
be run in no-hangup background mode to transfer multiple files from
SIMTEL20 without the user remaining logged-in on the local system.
For more information, get the file PD8:<MISC.UNIX>AUTOFTP30.TAR-Z, a
compressed tar archive.  After transferring it to your Unix host,
rename to autoftp30.tar.Z, uncompress, and extract with tar.  Also
see BATCHFTP102.TAR-Z which is an enhanced version of autoftp.

MAILING LIST CORRESPONDENCE ARCHIVES

Copies of correspondence for several mailing lists are kept on SIMTEL20
in directories with names of the form PD2:<ARCHIVES.KEYWORD>, where
"KEYWORD" has been chosen to indicate the associated mailing list.  At
present, the following correspondence archives are available:

   mailing list       mail archive filename
  ---------------     ---------------------
  ADA-SW              PD2:<ARCHIVES.ADA-SW>
  AMETHYST-USERS      PD2:<ARCHIVES.AMETHYST>
  INFO-68K            PD2:<ARCHIVES.68K>
  INFO-APPLE          PD2:<ARCHIVES.APPLE>
  INFO-CPM            PD2:<ARCHIVES.CPM>
  INFO-FORTH          PD2:<ARCHIVES.FORTH>
  INFO-IBMPC          PD2:<ARCHIVES.IBMPC>
  INFO-MICRO          PD2:<ARCHIVES.MICRO>
  INFO-MODEMS         PD2:<ARCHIVES.MODEMS>
  INFO-MODEMXX        PD2:<ARCHIVES.MODEMXX>
  INFO-MODULA-2       PD2:<ARCHIVES.MODULA-2>
  INFO-PASCAL         PD2:<ARCHIVES.PASCAL>
  INFO-XENIX310       PD2:<ARCHIVES.XENIX310>
  INFO-XMODEM         PD2:<ARCHIVES.XMODEM>
  NORTHSTAR-USERS     PD2:<ARCHIVES.NORTHSTAR>
  UNIX-SW             PD2:<ARCHIVES.UNIX-SW>
  VIDEOTECH           PD2:<ARCHIVES.VIDEOTECH>

Descriptions of these and other mailing lists can be obtained via FTP
with anonymous login (as for SIMTEL20) from FTP.NISC.SRI.COM.  Ask for
the file netinfo/interest-groups (an ASCII file).  And please note,
this is NOT on SIMTEL20.

File names for SIMTEL20 mailing list correspondence archives have two
forms.  For example, in PD2:<ARCHIVES.CPM>, which holds the INFO-CPM
correspondence (the "INFO-" is assumed), the forms are: yymm.n-TXT or
yymm.n-TXT-Z.  Files with names ending in -Z were compressed with a
Unix compress-compatible program.  The characters "yymm" in the file
names are the digits of the year and month of the messages in each
particular file.  The "n" was incremented as overflowed 150 disk pages
(approximately 375K).  The current month's correspondence is kept in
CPM-ARCHIV.TXT, which is constantly growing as new messages arrive.
There may also temporarily exist files named CURRENT.n-TXT, which hold
the overflow of the current month's messages when CPM-ARCHIV.TXT is
split into monthly files.  Although INFO-CPM has been used as an
example here, the same naming scheme is used for the other mailing list
files as well.  For a complete list of available files, connect to
SIMTEL20 via FTP and do this:

  dir PD2:<ARCHIVES>

You will receive a list of names of the form:

  KEYWORD.DIRECTORY.n

where "n" is one or more digits.  For example, the INFO-CPM listing
currently appears as "CPM.DIRECTORY.1"  To then get a list of files in
a particular archive, do this:

  dir PD2:<ARchives.keyword>

where "keyword" (for example, "cpm") is chosen from the preceding list,
and the word "directory" and the number "n" are not used.  At present,
all of these files are stored in ASCII.

FTP PROBLEMS, FILE ERRORS, CONNECT OR LOGIN PROBLEMS

System-related problems should be reported to ACTION@WSMR-SIMTEL20.ARMY.MIL.

ADDITIONS, IMPROVEMENTS AND CORRECTIONS

Suggestions for additions, improvements and corrections to this message
are always welcome. Please send them to w8sdz@WSMR-SIMTEL20.ARMY.MIL.

Contributions of public domain software are actively solicited.  If
you have something that seems appropriate for inclusion in the <CPM>,
<MSDOS>, or <MISC> archives, please contact Keith Petersen
<w8sdz@WSMR-SIMTEL20.ARMY.MIL>.

Contact Richard Conn <ADA-SW-Request@WSMR-SIMTEL20.ARMY.MIL> if you wish to
contribute to the <ADA> archive.

Contact Robert Thum <RThum@WSMR-SIMTEL20.ARMY.MIL> if you wish to contribute
to the <MACINTOSH> archive.

Contact Dave Curry <UNIX-SW-Request@WSMR-SIMTEL20.ARMY.MIL> if you have
something for the <UNIX-C> archive.

     Happy computing!

     Keith Petersen
     w8sdz@WSMR-SIMTEL20.Army.Mil