lph@sei.cmu.edu (Larry Howard) (07/24/90)
The Software Engineering Institute, Real-Time Embedded Systems Testbed
(REST) Project, has conducted an evaluation of seven Ada compilation
systems, for three embedded processors and two non-embedded systems, using
its Hartstone benchmark. A technical report has been produced in which the
characteristics and expected behavior of the benchmark are described, actual
results are presented and analyzed, and the lessons learned about the
compilers and processors, and the benchmark itself, are described. The
report is entitled "Hartstone Benchmark Results and Analysis, Version 1.0"
(CMU/SEI-90-TR-07) and is being made available to the public at no charge.
The document is currently available electronically in PostScript (via
anonymous ftp) and will be available in hardcopy in a week or two. The size
is rather large, 162 pages (497223 bytes). Requests, as well as inquires
concerning Hartstone (which is also available free of charge) should be sent
to:
REST Transition Services
Software Engineering Institute
Carnegie Mellon
University Pittsburgh, PA 15213-3890
Internet: hartstone-info@sei.cmu.edu
The selection of target processors and compilation systems for evaluation
was determined by their availability in our testbed. Nothing in the report
should be taken as an endorsement of, or indictment of, a particular product.
The embedded processors evaluated were:
. Intel iSBC 386/116-M02 board (16 MHz i80386 CPU, 16 MHz i80387 math
co-processor, 2 Mbytes of RAM, and 64 Kbyte cache)
. Fairchild SBC-50 board (MIL-STD-1750A Instruction Set Architecture,
15 MHz CPU, and 128 Kbytes of RAM)
. Motorola MVME133A board (20 MHz MC68020 CPU, 20 MHz MC68881
floating-point co-processor, 1 Mbyte of RAM, and 256 byte
instruction cache)
The non-embedded systems evaluated were:
. A DEC MicroVAX 3200 running VMS 5.3-1
. A Rational R1000, Series 200, Model 20, running the Delta 1 release of
the Rational Environment
The compilers for the embedded targets evaluated were:
. DDC-I DACS-80386PM VAX/VMS - i80386, release 4.3
. SD-Scicon XD Ada VAX/VMS - MC68020, version 1.0
. Tartan Ada VMS/1750A, version 2.14
. TeleSoft TeleGen2 VAX/VMS - MC68020, release 3.22a
. Verdix VADS VAX/VMS - MC68020, version 5.7
The compilers for the non-embedded systems evaluated were:
. DEC VAX Ada 2.1
. Rational Environment, Delta 1 release
Sponsored by the U.S. Department of Defense.