davel@cbnewsl.ATT.COM (David Loewenstern) (03/06/90)
LISP BENCHMARK Gabriel benchmarks, from SYS:EXAMPLES; on the Symbolics lisp machine. All times in seconds of "clock" time, on single-user standalone systems (in the case of the DN10000) or systems in which all external connections were closed and in which there was no network traffic involving the test machine. All tests run with freshly booted worlds (in the case of the Symbolicses, these worlds were full-gc'ed and optimized) with only the Gabriels and a small amount of lispm-init code loaded. Ephemeral GC was *on*, Dynamic GC was *off* on all machines. Fuller descriptions of the systems are given below. For reference: HP = HP DN10000, TI = TI Explorer model II 36xx = various Symbolics machines. The HP was benchmarked with (OPT) and without (NOPT) type declarations and production-mode compiler optimizations. If anyone has an explanation for why the 3650 was so slow relative to the 3675 and even 3645, I'd like to hear it. _____________________________________________________________________________ NAME HP(OPT) HP(NOPT) TI 3645 3675 3650 _____________________________________________________________________________ BOYER 3.442 5.006 3.483 9.309 9.311 10.423 _____________________________________________________________________________ BROWSE 5.507 8.016 5.233 11.824 11.874 13.622 _____________________________________________________________________________ DESTRUCT 0.373 0.654 0.517 1.372 1.367 1.522 _____________________________________________________________________________ TRAVERSE-INIT 1.274 3.398 2.3 5.640 5.627 6.985 _____________________________________________________________________________ TRAVERSE 7.636 21.585 18.083 32.813 32.807 37.754 _____________________________________________________________________________ TAK 0.067 0.132 0.117 0.586 0.436 0.470 _____________________________________________________________________________ STAK 0.426 0.607 0.917 2.487 2.408 2.452 _____________________________________________________________________________ CTAK 0.317 0.504 0.450 5.105 5.069 5.745 _____________________________________________________________________________ TAKL 0.468 1.073 1.850 5.790 5.002 5.433 _____________________________________________________________________________ TAKR 0.092 0.164 0.117 0.574 0.491 0.523 _____________________________________________________________________________ DERIV 1.003 1.058 1.400 3.462 3.470 3.670 _____________________________________________________________________________ DDERIV 1.146 1.229 1.483 3.436 3.482 3.558 _____________________________________________________________________________ DIV2-I 0.365 0.652 0.550 1.571 1.586 1.746 _____________________________________________________________________________ DIV2-R 0.460 0.780 0.900 2.576 2.594 2.763 _____________________________________________________________________________ FFT 0.353 12.426 3.767 3.515 3.520 2.560 _____________________________________________________________________________ PUZZLE 1.718 9.315 3.150 12.025 12.020 15.455 _____________________________________________________________________________ TRIANG 19.999 106.162 44.367 118.199 118.843 140.498 _____________________________________________________________________________ FRPOLY10R 0.106 0.194 0.117 0.380 0.381 0.447 _____________________________________________________________________________ FRPOLY10R2 0.359 0.462 0.317 1.936 1.769 2.312 _____________________________________________________________________________ FRPOLY10R3 0.166 0.268 0.233 0.422 0.369 0.443 _____________________________________________________________________________ FRPOLY15R 0.702 1.372 0.90 2.530 2.535 3.002 _____________________________________________________________________________ FRPOLY15R2 3.394 4.133 2.783 1.394 1.397 16.791 _____________________________________________________________________________ FRPOLY15R3 1.194 1.964 1.75 2.857 2.859 2.973 _____________________________________________________________________________ TOTAL 50.567 181.154 94.784 229.803 229.217 281.147 _____________________________________________________________________________ The system configurations: Lisp Type: Symbolics Common Lisp Lisp Version: System 376.158, 3645-MIC microcode 420 Software Type: Lisp Machine Software Version: Genera 7.2, System 376.158, Experimental Logical Pathnames Translation Files NEWEST, Utilities 27.29, Server Utilities 28.5, Hardcopy 118.17, Zmail 165.20, LMFS 102.7, Tape 82.18, Nsage 27.245, Extended Help 18.4, Documentation Database 62.1, Print Spooler 16.1, DNA 41.9, IP-TCP 67.5, Security Logging System 4.2, microcode 3645-MIC 420, FEP 127, fep0:>v127-lisp.flod(64), fep0:>v127-loaders.flod(64), fep0:>v127-debug.flod(38), fep0:>v127-info.flod(64), Machine serial number 10232 Machine Type: Symbolics 3645 Machine Version: Chassis (P.N. 170219) S.N. 1576, manufactured on 1986-05-30 Machine serial number 10232. Manufactured as rev 1, functions as rev 1, ECO level 0 Datapath (P.N. 170032) S.N. 4455, manufactured on 1986-01-17 Manufactured as rev 3, functions as rev 3, ECO level 0 Extended Sequencer (P.N. 170299) S.N. 498, manufactured on 1986-04-03 Manufactured as rev 1, functions as rev 1, ECO level 0 Instruction Fetch Unit (P.N. 170260) S.N. 384, manufactured on 1986-05-30 Manufactured as rev 1, functions as rev 1, ECO level 0 Front End (P.N. 170062) S.N. 2852, manufactured on 1984-10-18 Manufactured as rev 5, functions as rev 5, ECO level 0 1Meg Memory (P.N. 170473) S.N. 741, manufactured on 1986-04-23 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 0 (octal base address 0) IO (P.N. 170157) S.N. 3675, manufactured on 1986-12-09 Manufactured as rev 6, functions as rev 6, ECO level 0 LBUS slot 3 (octal base address 6000000) 2Meg Memory (P.N. 170309) S.N. 2452, manufactured on 1987-12-28 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 4 (octal base address 10000000) FEP Paddle Card (P.N. 170069) S.N. 2501, manufactured on 1986-04-15 Manufactured as rev 1, functions as rev 1, ECO level 0 IO Paddle Card (P.N. 170162) S.N. 1225, manufactured on 1986-04-22 Ethernet address: 08-00-05-02-48-26 Monitor-type: Moniterm Manufactured as rev 1, functions as rev 1, ECO level 0 Machine Instance: GREER Site: Wh Features: (:DEFSTORAGE :DEBUG-SCHEDULER-QUEUES :NEW-SCHEDULER :LOOP :DEFSTRUCT :LISPM :SYMBOLICS :GENERA :ROW-MAJOR 3600 :CHAOS :IEEE-FLOATING-POINT :SORT :FASLOAD :STRING :NEWIO :ROMAN :TRACE :GRINDEF :GRIND) Lisp Type: Symbolics Common Lisp Lisp Version: System 376.158, 3650-FPA-MIC microcode 420 Software Type: Lisp Machine Software Version: Genera 7.2, System 376.158, Experimental Logical Pathnames Translation Files NEWEST, Utilities 27.29, Server Utilities 28.5, Hardcopy 118.17, Zmail 165.20, LMFS 102.7, Tape 82.18, Nsage 27.245, Extended Help 18.4, Documentation Database 62.1, DNA 41.9, IP-TCP 67.5, Security Logging System 4.2, microcode 3650-FPA-MIC 420, FEP 208, Fep0:>g208-lisp.flod(4), Fep0:>g208-loaders.flod(4), Fep0:>g208-info.flod (4), Fep0:>g208-debug.flod(2), Machine serial number 30711 Machine Type: Symbolics 3650 Machine Version: Chassis (P.N. 364202) S.N. 30711, manufactured on 1988-01-05 Machine serial number 30711. Manufactured as rev 1, functions as rev 1, ECO level 0 NBS Processor (P.N. 170393) S.N. 2085, manufactured on 1988-11-04 FPA is present. Manufactured as rev 1, functions as rev 1, ECO level 0 2Meg Memory (P.N. 170309) S.N. 2446, manufactured on 1987-12-28 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 0 (octal base address 0) 2Meg Memory (P.N. 170309) S.N. 2849, manufactured on 1988-05-06 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 1 (octal base address 2000000) 2Meg Memory (P.N. 170309) S.N. 2622, manufactured on 1988-02-24 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 2 (octal base address 4000000) 2Meg Memory (P.N. 170309) S.N. 2587, manufactured on 1988-01-15 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 3 (octal base address 6000000) NBS FEP/IO (P.N. 170495) S.N. 1804, manufactured on 1987-10-15 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 4 (octal base address 10000000) SLB Console (P.N. 170464) S.N. 1920, manufactured on 1988-03-18 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 20 (octal base address 50000000) NBS FEP/IO SMD Paddle (P.N. 170413) S.N. 1161, manufactured on 1987-12-19 Manufactured as rev 1, functions as rev 1, ECO level 0 Machine Instance: WHITE-SANDS Site: Wh Features: (:DEBUG-FDS :DEFSTORAGE :DEBUG-SCHEDULER-QUEUES :NEW-SCHEDULER :LOOP :DEFSTRUCT :LISPM :SYMBOLICS :GENERA :ROW-MAJOR 3600 :CHAOS :IEEE-FLOATING-POINT :SORT :FASLOAD :STRING :NEWIO :ROMAN :TRACE :GRINDEF :GRIND) Lisp Type: Symbolics Common Lisp Lisp Version: System 376.158, 3675-MIC microcode 420 Software Type: Lisp Machine Software Version: Genera 7.2, System 376.158, Experimental Logical Pathnames Translation Files NEWEST, Utilities 27.29, Server Utilities 28.5, Hardcopy 118.17, Zmail 165.20, LMFS 102.7, Tape 82.18, Nsage 27.245, Extended Help 18.4, Documentation Database 62.1, IP-TCP 67.5, DNA 41.9, Color 405.13, Color Patches 401.1, Color Support 409.13, Color Doc 408.0, SGD Book Design 2.6, Security Logging System 4.2, microcode 3675-MIC 420, FEP 127, Fep1:>v127-lisp.flod(56), Fep1:>v127-loaders.flod(56), Fep1:>v127-tests.flod(56), Fep1:>v127-debug.flod(34), Fep1:>v127-info.flod(56), Machine serial number 7619, Machine Type: Symbolics 3675 Machine Version: Chassis (P.N. 170027) S.N. 2872, manufactured on 1986-05-14 Machine serial number 7619. Manufactured as rev 1, functions as rev 1, ECO level 0 Datapath (P.N. 170032) S.N. 5594, manufactured on 1986-09-08 Manufactured as rev 3, functions as rev 3, ECO level 0 Extended Sequencer (P.N. 170299) S.N. 318, manufactured on 1986-01-06 Manufactured as rev 1, functions as rev 1, ECO level 0 Instruction Fetch Unit (P.N. 170260) S.N. 401, manufactured on 1986-06-06 Manufactured as rev 1, functions as rev 1, ECO level 0 Front End (P.N. 170062) S.N. 5369, manufactured on 1986-05-27 Manufactured as rev 5, functions as rev 5, ECO level 0 2Meg Memory (P.N. 170309) S.N. 1600, manufactured on 1987-01-27 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 0 (octal base address 0) Color memory (P.N. 170136) S.N. 2915, manufactured on 1987-03-10 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 1 (octal base address 2000000) Color memory (P.N. 170136) S.N. 2778, manufactured on 1986-12-08 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 2 (octal base address 4000000) Color memory (P.N. 170136) S.N. 2651, manufactured on 1986-08-01 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 3 (octal base address 6000000) Color controller (P.N. 170140) S.N. 1286, manufactured on 1985-11-23 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 4 (octal base address 10000000) Tape (P.N. 170176) S.N. 58, manufactured on 1985-08-27 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 7 (octal base address 16000000) 2Meg Memory (P.N. 170309) S.N. 2816, manufactured on 1988-04-20 Manufactured as rev 1, functions as rev 1, ECO level 0 LBUS slot 8 (octal base address 20000000) IO (P.N. 170157) S.N. 155, manufactured on 1984-07-24 Manufactured as rev 6, functions as rev 6, ECO level 0 LBUS slot 12 (octal base address 30000000) FEP Paddle Card (P.N. 170069) S.N. 3079, manufactured on 1986-11-13 Manufactured as rev 1, functions as rev 1, ECO level 0 IO Paddle Card (P.N. 170162) S.N. 1048, manufactured on 1986-01-24 Ethernet address: 08-00-05-02-C0-20 Monitor-type: Philips Manufactured as rev 1, functions as rev 1, ECO level 0 Machine Instance: RYAN Site: Wh Features: (:DEBUG-FDS :DEFSTORAGE :DEBUG-SCHEDULER-QUEUES :NEW-SCHEDULER :LOOP :DEFSTRUCT :LISPM :SYMBOLICS :GENERA :ROW-MAJOR 3600 :CHAOS :IEEE-FLOATING-POINT :SORT :FASLOAD :STRING :NEWIO :ROMAN :TRACE :GRINDEF :GRIND) Lisp Type: TI Common Lisp Lisp Version: Explorer System Release 6.0, Microcode EXP2-UCODE 429 for the Explorer Lisp Microprocessor. With SYSTEM 6.15, VIRTUAL-MEMORY 6.1, EH 6.4, MAKE-SYSTEM 6.0, MICRONET 6.0, LOCAL-FILE 6.0, BASIC-PATHNAME 6.1, NETWORK-SUPPORT-COLD 6.0, BASIC-NAMESPACE 6.2, NETWORK-NAMESPACE 6.0, DISK-IO 6.1, DISK-LABEL 6.0, BASIC-FILE 6.2, MAC-PATHNAME 6.0, NETWORK-PATHNAME 6.0, COMPILER 6.10, TV 6.15, DATALINK 6.0, CHAOSNET 6.0, GC 6.3, MEMORY-AUX 6.0, NVRAM 6.1, SYSLOG 6.1, STREAMER-TAPE 6.4, UCL 6.0, INPUT-EDITOR 6.0, METER 6.1, ZWEI 6.5, ZMACS-EXTRAS 6.0, DEBUG-TOOLS 6.3, NETWORK-SUPPORT 6.0, NETWORK-SERVICE 6.1, DATALINK-DISPLAYS 6.0, FONT-EDITOR 6.1, SERIAL 6.0, PRINTER 6.3, MAC-PRINTER-TYPES 6.1, PRINTER-TYPES 6.1, IMAGEN 6.0, SUGGESTIONS 6.0, MAIL-DAEMON 6.2, MAIL-READER 6.2, TELNET 6.0, VT100 6.0, NAMESPACE-EDITOR 6.0, PROFILE 6.1, VISIDOC 6.4, TI-CLOS 6.20, CLEH 6.5, COLOR-MAP-EDITOR 6.0. Software Type: TI Common Lisp Software Version: Explorer System Release 6.0, Microcode EXP2-UCODE 429 for the Explorer Lisp Microprocessor. With SYSTEM 6.15, VIRTUAL-MEMORY 6.1, EH 6.4, MAKE-SYSTEM 6.0, MICRONET 6.0, LOCAL-FILE 6.0, BASIC-PATHNAME 6.1, NETWORK-SUPPORT-COLD 6.0, BASIC-NAMESPACE 6.2, NETWORK-NAMESPACE 6.0, DISK-IO 6.1, DISK-LABEL 6.0, BASIC-FILE 6.2, MAC-PATHNAME 6.0, NETWORK-PATHNAME 6.0, COMPILER 6.10, TV 6.15, DATALINK 6.0, CHAOSNET 6.0, GC 6.3, MEMORY-AUX 6.0, NVRAM 6.1, SYSLOG 6.1, STREAMER-TAPE 6.4, UCL 6.0, INPUT-EDITOR 6.0, METER 6.1, ZWEI 6.5, ZMACS-EXTRAS 6.0, DEBUG- TOOLS 6.3, NETWORK-SUPPORT 6.0, NETWORK-SERVICE 6.1, DATALINK-DISPLAYS 6.0, FONT-EDITOR 6.1, SERIAL 6.0, PRINTER 6.3, MAC-PRINTER-TYPES 6.1, PRINTER-TYPES 6.1, IMAGEN 6.0, SUGGESTIONS 6.0, MAIL-DAEMON 6.2, MAIL- READER 6.2, TELNET 6.0, VT100 6.0, NAMESPACE-EDITOR 6.0, PROFILE 6.1, VISIDOC 6.4, TI-CLOS 6.20, CLEH 6.5, COLOR-MAP-EDITOR 6.0. Machine Type: Explorer II Machine Version: Explorer II, Microcode EXP2-UCODE 429 for the Explorer Lisp Microprocessor Machine Instance: MAGELLAN Site: BOOT Features: (:COLOR :CLOS :TI :EXPLORER :COMMON-LISP :IEEE-FLOATING-POINT :LISPM :FLAVORS :DEFSTRUCT :LOOP :ELROY :CHAOS :SORT :FASLOAD :STRING :NEWIO :TRACE :GRINDEF) Lisp Type: Domain/CommonLISP Lisp Version: Domain/CommonLISP, Development Environment Version 4.00. Beta, 20 December 1989 Software Type: Domain/OS Software Version: Domain/OS kernel(10), revision 10.2, November 13, 1989 3:09:42 pm Machine Type: Apollo DN10000 Machine Version: Apollo DN10000, 49152 KB Memory Machine Instance: node_1f410_1F410 Site: NIL Features: (:MULTITASKING :LCL4.0 :LCL3.0 :EGC :EDITOR :WINDOWS :COLOR :CLXR3 :XLIB :MONITORING :FLAVORS :PQC :COMPILER :LOOP :IEEE-FLOATING-POINT :PRISM :APOLLO :DOMAIN/OS :AEGIS :UNIX :LUCID :COMMON-LISP) The DN10000 was run with 2 CPU's, but this should have had little impact since only one process was run (there may be some effect on garbage collection speed). David Loewenstern AT&T Bell Laboratories 14B-253 Whippany, NJ 07981 email: davel@whutt.att.com || whutt!davel at&t: 201-386-6516