[comp.ai.neural-nets] Information capacity of neural networks

drolet@wiener.ino.qc.ca (Jean-Jacques Drolet) (04/11/91)

Hi!

I would like to obtain some information regarding the information capacity
of common neural network models such as the Hopfield network, the
back-propagation network, the Kohonen self-organizing feature map and
ART networks. Does anybody know good references on this subject?
I thank you in advance for your help.

-- 
Jean-Jacques Drolet            |    Snail: 2631 boul. Liegeois, Sainte-Foy
National Optics Institute      |           Quebec, Canada, G1W 1Z5
Phone:         +1 418 657 7006 | Internet: drolet@drolet.CAM.ORG
Home phone:    +1 418 651 3796 |     UUCP: uunet!drolet!drolet

ronl@tessi.UUCP (Ron Lunde) (04/28/91)

One source for the information capacity of Hopfield networks,
and variations, is:

Introduction to the Theory of Neural Computation,
by John Hertz, Anders Krogh, Richard G. Palmer
Published by Addison-Wesley, 1991

I'm not sure their book will satisfy everyone, since they are
statistical physicists and tend to have very "physical" views
of neural networks, but they have mathematical proofs of things
like capacity limits, which might be more useful as reference 
material than the popular press.

-----------------------------------------------------------------------------
Ron E. Lunde    ronl@tessi  sun.com!nosun!tessi!ronl
Test Systems Strategies, Inc.            
8205 S.W. Creekside Place        | I'm not sure if my opinions reflect
Beaverton, OR 97005 USA          | those of my employer, or not...
Phone: (503) 643-9281   FAX: (503) 646-4954
-----------------------------------------------------------------------------