guy@kcl-cs.UUCP (YUG) (03/19/90)
Does anyone out there have any information on learning of temporal patterns
with neural networks? The only reference I currently have is :-
Neural Networks that learn temporal sequences by selection
S.Dehaene et al
Proc. Natl. Acad. Sci. Vol.84 May 1987 pp2727-2731
Any further references would be greatly appreciated.
YUG
---\-/|--/---------------------------------------------------------------------
\ | / Guy Bunker, Dept. of Computing, King's College London.
\|/ JANET : guy%kcl-cs@uk.ac.ukc
__|__ JANET : G.Bunker@uk.ac.kcl.oak
---"-----"---------------------------------------------------------------------
Nature it seems decrees that waves should reach their greatest stature
of power and beauty barely an instant before their annihilation.gaudiano@retina.bu.edu (Paolo Gaudiano) (03/21/90)
I presented some work at the 1987 NIPS conference in Denver (American
Institute of Physics), titled "Temporal Patterns of Activity in Neural
Networks." While the results left a lot to be desired due to a
numerical error, the bibliography has some good references I report
below. Also, the same volue has articles by A. Robinson & F. Fallside
("Static and dynamic error propagation networks with application to
speech coding"), W. S. Stornetta ("A Dynamical Approach to Temporal
Pattern Processing"), and T. Homma et al. ("An artificial neural
network for spatiotemporal bipolar patterns: Application to phoneme
classification").
[1] B. Baird, "Nonlinear Dynamics of pattern formation and pattern
recognition in the rabbit olfactory bulb". Physica 22D, 150-175. 1986.
[2] M. Jordan, "Attractor dynamics and parallelism in a connectionist
sequential machine". Proceedings of the Eighth annual conference of
the cognitive sciences society. 1986.
[3] D. Kleinfeld, "Sequential State generation by model neural
networks" Proc. Natl. Acad. Sci. USA. 83: 9469-9473. 1986.
[4] H. Sompolinsky, I. Kanter, "Temporal association in asymmetric
neural networks". Phys. Rev. Let. 57: 2861-2864. 1986.
Prior to that there is also some interesting work by Grossberg, that
is distributed over a number of papers and under many headings. A good
overview is;
[5] S. Grosberg, "The adaptive self-organization of serial order in
behavior: speech, language, and motor control." Reprinted as ch. 6 in
'The adaptive Brain II'. Amsterdam:Elsevier/North-Holland. 1986.
A more recent model is:
[6] S. Grossberg, N. Schmajuk "Neural dynamics of adaptive timing and
temporal discrimination during associative learning". Neural Networks.
V. 2 (2). 79-102. 1989.
Hope this is useful to other people as well.
Paolo Gaudianokerce@nu.cs.fsu.edu (Kingsley F. Kerce) (03/21/90)
[Email to guy@kcl-cs.UUCP bounced.] Here's some references from a tutorial I attended during the WNN-AIND 1990 workshop. Grossberg, Stephen. "Some networks can learn, remember, and reproduce any number of complicated space-time patterns", Journal of Math. and Mechanics #19, pp. 53-91, 196?. (unsure of the year) Hecht-Nielsen. "Nearest matched filter classification of spatio-temporal patterns", Applied Optics #26, pp. 1892-1899, 1987. Ito and Fukushima. "Recognition of spatio-temporal patterns with a hierarchical neural network", Proc. of IJCNN 1990 #1, pp. 273-276, 1990. Fukushima. "Spatio-temporal vs. spatial pattern recognition by neocognitron", Proc. of IJCNN 90 #2, pp. 279-282, 1990. Waibel, Hanazawa, Hinton, Shikano, and Lang. "Phoneme recognition using time-delay neural networks", IEEE Trans. ASSP #37, pp. 328-339, 1989. Hope this is actually what you're after. Note that I'm not particularly interested in the above references--I just recalled running across them in the tutorial. Good luck, -- Kingsley Kerce USnail: Dept. of Computer Sci. (or Dept. of Psych.) Email: kerce@nu.cs.fsu.edu Florida State University Work Phone: (904) 644-5436 Tallahassee, FL 32306