skip to main content
article
Free Access

The basic ideas in neural networks

Published:01 March 1994Publication History
First page image

References

  1. 1 Cohen, M.N. and Grossberg, S. Absolute stability of global pattern formation and parallel memory storage by competitive neural networks. IEEE Trans. Man Cybernet. 13 (1983).Google ScholarGoogle Scholar
  2. 2 Curry, B. and Rumethart, D.E. MSNET: A neural network that classities mass spectra. H PL "I~ch. Rep. 90- 16, MPI.Google ScholarGoogle Scholar
  3. 3 Grossberg, S. Adaptive pattern classification and universal recoding: Part Parallel development and .coding of neural feature detectors. Bio. Cybeme~. 23 (I976), 1121-I34.Google ScholarGoogle Scholar
  4. 4 Hebb, D.O. The ONanization of Beluzv-. ior. Wiley, New York, 1949.Google ScholarGoogle Scholar
  5. 5 Hinton, G.E. and Sejnowski, T. Learning and relearning in Boitzmann Ma.clhines. In Parallel DistribuIed Processing: Exploration in the Microstructure of Cognition. Vol. 1: Foun&tions, D.E. Rume|hart, J.I .. McCMland, and PDP Res. Grp. MIT Press/Bradford Books, Cambridge, Mass., 1986. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. 6 Hoptield, JJ. Neural networks and physical systems with emergent collective computational abilities. In Proceedings of the National Academy 0f Sciences, :USA. Vol. 79. National Academy of Sciences, Washington, D.C., 19:82.Google ScholarGoogle Scholar
  7. 7 McCulloch, W.S. and Pitts, W. A logical calculus of the ideas imminent in nervous activity. Bull. Math. Biophys. 5, 115-I33.Google ScholarGoogle ScholarCross RefCross Ref
  8. 8 Minsky, M. and Papert, S. Perceptrons. M IT Press, Cambridge, Mass., 1969.Google ScholarGoogle Scholar
  9. 9 Rosenblatt, E Principles of Neurodynamics. Spartan,. New York, 19,62.Google ScholarGoogle Scholar
  10. 10 R.umelhart, D.E. Theory to pm.ctice: A case study-Recognizing lsjij hand writing. In Proceedings of teh Third NEC Research Symposium. SIAM. 1993.Google ScholarGoogle Scholar
  11. 11 Rumelhart, E.D., Hinton, G.E., and illiams, R.J. Learning internal representations by error propagation. In Distributed Procerssing: Explorations in the Microstructure of Cogntion. Vol. I Foundations, D.E., Rumelhart. J.L. Mcclelland, and PDP Res. Grp. MIT Press/Bradford Books, Cambridge, Mass., 1986. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. 12 Rumelhart, D.E., McClelland. J.L., and the PDP Research Grupou Parallel Distributed Processing Explorations in the Microstructure of cagnition., Vol. I Foundations. MIT Press/Bradford Books, cambridge, Mass., 1986. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. 13 Selfridge, o.G. Pattern recognition in modern computers. In Proceedings of the western joint computer conference ACM New York. 1955.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. 14 Smolensky, P. Information processing in dynamical systems. Foundations of harmony theory. In Paralel Distributed Processing: Explorations in the Microstructure of Cognition. Vol. 1 Foundations, D.E. Rumelhart, J.L. McGlelland, and the PDP Res. Grp. MIT Press/Bradford Books, Cambridge Mass., 1986. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. 15 Weigend, A.S., Rumelhart. D.E. and Hubberman. B. Genrealization by weight- elimination with applications to forecasting. In Advances in Neural Information Processing. Vol. 3 R.P. J. Mody, and D.S. Tour- Morgan Kaufman San mateo. Calif., 1991, pp. 825-882. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. 16 Werbos. P. Beyond Regression: New Tools for prediction and Analysis in the Behavirol Sciences. Harvard. univ- Cambridge, Mass.Google ScholarGoogle Scholar
  17. 17 Window, b. and Hoff, M.E. Adaptive switching circuits. In Institute of radio Engineers, Western Electrnnic Show and convention, convention record. Part 4. Inst. Radio Eng., 1960, pp. 96-104.Google ScholarGoogle Scholar
  18. 18 Window, B., Rumelhart, D.E., and Lehr, M.A. Common ACM 37, 4 (March 1994) (this issue). Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. The basic ideas in neural networks

            Recommendations

            Reviews

            Jaak Tepandi

            A long list of scientists motivated to work in the neural network area begins this introductory paper. The paper proceeds with an overview of a basic model of a neuron, a sketch of a brain-like computational device, and a historical overview of neural network work. Learning by example, the backpropagation learning procedure, and generalization are treated in some detail. The paper concludes with hints for successful applications. The references cover a wider than usual span of time, presenting some important earlier work. The paper can be good reading for those wishing to get an overview of basic neural network ideas and some implementation insight in the shortest time with the smallest effort.

            Access critical reviews of Computing literature here

            Become a reviewer for Computing Reviews.

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            • Published in

              cover image Communications of the ACM
              Communications of the ACM  Volume 37, Issue 3
              March 1994
              105 pages
              ISSN:0001-0782
              EISSN:1557-7317
              DOI:10.1145/175247
              Issue’s Table of Contents

              Copyright © 1994 ACM

              Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

              Publisher

              Association for Computing Machinery

              New York, NY, United States

              Publication History

              • Published: 1 March 1994

              Permissions

              Request permissions about this article.

              Request Permissions

              Check for updates

              Qualifiers

              • article

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader