Neocognitron
The neocognitron is a hierarchical, multilayered artificial neural network proposed by Kunihiko Fukushima in 1979.[1][2] It has been used for Japanese handwritten character recognition and other pattern recognition tasks, and served as the inspiration for convolutional neural networks.[3]
Previously in 1969, he published a similar architecture, but with hand-designed kernels inspired by convolutions in mammalian vision.[4] In 1975 he improved it to the Cognitron,[5][6] and in 1979 he improved it to the neocognitron, which learns all convolutional kernels by unsupervised learning (in his terminology, "self-organized by 'learning without a teacher'").[2]
The neocognitron was inspired by the model proposed by Hubel & Wiesel in 1959. They found two types of cells in the visual primary cortex called simple cell and complex cell, and also proposed a cascading model of these two types of cells for use in pattern recognition tasks.[7][8]
The neocognitron is a natural extension of these cascading models. The neocognitron consists of multiple types of cells, the most important of which are called S-cells and C-cells.Template:Sfn The local features are extracted by S-cells, and these features' deformation, such as local shifts, are tolerated by C-cells. Local features in the input are integrated gradually and classified in the higher layers.Template:Sfn The idea of local feature integration is found in several other models, such as the Convolutional Neural Network model, the SIFT method, and the HoG method.
There are various kinds of neocognitron.Template:Sfn For example, some types of neocognitron can detect multiple patterns in the same input by using backward signals to achieve selective attention.Template:Sfn
See also
- Artificial neural network
- Deep learning
- Pattern recognition
- Receptive field
- Self-organizing map
- Unsupervised learning
Notes
References
- Script error: No such module "Citation/CS1".
- Script error: No such module "Citation/CS1".
- Script error: No such module "citation/CS1".
- Script error: No such module "Citation/CS1".
- Script error: No such module "Citation/CS1".
External links
- Neocognitron on Scholarpedia
- NeoCognitron by Ing. Gabriel Minarik - application (C#) and video
- Neocognitron resources at Visiome Platform - includes MATLAB environment
- Beholder - a Neocognitron simulator
Template:Artificial-neural-network-stub
- ↑ Script error: No such module "Citation/CS1".
- ↑ a b Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ Script error: No such module "Citation/CS1".
- ↑ Fukushima, K.: Self-organizing multilayered neuron network "Cognitron" (in Japanese), Paper of Technical Group on Pattern Recognition and Learning, Inst. Electronics Comm. Engrs. Japan, PRL74-25 (1974); and 1974 Nat. Conv. Rec. of Inst. Electronics Commun. Engrs. Japan, No. S9-8 (1974)
- ↑ Script error: No such module "citation/CS1".
- ↑ Script error: No such module "Citation/CS1".