| | |
| | |
Stat |
Members: 3667 Articles: 2'599'751 Articles rated: 2609
07 February 2025 |
|
| | | |
|
Article overview
| |
|
The Predictive Forward-Forward Algorithm | Alexander Ororbia
; Ankur Mali
; | Date: |
4 Jan 2023 | Abstract: | In this work, we propose a generalization of the forward-forward (FF)
algorithm that we call the predictive forward-forward (PFF) algorithm.
Specifically, we design a dynamic, recurrent neural system that learns a
directed generative circuit jointly and simultaneously with a representation
circuit, combining elements of predictive coding, an emerging and viable
neurobiological process theory of cortical function, with the forward-forward
adaptation scheme. Furthermore, PFF efficiently learns to propagate learning
signals and updates synapses with forward passes only, eliminating some of the
key structural and computational constraints imposed by a backprop-based
scheme. Besides computational advantages, the PFF process could be further
useful for understanding the learning mechanisms behind biological neurons that
make use of local (and global) signals despite missing feedback connections. We
run several experiments on image data and demonstrate that the PFF procedure
works as well as backprop, offering a promising brain-inspired algorithm for
classifying, reconstructing, and synthesizing data patterns. As a result, our
approach presents further evidence of the promise afforded by
backprop-alternative credit assignment algorithms within the context of
brain-inspired computing. | Source: | arXiv, 2301.01452 | Services: | Forum | Review | PDF | Favorites |
|
|
No review found.
Did you like this article?
Note: answers to reviews or questions about the article must be posted in the forum section.
Authors are not allowed to review their own article. They can use the forum section.
|
| |
|
|
|