|
| | | | |
| | | |
| Stat |
Members: 3645
Articles: 2'500'096
Articles rated: 2609
18 April 2024 |
|
| | | | |
|
Article overview
| |
|
|
Deep Learning is Singular, and That's Good | | Daniel Murfet
; Susan Wei
; Mingming Gong
; Hui Li
; Jesse Gell-Redman
; Thomas Quella
; | | Date: |
22 Oct 2020 | | Abstract: | In singular models, the optimal set of parameters forms an analytic set with
singularities and classical statistical inference cannot be applied to such
models. This is significant for deep learning as neural networks are singular
and thus "dividing" by the determinant of the Hessian or employing the Laplace
approximation are not appropriate. Despite its potential for addressing
fundamental issues in deep learning, singular learning theory appears to have
made little inroads into the developing canon of deep learning theory. Via a
mix of theory and experiment, we present an invitation to singular learning
theory as a vehicle for understanding deep learning and suggest important
future work to make singular learning theory directly applicable to how deep
learning is performed in practice. | | Source: | arXiv, 2010.11560 | | Services: | Forum | Review | PDF | Favorites | |
|
|
No review found.
Did you like this article?
Note: answers to reviews or questions about the article must be posted in the forum section.
Authors are not allowed to review their own article. They can use the forum section.
browser claudebot
|
| |
|
|
|
|
News, job offers and information for researchers and scientists:
| |
REGISTER