|
| | | | |
| | | |
| Stat |
Members: 3645
Articles: 2'500'096
Articles rated: 2609
18 April 2024 |
|
| | | | |
|
Article overview
| |
|
|
RotationOut as a Regularization Method for Neural Network | | Kai Hu
; Barnabas Poczos
; | | Date: |
18 Nov 2019 | | Abstract: | In this paper, we propose a novel regularization method, RotationOut, for
neural networks. Different from Dropout that handles each neuron/channel
independently, RotationOut regards its input layer as an entire vector and
introduces regularization by randomly rotating the vector. RotationOut can also
be used in convolutional layers and recurrent layers with small modifications.
We further use a noise analysis method to interpret the difference between
RotationOut and Dropout in co-adaptation reduction. Using this method, we also
show how to use RotationOut/Dropout together with Batch Normalization.
Extensive experiments in vision and language tasks are conducted to show the
effectiveness of the proposed method. Codes are available at
url{this https URL}. | | Source: | arXiv, 1911.7427 | | Services: | Forum | Review | PDF | Favorites | |
|
|
No review found.
Did you like this article?
Note: answers to reviews or questions about the article must be posted in the forum section.
Authors are not allowed to review their own article. They can use the forum section.
browser claudebot
|
| |
|
|
|
|
News, job offers and information for researchers and scientists:
| |
REGISTER