|
| | | | |
| | | |
| Stat |
Members: 3645
Articles: 2'504'585
Articles rated: 2609
25 April 2024 |
|
| | | | |
|
Article overview
| |
|
|
Feature Learning Viewpoint of AdaBoost and a New Algorithm | | Fei Wang
; Zhongheng Li
; Fang He
; Rong Wang
; Weizhong Yu
; Feiping Nie
; | | Date: |
8 Apr 2019 | | Abstract: | The AdaBoost algorithm has the superiority of resisting overfitting.
Understanding the mysteries of this phenomena is a very fascinating fundamental
theoretical problem. Many studies are devoted to explaining it from statistical
view and margin theory. In this paper, we illustrate it from feature learning
viewpoint, and propose the AdaBoost+SVM algorithm, which can explain the
resistant to overfitting of AdaBoost directly and easily to understand.
Firstly, we adopt the AdaBoost algorithm to learn the base classifiers. Then,
instead of directly weighted combination the base classifiers, we regard them
as features and input them to SVM classifier. With this, the new coefficient
and bias can be obtained, which can be used to construct the final classifier.
We explain the rationality of this and illustrate the theorem that when the
dimension of these features increases, the performance of SVM would not be
worse, which can explain the resistant to overfitting of AdaBoost. | | Source: | arXiv, 1904.3953 | | Services: | Forum | Review | PDF | Favorites | |
|
|
No review found.
Did you like this article?
Note: answers to reviews or questions about the article must be posted in the forum section.
Authors are not allowed to review their own article. They can use the forum section.
browser Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
| |
|
|
|
|
News, job offers and information for researchers and scientists:
| |
REGISTER