|
| | | | |
| | | |
| Stat |
Members: 3645
Articles: 2'506'133
Articles rated: 2609
27 April 2024 |
|
| | | | |
|
Article overview
| |
|
|
Learning from the Past: Continual Meta-Learning via Bayesian Graph Modeling | | Yadan Luo
; Zi Huang
; Zheng Zhang
; Ziwei Wang
; Mahsa Baktashmotlagh
; Yang Yang
; | | Date: |
12 Nov 2019 | | Abstract: | Meta-learning for few-shot learning allows a machine to leverage previously
acquired knowledge as a prior, thus improving the performance on novel tasks
with only small amounts of data. However, most mainstream models suffer from
catastrophic forgetting and insufficient robustness issues, thereby failing to
fully retain or exploit long-term knowledge while being prone to cause severe
error accumulation. In this paper, we propose a novel Continual Meta-Learning
approach with Bayesian Graph Neural Networks (CML-BGNN) that mathematically
formulates meta-learning as continual learning of a sequence of tasks. With
each task forming as a graph, the intra- and inter-task correlations can be
well preserved via message-passing and history transition. To remedy
topological uncertainty from graph initialization, we utilize Bayes by Backprop
strategy that approximates the posterior distribution of task-specific
parameters with amortized inference networks, which are seamlessly integrated
into the end-to-end edge learning. Extensive experiments conducted on the
miniImageNet and tieredImageNet datasets demonstrate the effectiveness and
efficiency of the proposed method, improving the performance by 42.8% compared
with state-of-the-art on the miniImageNet 5-way 1-shot classification task. | | Source: | arXiv, 1911.4695 | | Services: | Forum | Review | PDF | Favorites | |
|
|
No review found.
Did you like this article?
Note: answers to reviews or questions about the article must be posted in the forum section.
Authors are not allowed to review their own article. They can use the forum section.
browser Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
| |
|
|
|
|
News, job offers and information for researchers and scientists:
| |
REGISTER