|
| | | | |
| | | |
| Stat |
Members: 3645
Articles: 2'504'585
Articles rated: 2609
24 April 2024 |
|
| | | | |
|
Article overview
| |
|
|
Feature Flow: In-network Feature Flow Estimation for Video Object Detection | | Ruibing Jin
; Guosheng Lin
; Changyun Wen
; Jianliang Wang
; Fayao Liu
; | | Date: |
21 Sep 2020 | | Abstract: | Optical flow, which expresses pixel displacement, is widely used in many
computer vision tasks to provide pixel-level motion information. However, with
the remarkable progress of the convolutional neural network, recent
state-of-the-art approaches are proposed to solve problems directly on
feature-level. Since the displacement of feature vector is not consistent to
the pixel displacement, a common approach is to:forward optical flow to a
neural network and fine-tune this network on the task dataset. With this
method,they expect the fine-tuned network to produce tensors encoding
feature-level motion information. In this paper, we rethink this de facto
paradigm and analyze its drawbacks in the video object detection task. To
mitigate these issues, we propose a novel network (IFF-Net) with an
extbf{I}n-network extbf{F}eature extbf{F}low estimation module (IFF
module) for video object detection. Without resorting pre-training on any
additional dataset, our IFF module is able to directly produce extbf{feature
flow} which indicates the feature displacement. Our IFF module consists of a
shallow module, which shares the features with the detection branches. This
compact design enables our IFF-Net to accurately detect objects, while
maintaining a fast inference speed. Furthermore, we propose a transformation
residual loss (TRL) based on extit{self-supervision}, which further improves
the performance of our IFF-Net. Our IFF-Net outperforms existing methods and
sets a state-of-the-art performance on ImageNet VID. | | Source: | arXiv, 2009.09660 | | Services: | Forum | Review | PDF | Favorites | |
|
|
No review found.
Did you like this article?
Note: answers to reviews or questions about the article must be posted in the forum section.
Authors are not allowed to review their own article. They can use the forum section.
browser Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
| |
|
|
|
|
News, job offers and information for researchers and scientists:
| |
REGISTER