|
| | | | |
| | | |
| Stat |
Members: 3645
Articles: 2'501'711
Articles rated: 2609
19 April 2024 |
|
| | | | |
|
Article overview
| |
|
|
EDD: Efficient Differentiable DNN Architecture and Implementation Co-search for Embedded AI Solutions | | Yuhong Li
; Cong Hao
; Xiaofan Zhang
; Xinheng Liu
; Yao Chen
; Jinjun Xiong
; Wen-mei Hwu
; Deming Chen
; | | Date: |
6 May 2020 | | Abstract: | High quality AI solutions require joint optimization of AI algorithms and
their hardware implementations. In this work, we are the first to propose a
fully simultaneous, efficient differentiable DNN architecture and
implementation co-search (EDD) methodology. We formulate the co-search problem
by fusing DNN search variables and hardware implementation variables into one
solution space, and maximize both algorithm accuracy and hardware
implementation quality. The formulation is differentiable with respect to the
fused variables, so that gradient descent algorithm can be applied to greatly
reduce the search time. The formulation is also applicable for various devices
with different objectives. In the experiments, we demonstrate the effectiveness
of our EDD methodology by searching for three representative DNNs, targeting
low-latency GPU implementation and FPGA implementations with both recursive and
pipelined architectures. Each model produced by EDD achieves similar accuracy
as the best existing DNN models searched by neural architecture search (NAS)
methods on ImageNet, but with superior performance obtained within 12 GPU-hour
searches. Our DNN targeting GPU is 1.40x faster than the state-of-the-art
solution reported in Proxyless, and our DNN targeting FPGA delivers 1.45x
higher throughput than the state-of-the-art solution reported in DNNBuilder. | | Source: | arXiv, 2005.2563 | | Services: | Forum | Review | PDF | Favorites | |
|
|
No review found.
Did you like this article?
Note: answers to reviews or questions about the article must be posted in the forum section.
Authors are not allowed to review their own article. They can use the forum section.
browser Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
| |
|
|
|
|
News, job offers and information for researchers and scientists:
| |
REGISTER