|
| | | | |
| | | |
| Stat |
Members: 3645
Articles: 2'506'133
Articles rated: 2609
26 April 2024 |
|
| | | | |
|
Article overview
| |
|
|
Nonlinear ISA with Auxiliary Variables for Learning Speech Representations | | Amrith Setlur
; Barnabas Poczos
; Alan W Black
; | | Date: |
25 Jul 2020 | | Abstract: | This paper extends recent work on nonlinear Independent Component Analysis
(ICA) by introducing a theoretical framework for nonlinear Independent Subspace
Analysis (ISA) in the presence of auxiliary variables. Observed high
dimensional acoustic features like log Mel spectrograms can be considered as
surface level manifestations of nonlinear transformations over individual
multivariate sources of information like speaker characteristics, phonological
content etc. Under assumptions of energy based models we use the theory of
nonlinear ISA to propose an algorithm that learns unsupervised speech
representations whose subspaces are independent and potentially highly
correlated with the original non-stationary multivariate sources. We show how
nonlinear ICA with auxiliary variables can be extended to a generic
identifiable model for subspaces as well while also providing sufficient
conditions for the identifiability of these high dimensional subspaces. Our
proposed methodology is generic and can be integrated with standard
unsupervised approaches to learn speech representations with subspaces that can
theoretically capture independent higher order speech signals. We evaluate the
gains of our algorithm when integrated with the Autoregressive Predictive
Decoding (APC) model by showing empirical results on the speaker verification
and phoneme recognition tasks. | | Source: | arXiv, 2007.12948 | | Services: | Forum | Review | PDF | Favorites | |
|
|
No review found.
Did you like this article?
Note: answers to reviews or questions about the article must be posted in the forum section.
Authors are not allowed to review their own article. They can use the forum section.
browser Mozilla/5.0 AppleWebKit/537.36 (KHTML, like Gecko; compatible; ClaudeBot/1.0; +claudebot@anthropic.com)
|
| |
|
|
|
|
News, job offers and information for researchers and scientists:
| |
REGISTER