| | |
| | |
Stat |
Members: 3643 Articles: 2'488'730 Articles rated: 2609
29 March 2024 |
|
| | | |
|
Article overview
| |
|
Multilingual Question Answering from Formatted Text applied to Conversational Agents | Wissam Siblini
; Charlotte Pasqual
; Axel Lavielle
; Cyril Cauchois
; | Date: |
10 Oct 2019 | Abstract: | Recent advances in NLP with language models such as BERT, GPT-2, XLNet or
XLM, have allowed surpassing human performance on Reading Comprehension tasks
on large-scale datasets (e.g. SQuAD), and this opens up many perspectives for
Conversational AI. However, task-specific datasets are mostly in English which
makes it difficult to acknowledge progress in foreign languages. Fortunately,
state-of-the-art models are now being pre-trained on multiple languages (e.g.
BERT was released in a multilingual version managing a hundred languages) and
are exhibiting ability for zero-shot transfer from English to others languages
on XNLI. In this paper, we run experiments that show that multilingual BERT,
trained to solve the complex Question Answering task defined in the English
SQuAD dataset, is able to achieve the same task in Japanese and French. It even
outperforms the best published results of a baseline which explicitly combines
an English model for Reading Comprehension and a Machine Translation Model for
transfer. We run further tests on crafted cross-lingual QA datasets (context in
one language and question in another) to provide intuition on the mechanisms
that allow BERT to transfer the task from one language to another. Finally, we
introduce our application Kate. Kate is a conversational agent dedicated to HR
support for employees that exploits multilingual models to accurately answer to
questions, in several languages, directly from information web pages. | Source: | arXiv, 1910.4659 | Services: | Forum | Review | PDF | Favorites |
|
|
No review found.
Did you like this article?
Note: answers to reviews or questions about the article must be posted in the forum section.
Authors are not allowed to review their own article. They can use the forum section.
browser claudebot
|
| |
|
|
|
| News, job offers and information for researchers and scientists:
| |