| | |
| | |
Stat |
Members: 3643 Articles: 2'487'895 Articles rated: 2609
28 March 2024 |
|
| | | |
|
Article overview
| |
|
From Appearance to Essence: Comparing Truth Discovery Methods without Using Ground Truth | Xiu Susie Fang
; Quan Z. Sheng
; Xianzhi Wang
; Wei Emma Zhang
; Anne H.H. Ngu
; | Date: |
7 Aug 2017 | Abstract: | Truth discovery has been widely studied in recent years as a fundamental
means for resolving the conflicts in multi-source data. Although many truth
discovery methods have been proposed based on different considerations and
intuitions, investigations show that no single method consistently outperforms
the others. To select the right truth discovery method for a specific
application scenario, it becomes essential to evaluate and compare the
performance of different methods. A drawback of current research efforts is
that they commonly assume the availability of certain ground truth for the
evaluation of methods. However, the ground truth may be very limited or even
out-of-reach in practice, rendering the evaluation biased by the small ground
truth or even unfeasible. In this paper, we present CompTruthHyp, a general
approach for comparing the performance of truth discovery methods without using
ground truth. In particular, our approach calculates the probability of
observations in a dataset based on the output of different methods. The
probability is then ranked to reflect the performance of these methods. We
review and compare twelve existing truth discovery methods and consider both
single-valued and multi-valued objects. Empirical studies on both real-world
and synthetic datasets demonstrate the effectiveness of our approach for
comparing truth discovery methods. | Source: | arXiv, 1708.2029 | Services: | Forum | Review | PDF | Favorites |
|
|
No review found.
Did you like this article?
Note: answers to reviews or questions about the article must be posted in the forum section.
Authors are not allowed to review their own article. They can use the forum section.
browser claudebot
|
| |
|
|
|
| News, job offers and information for researchers and scientists:
| |