Dissemin is shutting down on January 1st, 2025

Published in

Springer Verlag, Lecture Notes in Computer Science, p. 574-590

DOI: 10.1007/978-3-642-41335-3_36

Links

Tools

Export citation

Search in Google Scholar

DAW: Duplicate-AWare Federated Query Processing over the Web of Data

This paper is available in a repository.
This paper is available in a repository.

Full text: Download

Green circle
Preprint: archiving allowed
Green circle
Postprint: archiving allowed
Red circle
Published version: archiving forbidden
Data provided by SHERPA/RoMEO

Abstract

Conference paper ; Over the last years the Web of Data has developed into a large compendium of interlinked data sets from multiple domains. Due to the decentralised architecture of this compendium, several of these datasets contain duplicated data. Yet, so far, only little attention has been paid to the effect of duplicated data on federated querying. This work presents DAW, a novel duplicate-aware approach to feder- ated querying over the Web of Data. DAW is based on a combination of min-wise independent permutations and compact data summaries. It can be directly combined with existing federated query engines in or- der to achieve the same query recall values while querying fewer data sources. We extend three well-known federated query processing engines DARQ, SPLENDID, and FedX with DAW and compare our exten- sions with the original approaches. The comparison shows that DAW can greatly reduce the number of queries sent to the endpoints, while keeping high query recall values. Therefore, it can significantly improve the performance of federated query processing engines. Moreover, DAW provides a source selection mechanism that maximises the query recall, when the query processing is limited to a subset of the sources. ; Science Foundation Ireland - Grant No. SFI/08/CE/I1380 (Lion-II) & Grant No. SFI/12/RC/2289 (INSIGHT) ; peer-reviewed