Published in

Elsevier, Procedia Computer Science, (4), p. 740-749, 2011

DOI: 10.1016/j.procs.2011.04.078

Links

Tools

Export citation

Search in Google Scholar

Harnessing the Scientific Data Produced by the Experimental Evaluation Search Engines and Information Access Systems

Journal article published in 2011 by Nicola Ferro, Allan Hanbury, Henning Müller, Giuseppe Santucci ORCID
This paper is made freely available by the publisher.
This paper is made freely available by the publisher.

Full text: Download

Green circle
Preprint: archiving allowed
Green circle
Postprint: archiving allowed
Green circle
Published version: archiving allowed
Data provided by SHERPA/RoMEO

Abstract

Measuring is a key to scientific progress. This is particularly true for research concerning complex systems, whether natural or human-built. Multilingual and multimedia information systems are increasingly complex: they need to satisfy diverse user needs and support challenging tasks. Their development calls for proper evaluation methodologies to ensure that they meet the expected user requirements and provide the desired e_ectiveness. In the process, vast amounts of experimental data are generated that beg for analysis tools to enable interpretation and thereby facilitate scientific and technological progress. These scientific data are at the basis of the research and publications in the field and can be better exploited and linked to the scientific literature and production. We are building a software infrastructure, called Distributed Information Retrieval Evaluation Campaign Tool (DIRECT), to manage, curate, enrich, and make these scientific data online accessible and we discuss how this infrastructure can be exploited to directly link the experimental data into papers and publications describing them.