Published in

2015 IEEE International Conference on Bioinformatics and Biomedicine (BIBM)

DOI: 10.1109/bibm.2015.7359810

Links

Tools

Export citation

Search in Google Scholar

A Prototype for a Hybrid System to Support Systematic Review Teams: A Case Study of Organ Transplantation

Journal article published in 2015 by Tanja Bekhuis ORCID, Eugene Tseytlin, Mitchell Kj, Kevin J. Mitchell
This paper is available in a repository.
This paper is available in a repository.

Full text: Download

Green circle
Preprint: archiving allowed
Green circle
Postprint: archiving allowed
Red circle
Published version: archiving forbidden
Data provided by SHERPA/RoMEO

Abstract

We describe a prototype for a hybrid system designed to reduce the number of citations needed to re-screen (NNRS) by systematic reviewers, where citations include titles, abstracts, and metadata. The system obviates the need for screening the entire set of citations a second time, which is typically done to control human error. The reference set is based on a complex review about organ transplantation (N=10,796 citations). Data were split into 50% training and test sets, randomly stratified for percentage eligible citations. The system consists of a rule-based module and a machine-learning (ML) module. The former substantially reduces the number of negative citations passed to the ML module and improves imbalance. Relative to the baseline, the system reduces classification error (5.6% vs 2.9%) thereby reducing NNRS by 47.3% (300 vs 158). We discuss the implications of de-emphasizing sensitivity (recall) in favor of specificity and negative predictive value to reduce screening burden.