Renewable Energy Vol.63 Nr.March, 376 - 387 ; This study addresses the issue of poor intercomparability of measurements of organic photovoltaic (OPV) devices among different laboratories. We present a round robin performance testing of novel OPV devices among 16 laboratories, organized within the framework of European Research Infrastructure Project (SOPHIA) and European Energy Research Alliance (EERA). Three types of OPVs with different structures, dimensions and encapsulations are studied and compared with reference Si solar cells certified by accredited laboratories. The agreement of the measurements of these among different laboratories is analyzed by focusing on testing procedures, testing equipment and sample designs. A number of deviations and pitfalls are revealed and based on the analyses, a set of recommendations are suggested for improving the agreement among the measurements of such OPV technologies.