Abstract Background Medical imaging related knowledge and skills are widely used in clinical practice. However, radiology teaching methods and resultant knowledge among medical students and junior doctors is variable. A systematic review and meta-analysis was performed to compare the impact of different components of radiology teaching methods (active versus passive teaching, eLearning versus traditional face-to-face teaching) on radiology knowledge / skills of medical students. Methods PubMed and Scopus databases were searched for articles published in English over a 15-year period ending in June 2021 quantitatively comparing the effectiveness of undergraduate medical radiology education programs regarding acquisition of knowledge and/or skills. Study quality was appraised by the Medical Education Research Study Quality Instrument (MERSQI) scoring and analyses performed to assess for risk of bias. A random effects meta-analysis was performed to pool weighted effect sizes across studies and I² statistics quantified heterogeneity. A meta-regression analysis was performed to assess for sources of heterogeneity. Results From 3,052 articles, 40 articles involving 6,242 medical students met inclusion criteria. Median MERSQI score of the included articles was 13 out of 18 possible with moderate degree of heterogeneity (I² = 93.42%). Thematic analysis suggests trends toward synergisms between radiology and anatomy teaching, active learning producing superior knowledge gains compared with passive learning and eLearning producing equivalent learning gains to face-to-face teaching. No significant differences were detected in the effectiveness of methods of radiology education. However, when considered with the thematic analysis, eLearning is at least equivalent to traditional face-to-face teaching and could be synergistic. Conclusions Studies of educational interventions are inherently heterogeneous and contextual, typically tailored to specific groups of students. Thus, we could not draw definitive conclusion about effectiveness of the various radiology education interventions based on the currently available data. Better standardisation in the design and implementation of radiology educational interventions and design of radiology education research are needed to understand aspects of educational design and delivery that are optimal for learning. Trial registration Prospero registration number CRD42022298607.