Background Prior literature demonstrates internal medicine residents have suboptimal competence in critical appraisal. Journal clubs are a common intervention to address this skill, but engagement and critical appraisal skill improvement are variable. Objective We evaluated journal club engagement and critical appraisal skills after implementation of a gamified format. Methods This was a single-arm study, conducted from July 1, 2020 to June 30, 2021, involving internal medicine residents at 2 US programs. Residents participated in a 12-month gamified journal club that sorted residents into 2 teams. Residents attended an orientation followed by 6 to 10 monthly, hour-long competitions. In each competition, a subset of the resident teams competed to answer a clinical prompt by critically appraising an original article of their choice. A chief medical resident or faculty member moderated each session and chose the winning team, which received a nominal prize of candy. The primary outcome was engagement, measured by a 7-question survey developed de novo by the authors with Likert scale responses at baseline and 12 months. The secondary outcome was critical appraisal skills assessed by the Berlin Questionnaire. Results Sixty-one of 72 eligible residents (84.7%) completed both engagement surveys. Residents reported statistically significant improvements in most dimensions of engagement, including a higher likelihood of reading articles before sessions (posttest minus pretest score -1.08; 95% CI -1.34 to -0.82; P<.001) and valuing time spent (posttest minus pretest score -0.33; 95% CI -0.55 to -0.11; P=.004). Critical appraisal skills marginally improved at 12 months (posttest minus pretest score -0.84; 95% CI -1.54 to -0.14; P=.02). Conclusions Our study demonstrates a gamified journal club was associated with improvements in engagement and minimal change in critical appraisal skills.