Objective Emergency cricothyrodotomy (EC) is a lifesaving procedure. Evidence-based assessment of training effects and competency levels is relevant to all departments involved in emergency airway management. As most training uses low-fidelity models, the predictive value of good performance on such a model becomes relevant with regard to performance on a high-fidelity model (cadaver). This requires a valid assessment tool for EC performance. Study Design Psychometric study on low-fidelity models and human cadavers. Setting University hospital. Subjects and Methods An assessment tool was created. Sixteen physicians (7 experienced surgeons and 9 novice physicians) performed an EC on a low-fidelity model and a cadaver. Two blinded raters assessed video recordings of performances using the assessment tool. Results We found a high interrater reliability, based on a Pearson's r (0.81), and good evidence for validity, based on successfully distinguishing the 2 groups, using an independent samples t test (P < .001). We found a good correlation between performance on a low-fidelity model and the cadaver with an R-2 = 0.78. Conclusion The tool for assessing EC competence proved reliable and valid. Performance on a low-fidelity model measured this way is a good predictor of performance in a more lifelike situation.