Objective: The Quantified Behavioral Test (QbTest) is a computerized diagnostic test for ADHD, used in clinical psychiatric care, but its validity may be questioned. We analyzed the QbTest’s diagnostic validity and its relation to cognitive ability and psychosocial factors in an adolescent population with a high occurrence of neurodevelopmental disorders. Method: In total, 340 participants aged 15 years, completed the QbTest, along with questionnaires, clinical and intelligence quotient (IQ) assessments. Results: The clinical assessment resulted in 89 (26%) participants with ADHD. Area under curve (AUC) scores indicated a random to poor validity of the QbTest (AUC range = 0.48-0.64). QbTest scores of inattention and impulsivity correlated with IQ. Conclusion: The QbTest was insufficient as a diagnostic test for ADHD, and was not able to differentiate ADHD from other neurodevelopmental conditions. Clinicians should be aware of the dubious discriminating power of the QbTest.