Puberty reflects a period of hormonal changes, physical maturation and structural brain reorganization. However, little attention has been paid to what extent sex steroids and pituitary hormones are associated with the refinement of brain maturation across adolescent development. Here we used high-resolution structural MRI scans from 215 typically developing individuals between ages 8-25, to examine the association between cortical thickness, surface area and (sub)cortical brain volumes with luteinizing hormone, testosterone and estradiol, and pubertal stage based on self-reports. Our results indicate sex-specific differences in testosterone related influences on gray matter volumes of the anterior cingulate cortex after controlling for age effects. No significant associations between subcortical structures and sex hormones were found. Pubertal stage was not a stronger predictor than chronological age for brain anatomical differences. Our findings indicate that sex steroids are associated with cerebral gray matter morphology in a sex specific manner. These hormonal and morphological differences may explain in part differences in brain development between boys and girls.