Abstract Brain age predicted differences (brain-PAD: predicted brain age minus chronological age) have been reported to be significantly larger for individuals with chronic pain compared with those without. However, a debate remains after one article showed no significant differences. Using Gaussian Process Regression, an article provides evidence that these negative results might owe to the use of mixed samples by reporting a differential effect of chronic pain on brain-PAD across pain types. However, some remaining methodological issues regarding training sample size and sex-specific effects should be tackled before settling this controversy. Here, we explored differences in brain-PAD between musculoskeletal pain types and controls using a novel convolutional neural network for predicting brain-PADs, ie, DeepBrainNet. Based on a very large, multi-institutional, and heterogeneous training sample and requiring less magnetic resonance imaging preprocessing than other methods for brain age prediction, DeepBrainNet offers robust and reproducible brain-PADs, possibly highly sensitive to neuropathology. Controlling for scanner-related variability, we used a large sample (n = 660) with different scanners, ages (19-83 years), and musculoskeletal pain types (chronic low back [CBP] and osteoarthritis [OA] pain). Irrespective of sex, brain-PAD of OA pain participants was ∼3 to 4.7 years higher than that of CBP and controls, whereas brain-PAD did not significantly differ among controls and CBP. Moreover, brain-PAD was significantly related to multiple variables underlying the multidimensional pain experience. This comprehensive work adds evidence of pain type–specific effects of chronic pain on brain age. This could help in the clarification of the debate around possible relationships between brain aging mechanisms and pain.