This study investigated the putative changes in regional gray matter and cingulum bundle segments in mild cognitive impairment (MCI) by using two diagnostic criteria. Participants comprised 50 older adults with MCI and 22 healthy older controls (HC). The older adults with MCI were further divided into two groups defined by a global Clinical Dementia Rating (CDR) score of 0.5 and with (the CDR/NPT MCI group) or without (the CDR MCI group) objective cognitive impairments determined using neuropsychological tests (NPTs). Comparable regional gray matter integrity was observed among the three groups. However, the integrity of the right inferior segment of the cingulum bundle in the two MCI groups was more reduced than that in the HC group, and the CDR/NPT MCI group exhibited additional disruption in the left inferior cingulum bundle. The results also demonstrated that neuropsychological measures have greater predictive value for changes in white matter beyond the contribution of an informant-based instrument alone. Overall, the findings confirm the utility of informant-based assessment in detecting microstructural brain changes in high-risk older adults, even before objective cognitive impairment is evident. The findings also suggest that combining the neuropsychological measures with the informant-based assessment provided the greatest predictive value in assessing white matter disruption. The essential role of the white matter measurement as a biomarker for detecting individuals at a high risk of developing dementia was highlighted.