Several studies have shown that obesity is associated with changes in human brain function and structure. Since women are more susceptible to obesity than men, it seems plausible that neural correlates may also be different. However, this has not been demonstrated so far. To address this issue, we systematically investigated the brain's white matter (WM) structure in 23 lean to obese women (mean age 25.5 y, std 5.1 y; mean body mass index (BMI) 29.5 kg/m(2), std 7.3 kg/m(2)) and 26 lean to obese men (mean age 27.1 y, std 5.0 y; mean BMI 28.8 kg/m(2), std 6.8 kg/m(2)) with diffusion-weighted magnetic resonance imaging (MRI). There was no significant age (p>0.2) or BMI (p>0.7) difference between female and male participants. Using tract-based spatial statistics, we correlated several diffusion parameters including the apparent diffusion coefficient, fractional anisotropy (FA), as well as axial (λ(∥)) and radial diffusivity (λ(⊥)) with BMI and serum leptin levels. In female and male subjects, the putative axon marker λ(∥) was consistently reduced throughout the corpus callosum, particularly in the splenium (r = -0.62, p<0.005). This suggests that obesity may be associated with axonal degeneration. Only in women, the putative myelin marker λ(⊥) significantly increased with increasing BMI (r = 0.57, p<0.005) and serum leptin levels (r = 0.62, p<0.005) predominantly in the genu of the corpus callosum, suggesting additional myelin degeneration. Comparable structural changes were reported for the aging brain, which may point to accelerated aging of WM structure in obese subjects. In conclusion, we demonstrate structural WM changes related to an elevated body weight, but with differences between men and women. Future studies on obesity-related functional and structural brain changes should therefore account for sex-related differences.