In the transposition of the great arteries (TGA), alterations in hemodynamics and oxygen saturation could result in fibrotic remodeling, but histological studies are scarce. We aimed to investigate fibrosis and innervation state in the full spectrum of TGA and correlate findings to clinical literature. Twenty-two human postmortem TGA hearts, including TGA without surgical correction (n = 8), after Mustard/Senning (n = 6), and arterial switch operation (ASO, n = 8), were studied. In newborn uncorrected TGA specimens (1 day–1.5 months), significantly more interstitial fibrosis (8.6% ± 3.0) was observed compared to control hearts (5.4% ± 0.8, p = 0.016). After the Mustard/Senning procedure, the amount of interstitial fibrosis was significantly higher (19.8% ± 5.1, p = 0.002), remarkably more in the subpulmonary left ventricle (LV) than in the systemic right ventricle (RV). In TGA-ASO, an increased amount of fibrosis was found in one adult specimen. The amount of innervation was diminished from 3 days after ASO (0.034% ± 0.017) compared to uncorrected TGA (0.082% ± 0.026, p = 0.036). In conclusion, in these selected postmortem TGA specimens, diffuse interstitial fibrosis was already present in newborn hearts, suggesting that altered oxygen saturations may already impact myocardial structure in the fetal phase. TGA-Mustard/Senning specimens showed diffuse myocardial fibrosis in the systemic RV and, remarkably, in the LV. Post-ASO, decreased uptake of nerve staining was observed, implicating (partial) myocardial denervation after ASO.