Abstract Background Studies have demonstrated worse breast cancer-specific mortality with older age, despite an increasing risk of dying from other causes due to comorbidity (competing mortality). However, findings on the association between older age and recurrence risk are inconsistent. The aim of this study was to assess incidences of locoregional and distant recurrence by age, taking competing mortality into account. Materials and Methods Patients surgically treated for nonmetastasized breast cancer between 2003 and 2009 were selected from The Netherlands Cancer Registry. Cumulative incidences of recurrence were calculated considering death without distant recurrence as competing event. Fine and Gray analyses were performed to characterize the impact of age (70–74 [reference group], 75–79, and ≥80 years) on recurrence risk. Results A total of 18,419 patients were included. Nine-year cumulative incidences of locoregional recurrence were 2.5%, 3.1%, and 2.9% in patients aged 70–74, 75–79, and ≥80 years, and 9-year cumulative incidences of distant recurrence were 10.9%, 15.9%, and 12.7%, respectively. After adjustment for tumor and treatment characteristics, age was not associated with locoregional recurrence risk. For distant recurrence, patients aged 75–79 years remained at higher risk after adjustment for tumor and treatment characteristics (75–79 years subdistribution hazard ratio [sHR], 1.25; 95% confidence interval [CI], 1.11–1.41; ≥80 years sHR, 1.03; 95% CI, 0.91–1.17). Conclusion Patients aged 75–79 years had a higher risk of distant recurrence than patients aged 70–74 years, despite the higher competing mortality. Individualizing treatment by using prediction tools that include competing mortality could improve outcome for older patients with breast cancer.