The DNA damage response (DDR) is critical for maintaining genome stability, and abnormal DDR—resulting from mutations in DNA damage-sensing and repair proteins—is a hallmark of cancer. Here, we aimed to investigate the predictive power of DDR gene mutations and the tumor mutational load (TML) for survival outcomes in a cohort of 22 rectal cancer patients who received pre-operative neoadjuvant therapy. Univariate analysis revealed that TML-high and TP53 mutations were significantly associated with worse overall survival (OS) with TML-high retaining significance in multivariate analyses. Kaplan–Meier survival analyses further showed TML-high was associated with worse disease-free (p = 0.036) and OS (p = 0.024) results in our patient cohort. A total of 53 somatic mutations were identified in 22 samples with eight (36%) containing mutations in DDR genes, including ATM, ATR, CHEK2, MRE11A, RAD50, NBN, ERCC2 and TP53. TP53 was the most frequently mutated gene, and TP53 mutations were significantly associated with worse OS (p = 0.023) in Kaplan–Meier survival analyses. Thus, our data indicate that TML and TP53 mutations have prognostic value for rectal cancer patients and may be important independent biomarkers for patient management. This suggests that prognostic determination for rectal cancer patients receiving pre-operative neoadjuvant therapy should include consideration of the initial TML and tumor genetic status.