Anxiety and depression symptoms are frequent among patients with breast cancer (BCa) and may last after initial treatments. We aimed to identify five-year trajectories of anxiety and depression symptoms among women with BCa. Neuro-oncological complications of BCa (NEON-BC) cohort included 506 patients admitted at the Portuguese Institute of Oncology of Porto in 2012, who were evaluated with the Hospital Anxiety and Depression Scale before cancer treatment and after one, three, and five years (7.9% attrition rate). Mixed-effect models were used to model anxiety and depression scores over time and model-based clustering to identify the different trajectories. Three trajectories of anxiety symptoms were identified: (1) high scores at baseline and increasing over time (21.7%); (2) consistently low scores over time (63.6%); (3) mid-range scores at baseline, decreasing over time (14.6%). Three trajectories were identified for depression symptoms: (1) high scores at baseline and increasing over time (21.1%); (2) mid-range scores at baseline, which decreased afterward (58.7%); (3) consistently low levels over time (20.2%). Age, education, baseline, and one-year anxiety/depression status predicted the worst five-year trajectories. These results show that assessing anxiety and depression symptoms before treatment and after one year may contribute to identifying the patients who could benefit the most from psychological support.