Abstract Purpose: The recent approval of anti-programmed death-ligand 1 immunotherapy in combination with nab-paclitaxel for metastatic triple-negative breast cancer (TNBC) highlights the need to understand the role of chemotherapy in modulating the tumor immune microenvironment (TIME). Experimental Design: We examined immune-related gene expression patterns before and after neoadjuvant chemotherapy (NAC) in a series of 83 breast tumors, including 44 TNBCs, from patients with residual disease (RD). Changes in gene expression patterns in the TIME were tested for association with recurrence-free (RFS) and overall survival (OS). In addition, we sought to characterize the systemic effects of NAC through single-cell analysis (RNAseq and cytokine secretion) of programmed death-1–high (PD-1HI) CD8+ peripheral T cells and examination of a cytolytic gene signature in whole blood. Results: In non-TNBC, no change in expression of any single gene was associated with RFS or OS, while in TNBC upregulation of multiple immune-related genes and gene sets were associated with improved long-term outcome. High cytotoxic T-cell signatures present in the peripheral blood of patients with breast cancer at surgery were associated with persistent disease and recurrence, suggesting active antitumor immunity that may indicate ongoing disease burden. Conclusions: We have characterized the effects of NAC on the TIME, finding that TNBC is uniquely sensitive to the immunologic effects of NAC, and local increases in immune genes/sets are associated with improved outcomes. However, expression of cytotoxic genes in the peripheral blood, as opposed to the TIME, may be a minimally invasive biomarker of persistent micrometastatic disease ultimately leading to recurrence.