XIAP, the most potent inhibitor of cell death pathways, is linked to chemotherapy resistance and tumor aggressiveness. Currently, multiple XIAP-targeting agents are in clinical trials. However, the characterization of XIAP expression in relation to clinicopathological variables in large clinical series of breast cancer is lacking. We retrospectively analyzed non-metastatic, non-inflammatory, primary, invasive breast cancer samples for XIAP mRNA (n = 2341) and protein (n = 367) expression. XIAP expression was analyzed as a continuous value and correlated with clinicopathological variables. XIAP mRNA expression was heterogeneous across samples and significantly associated with younger patients’ age (≤50 years), pathological ductal type, lower tumor grade, node-positive status, HR+/HER2− status, and PAM50 luminal B subtype. Higher XIAP expression was associated with shorter DFS in uni- and multivariate analyses in 909 informative patients. Very similar correlations were observed at the protein level. This prognostic impact was significant in the HR+/HER2− but not in the TN subtype. Finally, XIAP mRNA expression was associated with lower pCR rate to anthracycline-based neoadjuvant chemotherapy in both uni- and multivariate analyses in 1203 informative patients. Higher XIAP expression in invasive breast cancer is independently associated with poorer prognosis and resistance to chemotherapy, suggesting the potential therapeutic benefit of targeting XIAP.