Breast cancer (BC) is the second most common cancer and the fifth deadliest in the world. Exposure to endocrine disrupting pollutants has been suggested to contribute to the increase in disease incidence. Indeed, a growing number of researchershave investigated the effects of widely used environmental chemicals with endocrine disrupting properties on BC development in experimental (in vitro and animal models) and epidemiological studies. The complex effects of endocrine disrupting chemicals (EDCs) on hormonal pathways, involving carcinogenic effects and an increase in mammary gland susceptibility to carcinogenesis—together with the specific characteristics of the mammary gland evolving over the course of life and the multifactorial etiology of BC—make the evaluation of these compounds a complex issue. Among the many EDCs suspected of increasing the risk of BC, strong evidence has only been provided for few EDCs including diethylstilbestrol, dichlorodiphenyltrichloroethane, dioxins and bisphenol A. However, given the ubiquitous nature and massive use of EDCs, it is essential to continue to assess their long-term health effects, particularly on carcinogenesis, to eradicate the worst of them and to sensitize the population to minimize their use.