During pregnancy, the ETS transcription factor ELF5 establishes the milk-secreting alveolar cell lineage by driving a cell fate decision of the mammary luminal progenitor cell. In breast cancer, ELF5 is a key transcriptional determinant of tumor subtype and has been implicated in the development of insensitivity to anti-estrogen therapy. In the mouse mammary tumor virus-Polyoma Middle T (MMTV-PyMT) model of luminal breast cancer, induction of ELF5 levels increased leukocyte infiltration, angiogenesis, and blood vessel permeability in primary tumors and greatly increased the size and number of lung metastasis. Myeloid-derived suppressor cells, a group of immature neutrophils recently identified as mediators of vasculogenesis and metastasis, were recruited to the tumor in response to ELF5. Depletion of these cells using specific Ly6G antibodies prevented ELF5 from driving vasculogenesis and metastasis. Expression signatures in luminal A breast cancers indicated that increased myeloid cell invasion and inflammation were correlated with ELF5 expression, and increased ELF5 immunohistochemical staining predicted much shorter metastasis-free and overall survival of luminal A patients, defining a group who experienced unexpectedly early disease progression. Thus, in the MMTV-PyMT mouse mammary model, increased ELF5 levels drive metastasis by co-opting the innate immune system. As ELF5 has been previously implicated in the development of antiestrogen resistance, this finding implicates ELF5 as a defining factor in the acquisition of the key aspects of the lethal phenotype in luminal A breast cancer.