Purpose The association between established risk factors for breast cancer and subtypes or prognosis of the disease is not well known. We analyzed whether the Tyrer-Cuzick–predicted 10-year breast cancer risk score (TCRS), mammographic density (MD), and a 77-single nucleotide polymorphism polygenic risk score (PRS) were associated with breast cancer tumor prognosticators and risk of distant metastasis. Patients and Methods We used a case-only design in a population-based cohort of 5,500 Swedish patients with breast cancer. Logistic and multinomial logistic regression of outcomes, estrogen receptor (ER) status, lymph node involvement, tumor size, and grade was performed with TCRS, PRS, and percent MD as exposures. Cox proportional hazard models were used to estimate hazard ratios (HRs) of distant metastasis. Results Women at high risk for breast cancer based on PRS and/or TCRS were significantly more likely to be diagnosed with favorable prognosticators, such as ER-positive and low-grade tumors. In contrast, PRS weighted on ER-negative disease was associated with ER-negative tumors. When stratifying by age, the associations of TCRS with favorable prognosticators were restricted to women younger than age 50. Women scoring high in both TCRS and PRS had a lower risk of distant metastasis (HR, 0.69; 95% CI, 0.49 to 0.98). MD was not associated with any of the examined prognosticators. Conclusion Women at high risk for breast cancer based on genetic and lifestyle factors were significantly more likely to be diagnosed with breast cancers with a favorable prognosis. Better knowledge of subtype-specific risk factors could be vital for the success of prevention programs aimed at lowering mortality.