Abstract Background The extent to which the risk of estrogen receptor (ER)–specific breast cancer is associated with ER status of breast cancer and other cancers among first-degree relatives is unclear. Methods This population-based cohort included 464 707 cancer-free women in Stockholm, Sweden, during 1978-2019. For ER-negative and ER-positive breast cancers, we estimated hazard ratios (HRs) associated with ER status of female first-degree relatives with breast cancer and of other cancers in all first-degree relatives. Associations between ER-negative and ER-positive status by family cancer history were estimated using logistic regression in a case-only design. Results Women with familial ER-positive breast cancer had 1.87 times (95% confidence interval [CI] = 1.77 to 1.97) higher risk of ER-positive subtype, whereas the corresponding hazard ratio for ER-negative was 2.54 (95% CI = 2.08 to 3.10) when having familial ER-negative breast cancer. The risk increased with an increasing number of female first-degree relatives having concordant subtypes and younger age at diagnosis (Ptrend <.001 for both). Nonbreast cancers among first-degree relatives were associated with both ER-positive (HR = 1.14, 95% CI = 1.10 to 1.17) and ER-negative (HR = 1.08, 95% CI = 1.01 to 1.16) breast cancers. Compared with women with ER-positive breast cancer, women with ER-negative breast cancer were more likely to have family history of liver (odds ratio [OR] = 1.33, 95% CI = 1.05 to 1.67), ovary (OR = 1.28, 95% CI = 1.01 to 1.61), and testicle cancer (OR = 1.79, 95% CI = 1.01 to 3.16) but less likely to have family history of endometrial cancer (OR = 0.77, 95% CI = 0.60 to 1.00) and leukemia (OR = 0.72, 95% CI = 0.56 to 0.91). Conclusions Risk of ER-specific breast cancer differs according to ER status of female first-degree relatives with breast cancer and some other cancers of first-degree relatives. This family history information should be considered in the individual risk prediction for ER subtypes.