Although a number of studies explain the association between dietary patterns, which take into account that foods are eaten in combination, and breast cancer risk, the findings are inconsistent. We examined the association between dietary patterns and multi-grain rice intake, and the risk of breast cancer in a large-scale prospective cohort study in Korean women. A total of 93,306 women aged 40–69 years from the Health Examinees-Gem (HEXA-G) study (2004 and 2013) were included. We obtained Information on cancer diagnosis via linkage to the Korea Central Cancer Registry. Factor analysis was conducted to obtain dietary patterns, and Cox proportional models were used to estimate the hazard ratios (HRs) and 95% confidence intervals (95% CI) for breast cancer risk. For 494,490 person-years, 359 new cases of breast cancer occurred. We identified three major dietary patterns, that explained 23.9% of the total variance based on daily total food intake (g/day) from 37 food groups: the meat dietary pattern (higher intake of bread and red meat), the white rice dietary pattern (higher intake of white rice and lower intake of multi-grain rice), and the other pattern. Women who had higher white rice dietary pattern scores had a 35% higher risk of breast cancer, than did women with lower white rice dietary pattern scores (multivariable HR 1.35; 95% CI 1.00–1.84 for the highest vs. lowest quartile of the white rice dietary pattern scores, p for trend = 0.0384). We found that women who consumed three or more servings of multi-grain rice per day had 33% lower risk of breast cancer than did those who consumed one or less multi-grain rice serving per day among women under 50 years of age (multivariable HR 0.67; 95% CI 0.45–0.99, p for trend = 0.0204). Our study suggests that a multi-grain rice diet may be associated with lower risk of breast cancer in Korean women.