Abstract Background Some studies have investigated the relation between dairy products and mortality, but with inconsistent results. Objective We examined the association between the consumption of dairy products and the risk of all-cause, cancer-related, and cardiovascular disease (CVD)-related mortality. Methods From the Japan Public Health Center-based Prospective (JPHC) study, 43,117 males and 50,193 females with no history of cancer or CVD finished the food frequency questionnaire (FFQ) and were included in the study. Intake of dairy products was assessed using the FFQ and adjusted for total energy by using the residual method. We used multivariate Cox proportional hazard models to calculate hazard ratios (HRs) and 95% confidence intervals (95% CIs) for mortality risk in males and females. Results 14,211 deaths in males and 9547 deaths in females from all causes were identified during an average follow-up of 19.3 years. For males, total dairy consumption was nonlinearly and significantly associated with lower risk of mortality from all causes [the third quartile, HR = 0.87 (0.83, 0.91), the fourth quartile, HR = 0.89 (0.85, 0.94), P for nonlinearity < 0.001] and CVD [the third quartile, HR = 0.77 (0.70, 0.85), the fourth quartile, HR = 0.78 (0.70, 0.86), P for nonlinearity < 0.001]. Milk and fermented milk intake were inversely associated with all-cause and CVD-related mortality in males. Cheese consumption was inversely associated with CVD-related mortality among males. There was no association between total dairy intake and mortality risk among females. Conclusion For Japanese people, consumption of dairy products was associated with a decreased risk of mortality from all-cause and cardiovascular diseases among males.