Results from epidemiological studies of milk consumption and mortality are inconsistent. We conducted a systematic review and meta-analysis of prospective studies assessing the association of non-fermented and fermented milk consumption with mortality from all causes, cardiovascular disease, and cancer. PubMed was searched until August 2015. A two-stage, random-effects, dose-response meta-analysis was used to combine study-specific results. Heterogeneity among studies was assessed with the I2 statistic. During follow-up periods ranging from 4.1 to 25 years, 70,743 deaths occurred among 367,505 participants. The range of non-fermented and fermented milk consumption and the shape of the associations between milk consumption and mortality differed considerably between studies. There was substantial heterogeneity among studies of non-fermented milk consumption in relation to mortality from all causes (12 studies; I2 = 94%), cardiovascular disease (five studies; I2 = 93%), and cancer (four studies; I2 = 75%) as well as among studies of fermented milk consumption and all-cause mortality (seven studies; I2 = 88%). Thus, estimating pooled hazard ratios was not appropriate. Heterogeneity among studies was observed in most subgroups defined by sex, country, and study quality. In conclusion, we observed no consistent association between milk consumption and all-cause or cause-specific mortality.