Background Recent randomized controlled trials (RCTs) have shown no effect of vitamin D supplementation on cardiovascular disease, cancer events and mortality or all-cause mortality in Western populations. However, there has been a lack of research on populations with low vitamin D status, including Asians. In addition, there have been indications that an individual’s sex or hypertension status may affect the relationship between vitamin D status and mortality. In this study, we retrospectively assessed the association between vitamin D status and all-cause, cardiovascular, and cancer mortality in Koreans using a national database, and stratified participants according to sex and hypertension status. Methods Participants in the Korean Health and Nutrition Examination Survey 2008–2014, who consented to their data being synthesized with mortality data (up to December 2019), were included (n = 22,742; mean follow-up: 8.9 years). Participants’ level of serum 25-hydroxyvitamin D (25(OH)D) was measured by radioimmunoassay and categorized as <12, 12–19.9, and ≥20 ng/mL. A Cox proportional hazard model was used to assess the risk of mortality. Results In the total sample, risk of all-cause, cancer, and cardiovascular mortality was greater in adults with a serum 25(OH)D level below 12 and 12–19.9 ng/mL than those with ≥20 ng/mL. Men and adults with hypertension, who had low vitamin D status, had a higher risk of cancer and cardiovascular mortality, but not women or adults without hypertension. Similar results were observed when various cutoffs for 25(OH)D were employed, or extrinsic deaths were excluded. Conclusions Vitamin D status below 20 ng/mL is associated with a higher risk of mortality in Korean adults, especially in men and those with hypertension, on the basis of data from a nationally representative sample. Further RCTs on Asian adults with low vitamin D status are warranted.