Due to its high prevalence, screening for hepatic fibrosis in the low-risk population is called for action in the primary care clinic. However, current guidelines provide conflicting recommendations on populations to be screened. We aimed to identify the target populations that would most benefit from screening for hepatic fibrosis in clinical practice. This study examined 1288 subjects who underwent magnetic resonance elastography. The diagnostic performance of the Fibrosis-4 (FIB-4) index and NAFLD fibrosis score was compared in the following groups: (1) ultrasonography (USG)-diagnosed NAFLD, (2) elevated liver enzyme, (3) metabolic syndrome, (4) impaired fasting glucose, and (5) type 2 diabetes regardless of fatty liver. Decision curve analysis was performed to express the net benefit of groups over a range of probability thresholds (Pts). The diabetes group showed a better area under the receiver operating characteristic curve (AUROC: 0.69) compared with subjects in the USG-diagnosed NAFLD (AUROC: 0.57) and elevated liver enzyme (AUROC: 0.55) groups based on the FIB-4 index. In decision curve analysis, the diabetes group showed the highest net benefit for the detection of significant fibrosis across a wide range of Pts. Patients with diabetes, even in the absence of fatty liver, would be preferable for hepatic fibrosis screening in low-risk populations.