Background: Aging is the main negative prognostic factor for various chronic diseases, such as liver fibrosis, and clinical disorders such as hearing loss. This study aimed to investigate the association between age-related hearing loss (ARHL) and age-related central auditory processing disorder (CAPD), and the risk for liver fibrosis in a cross-sectional study on an aging population. Methods: Liver fibrosis risk was judged on the fibrosis-4 (FIB-4) score. Peripheral ARHL was evaluated with pure tone audiometry using a calibrated audiometer. The pure tone average (PTA), calculated as a threshold ≤ 40 dB (HL) in the better ear, was measured at the frequencies 0.5–4 kHz. For age-related CAPD assessment, we employed the Synthetic Sentence Identification with an Ipsilateral Competitive Message test (SSI-ICM). General linear Logistic regression models were used to estimate the association. Results: The increase in the PTA 0.5–2 kHz (coefficient: 0.02, SE: 0.01, CI 95%: 0.01 to 0.03) was directly associated with a higher risk of liver fibrosis (FIB-4 ≥ 2.67). Moreover, the reduction in SSI (coefficient: −0.02, SE: 0.01, CI 95%: −0.03 to −0.01) was inversely associated with FIB-4 values < 2.67. Conclusion: Our results show an association between liver fibrosis and both ARHL and CAPD, linked by the typical consequence of aging. We also assume a role of inflammatory responses and oxidative stress.