An inverse association between use of antiepileptic drugs (AEDs) and prostate cancer (PCa) has been suggested, putatively due to the histone deacetylases inhibitory (HDACi) properties of the AEDs. In a case-control study in Prostate Cancer data Base Sweden (PCBaSe), PCa cases diagnosed between 2014 and 2016 were matched to five controls by year of birth and county of residence. AED prescriptions were identified in the Prescribed Drug Registry. Odds ratios (ORs) and 95% confidence intervals for risk of PCa were estimated using multivariable conditional logistic regression, adjusted for civil status, education level, Charlson comorbidity index, number of outpatient visits, and cumulative duration of hospital stay. Dose responses in different PCa risk categories and HDACi properties of specific AED substances were further explored. 1738/31591 (5.5%) cases and 9674/156802 (6.2%) controls had been exposed to AED. Overall, users of any AED had a reduced risk of PCa as compared to nonusers (OR: 0.92; 95% CI: 0.87–0.97) which was attenuated by adjustment to healthcare utilisation. A reduced risk was also observed in all models for high-risk or metastatic PCa in AED users compared to nonusers (OR: 0.89; 95% CI: 0.81–0.97). No significant findings were observed for dose response or HDACi analyses. Our findings suggest a weak inverse association between AED use and PCa risk, which was attenuated by adjustment for healthcare utilisation. Moreover, our study showed no consistent dose-response pattern and no support for a stronger reduction related to HDAC inhibition. Further studies focusing on advanced PCa and PCa treatments are needed to better analyse the association between use of AED and risk of PCa.