Abstract Background and Objectives Quality of life (QoL) has never been assessed in previous illicit users of androgens years following androgen cessation. Therefore, the objective of this study was to assess QoL in previous illicit androgen users compared with current illicit androgen users and controls who had never used androgens. Methods Cross-sectional study including men involved in recreational strength training grouped according to their history of androgen use. We used the RAND Short-Form-36 questionnaire to assess physical and mental health-related QoL. Results We included 77 previous and 118 current androgen users and 39 healthy nonusers. The mean (SD) age of all participants was 33 (8) years. The elapsed duration since androgen cessation, geometric mean (95% CI), was 2.0 (1.5-2.6) years in former users. Median (25th-75th percentiles) serum total testosterone was lower in former users than controls, 14 (11-17) vs 19 (16-21) nmol/L, P < .001. Previous users displayed lower mean (SD) across both mental and physical (PCS) component summary scores, 48 (10) vs 54 (4) (P = .004) and 48 (9) vs 53 (3) (P = .002) compared with controls. Using multivariate linear regressions, evaluating physical and mental component scores as dependent variables, lower serum total testosterone, longer duration since androgen cessation, study recruitment from an endocrine outpatient clinic, and established chronic diseases were all independently associated with reduced QoL in previous users, P < .05. Conclusions Previous illicit androgen users exhibited reduced QoL 2 years after androgen discontinuation, which may be a persistent condition.