Objective To evaluate two user-operated audiometry methods, the AMTAS^TM PC-based audiometry and a low-cost smartphone audiometry research application (R-App). Design A repeated-measures within-subject study design was used to compare both user-operated methods to traditional manual audiometry and to evaluate test-retest reliability of each method. Study sample 58 subjects were recruited in the study of which 83 ears had normal hearing thresholds and 33 ears had hearing loss (pure-tone average > 25 dB HL). Average age of participants was 44.8 years, with an age range of 11–85. Results Standard deviation of absolute differences ranged between 3.9–6.9 dB on AMTAS^TM and 4.5–6.8 dB on the R-App. The highest variability was found at the 8000 Hz frequency (R-App and AMTAS^TM test) and 3000 Hz frequency (AMTAS^TM retest). Evaluation of test-retest reliability of AMTAS^TM and R-App showed SD of absolute differences ranging between 3.5–5.8 dB and 3.1–5.0 dB, respectively. The mean threshold difference between test and retest was within ±1.5 dB on AMTAS^TM and ±1 dB on the R-App. Conclusion Accuracy of AMTAS^TM and the R-App was within acceptable limits for audiometry and comparable to traditional manual audiometry on all tested frequencies (250–8000 Hz). Evaluation of test-retest reliability showed acceptable variation on both AMTAS^TM and R-App. Both user-operated methods could be reliably performed in a quiet non-soundproofed environment.