Peach bacterial spot caused by Xanthomonas arboricola pv. pruni (Xap) is a devastating disease worldwide and frequently causes massive economic losses. In recent years, it has become a pandemic outbreak in most peach production areas of China, especially on precocious peaches in the middle reach of the Yangtze River. Rapid, user-friendly detection is extremely important to make the correct diagnosis and develop suitable control strategies. In this study, we described a recombinase polymerase amplification (RPA)/Cas12a-based system that combines RPA and CRISPR/Cas12a for Xap identification. A total of three crRNAs were designed to target a highly conserved ABC transporter ATP-binding protein-encoding gene ftsX to make specific detection of Xap. Results showed that crRNA 2 and crRNA 3 could get consistent detection for Xap. To realize the visualization of detection results, we additionally introduced FQ-reporter and FB-reporter. The developed method was highly sensitive and could detect as low as 10^–18 M Xap gDNA with a mini-UV torch, corresponding to 1.63 copies/μl or 8.855 fg/μl gDNA of Xap, while with lateral flow strips, the sensitivity was 10^–17 M. In addition, this method could specifically detect Xap from other closely related bacteria or pathogens associated with peach diseases. Furthermore, this method could make correct identification for Xap with crude DNA using NaOH-based extraction (3 min) directly from diseased peach samples. Considering that the developed method could get results within 2 h and could be performed at 37°C (body temperature), it is promising to be applied for Xap diagnosis and monitoring in fields.