Meiotic recombination is initiated by the SPORULATION 11 (SPO11)–triggered formation of double-strand breaks (DSBs) that usually occur in open chromatin with active transcriptional features in many eukaryotes. However, gene transcription at DSB sites appears to be detrimental for repair, but the regulatory mechanisms governing transcription at meiotic DSB sites are largely undefined in plants. Here, we demonstrate that the largest DNA polymerase epsilon subunit POL2A interacts with SU(VAR)3 to 9 homologs SUVH2 and SUVH9. N-SIM (structured illumination microscopy) observation shows that the colocalization of SUVH2 with the meiotic DSB marker γ-H2AX is dependent on POL2A. RNA-seq of male meiocytes demonstrates that POL2A and SUVH2 jointly repress the expression of 865 genes, which have several known characteristics associated with meiotic DSB sites. Bisulfite-seq and small RNA-seq of male meiocytes support the idea that the silencing of these genes by POL2A and SUVH2/9 is likely independent of CHH methylation or 24-nt siRNA accumulation. Moreover,pol2a suvh2 suvh9triple mutants have more severe defects in meiotic recombination and fertility compared with eitherpol2aorsuvh2 suvh9. Our results not only identify a epigenetic regulatory mechanism for gene silencing in male meiocytes but also reveal roles for DNA polymerase and SUVH2/9 beyond their classic functions in mitosis.