Leaf rust constitutes one of the most important foliar diseases in rye (Secale cereale L.). To discover new sources of resistance, we phenotyped 180 lines belonging to a less well-characterized Gülzow germplasm at three field trial locations in Denmark and Northern Germany in 2018 and 2019. We observed lines with high leaf rust resistance efficacy at all locations in both years. A genome-wide association study using 261,406 informative single-nucleotide polymorphisms revealed two genomic regions associated with resistance on chromosome arms 1RS and 7RS, respectively. The most resistance-associated marker on chromosome arm 1RS physically co-localized with molecular markers delimiting Pr3. In the reference genomes Lo7 and Weining, the genomic region associated with resistance on chromosome arm 7RS contained a large number of nucleotide-binding leucine-rich repeat (NLR) genes. Residing in close proximity to the most resistance-associated marker, we identified a cluster of NLRs exhibiting close protein sequence similarity with the wheat leaf rust Lr1 gene situated on chromosome arm 5DL in wheat, which is syntenic to chromosome arm 7RS in rye. Due to the close proximity to the most resistance-associated marker, our findings suggest that the considered leaf rust R gene, provisionally denoted Pr6, could be a Lr1 ortholog in rye.