Abstract Background Plants and their associated microbiota constitute an assemblage of species known as holobionts. The plant seed microbiome plays an important role in nutrient uptake and stress attenuation. However, the core vertically transmitted endophytes remain largely unexplored. Results To gain valuable insights into the vertical transmission of rice seed core endophytes, we conducted a large-scale analysis of the microbiomes of two generations of six different rice varieties from five microhabitats (bulk soil, rhizosphere, root, stem, and seed) from four geographic locations. We showed that the microhabitat rather than the geographic location and rice variety was the primary driver of the rice microbiome assemblage. The diversity and network complexity of the rice-associated microbiome decreased steadily from far to near the roots, rice exterior to interior, and from belowground to aboveground niches. Remarkably, the microbiomes of the roots, stems, and seeds of the rice interior compartments were not greatly influenced by the external environment. The core bacterial endophytes of rice were primarily comprised of 14 amplicon sequence variants (ASVs), 10 of which, especially ASV_2 (Pantoea) and ASV_48 (Xanthomonas), were identified as potentially vertically transmitted taxa because they existed across generations, were rarely present in exterior rice microhabitats, and were frequently isolated from rice seeds. The genome sequences of Pantoea and Xanthomonas isolated from the parental and offspring seeds showed a high degree of average nucleotide and core protein identity, indicating vertical transmission of seed endophytes across generations. In silico prediction indicated that the seed endophytes Pantoea and Xanthomonas possessed streamlined genomes with short lengths, low-complexity metabolism, and various plant growth-promoting traits. We also found that all strains of Pantoea and Xanthomonas exhibited cellulase activity and produced indole-3-acetic acid. However, most strains exhibited insignificant antagonism to the major pathogens of rice, such as Magnaporthe oryzae and X. oryzae pv. oryzae. Conclusion Overall, our study revealed that microhabitats, rather than site-specific environmental factors or host varieties, shape the rice microbiome. We discovered the vertically transmitted profiles and keystone taxa of the rice microbiome, which led to the isolation of culturable seed endophytes and investigation of their potential roles in plant-microbiome interactions. Our results provide insights on vertically transmitted microbiota and suggest new avenues for improving plant fitness via the manipulation of seed-associated microbiomes.