Bacteria play key roles in the ecology of both aquatic and terrestrial ecosystems; however, little is known about their diversity and biogeography, especially in the rare microbial biosphere of inland freshwater ecosystems. Here we investigated aspects of the community ecology and geographical distribution of abundant and rare bacterioplankton using high-throughput sequencing and examined the relative influence of local environmental variables and regional (spatial) factors on their geographical distribution patterns in 42 lakes and reservoirs across China. Our results showed that the geographical patterns of abundant and rare bacterial subcommunities were generally similar, and both of them showed a significant distance-decay relationship. This suggests that the rare bacterial biosphere is not a random assembly, as some authors have assumed, and that its distribution is most likely subject to the same ecological processes that control abundant taxa. However, we identified some differences between the abundant and rare groups as both groups of bacteria showed a significant positive relationship between sites occupancy and abundance, but the abundant bacteria exhibited a weaker distance-decay relationship than the rare bacteria. Our results implied that rare subcommunities were mostly governed by local environmental variables, whereas the abundant subcommunities were mainly affected by regional factors. In addition, both local and regional variables that were significantly related to the spatial variation of abundant bacterial community composition were different to those of rare ones, suggesting that abundant and rare bacteria may have discrepant ecological niches and may play different roles in natural ecosystems.