The description of microbiomes as intrinsic fractions of any given ecosystem is an important issue, for instance, by linking their compositions and functions with other biotic and abiotic components of natural systems and hosts. Here we describe the archaeal and bacterial communities from soils of the Atlantic Rainforest in Brazil. Based on the comparison of three areas located along an altitudinal gradient-namely, Santa Virginia, Picinguaba and Restinga-we detected the most abundant groups of Bacteria (Acidobacteria and Proteobacteria) and Archaea (Thaumarchaeota, Crenarchaeota and Euryarchaeota). The particular composition of such communities in each of these areas was first evidenced by PCR-DGGE patterns [determined for Bacteria, Archaea and ammonia-oxidizing organisms-ammonia-oxidizing archaea (AOA) and bacteria (AOB)]. Moreover, sequence-based analysis provided a better resolution of communities, which indicated distinct frequencies of archaeal phyla and bacterial OTUs across areas. We found, as indicated by the Mantel test and multivariate analyses, a potential effect of the flora composition that outpaces the effect of soil characteristics (either physical and chemical) influencing the assembly of these microbial communities in soils. Our results indicate a collective role of the ecosystem underlying observed differences in microbial communities in these soils. Particularly, we posit that rainforest preservation also needs to take into account the maintenance of the soil biodiversity, as this is prompted to influence major processes that affect ecosystem functioning.