A feedback loop between dysbiotic gut microbiota, increased translocation of microbial products such as lipopolysaccharide, and inflammation has been hypothesized to cause immune system dysfunction in early HIV infection. However, despite evidence of a chronic inflammatory phenotype in patients on antiretroviral therapy (ART), the role of oral microbiota in systemic immune activation and the relationship between oral and gut bacterial and fungal diversity have not been explored. Our study suggests a crucial role for oral bacterial and fungal communities in long-term systemic immune activation in patients on ART, expanding the current paradigm focused on gut bacteria. Our results indicate that interventions targeting both inflammation and microbial diversity are needed to mitigate oral inflammation-related comorbidities, particularly in HIV-positive patients. More broadly, these findings can bolster general models of microbiome-mediated chronic systemic immune activation and aid the development of precise microbiota-targeted interventions to reverse chronic inflammation.