Ectomycorrhizal (EM) fungi play vital roles in ensuring host plants’ health, plant diversity, and the functionality of the ecosystem. However, EM fungal diversity, community composition, and underlying assembly processes in Inner Mongolia, China, where forests are typically semiarid and cold-temperate zones, attract less attention. In this study, we investigated EM fungal communities from 63 root samples of five common pine plants in Inner Mongolia across 1,900 km using Illumina Miseq sequencing of the fungal internal transcribed spacer 2 region. We evaluated the impact of host plant phylogeny, soil, climatic, and spatial variables on EM fungal diversity and community turnover. Deterministic vs. stochastic processes for EM fungal community assembly were quantified using β-nearest taxon index scores. In total, we identified 288 EM fungal operational taxonomic units (OTUs) belonging to 31 lineages, of which the most abundant lineages were Tomentella–Thelephora, Wilcoxina, Tricholoma, and Suillus–Rhizopogon. Variations in EM fungal OTU richness and community composition were significantly predicted by host phylogeny, soil (total nitrogen, phosphorus, nitrogen–phosphorus ratio, and magnesium), climate, and spatial distance, with the host plant being the most important factor. β-nearest taxon index demonstrated that both deterministic and stochastic processes jointly determined the community assembly of EM fungi, with the predominance of stochastic processes. At the Saihanwula site selected for preference analysis, all plant species (100%) presented significant preferences for EM fungi, 54% of abundant EM fungal OTUs showed significant preferences for host plants, and 26% of pairs of plant species and abundant fungal OTUs exhibited remarkably strong preferences. Overall, we inferred that the high diversity and distinctive community composition of EM fungi associated with natural pine species in Inner Mongolia and the stochastic processes prevailed in determining the community assembly of EM fungi. Our study shed light on the diversity and community assembly of EM fungi associated with common pine species in semiarid and cold temperate forests in Inner Mongolia, China, for the first time and provided a better understanding of the ecological processes underlying the community assembly of mutualistic fungi.