Aspergillus includes both plant pathogenic and beneficial fungi. Although endophytes beneficial to plants have high potential for plant growth promotion and improving stress tolerance, studies on endophytic lifestyles and endophyte-plant interactions are still limited. Here, three endophytes belonging to Aspergillus, AS31, AS33, and AS42, were isolated. They could successfully colonize rice roots and significantly improved rice growth. The genomes of strains AS31, AS33, and AS42 were sequenced and compared with other Aspergillus species covering both pathogens and endophytes. The genomes of AS31, AS33, and AS42 were 36.8, 34.8, and 35.3 Mb, respectively. The endophytic genomes had more genes encoding carbohydrate-active enzymes (CAZymes) and small secreted proteins (SSPs) and secondary metabolism gene clusters involved in indole metabolism than the pathogens. In addition, these endophytes were able to improve Pi (phosphorus) accumulation and transport in rice by inducing the expression of Pi transport genes in rice. Specifically, inoculation with endophytes significantly increased Pi contents in roots at the early stage, while the Pi contents in inoculated shoots were significantly increased at the late stage. Our results not only provide important insights into endophyte-plant interactions but also provide strain and genome resources, paving the way for the agricultural application of Aspergillus endophytes.