Afforestation of former agricultural land poses a real challenge for foresters because soil life is often severely limited by the loss of natural soil fungal diversity. In addition, former agricultural soils have low levels of fungal species typical of forest soils, which have a unique microbiome that plays a protective role (antagonists, plant growth promoters, mycorrhizal fungi, etc.). This study aimed to determine the effect of using organic material in the form of bark compost, wood waste, and sawdust to improve the soil mycobiome of soils that have been damaged by their agricultural use. This study used experimental plots established 20 years ago, and we compared the biodiversity of the treated soils with that of the control soils by analysing soil samples with powerful molecular methods. Next-generation sequencing analysis of DNA extracted from soil samples and subsequent analysis of their species composition and biodiversity showed that the mycobiome of soil fungi has been altered by the addition of various forms of organic material. The proportion of fungi belonging to the Ascomycota decreased in favour of species from the Basidiomycota and Mucoromycota. The dominant fungal groups in the soil of the control area were Sagenomella, Wilcoxina, Oidiodendron, Meliniomyces, and Penicillium. Enrichment with organic matter by adding bark compost under the roots led to an increase in Penicillium, Inocybe, and Amphinema. The application of bark compost on the surface led to an increase in the dominance of Inocybe fungi in the soil. The mycobiome of the plant to which woody debris was applied was characterised by a marked dominance of fungi of the genera Russula, Oidiodendron, and Penicillium. Similar ratios were found in the plant to which sawdust was applied, where the fungi Meliniomyces, Penicillium, Oidiodendron, and Russula dominated. A comparative analysis of fungal diversity with the Shannon diversity index showed that the most diverse fungal communities were found in the sawdust plant (6.56), while the control sample (a soil sample from an agricultural area where no organic material was applied) had an index of 5.71. After the treatments, more potential antagonists against pine pathogens and mycorrhizal fungi were found to form beneficial symbiotic relationships with them. In our opinion, the results of this study show that it is worthwhile to introduce different forms of organic matter to post-agricultural land to improve soil biodiversity and mycorrhizal associations of pine roots with fungi to ensure the sustainability of the first generation of forests created.