The displacement cross-sections, implemented in the particle and heavy ion transport code system (PHITS), have been calculated to estimate the radiation damage in structural materials used at accelerator facilities. The event generator in PHITS was used to calculate displacement cross-sections for 14 elemental targets and two practical alloys irradiated with neutrons at energies from 10−10 MeV to 3 GeV, and protons and deuterons at energies from several keV to 3 GeV. These displacement cross-sections were used to estimate the displacement per atom (DPA) in the target assembly at accelerator driven system (ADS) Target Test Facility (TEF-T) using 400-MeV protons, and in the Type 316 stainless steel target using 40-MeV deuterons. For the target assembly at TEF-T using 400-MeV protons, the DPA value for the proton component was approximately twice higher than that for the neutron component. For the Type 316 target using 40-MeV deuterons, radiation damage took place near the surface of Type 316 because of the Coulomb scattering effect between the incident deuterons and the material.