Multi-principal element alloys (MPEAs) are a new class of alloys that consist of many principal elements randomly distributed on a crystal lattice. The random presence of many elements lends large variations in the point defect formation and migration energies even within a given alloy composition. Compounded by the fact that there could be exponentially large number of MPEA compositions, there is a major computational challenge to capture complete point-defect energy phase-space in MPEAs. In this work, we present a machine learning based framework in which the point defect energies in MPEAs are predicted from a database of their constituent binary alloys. We demonstrate predictions of vacancy migration and formation energies in face centered cubic ternary, quaternary and quinary alloys in Ni-Fe-Cr-Co-Cu system. A key benefit of building this framework based on the database of binary alloys is that it enables defect-energy predictions in alloy compositions that may be unearthed in future. Furthermore, the methodology enables identifying the impact of a given alloying element on the defect energies thereby enabling design of alloys with tailored defect properties.