Diabetes mellitus (DM) is a metabolic disease caused by improper insulin secretion leading to hyperglycemia. Syzygium cumini has excellent therapeutic properties due to its high levels of phytochemicals. The current research aimed to evaluate the anti-diabetic potential of S. cumini plant’s seeds and the top two phytochemicals (kaempferol and gallic acid) were selected for further analysis. These phytochemicals were selected via computational tools and evaluated for α-Glucosidase inhibitory activity via enzymatic assay. Gallic acid (IC50 0.37 µM) and kaempferol (IC50 0.87 µM) have shown a stronger α-glucosidase inhibitory capacity than acarbose (5.26 µM). In addition, these phytochemicals demonstrated the highest binding energy, hydrogen bonding, protein–ligand interaction and the best MD simulation results at 100 ns compared to acarbose. Furthermore, the ADMET properties of gallic acid and kaempferol also fulfilled the safety criteria. Thus, it was concluded that S. cumini could potentially be used to treat DM. The potential bioactive molecules identified in this study (kaempferol and gallic acid) may be used as lead drugs against diabetes.