Sirtuin isoform 2 (SIRT2) is one of the seven sirtuin isoforms present in humans, being classified as class III histone deacetylases (HDACs). Based on the high sequence similarity among SIRTs, the identification of isoform selective modulators represents a challenging task, especially for the high conservation observed in the catalytic site. Efforts in rationalizing selectivity based on key residues belonging to the SIRT2 enzyme were accompanied in 2015 by the publication of the first X-ray crystallographic structure of the potent and selective SIRT2 inhibitor SirReal2. The subsequent studies led to different experimental data regarding this protein in complex with further different chemo-types as SIRT2 inhibitors. Herein, we reported preliminary Structure-Based Virtual Screening (SBVS) studies using a commercially available library of compounds to identify novel scaffolds for the design of new SIRT2 inhibitors. Biochemical assays involving five selected compounds allowed us to highlight the most effective chemical features supporting the observed SIRT2 inhibitory ability. This information guided the following in silico evaluation and in vitro testing of further compounds from in-house libraries of pyrazolo-pyrimidine derivatives towards novel SIRT2 inhibitors (1–5). The final results indicated the effectiveness of this scaffold for the design of promising and selective SIRT2 inhibitors, featuring the highest inhibition among the tested compounds, and validating the applied strategy.