Pancreatic neuroendocrine tumors (p-NETs) are rare tumors with a recent growing incidence. In the 2017 WHO classification, p-NETs are classified into well-differentiated (i.e., p-NETs grade 1 to 3) and poorly differentiated neuroendocrine carcinomas (i.e., p-NECs). P-NETs G1 and G2 are often non-functioning tumors, of which the prognosis depends on the metastatic status. In the localized setting, p-NETs should be surgically managed, as no benefit for adjuvant chemotherapy has been demonstrated. Parenchymal sparing resection, including both duodenum and pancreas, are safe procedures in selected patients with reduced endocrine and exocrine long-term dysfunction. When the p-NET is benign or borderline malignant, this surgical option is associated with low rates of severe postoperative morbidity and in-hospital mortality. This narrative review offers comments, tips, and tricks from reviewing the available literature on these different options in order to clarify their indications. We also sum up the overall current data on p-NETs G1 and G2 management.