Background: This study aimed to evaluate and identify the specific CT findings by focusing on abnormalities in the main pancreatic duct (MPD) and pancreatic parenchyma in patients with small pancreatic cancer (PC) including carcinoma in situ (CIS). Methods: Nine CT findings indicating abnormalities of MPD and pancreatic parenchyma were selected as candidate findings for the presence of small PC ≤ 10 mm. The proportions of patients positive for each finding were compared between small PC and benign MPD stenosis groups. Interobserver agreement between two independent image reviewers was evaluated using kappa statistics. Results: The final analysis included 24 patients with small PC (including 11 CIS patients) and 28 patients with benign MPD stenosis. The proportion of patients exhibiting partial pancreatic parenchymal atrophy (PPA) corresponding to the distribution of MPD stenosis (45.8% vs. 7.1%, p < 0.01), upstream PPA arising from the site of MPD stenosis (33.3% vs. 3.6%, p = 0.01), and MPD abrupt stenosis (45.8% vs. 14.3%, p = 0.03) was significantly higher in the small PC group than in the benign MPD stenosis group. Conclusions: The presence of partial PPA, upstream PPA, and MPD abrupt stenosis on a CT image was highly suggestive of the presence of small PCs including CIS.