The Magellanic clouds are uniquely placed to study the stellar contribution to dust emission. Individual stars can be resolved in these systems even in the mid-infrared, and they are close enough to allow detection of infrared excess caused by dust.We have searched the Spitzer Space Telescope data archive for all Infrared Spectrograph (IRS) staring-mode observations of the Small Magellanic Cloud (SMC) and found that 209 Infrared Array Camera (IRAC) point sources within the footprint of the Surveying the Agents of Galaxy Evolution in the Small Magellanic Cloud (SAGE-SMC) Spitzer Legacy programme were targeted, within a total of 311 staring mode observations. We classify these point sources using a decision tree method of object classification, based on infrared spectral features, continuum and spectral energy distribution shape, bolometric luminosity, cluster membership and variability information. We find 58 asymptotic giant branch (AGB) stars, 51 young stellar objects (YSOs), 4 post-AGB objects, 22 Red Supergiants (RSGs), 27 stars (of which 23 are dusty OB stars), 24 planetary nebulae (PNe), 10Wolf-Rayet (WR) stars, 3 Hii regions, 3 R Coronae Borealis (R CrB) stars, 1 Blue Supergiant and 6 other objects, including 2 foreground AGB stars. We use these classifications to evaluate the success of photometric classification methods reported in the literature. ; Comment: During the preprint phase, Table 2 can be downloaded from https://www.dropbox.com/s/8bctzhzijy0zxfy/online_classification_table.csv?dl=0 This link will be de-activated as soon as Table 2 finds a more permanent home online