Composite materials are one of the primary structural components in most current transportation applications, such as the aerospace industry. Composite material diagnostics is a promising area in the fight against structural damage in aircraft and spaceships. Detection and diagnostic technologies often provide analysts with a valuable and rapid mechanism to monitor the health and safety of composite materials. Although many attempts have been made to develop damage detection techniques and make operations more efficient, there is still a need to develop/improve existing methods. Pulsed thermography (PT) technology was used in this study to obtain healthy and defective data sets from custom-designed composite samples having similar dimensions but different thicknesses (1.6 and 3.8). Ten carbon fibre-reinforced plastic (CFRP) panels were tested. The samples were subjected to impact damage of various energy levels, ranging from 4 to 12 J. Two different methods have been applied to detect and classify the damage to the composite structures. The first applied method is the statistical analysis, where seven different statistical criteria have been calculated. The final results have proved the possibility of detecting the damaged area in most cases. However, for a more accurate detection technique, a machine learning method was applied to thermal images; specifically, the Cube Support Vector Machine (SVM) algorithm was selected. The prediction accuracy of the proposed classification models was calculated within a confusion matrix based on the dataset patterns representing the healthy and defective areas. The classification results ranged from 78.7% to 93.5%, and these promising results are paving the way to develop an automated model to efficiently evaluate the damage to composite materials based on the non-distractive testing (NDT) technique.