Mammograms are by far one of the most preferred methods of screening for breast cancer. Early detection of breast cancer can improve survival rates to a greater extent. Although the analysis and diagnosis of breast cancer are done by experienced radiologists, there is always the possibility of human error. Interobserver and intraobserver errors occur frequently in the analysis of medical images, given the high variability between every patient. Also, the sensitivity of mammographic screening varies with image quality and expertise of the radiologist. So, there is no golden standard for the screening process. To offset this variability and to standardize the diagnostic procedures, efforts are being made to develop automated techniques for diagnosis and grading of breast cancer images. This article presents a classification pipeline to improve the accuracy of differentiation between normal, benign, and malignant mammograms. Several features based on higher-order spectra, local binary pattern, Laws’ texture energy, and discrete wavelet transform were extracted from mammograms. Feature selection techniques based on sequential forward, backward, plus-l-takeaway-r, individual, and branch-and-bound selections using the Mahalanobis distance criterion were used to rank the features and find classification accuracies for combination of several features based on the ranking. Six classifiers were used, namely, decision tree classifier, fisher classifier, linear discriminant classifier, nearest mean classifier, Parzen classifier, and support vector machine classifier. We evaluated our proposed methodology with 300 mammograms obtained from the Digital Database for Screening Mammography and 300 mammograms from the Singapore Anti-Tuberculosis Association CommHealth database. Sensitivity, specificity, and accuracy values were used to compare the performances of the classifiers. Our results show that the decision tree classifier demonstrated an excellent performance compared to other classifiers with classification accuracy, sensitivity, and specificity of 91% for the Digital Database for Screening Mammography database and 96.8% for the Singapore Anti-Tuberculosis Association CommHealth database.