Recently, the high demand for marble stones has progressed in the construction industry, ultimately resulting in waste marble production. Thus, environmental degradation is unavoidable because of waste generated from quarry drilling, cutting, and blasting methods. Marble waste is produced in an enormous amount in the form of odd blocks and unwanted rock fragments. Absence of a systematic way to dispose of these marble waste massive mounds results in environmental pollution and landfills. To reduce this risk, an effort has been made for the incorporation of waste marble powder into concrete for sustainable construction. Different proportions of marble powder are considered as a partial substitute in concrete. A total of 40 mixes are prepared. The effectiveness of marble in concrete is assessed by comparing the compressive strength with the plain mix. Supervised machine learning algorithms, bagging (Bg), random forest (RF), AdaBoost (AdB), and decision tree (DT) are used in this study to forecast the compressive strength of waste marble powder concrete. The models’ performance is evaluated using correlation coefficient (R2), root mean square error, and mean absolute error and mean square error. The achieved performance is then validated by using the k-fold cross-validation technique. The RF model, having an R2 value of 0.97, has more accurate prediction results than Bg, AdB, and DT models. The higher R2 values and lesser error (RMSE, MAE, and MSE) values are the indicators for better performance of RF model among all individual and ensemble models. The implementation of machine learning techniques for predicting the mechanical properties of concrete would be a practical addition to the civil engineering domain by saving effort, resources, and time.