Recent reports on the impressive efficacy of chimeric antigen receptor (CAR)-modified T cells against hematologic malignancies have inspired oncologists to extend these efforts for the treatment of solid tumors. Clinical trials of CAR-T-based cancer immunotherapy for solid tumors showed that the efficacies are not as remarkable as in the case of hematologic malignancies. There are several challenges that researchers must face when treating solid cancers with CAR-T cells, these include choosing an ideal target, promoting efficient trafficking and infiltration, overcoming the immunosuppressive microenvironment, and avoiding associated toxicity. In this review, we discuss the obstacles imposed by solid tumors on CAR-T cell-based immunotherapy and strategies adopted to improve the therapeutic potential of this approach. Continued investigations are necessary to improve therapeutic outcomes and decrease the adverse effects of CAR-T cell therapy in patients with solid malignancies in the future.