Immunotherapy of cancer with CD3-bispecific antibodies is an approved therapeutic option for some hematological malignancies and is under clinical investigation for solid cancers. However, the treatment of solid tumors faces more pronounced hurdles, such as increased on-target off-tumor toxicities, sparse T-cell infiltration and impaired T-cell quality due to the presence of an immunosuppressive tumor microenvironment, which affect the safety and limit efficacy of CD3-bispecific antibody therapy. In this review, we provide a brief status update of the CD3-bispecific antibody therapy field and identify intrinsic hurdles in solid cancers. Furthermore, we describe potential combinatorial approaches to overcome these challenges in order to generate selective and more effective responses.