The introduction of a wide range of immunotherapies in clinical practice has revolutionized the treatment of cancer in the last decade. The majority of these therapeutic modalities are centered on reinvigorating a tumor-reactive cytotoxic T-cell response. While impressive clinical successes are obtained, the majority of cancer patients still fail to show a clinical response, despite the fact that their tumors express antigens that can be recognized by the immune system. This is due to a series of other cellular actors, present in or attracted towards the tumor microenvironment, including regulatory T-cells, myeloid-derived suppressor cells and cancer-associated fibroblasts (CAFs). As the main cellular constituent of the tumor-associated stroma, CAFs form a heterogeneous group of cells which can drive cancer cell invasion but can also impair the migration and activation of T-cells through direct and indirect mechanisms. This singles CAFs out as an important next target for further optimization of T-cell based immunotherapies. Here, we review the recent literature on the role of CAFs in orchestrating T-cell activation and migration within the tumor microenvironment and discuss potential avenues for targeting the interactions between fibroblasts and T-cells.