Cancer immune therapy, in particular the use of checkpoint inhibitors and adoptive transfer of T cells has recently demonstrated significant clinical responses against several tumor types. Unfortunately, these therapies are frequently accompanied by severe toxicities, underscoring the need for markers that provide information on therapy response. Monitoring immune responses in the tumor microenvironment and peripheral blood prior to and during these therapies will provide better insight into the mechanisms underlying clinical activities, and will potentially enable the identification of such markers. In this review, we present an overview of adoptive T-cell trials conducted with a special focus on immune monitoring, and argue that accurate monitoring of T cells is pivotal to further development of immune therapies to treat cancer.