Plasma-derived exosomes of head and neck squamous cell carcinoma (HNSCC) patients carry inhibitory factors mediating immune suppression. Separation of tumor-derived exosomes (TEX) and non-TEX may assist in a better understanding of their respective parental cells. Here, we evaluate the impact of TEX or hematopoietic-derived exosomes on immune suppression. We evaluated apoptosis in CD8+ T cells, conversion of CD4+ T cells to regulatory T cells (Treg), and adenosine production by TEX, non-TEX, or total exosomes. Exosome protein cargo was significantly higher in total and CD45(−) exosomes from high stage compared to low stage patients. Furthermore, total and CD45(−) exosomes of high stage patients induced more apoptosis in CD8+ T cells than their low stage counterparts. CD69 suppression, a marker of reduced CD8+ T cell activation, was only mediated by CD45(−) exosomes. All fractions induced Treg differentiation, defined by CD39 expression, but only CD45(−) exosomes showed a stage-dependent conversion. CD45(−) exosomes produced higher adenosine concentrations than CD45(+) exosomes, concluding that adenosine production measured in total exosomes mainly derives from TEX. The presented results show significant induction of immune suppression by TEX in HNSCC. This immunosuppressive effect supports the potential role of exosomes as liquid biomarkers for disease stage and level of immune suppression.