Recent approval of chimeric antigen receptor (CAR) T cell therapy by the European Medicines Agency (EMA)/Federal and Drug Administration (FDA) and the remarkable results of CAR T clinical trials illustrate the curative potential of this therapy. While CARs against a multitude of different antigens are being developed and tested (pre)clinically, there is still a need for optimization. The use of single-chain variable fragments (scFvs) as targeting moieties hampers the quick generation of functional CARs and could potentially limit the efficacy. Instead, nanobodies may largely circumvent these difficulties. We used an available nanobody library generated after immunization of llamas against Cluster of Differentiation (CD) 20 through DNA vaccination or against the ectodomain of CD33 using soluble protein. The nanobody specific sequences were amplified by PCR and cloned by Gibson Assembly into a retroviral vector containing two different second-generation CAR constructs. After transduction in T cells, we observed high cell membrane nanoCAR expression in all cases. Following stimulation of nanoCAR-expressing T cells with antigen-positive cell lines, robust T cell activation, cytokine production and tumor cell lysis both in vitro and in vivo was observed. The use of nanobody technology in combination with PCR and Gibson Assembly allows for the rapid and effective generation of compact CARs.