The increased use of nanoparticles (NPs) requires efficient testing of their potential toxic effects. A promising approach is to use reporter cell lines to quickly assess the activation of cellular stress response pathways. This study aimed to use the ToxTracker reporter cell lines to investigate (geno)toxicity of various metal- or metal oxide NPs and draw general conclusions on NP-induced effects, in combination with our previous findings. The NPs tested in this study (n = 18) also included quantum dots (QDs) in different sizes. The results showed a large variation in cytotoxicity of the NPs tested. Furthermore, whereas many induced oxidative stress only few activated reporters related to DNA damage. NPs of manganese (Mn and Mn3O4) induced the most remarkable ToxTracker response with activation of reporters for oxidative stress, DNA damage, protein unfolding and p53-related stress. The QDs (CdTe) were highly toxic showing clearly size-dependent effects and calculations suggest surface area as the most relevant dose metric. Of all NPs investigated in this and previous studies the following induce the DNA damage reporter; CuO, Co, CoO, CdTe QDs, Mn, Mn3O4, V2O5, and welding NPs. We suggest that these NPs are of particular concern when considering genotoxicity induced by metal- and metal oxide NPs.