Safe working conditions must be guaranteed during waste sorting, which is crucial to maximizing recycling and reuse, in order to minimize workers’ exposure to chemical and biological hazards. This study determines the contribution of Aspergillus section Fumigati to the overall cytotoxicity of filtering respiratory protection devices (FRPD) and mechanic protection gloves (MPG) collected in 2019 from different workstations in one waste sorting industry in Portugal. The cytotoxicity of 133 Aspergillus section Fumigati isolates was determined as IC50 in human A549 epithelial lung cells and swine kidney cells, using the MTT (3-(4,5-dimethylthiazol-2-yl)-2,5-diphenyltetrazolium bromide) assay. Aspergillus section Fumigati cytotoxicity results were compared with previous total cytotoxicity data from FRPD and MPG samples. A significant correlation was detected between the total cytotoxicity of samples and cytotoxicity of Aspergillus section Fumigati isolates in A549 cells (rS = −0.339, p = 0.030). The cytotoxicity of Aspergillus section Fumigati isolates explained 10.7% of the total cytotoxicity of the sample. On the basis of the comparison of cytotoxicity levels, it was possible to determine the contribution of Aspergillus section Fumigati isolates for the total cytotoxicity of protection devices used in the waste sorting industry. The results support in vitro toxicology as a relevant approach in risk assessments regarding cytotoxicity in passive sampling, and thus, useful in determining the contribution of relevant microbial contaminants to overall cytotoxicity. This approach can provide valuable answers in dose/response studies, and support innovations in risk characterization and their translation into occupational policies.