Potentially toxic elements are a widespread concern due to their increasing diffusion into the environment. To counteract this problem, the relationship between plants and metal(loid)s has been investigated in the last 30 years. In this field, research has mainly dealt with angiosperms, whereas plant clades that are lower in the evolutive scale have been somewhat overlooked. However, recent studies have revealed the potential of bryophytes, pteridophytes and gymnosperms in environmental sciences, either as suitable indicators of habitat health and elemental pollution or as efficient tools for the reclamation of degraded soils and waters. In this review, we summarize recent research on the interaction between plants and potentially toxic elements, considering all land plant clades. The focus is on plant applicability in the identification and restoration of polluted environments, as well as on the characterization of molecular mechanisms with a potential outlet in the engineering of element tolerance and accumulation.