Dietary assessment reports and population surveillance programs show that chronic exposure to low levels of environmental cadmium (Cd) is inevitable for most people, and adversely impacts the health of children and adults. Based on a risk assessment model that considers an increase in the excretion of β2-microglobulin (β2M) above 300 μg/g creatinine to be the “critical” toxicity endpoint, the tolerable intake level of Cd was set at 0.83 µg/kg body weight/day, and a urinary Cd excretion rate of 5.24 µg/g creatinine was considered to be the toxicity threshold level. The aim of this review is to draw attention to the many other toxicity endpoints that are both clinically relevant and more appropriate to derive Cd exposure limits than a β2M endpoint. In the present review, we focus on a reduction in the glomerular filtration rate and diminished fecundity because chronic exposure to low-dose Cd, reflected by its excretion levels as low as 0.5 µg/g creatinine, have been associated with dose-dependent increases in risk of these pathological symptoms. Some protective effects of the nutritionally essential elements selenium and zinc are highlighted. Cd-induced mitochondrial dysfunction is discussed as a potential mechanism underlying gonadal toxicities and infertility.