Intralocus sexual conflict (IASC) occurs when a trait under selection in one sex constrains the other sex from achieving its sex-specific fitness optimum. Selection pressures on body size often differ between the sexes across many species, including humans: among men individuals of average height enjoy the highest reproductive success, while shorter women have the highest reproductive success. Given its high heritability, IASC over human height is likely. Using data from sibling pairs from the Wisconsin Longitudinal Study, we present evidence for IASC over height: in shorter sibling pairs (relatively) more reproductive success (number of children) was obtained through the sister than through the brother of the sibling pair. By contrast, in average height sibling pairs most reproductive success was obtained through the brother relative to the sister. In conclusion, we show that IASC over a heritable, sexually dimorphic physical trait (human height) affects Darwinian fitness in a contemporary human population.