Exposing natural selection driving phenotypic and genotypic adaptive differentiation is an extraordinary challenge. Given that an organism's life stages are exposed to the same environmental variations, we reasoned that fitness components, such as the lag, rate, and efficiency of growth, directly reflecting performance in these life stages, should often be selected in concert. We therefore conjectured that correlations between fitness components over natural isolates, in a particular environmental context, would constitute a robust signal of recent selection. Critically, this test for selection requires fitness components to be determined by different genetic loci. To explore our conjecture, we exhaustively evaluated the lag, rate, and efficiency of asexual population growth of natural isolates of the model yeast Saccharomyces cerevisiae in a large variety of nitrogen-limited environments. Overall, fitness components were well correlated under nitrogen restriction. Yeast isolates were further crossed in all pairwise combinations and coinheritance of each fitness component and genetic markers were traced. Trait variations tended to map to quantitative trait loci (QTL) that were private to a single fitness component. We further traced QTLs down to single-nucleotide resolution and uncovered loss-of-function mutations in RIM15, PUT4, DAL1, and DAL4 as the genetic basis for nitrogen source use variations. Effects of SNPs were unique for a single fitness component, strongly arguing against pleiotropy between lag, rate, and efficiency of reproduction under nitrogen restriction. The strong correlations between life stage performances that cannot be explained by pleiotropy compellingly support adaptive differentiation of yeast nitrogen source use and suggest a generic approach for detecting selection.