Transcriptional noise is known to be an important cause of cellular heterogeneity and phenotypic variation. The extent to which molecular interaction networks may have evolved to either filter or exploit transcriptional noise is a much debated question. The yeast genetic network regulating galactose metabolism involves two proteins, Gal3p and Gal80p, that feed back positively and negatively, respectively, on GAL gene expression. Using kinetic modeling and experimental validation, we demonstrate that these feedback interactions together are important for (i) controlling the cell-to-cell variability of GAL gene expression and (ii) ensuring that cells rapidly switch to an induced state for galactose uptake.