Experience plays an essential role in building brain architecture after birth. The question we address in this paper is what happens to brain and behavior when a young child is deprived of key experiences during critical periods of brain development. We focus in particular on the consequences of institutional rearing, with implication for the tens of millions of children around the world who from an early age experience profound psychosocial deprivation. Evidence is clear that deprivation can lead to a host of both short- and long-term consequences, including perturbations in brain structure and function, changes at cellular and molecular levels, and a plethora of psychological and behavioral impairments.