The roles played by cortical inhibitory neurons in experience-dependent plasticity are not well understood. Here we evaluate the participation of parvalbumin-expressing (PV+) GABAergic neurons in two forms of experience-dependent modification of primary visual cortex (V1) in adult mice: ocular dominance (OD) plasticity resulting from monocular deprivation and stimulus-selective response potentiation (SRP) resulting from enriched visual experience. These two forms of plasticity are triggered by different events but lead to a similar increase in visual cortical response. Both also require the NMDA class of glutamate receptor (NMDAR). However, we find that PV+ inhibitory neurons in V1 play a critical role in the expression of SRP and its behavioral correlate of familiarity recognition, but not in the expression of OD plasticity. Furthermore, NMDARs expressed within PV+ cells, reversibly inhibited by the psychotomimetic drug ketamine, play a critical role in SRP, but not in the induction or expression of adult OD plasticity.