Memory loss in Alzheimer’s disease (AD) is attributed to pervasive weakening and loss of synapses. Here, we present findings supporting a special role for excitatory synapses connecting pyramidal neurons of the hippocampus and cortex with fast-spiking parvalbumin (PV) interneurons that control network excitability and rhythmicity. Excitatory synapses on PV interneurons are dependent on the AMPA receptor subunit GluA4, which is regulated by presynaptic expression of the synaptogenic immediate early gene NPTX2 by pyramidal neurons. In a mouse model of AD amyloidosis, Nptx2-/- results in reduced GluA4 expression, disrupted rhythmicity, and increased pyramidal neuron excitability. Postmortem human AD cortex shows profound reductions of NPTX2 and coordinate reductions of GluA4. NPTX2 in human CSF is reduced in subjects with AD and shows robust correlations with cognitive performance and hippocampal volume. These findings implicate failure of adaptive control of pyramidal neuron-PV circuits as a pathophysiological mechanism contributing to cognitive failure in AD.