Protein kinase A (PKA) plays multiple roles in neurons. The localization and specificity of PKA are largely controlled by A-kinase anchoring proteins (AKAPs). However, the dynamics of PKA in neurons, and the roles of specific AKAPs, are poorly understood. We imaged the distribution of type II PKA in hippocampal and cortical layer 2/3 pyramidal neurons in vitro and in vivo. PKA was concentrated in dendritic shafts compared to the soma, axons and dendritic spines. This spatial distribution was imposed by the microtubule-binding protein MAP2, indicating that MAP2 is the dominant AKAP in neurons. Following cAMP elevation, catalytic subunits dissociated from the MAP2-tethered regulatory subunits and rapidly moved to become enriched in nearby spines. The spatial gradient of type II PKA between dendritic shafts and spines was critical for the regulation of synaptic strength and long-term potentiation. The localization and activity-dependent translocation of type II PKA are therefore important determinants of PKA function.