The history of neural activity determines the synaptic plasticity mechanisms employed in the brain. Previous studies report a rapid reduction in the strength of excitatory synapses onto layer 2/3 (L2/3) pyramidal neurons of the primary visual cortex (V1) following two days of dark exposure and subsequent re-exposure to light. The abrupt increase in visually driven activity is predicted to drive homeostatic plasticity, however, the parameters of neural activity that trigger these changes are unknown. To determine this, we first recorded spike trains in vivo from V1 layer 4 (L4) of dark exposed (DE) mice of both sexes that were re-exposed to light through homogeneous or patterned visual stimulation. We found that delivering the spike patterns recorded in vivo to L4 of V1 slices was sufficient to reduce the amplitude of miniature excitatory postsynaptic currents (mEPSCs) of V1 L2/3 neurons in DE mice, but not in slices obtained from normal reared (NR) controls. Unexpectedly, the same stimulation pattern produced an up-regulation of mEPSC amplitudes in V1 L2/3 neurons from mice that received 2 h of light re-exposure (LE). A Poisson spike train exhibiting the same average frequency as the patterns recorded in vivo was equally effective at depressing mEPSC amplitudes in L2/3 neurons in V1 slices prepared from DE mice. Collectively, our results suggest that the history of visual experience modifies the responses of V1 neurons to stimulation and that rapid homeostatic depression of excitatory synapses can be driven by non-patterned input activity.