An oxygen vacancy driven structural response at the epitaxial interface between La0.7Sr0.3MnO3 films and SrTiO3 substrates is reported. A combined scanning transmission electron microscopy and electron energy loss spectroscopy study reveal the presence of an elongated out-of-plane lattice parameter, coupled to oxygen vacancies and reduced manganese oxidation state at the La0.7Sr0.3MnO3 side of the interface. Density functional theory calculations support that the measured interface structure is a disordered oxygen deficient brownmillerite structure. The effect of oxygen vacancy mobility is assessed, revealing an ordering of the vacancies with time.