Complex oxides displaying ferroelectric and/or multiferroic behavior are of high fundamental and applied interest. In this work, for the first time, we show that it is possible to achieve polar order in a superlattice made up of two non-polar oxides by means of oxygen vacancy ordering. Using scanning transmission electron microscopy imaging, we show polar displacement of magnetic Fe ions in a superlattice of (LaFeO3)2/(SrFeO3) grown on a SrTiO3 substrate. Using density functional theory calculations, we systematically study the effect of epitaxial strain, octahedral rotations and surface terminations in the superlattice and find them to have negligible effect on the antiferroelectric displacements of the Fe ions lying in between SrO and LaO layers of the superlattice (i.e., within La0.5Sr0.5FeO3 unit cells). Introduction of oxygen vacancies, on the other hand, triggers a polar displacement of the Fe ions. We confirm this important result using electron energy loss spectroscopy, which shows partial oxygen vacancy ordering in the region where polar displacements are observed and an absence of vacancy ordering outside of that area.