Epitaxial strain provides a powerful approach to manipulate physical properties of materials through rigid compression or extension of their chemical bonds via lattice-mismatch. Although symmetry-mismatch can lead to new physics by stabilizing novel interfacial structures, challenges in obtaining atomic-level structural information as well as lack of a suitable approach to separate it from the parasitical lattice-mismatch have limited the development of this field. Here, we present unambiguous experimental evidence that the symmetry-mismatch can be strongly controlled by dimensionality and significantly impact the collective electronic and magnetic functionalities in ultrathin perovskite LaCoO3/SrTiO3 heterojunctions. State-of-art diffraction and microscopy reveal that symmetry breaking dramatically modifies the interfacial structure of CoO6 octahedral building-blocks, resulting in expanded octahedron volume, reduced covalent screening, and stronger electron correlations. Such phenomena fundamentally alter the electronic and magnetic behaviors of LaCoO3 thin-films. We conclude that for epitaxial systems, correlation strength can be tuned by changing orbital hybridization, thus affecting the Coulomb repulsion, U, instead of by changing the band structure as the common paradigm in bulks. These results clarify the origin of magnetic ordering for epitaxial LaCoO3 and provide a route to manipulate electron correlation and magnetic functionality by orbital engineering at oxide heterojunctions. ; Times Cited: 0