Hybrid improper ferroelectrics have their electric polarization generated by two or more combined non-ferroelectric structural distortions, such as the rotation and tilting of Ti-O octahedral in the Ca3Ti2O7 (CTO) family. In this work, we prepare the high quality (010)-oriented CTO thin films on (110) SrTiO3 (STO) substrates by pulsed laser deposition. The good epitaxial growth of the CTO thin films on the substrates with the interfacial epitaxial relationship of [001]CTO//[001]STO and [100]CTO//[-110]STO is revealed. The in-plane ferroelectric hysteresis unveils an ultralow coercive field of ∼5 kV/cm even at low temperature, nearly two orders of magnitude lower than that of bulk CTO single crystals. The huge difference between the epitaxial thin films and bulk crystals is most likely due to the lattice imperfections in the thin films rather than substrate induced lattice strains, suggesting high sensitivity of the ferroelectric properties to lattice defects.