Solar energy conversion using semiconductors to fabricate photovoltaic devices relies on efficient light absorption, charge separation of electron–hole pair carriers or excitons, and fast transport and charge extraction to counter recombination processes. Ferroelectric materials are able to host a permanent electrical polarization which provides control over electrical field distribution in bulk and interfacial regions. In this review, we provide a critical overview of the physical principles and mechanisms of solar energy conversion using ferroelectric semiconductors and contact layers, as well as the main achievements reported so far. In a ferroelectric semiconductor film with ideal contacts, the polarization charge would be totally screened by the metal layers and no charge collection field would exist. However, real materials show a depolarization field, smooth termination of polarization, and interfacial energy barriers that do provide the control of interface and bulk electric field by switchable spontaneous polarization. We explore different phenomena as the polarization-modulated Schottky-like barriers at metal/ferroelectric interfaces, depolarization fields, vacancy migration, and the switchable rectifying behavior of ferroelectric thin films. Using a basic physical model of a solar cell, our analysis provides a general picture of the influence of ferroelectric effects on the actual power conversion efficiency of the solar cell device, and we are able to assess whether these effects or their combinations are beneficial or counterproductive. We describe in detail the bulk photovoltaic effect and the contact layers that modify the built-in field and the charge injection and separation in bulk heterojunction organic cells as well as in photocatalytic and water splitting devices. We also review the dominant families of ferroelectric materials that have been most extensively investigated and have provided the best photovoltaic performance. ; The research leading to these results has received funding from the European Union Seventh Framework Program [FP7/2007–2013] under grant agreement 316494 and from MINECO of Spain under project TEC2013-47283-R and Grant FPU12/02712. F.R. acknowledges funding and partial salary support for work on multiferroic materials from NSERC, through an EWR Steacie Memorial Fellowship.