Mitochondria are complex organelles with two membranes. Their architecture is determined by characteristic folds of the inner membrane, termed cristae. Recent studies in yeast and other organisms led to the identification of four major pathways that cooperate to shape cristae membranes. These include dimer formation of the mitochondrial ATP synthase, assembly of the mitochondrial contact site and cristae organizing system (MICOS), inner membrane remodelling by a dynamin-related GTPase (Mgm1/OPA1), and modulation of the mitochondrial lipid composition. In this review, we describe the function of the evolutionarily conserved machineries involved in mitochondrial cristae biogenesis with a focus on yeast and present current models to explain how their coordinated activities establish mitochondrial membrane architecture.