In the field of regenerative medicine, stem cells are highly promising due to their innate ability to generate multiple types of cells that could replace/repair damaged parts of human organs and tissues. It has been reported that both in vitro and in vivo function/survival of stem cells could significantly be improved by utilizing functional materials such as biodegradable polymers, metal composites, nanopatterns and nanohybrid particles. Of various biocompatible materials available for use in stem cell-based therapy and research, carbon-based materials—including fullerenes graphene/graphene oxide and carbon nanotubes—have been found to possess unique physicochemical characteristics that contribute to the effective guidance of stem cell differentiation into specific lineages. In this review, we discuss a number of previous reports that investigated the use of carbon-based materials to control stem cell behavior, with a particular focus on their immense potential to guide the osteogenesis of mesenchymal stem cells (MSCs). We hope that this review will provide information on the full potential of using various carbon-based materials in stem cell-mediated regenerative therapy, particularly for bone regeneration and repair.