The on-surface synthesis of carbon nanostructures has attracted tremendous attention owing to their unique properties and numerous applications in various fields. With the extensive development of scanning tunneling microscope (STM) and noncontact atomic force microscope (nc-AFM), the on-surface fabricated nanostructures so far can be characterized on atomic and even single-bond level. Therefore, various novel low-dimensional carbon nanostructures, challenging to traditional solution chemistry, have been widely studied on surfaces, such as polycyclic aromatic hydrocarbons, graphene nanoribbons, nanoporous graphene, and graphyne/graphdiyne-like nanostructures. In particular, nanostructures containing sp-hybridized carbons are of great advantage for their structural linearity and small steric demands as well as intriguing electronic and mechanical properties. Herein, the recent developments of low-dimensional sp-carbon nanostructures fabricated on surfaces will be summarized and discussed.