ABSTRACT Retinal ganglion cells (RGCs) serve as a crucial communication channel from the retina to the brain. In the adult, these cells receive input from defined sets of presynaptic partners and communicate with postsynaptic brain regions to convey features of the visual scene. However, in the developing visual system, RGC interactions extend beyond their synaptic partners such that they guide development before the onset of vision. In this Review, we summarize our current understanding of how interactions between RGCs and their environment influence cellular targeting, migration and circuit maturation during visual system development. We describe the roles of RGC subclasses in shaping unique developmental responses within the retina and at central targets. Finally, we highlight the utility of RNA sequencing and genetic tools in uncovering RGC type-specific roles during the development of the visual system.