The present study investigates the effect of early-onset hearing loss on the reorganization of visual and auditory networks in children without cochlear implants. Eleven congenitally deaf children and 12 age-matched hearing children were included in the study. Bilateral transverse temporal cortices and bilateral lateral occipital cortices were defined as auditory and visual seeds, respectively (as verified using an independent component analysis). The four seed-based connectivity maps were computed for each participant. As a result, group analysis showed that the primary auditory cortex was less connected with the motor cortex, whereas the visual cortex showed strengthened connectivity with motor and speech cortices in congenitally deaf children compared with the controls. Moreover, we found that the differences in functional connectivity between deaf and control children were not because of morphometric changes. Our results provide neural evidence for the sensorimotor coupling model of speech development.