Diverse innate lymphoid cell (ILC) subtypes have been defined on the basis of effector function and transcription factor expression. ILCs derive from common lymphoid progenitors, although the transcriptional pathways that lead to ILC-lineage specification remain poorly characterized. Here we found that the transcriptional regulator TOX was required for the in vivo differentiation of common lymphoid progenitors into ILC lineage-restricted cells. In vitro modeling demonstrated that TOX deficiency resulted in early defects in the survival or proliferation of progenitor cells, as well as ILC differentiation at a later stage. In addition, comparative transcriptome analysis of bone marrow progenitors revealed that TOX-deficient cells failed to upregulate many genes of the ILC program, including genes that are targets of Notch, which indicated that TOX is a key determinant of early specification to the ILC lineage.