Seed germination is a complex, multistage developmental process that is an important step in plant development. In this study, RNA-Seq was conducted in the embryo and endosperm of unshelled germinating rice seeds. A total of 14,391 differentially expressed genes (DEGs) were identified between the dry seeds and the germinating seeds. Of these DEGs, 7109 were identified in both the embryo and endosperm, 3953 were embryo specific, and 3329 were endosperm specific. The embryo-specific DEGs were enriched in the plant-hormone signal-transduction pathway, while the endosperm-specific DEGs were enriched in phenylalanine, tyrosine, and tryptophan biosynthesis. We categorized these DEGs into early-, intermediate-, and late-stage genes, as well as consistently responsive genes, which can be enriched in various pathways related to seed germination. Transcription-factor (TF) analysis showed that 643 TFs from 48 families were differentially expressed during seed germination. Moreover, 12 unfolded protein response (UPR) pathway genes were induced by seed germination, and the knockout of OsBiP2 resulted in reduced germination rates compared to the wild type. This study enhances our understanding of gene responses in the embryo and endosperm during seed germination and provides insight into the effects of UPR on seed germination in rice.