A significant decline in pediatric vaccination uptake due to the COVID-19 pandemic has been documented. Little is known about the parental willingness and associated factors of pediatric vaccination during the COVID-19 pandemic. An extensive literature search in the databases of PubMed, Scopus, Web of Science, and EBSCOhost were conducted. A total of 20 eligible studies published from 2020–2022 were included for systematic summary by a thematic analysis, among which 12 studies were included in a meta-analysis conducted with R-4.2.1. The prevalence of parental willingness to childhood/routine vaccination and seasonal influenza vaccination was 58.6% (95%CI 2.8–98.6%) and 47.3% (95%CI 25.3–70.5%). Moreover, there is no sufficient evidence of significant change in parental willingness to childhood/routine vaccination, human papillomavirus vaccination, or pneumococcal conjugate vaccination during the pandemic. However, a significant increase in parental willingness to vaccinate their children against seasonal influenza was found. In addition to the factors of parental vaccination willingness/hesitancy that are well-studied in literature, children/parents’ history of COVID-19 and children’s perceived vulnerability to COVID-19 were associated with parental willingness. Developing synergetic strategies to promote COVID-19 vaccination together with other pediatric vaccination is warranted during the pandemic. This may help to improve and/or catch up the vaccine uptake of children during and/or after the COVID-19 pandemic.