Abstract Background The likelihood that health-related quality of life (HRQoL) could depend on factors other than clinical data increases with the duration of follow-up since diagnosis. The aim of this study was to identify determinants of long-term HRQoL in women with cervical, endometrial, and ovarian cancer. Secondary objectives were to describe their living conditions (sexual function, psychological distress, social and professional reinsertion). Materials and Methods In a cross-sectional survey, women diagnosed with cervical, endometrial, and ovarian cancers from 2006 to 2013 were selected through the French gynecological cancers registry of Côte d'Or. Validated questionnaires exploring HRQoL (short-form health survey; SF-12), anxiety and depression (Hospital Anxiety and Depression Scale), social support (Sarason's Social Support Questionnaire), sexual function (Female Sexual Function Index), and living conditions (EPICES questionnaire) were used to assess HRQoL and its determinants. Social and professional reinsertion were also investigated using study-specific questionnaires. Determinants of HRQoL were identified using a multivariable mixed-regression model for each composite score of the SF-12. Results In total, 195 gynecological cancer survivors participated in the survey. HRQoL was deteriorated for almost all the SF-12 dimensions. The main determinants of poor HRQoL were comorbidities, deprivation, lack of availability and satisfaction with social support, and psychological outcomes. Thirty-four percent of survivors of gynecological cancer reported a negative impact of cancer on their work, and 73% reported an impaired ability to work after treatment. Conclusions Long-term HRQoL of survivors of gynecological cancer is not impacted by stage of disease. Specific interventions should focus on issues that promote social and professional reintegration and improve HRQoL.