Problems arising from hypersexual behavior are often seen in clinical settings. We aimed to extend the knowledge about the clinical characteristics of individuals with hypersexual disorder (HD). A group of people who fulfilled the proposed diagnostic criteria for HD (men with HD, n = 50) was compared to a group of healthy controls (n = 40). We investigated differences in sociodemographic, neurodevelopmental, and family factors based on self-report questionnaires and clinical interviews. Men with HD reported elevated rates of sexual activity, paraphilias, consumption of child abusive images, and sexual coercive behavior compared to healthy controls. Moreover, rates of affective disorders, attachment difficulties, impulsivity, and dysfunctional emotion regulation strategies were higher in men with HD. Men with HD seem to have experienced various forms of adverse childhood experiences, but there were no further differences in sociodemographic, neurodevelopmental factors, and family factors. Regression analyses indicated that attachment-related avoidance and early onset of masturbation differentiated between men with HD and healthy controls. In conclusion, men with HD appear to have the same neurodevelopment, intelligence levels, sociodemographic background, and family factors compared to healthy controls, but they report different and adverse experiences in childhood, problematic sexual behavior, and psychological difficulties.