The gaze pattern associated with image exploration is a sensitive index of our attention, motivation, and preference. To examine whether an individual's gaze behavior can reflect his or her sexual interest, this study compared gaze patterns of young heterosexual men and women (M = 19.94 years, SD = 1.05) while they viewed photographs of plain-clothed male and female figures aged from birth to 60 years old. The analysis revealed a clear gender difference in viewing sexually preferred figure images. Men displayed a distinctive gaze pattern only when viewing 20-year-old female images, with more fixations and longer viewing times dedicated to the upper body and waist-hip regions. Women also directed more attention at the upper body on female images in comparison to male images, but this difference was not age-specific. Analysis of local image salience revealed that observers' eye-scanning strategies could not be accounted for by low-level processes, such as analyzing local image contrast and structure, but were associated with attractiveness judgments. The results suggest that the difference in cognitive processing of sexually preferred and non-preferred figures can be manifested in gaze patterns associated with figure viewing. Thus, eye-tracking holds promise as a potential sensitive measure for sexual preference, particularly in men.