It is unclear whether genetic interactions are involved in the association between vegetable intake and reduced body mass index (BMI) or obesity. We conducted a comprehensive search for single nucleotide polymorphisms (SNPs) which are associated with the interaction between vegetable intake frequency and BMI or obesity. We performed a genome-wide association analysis to evaluate the genetic interactions between self-reported intake of vegetables such as carrot, broccoli, spinach, other green vegetables (green pepper and green beans), pumpkin, and cabbage with BMI and obesity, which is defined as a BMI ≥ 25.0 kg/m2 in the Japanese population (n = 12,225). The mean BMI and prevalence of obesity was 23.9 ± 3.4 kg/m2 and 32.3% in men and 22.1 ± 3.8 kg/m2 and 17.3% in in women, respectively. A significant interaction was observed between rs4445711 and frequency of carrot intake on BMI (p = 4.5 × 10−8). This interaction was slightly attenuated after adjustment for age, sex, alcohol intake, smoking, physical activity and the frequency of total vegetable intake (p = 2.1 × 10−7). A significant interaction was also observed between rs4445711 and frequency of carrot intake on obesity (p = 2.5 × 10−8). No significant interactions that were the same as the interaction between frequency of carrot intake and rs4445711 were observed between the intake frequency of broccoli, spinach, other green vegetables, pumpkin or cabbage and BMI or obesity. The frequency of carrot consumption is implicated in reducing BMI by the intermediary of rs4445711. This novel genetic association may provide new clues to clarify the association between vegetable intake and BMI or obesity.