Drusen are known to be the important hallmark to predict the development of age-related macular degeneration (AMD). The prevalence of drusen is lower in Asians compared with Caucasians so that the role of signs constituting early AMD is not well established in Asian populations as in Western countries. In this study, we retrospectively investigated clinical characteristics and 5-year incidence of neovascular AMD (nAMD) in the fellow eye of unilateral nAMD patients. Of 296 consecutive unilateral nAMD patients who had been followed up more than 5 years, 170 typical AMD, 119 polypoidal choroidal vasculopathy, and 7 retinal angiomatous proliferation were included. To examine factors associated with nAMD occurrence in the fellow eye, drusen and pigmentary abnormality in the fellow eye were classified into 4 categories; Category 1: no or small drusen < 63 μm (37.2%), Category 2: 63–125 μm medium drusen or pigmentary abnormality (22.2%), Category 3: large drusen > 125 μm (25.0%), Category P: pachydrusen (15.5%). The mean sub-foveal choroidal thickness (SFCT) was Category 1: 276 μm, Category 2: 308 μm, Category 3: 246 μm, and Category P: 302 μm, respectively. Of note, SFCT in Category 2 and Category P was significantly larger than those of Category 3. Finally, the 5-year incidence of nAMD in the fellow eye was 32/296 (10.8%); Category 1: 0/110 (0%), Category 2: 12/66 (18.2%), Category 3: 20/74 (27.0%), and Category P: 0/46 (0%). Thus, signs of intermediate AMD (large drusen) as well as those of early AMD, especially the pigmentary abnormality, may contribute to development of bilateral nAMD in Japanese patients.