Abstract Background The pathological and clinical features of invasive lobular carcinoma (ILC) differ from those of invasive ductal carcinoma (IDC). Several studies have indicated that patients with ILC have a better prognosis than those with ductal carcinoma. However, no previous study has considered the molecular subtypes and histological subtypes of ILC. We compared prognosis between IDC and classical, luminal type ILC and developed prognostic factors for early breast cancer patients with classical luminal ILC. Methods Four thousand one hundred ten breast cancer patients were treated at the Aichi Cancer Center Hospital from 2003 to 2012. We identified 1,661 cases with luminal IDC and 105 cases with luminal classical ILC. We examined baseline characteristics, clinical outcomes, and prognostic factors of luminal ILC. Results The prognosis of luminal ILC was significantly worse than that of luminal IDC. The rates of 5-year disease free survival (DFS) were 91.9 % and 88.4 % for patients with luminal IDC and luminal ILC, respectively (P = 0.008). The rates of 5-year overall survival (OS) were 97.6 % and 93.1 % for patients with luminal IDC and luminal ILC respectively (P = 0.030). Although we analyzed prognosis according to stratification by tumor size, luminal ILC tended to have worse DFS than luminal IDC in the large tumor group. In addition, although our analysis was performed according to matching lymph node status, luminal ILC had a significantly worse DFS and OS than luminal IDC in node-positive patients. Survival curves showed that the prognosis for ILC became worse than IDC over time. Multivariate analysis showed that ILC was an important factor related to higher risk of recurrence of luminal type breast cancer, even when tumor size, lymph node status and histological grade were considered. Conclusions Luminal ILC had worse outcomes than luminal IDC. Consequently, different treatment approaches should be used for luminal ILC than for luminal IDC.