Invasive lobular carcinoma (ILC) accounts for up to 15% of all breast cancer (BC) cases and responds well to endocrine treatment when estrogen receptor α-positive (ER+) yet differs in many biological aspects from other ER+ BC subtypes. Up to 30% of patients with ILC will develop late-onset metastatic disease up to ten years after initial tumor diagnosis and may experience failure of systemic therapy. Unfortunately, preclinical models to study ILC progression and predict the efficacy of novel therapeutics are scarce. Here, we review the current advances in ILC modeling, including cell lines and organotypic models, genetically engineered mouse models, and patient-derived xenografts. We also underscore four critical challenges that can be addressed using ILC models: drug resistance, lobular tumor microenvironment, tumor dormancy, and metastasis. Finally, we highlight the advantages of shared experimental ILC resources and provide essential considerations from the perspective of the European Lobular Breast Cancer Consortium (ELBCC), which is devoted to better understanding and translating the molecular cues that underpin ILC to clinical diagnosis and intervention. This review will guide investigators who are considering the implementation of ILC models in their research programs.