Alzheimer’s disease (AD) is a highly heterogeneous disorder. Untangling this variability could lead to personalized treatments and improve participant recruitment for clinical trials. We investigated the cognitive subgroups by using a data-driven clustering technique in an AD cohort. People with mild–moderate probable AD from Taiwan was included. Neuropsychological test results from the Cognitive Abilities Screening Instrument were clustered using nonnegative matrix factorization. We identified two clusters in 112 patients with predominant deficits in memory (62.5%) and non-memory (37.5%) cognitive domains, respectively. The memory group performed worse in short-term memory and orientation and better in attention than the non-memory group. At baseline, patients in the memory group had worse global cognitive status and dementia severity. Linear mixed effect model did not reveal difference in disease trajectory within 3 years of follow-up between the two clusters. Our results provide insights into the cognitive heterogeneity in probable AD in an Asian population.