<b><i>Background:</i></b> We explored the association between cerebral microbleeds (CMBs) and cognitive impairment in patients with ischemic stroke/transient ischemic attack (TIA). <b><i>Methods: </i></b>A total of 488 ischemic stroke/TIA patients received magnetic resonance imaging. Montreal Cognitive Assessment (MoCA) was used to evaluate global cognitive function and cognitive domains. The association of CMB quantity with cognitive function and the impact of CMB locations (strictly lobar, strictly deep, and mixed regions) on cognitive impairment were examined in regression models with adjustments for confounders. <b><i>Results: </i></b>A total of 113 subjects (23.2%) had ≥1 CMB. Strictly lobar, strictly deep, and mixed CMBs were identified in 36, 40, and 37 patients, respectively. The presence of ≥5 CMBs or strictly deep CMBs was associated with the MoCA total score (p = 0.007 and 0.020, respectively). Of all MoCA domains tested, a lower score in the attention domain was related to the presence of ≥5 CMBs (p = 0.014) and strictly deep CMBs (p = 0.028). <b><i>Conclusion:</i></b> CMBs were associated with cognitive dysfunction in stroke/TIA patients, especially in the attention domain. This association was mainly driven by CMBs in the deep region, underlining the role of hypertensive microangiopathy in stroke-related cognitive impairment.