Abstract Background Cerebral amyloid angiopathy (CAA) is associated with cognitive impairment, but the contributions of lobar intracerebral haemorrhage (ICH), underlying diffuse vasculopathy, and neurodegeneration, remain uncertain. We investigated the domain-specific neuropsychological profile of CAA with and without ICH, and their associations with structural neuroimaging features. Methods Data were collected from patients with possible or probable CAA attending a specialist outpatient clinic. Patients completed standardised neuropsychological assessment covering seven domains. MRI scans were scored for markers of cerebral small vessel disease and neurodegeneration. Patients were grouped into those with and without a macro-haemorrhage (CAA-ICH and CAA-non-ICH). Results We included 77 participants (mean age 72, 65% male). 26/32 (81%) CAA-non-ICH patients and 41/45 (91%) CAA-ICH patients were impaired in at least one cognitive domain. Verbal IQ and non-verbal IQ were the most frequently impaired, followed by executive functions and processing speed. We found no significant differences in the frequency of impairment across domains between the two groups. Medial temporal atrophy was the imaging feature most consistently associated with cognitive impairment (both overall and in individual domains) in both univariable and multivariable analyses. Discussion Cognitive impairment is common in CAA, even in the absence of ICH, suggesting a key role for diffuse processes related to small vessel disease and/or neurodegeneration. Our findings indicate that neurodegeneration, possibly due to co-existing Alzheimer’s disease pathology, may be the most important contributor. The observation that general intelligence is the most frequently affected domain suggests that CAA has a generalised rather than focal cognitive impact.