<b><i>Introduction:</i></b> Several early noncontrast CT (NCCT) signs of spontaneous intracerebral hemorrhage (ICH) can predict hematoma expansion (HE). However, the associations of underlying cerebral small vessel disease (SVD) on early NCCT signs and HE have been less explored. <b><i>Methods:</i></b> We conducted an analysis of all patients with spontaneous supratentorial ICH and received follow-up imaging between 2016 and 2020 at a stroke center. The early NCCT signs were categorized as shape or density signs. HE was defined as an increase in hematoma volume ≥6 mL or 33% from baseline. The severity of SVD was assessed by both a 3-point CT-based and a 4-point magnetic resonance imaging (MRI)-based SVD score. Regression models were used to examine the associations between SVD score and hematoma volume, NCCT signs, and HE. <b><i>Results:</i></b> A total of 328 patients (median age: 64 years; 38% female) were included. The median baseline ICH volume was 8.6 mL, with 38% of the patients had shape signs and 52% had density signs on the initial NCCT. Higher MRI-SVD scores were associated with smaller ICH volumes (<i>p</i> = 0.0006), fewer shape (<i>p</i> = 0.001), or density signs (<i>p</i> = 0.0003). Overall, 16% of patients experienced HE. A higher MRI-SVD score was inversely associated with HE (adjusted odds ratio 0.71, 95% CI: 0.53–0.96). Subgroup analysis revealed that this association was primarily observed in patients who were younger (&lt;65 years), male, had deep hemorrhage, or did not meet the criteria for cerebral amyloid angiopathy diagnosis. <b><i>Conclusions:</i></b> In patients with spontaneous ICH, a more severe SVD was associated with smaller hematoma volume, fewer NCCT signs, and a lower risk of HE. Further research is required to investigate why a higher burden of severely diseased cerebral small blood vessels is associated with less bleeding.