This article aims to analyze residential segregation by race (racial segregation) and income (economic segregation) in Brazil and explore its relationship with socioeconomic and socio-spatial factors. Residential segregation was assessed using the dissimilarity index based on the 2010 demographic census and considering urban census tracts since segregation is sociologically considered an urban problem. The results for racial segregation showed that it is more evident in cities in the South and Southeast of Brazil and mainly affects the self-declared black population. The approach used to calculate economic segregation involved examining the income level of different low-income groups. Therefore, we consider families that earned between 0 and 1 minimum wage as the group with the greatest social vulnerability. We did not find significant correlations between racial and income segregation indices with aspects such as urbanization (urban population size). Finally, we present the racial segregation indices stratifying families by income thresholds for the 27 Brazilian capitals and conclude that per capita household income is a preponderant factor for the segregation of the poorest, especially in families whose residents self-identify as black.