The abnormal accumulation of amyloid-β and tau targets specific spatial networks in Alzheimer’s disease. However, the relationship between these networks across different disease stages and their association with brain connectivity has not been explored. In this study, we applied a joint independent component analysis to 18F- Flutemetamol (amyloid-β) and 18F-Flortaucipir (tau) PET images to identify amyloid-β and tau networks across different stages of Alzheimer’s disease. We then assessed whether these patterns were associated with resting-state functional networks and white matter tracts. Our analyses revealed nine patterns that were linked across tau and amyloid-β data. The amyloid-β and tau patterns showed a fair to moderate overlap with distinct functional networks but only tau was associated with white matter integrity loss and multiple cognitive functions. These findings show that amyloid-β and tau have different spatial affinities, which can be used to understand how they accumulate in the brain and potentially damage the brain’s connections.