The diffusion of PCBM in P3HT:PCBM blend films has been investigated using multi-wavelength scanning absorption microscopy (MWSAM). By studying the depletion of PCBM in the vicinity of the phase segregated PCBM-rich regions that form upon thermal annealing, we are able to measure the diffusion constant and activation energy for PCBM diffusion in P3HT:PCBM blend films. The measured kinetic parameters are consistent with the diffusion of nanoscale PCBM crystallites rather than molecular PCBM. We show that the presence of two distinct diffusion processes in these blend materials provides an explanation for the large differences that have been reported for PCBM diffusion in P3HT:PCBM blends. This insight allows us to develop a unified model for PCBM mass transport in these materials.