We have investigated the hole dynamics at copper surfaces by high-resolution angle-resolved photoemission experiments and many-body quasiparticle GW calculations. Large deviations from a free-electron-like picture are observed both in the magnitude and the energy dependence of the lifetimes, with a clear indication that holes exhibit longer lifetimes than electrons with the same excitation energy. Our calculations show that the small overlap of d- and sp-states below the Fermi level is responsible for the observed enhancement. Although there is qualitative good agreement of our theoretical predictions and the measured lifetimes, there still exist some discrepancies pointing to the need of a better description of the actual band structure of the solid. ; Comment: 15 pages, 7 figures, 1 table, to appear in Phys. Rev. B