Carrier-envelope-phase (CEP)-dependent modulation was measured in above-threshold ionization of xenon driven with 30-fs laser pulses. We showed the dependence from the asymmetry map obtained using a velocity map imaging spectrometer, up to 17 eV in photoelectron energy. The dependence appeared to be linear with a slope of one photon energy increase per CEP change of 2π and did not rely on the sign or the amount of laser chirp. Our results indicated the existence of the quantum interference between different multiphoton ionization paths.