Owing to the use of a symmetrization π pulse at the middle of their laser sequences, Mach-Zehnder-type atom interferometers are insensitive to clocks shifts and Doppler shifts, if constant, but to changes in these quantities, which makes them accurate and sensitive inertial-force sensors. However, variations of the Raman laser coupling between laser pulses restore a parasitic sensitivity to the Doppler shift. This effect, which sets a limit to the symmetry of the interferometer, is quantitatively evaluated here as a function of the experimental parameters, in the case of an atom gravimeter experiment, and compared to expectations. We show in particular that velocity-distribution asymmetries lead to parasitic phase shifts that can compromise the accuracy and long-term stability of the gravity measurement in the low 10−9g range.