To achieve chromosome segregation during mitosis, sister chromatids must undergo a dramatic change in their behavior to switch from balanced oscillations at the metaphase plate to directed poleward motion during anaphase. However, the factors that alter chromosome behavior at the metaphase-to-anaphase transition remain incompletely understood. Here, we perform time-lapse imaging to analyze anaphase chromosome dynamics in human cells. Using multiple directed biochemical, genetic, and physical perturbations, our results demonstrate that differences in the global phosphorylation states between metaphase and anaphase are the major determinant of chromosome motion dynamics. Indeed, causing a mitotic phosphorylation state to persist into anaphase produces dramatic metaphase-like oscillations. These induced oscillations depend on both kinetochore-derived and polar ejection forces that oppose poleward motion. Thus, our analysis of anaphase chromosome motion reveals that dephosphorylation of multiple mitotic substrates is required to suppress metaphase chromosome oscillatory motions and achieve directed poleward motion for successful chromosome segregation.