In this paper we studied the impact of winds on Arctic sea ice through the ocean's memory by using numerical simulations. We found that the changes in halosteric height induced by wind perturbations can significantly affect the Arctic sea ice drift, thickness, concentration and deformation rates regionally even years after the wind perturbations. Changes in the Arctic liquid freshwater content and thus in halosteric height can cause changes in the sea surface height and surface geostrophic currents, which further enforce a lasting and strong impact on sea ice. The changes in both sea surface height gradient force (due to changes in sea surface height) and ice–ocean stress (due to changes in surface geostrophic currents) are found to be important in determining the overall ocean effects. The revealed ocean effects are mainly associated with changes in sea ice dynamics, not thermodynamics. Depending on the preceding atmospheric mode driving the ocean, the ocean's memory of the wind forcing can lead to changes in Arctic sea ice characteristics with very different spatial patterns. We obtained these spatial patterns associated with Arctic Oscillation, Arctic Dipole Anomaly and Beaufort High modes through dedicated numerical simulations. The dynamical impact of the ocean has strong seasonal variations, stronger in summer and weaker in winter and spring. This implies that declining trends of Arctic sea ice will very possibly allow a stronger ocean impact on the sea ice in a warming climate.