The analysis of cross-correlations is extensively applied for the understanding of interconnections in stock markets and the portfolio risk estimation. Current studies of correlations in Chinese market mainly focus on the static correlations between return series, and this calls for an urgent need to investigate their dynamic correlations. Our study aims to reveal the dynamic evolution of cross-correlations in the Chinese stock market, and offer an exact interpretation for the evolution behavior. The correlation matrices constructed from the return series of 367 A-share stocks traded on the Shanghai Stock Exchange from January 4, 1999 to December 30, 2011 are calculated over a moving window with a size of 400 days. The evolutions of the statistical properties of the correlation coefficients, eigenvalues, and eigenvectors of the correlation matrices are carefully analyzed. We find that the stock correlations are significantly increased in the periods of two market crashes in 2001 and 2008, during which only five eigenvalues significantly deviate from the random correlation matrix, and the systemic risk is higher in these volatile periods than calm periods. By investigating the significant contributors of the deviating eigenvectors in different time periods, we observe a dynamic evolution behavior in business sectors such as IT, electronics, and real estate, which lead the rise (drop) before (after) the crashes. Our results provide new perspectives for the understanding of the dynamic evolution of cross-correlations in the Chines stock markets, and the result of risk estimation is valuable for the application of risk management.