Global environmental changes have been dramatic recently, exerting substantial effects on the structures and functions of terrestrial ecosystems, especially for the ecologically-fragile karst regions. Southwest China is one of the largest karst continuum belts around the world, which also contributes about 1/3 of terrestrial carbon sequestration to China. Therefore, a deep understanding of the long-term changes of vegetation across Southwest China over the past decades is critical. Relying on the long time series of Advanced Very High Resolution Radiometer (AVHRR) Global Inventory Modeling and Mapping Studies normalized difference vegetation index (GIMMS NDVI3g) data set, this study examined the spatial and temporal patterns of vegetation conditions in Southwest China from 1982 to 2015, as well as their response to the environmental factors including temperature, precipitation and downward shortwave radiation. Multi-year mean NDVI showed that except the northwestern region, the NDVI of Southwest China was large, ranging from 0.5 to 0.8. Meanwhile, nearly 43.7% of the area experienced significant improvements in NDVI, whereas only 3.47% of the area exhibited significant decreases in NDVI. Interestingly, the NDVI in karst area increased more quickly with 1.035 × 10−3/a in comparison with that in the non-karst area with about 0.929 × 10−3/a. Further analysis revealed that temperature is the dominant environmental factor controlling the interannual changes in NDVI, accounting for 48.19% of the area, followed by radiation (3.71%) and precipitation (3.09%), respectively.