Overgrazing has led to severe degradation and desertification of semi-arid grasslands in Northern China over the last decades. Despite the fact that vegetation is often heterogeneously distributed in semi-arid steppes, little attention has been drawn to the effect of grazing on the spatial distribution of soil properties. We determined the spatial pattern of soil organic carbon (SOC), total nitrogen (N(tot)), total sulphur (S(tot)), bulk density (BD), pH, Ah thickness, and carbon isotope ratios (delta(13)C) at two continuously grazed (CG) and two ungrazed (UG79 = fenced and excluded from grazing in 1979) sites in Leymus chinensis and Stipa grandis dominated steppe ecosystems in Inner Mongolia, Northern China. Topsoils (0-4 cm) were sampled at each site using a large grid (120 m x 150 m) with 100 sampling points and a small plot (2 m x 2 m) with 40 points. Geostatistics were applied to elucidate the spatial distribution both at field (120 m x 150 m grid) and plant (2 m x 2 m plot) scale. Concentrations and stocks of SOC, N(tot), S(tot) were significantly lower and BD significantly higher at both CG sites. At the field scale, semivariograms of these parameters showed a heterogeneous distribution at UG79 sites and a more homogeneous distribution at CG sites, whereas nugget to sill ratios indicated a high small-scale variability. At the plant scale, semivariances of all investigated parameters were one order of magnitude higher at UG79 sites than at CG sites. The heterogeneous pattern of topsoil properties at UG79 sites can be attributed to a mosaic of vegetation patches separated by bare soil. Ranges of autocorrelation were almost congruent with spatial expansions of grass tussocks and shrubs at both steppe types. At CG sites, consumption of biomass by sheep and hoof action removed vegetation patches and led to a homogenization of chemical and physical soil properties. We propose that the spatial distribution of topsoil properties at the plant scale (<2 m) could be used as an indicator for degradation in semi-arid grasslands. Our results further show that the maintenance of heterogeneous vegetation and associated topsoil structures is essential for the accumulation of SOM in semi-arid grassland ecosystems.