Abstract Background Glasgow Microenvironment Score (GMS) stratifies long-term survival into three groups based on tumour phenotype: peritumoural inflammation (Klintrup–Mäkinen (KM)) and tumour stroma percentage (TSP). However, it is not known if the location of disease recurrence is influenced by the GMS category. Methods Seven hundred and eighty-three TNM I–III colorectal cancers (CRC) were included. GMS (GMS0—high KM; GMS1—low KM, low TSP; GMS2—low KM, high TSP) and cancer-specific survival (CSS), overall survival (OS) and disease recurrence were assessed using Cox regression analysis. Results Of the 783 patients, 221 developed CRC recurrence; 65 developed local recurrence + systemic disease. GMS was independent for CSS (HR 1.50, 95% CI 1.17–1.92, p < 0.001) and OS (HR 1.23, 1.05–1.44, p = 0.01). Higher GMS category was associated with T-stage, N-stage, emergency presentation and venous invasion. GMS was independent for local+systemic recurrence (HR 11.53, 95% CI 1.45–91.85, p = 0.04) and distant-only recurrence (HR 3.01, 95% CI 1.59–5.71, p = 0.002). GMS 2 disease did not appear to have statistically better outcomes with adjuvant chemotherapy in high-risk disease. Conclusion Although confounded by a higher rate of T4 and node-positive disease, GMS 1 and 2 are associated with an increased risk of local and distant recurrence. GMS is an independent poor prognostic indicator for recurrent colorectal cancer. Higher GMS patients may benefit from enhanced postoperative surveillance.