A drastic difference exists between the 5-year survival rates of colorectal cancer patients with localized cancer and distal organ metastasis. The liver is the most favorable organ for cancer metastases from the colorectum. Beyond the liver-colon anatomic relationship, emerging evidence highlights the impact of liver immune microenvironment on colorectal liver metastasis. Prior to cancer cell dissemination, hepatocytes secrete multiple factors to recruit or activate immune cells and stromal cells in the liver to form a favorable premetastatic niche. The liver-resident cells including Kupffer cells, hepatic stellate cells, and liver-sinusoidal endothelial cells are co-opted by the recruited cells, such as myeloid-derived suppressor cells and tumor-associated macrophages, to establish an immunosuppressive liver microenvironment suitable for tumor cell colonization and outgrowth. Current treatments including radical surgery, systemic therapy, and localized therapy have only achieved good clinical outcomes in a minority of colorectal cancer patients with liver metastasis, which is further hampered by high recurrence rate. Better understanding of the mechanisms governing the metastasis-prone liver immune microenvironment should open new immuno-oncology avenues for liver metastasis intervention.