Around 30–40% of patients with colorectal cancer (CRC) undergoing curative resection of the primary tumour will develop metastases in the subsequent years. Therapies to prevent disease relapse remain an unmet medical need. Here we uncover the identity and features of the residual tumour cells responsible for CRC relapse. An analysis of single-cell transcriptomes of samples from patients with CRC revealed that the majority of genes associated with a poor prognosis are expressed by a unique tumour cell population that we named high-relapse cells (HRCs). We established a human-like mouse model of microsatellite-stable CRC that undergoes metastatic relapse after surgical resection of the primary tumour. Residual HRCs occult in mouse livers after primary CRC surgery gave rise to multiple cell types over time, including LGR5⁺ stem-like tumour cells^{, –}, and caused overt metastatic disease. Using Emp1 (encoding epithelial membrane protein 1) as a marker gene for HRCs, we tracked and selectively eliminated this cell population. Genetic ablation of EMP1^high cells prevented metastatic recurrence and mice remained disease-free after surgery. We also found that HRC-rich micrometastases were infiltrated with T cells, yet became progressively immune-excluded during outgrowth. Treatment with neoadjuvant immunotherapy eliminated residual metastatic cells and prevented mice from relapsing after surgery. Together, our findings reveal the cell-state dynamics of residual disease in CRC and anticipate that therapies targeting HRCs may help to avoid metastatic relapse.