Abstract Background The receptor-binding domain (RBD) variants of SARS-CoV-2 could impair antibody-mediated neutralization of the virus by host immunity; thus, prospective surveillance of antibody escape mutants and understanding the evolution of RBD are urgently needed. Methods Using the single B cell cloning technology, we isolated and characterized 93 RBD-specific antibodies from the memory B cells of four COVID-19 convalescent individuals in the early stage of the pandemic. Then, global RBD alanine scanning with a panel of 19 selected neutralizing antibodies (NAbs), including several broadly reactive NAbs, was performed. Furthermore, we assessed the impact of single natural mutation or co-mutations of concern at key positions of RBD on the neutralization escape and ACE2 binding function by recombinant proteins and pseudoviruses. Results Thirty-three amino acid positions within four independent antigenic sites (1 to 4) of RBD were identified as valuable indicators of antigenic changes in the RBD. The comprehensive escape mutation map not only confirms the widely circulating strains carrying important immune escape RBD mutations such as K417N, E484K, and L452R, but also facilitates the discovery of new immune escape-enabling mutations such as F486L, N450K, F490S, and R346S. Of note, these escape mutations could not affect the ACE2 binding affinity of RBD, among which L452R even enhanced binding. Furthermore, we showed that RBD co-mutations K417N, E484K, and N501Y present in B.1.351 appear more resistant to NAbs and human convalescent plasma from the early stage of the pandemic, possibly due to an additive effect. Conversely, double mutations E484Q and L452R present in B.1.617.1 variant show partial antibody evasion with no evidence for an additive effect. Conclusions Our study provides a global view of the determinants for neutralizing antibody recognition, antigenic conservation, and RBD conformation. The in-depth escape maps may have value for prospective surveillance of SARS-CoV-2 immune escape variants. Special attention should be paid to the accumulation of co-mutations at distinct major antigenic sites. Finally, the new broadly reactive NAbs described here represent new potential opportunities for the prevention and treatment of COVID-19.