Antibodies to conserved epitopes on the human immunodeficiency virus (HIV) surface protein gp140 can protect against infection in non-human primates, and some infected individuals show high titres of broadly neutralizing immunoglobulin (Ig)G antibodies in their serum. However, little is known about the specificity and activity of these antibodies. To characterize the memory antibody responses to HIV, we cloned 502 antibodies from HIV envelope-binding memory B cells from six HIV-infected patients with broadly neutralizing antibodies and low to intermediate viral loads. We show that in these patients, the B-cell memory response to gp140 is composed of up to 50 independent clones expressing high affinity neutralizing antibodies to the gp120 variable loops, the CD4-binding site, the co-receptor-binding site, and to a new neutralizing epitope that is in the same region of gp120 as the CD4-binding site. Thus, the IgG memory B-cell compartment in the selected group of patients with broad serum neutralizing activity to HIV is comprised of multiple clonal responses with neutralizing activity directed against several epitopes on gp120.