Significance Phosphonates are a class of phosphorus metabolites characterized by a highly stable C-P bond. Phosphonates accumulate to high concentrations in seawater, fuel a large fraction of marine methane production, and serve as a source of phosphorus to microbes inhabiting nutrient-limited regions of the oligotrophic ocean. Here, we show that 15% of all bacterioplankton in the surface ocean have genes phosphonate synthesis and that most belong to the abundant groups Prochlorococcus and SAR11. Genomic and chemical evidence suggests that phosphonates are incorporated into cell-surface phosphonoglycoproteins that may act to mitigate cell mortality by grazing and viral lysis. These results underscore the large global biogeochemical impact of relatively rare but highly expressed traits in numerically abundant groups of marine bacteria.