A series of nitroimidazoles incorporating sulfonamide/sulfamide/sulfamate moieties were designed and synthesized as radio/chemosensitizing agent targeting the tumor-associated carbonic anhydrase (CA) isoforms IX and XII. Most of the new compounds were nanomolar inhibitors of these isoforms. Crystallographic studies on the complex of hCA II with the lead sulfamide derivative of this series, clarified the binding mode of this type of inhibitors in the enzyme active site cavity. Some of the best nitroimidazole CA IX inhibitors showed significant activity in vitro by reducing hypoxia-induced extracellular acidosis in HT-29 and HeLa cell lines. In vivo testing of the lead molecule in the sulfamide series, in co-treatment with doxorubicin, demonstrated a chemosensitization of CA IX containing tumors. Such CA inhibitors, specifically targeting the tumor-associated isoforms, are candidates for novel treatment strategies against hypoxic tumors overexpressing extracellular CA isozymes.