Treatment of tuberculosis, a complex granulomatous disease, requires long-term multidrug therapy to overcome tolerance, an epigenetic drug resistance that is widely attributed to nonreplicating bacterial subpopulations. Here, we deploy Mycobacterium marinum-infected zebrafish larvae for in vivo characterization of antitubercular drug activity and tolerance. We describe the existence of multi-drug tolerant organisms that arise within days of infection, are enriched in the replicating intracellular population, and are amplified and disseminated by the tuberculous granuloma. Bacterial efflux pumps that are required for intracellular growth mediate this macrophage-induced tolerance. This newly discovered tolerant population also develops when Mycobacterium tuberculosis infects cultured macrophages, suggesting that it contributes to the burden of drug tolerance in human tuberculosis. Efflux pump inhibitors like verapamil reduce this tolerance. Thus, the addition of this currently approved drug, or more specific inhibitors, to standard antitubercular therapy may shorten the duration of curative treatment.