Tuberculosis still remains a global health emergency, claiming 1.5 million lives in 2013. The bacterium responsible for this disease, Mycobacterium tuberculosis (M.tb), has successfully survived within hostile host environments, adapting to immune defence mechanisms, for centuries. This has resulted in a disease that is challenging to treat, requiring lengthy chemotherapy with multi-drug regimens. One explanation for this difficulty in eliminating M.tb bacilli in vivo is the disparate action of antimicrobials on heterogeneous populations of M.tb, where mycobacterial physiological state may influence drug efficacy. In order to develop improved drug combinations that effectively target diverse mycobacterial phenotypes, it is important to understand how such subpopulations of M.tb are formed during human infection. We review here the in vitro and in vivo systems used to model M.tb subpopulations that may persist during drug therapy, and offer aspirations for future research in this field.