Invasive fungal diseases are a public health problem. They affect a constantly increasing number of at-risk patients, and their incidence has risen in recent years. These opportunistic infections are mainly due to Candida sp. but less common or rare yeast infections should not be underestimated. These so-called “less common” yeasts include Ascomycota of the genera Candida (excluding the five major Candida species), Magnusiomyces/Saprochaete, Malassezia, and Saccharomyces, and Basidiomycota of the genera Cryptococcus (excluding the Cryptococcus neoformans/gattii complex members), Rhodotorula, and Trichosporon. The aim of this review is to (i) inventory the less common yeasts isolated in humans, (ii) provide details regarding the specific anatomical locations where they have been detected and the clinical characteristics of the resulting infections, and (iii) provide an update on yeast taxonomy. Of the total of 239,890 fungal taxa and their associated synonyms sourced from the MycoBank and NCBI Taxonomy databases, we successfully identified 192 yeasts, including 127 Ascomycota and 65 Basidiomycota. This repertoire allows us to highlight rare yeasts and their tropism for certain anatomical sites and will provide an additional tool for diagnostic management.