Prediabetes is characterized by abnormal glycemic levels below the type 2 diabetes threshold, and effective control of blood glucose may prevent the progression to type 2 diabetes. While the association between the gut microbiota, glucose metabolism, and insulin resistance in diabetic patients has been established in previous studies, there is a lack of research regarding these aspects in prediabetic patients in Asia. We aim to investigate the composition of the gut microbiota in prediabetic patients and their differences compared to healthy individuals. In total, 57 prediabetic patients and 60 healthy adult individuals aged 18 to 65 years old were included in this study. Biochemistry data, fecal samples, and 3 days of food records were collected. Deoxyribonucleic acid extraction and next-generation sequencing via 16S ribosomal ribonucleic acid metagenomic sequencing were conducted to analyze the relationship between the gut microbiota and dietary habits. Prediabetic patients showed a lower microbial diversity than healthy individuals, with 9 bacterial genera being less abundant and 14 others more abundant. Prediabetic patients who consumed a low-carbohydrate (LC) diet exhibited higher diversity in the gut microbiota than those who consumed a high-carbohydrate diet. A higher abundance of Coprococcus was observed in the prediabetic patients on an LC diet. Compared to healthy individuals, the gut microbiota of prediabetic patients was significantly different, and adopting an LC diet with high dietary fiber consumption may positively impact the gut microbiota. Future studies should aim to understand the relationship between the gut microbiota and glycemic control in the Asian population.