Chronic kidney disease (CKD) is characterized by the accumulation of uremic toxins which exert deleterious effects on various organ systems. Several of these uremic toxins originate from the bacterial metabolization of aromatic amino acids in the colon. This study assessed whether the gut microbial composition varies among patients in different stages of CKD. Uremic metabolites were quantified by UPLC/fluorescence detection and microbial profiling by 16S rRNA amplicon sequencing. Gut microbial profiles of CKD patients were compared among stages 1–2, stage 3 and stages 4–5. Although a substantial inter-individual difference in abundance of the top 15 genera was observed, no significant difference was observed between groups. Bristol stool scale (BSS) correlated negatively with p-cresyl sulfate and hippuric acid levels, irrespective of the intake of laxatives. Butyricicoccus, a genus with butyrate-generating properties, was decreased in abundance in advanced stages of CKD compared to the earlier stages (p = 0.043). In conclusion, in this cross-sectional study no gradual differences in the gut microbial profile over the different stages of CKD were observed. However, the decrease in the abundance of Butyricicoccus genus with loss of kidney function stresses the need for more in-depth functional exploration of the gut microbiome in CKD patients not on dialysis.