Human milk oligosaccharides (HMOs) are chief maternal milk constituents that feed the intestinal microbiota and drive maturation of the infant gut. Our objective was to determine whether supplementing individual HMOs to a weanling diet alters growth and gut health in rats. Healthy three-week-old Sprague Dawley rat pups were randomized to control, 2′-O-fucosyllactose (2′FL)- and 3′sialyllactose (3′SL)-fortified diets alone or in combination at physiological doses for eight weeks. Body composition, intestinal permeability, serum cytokines, fecal microbiota composition, and messenger RNA (mRNA) expression in the gastrointestinal tract were assessed. Males fed a control diet were 10% heavier and displayed elevated interleukin (IL-18) (p = 0.01) in serum compared to all HMO-fortified groups at week 11. No differences in body composition were detected between groups. In females, HMOs did not affect body weight but 2′FL + 3′SL significantly increased cecum weight. All female HMO-fortified groups displayed significant reductions in intestinal permeability compared to controls (p = 0.02). All HMO-fortified diets altered gut microbiota composition and mRNA expression in the gastrointestinal tract, albeit differently according to sex. Supplementation with a fraction of the HMOs found in breast milk has a complex sex-dependent risk/benefit profile. Further long-term investigation of gut microbial profiles and supplementation with other HMOs during early development is warranted.