Over the last few years, research indicated that Human Milk Oligosaccharides (HMOs) may serve to enhance cognition during development. HMOs hereby provide an exciting avenue in the understanding of the molecular mechanisms that contribute to cognitive development. Therefore, this review aims to summarize the reported observations regarding the effects of HMOs on memory and cognition in rats, mice and piglets. Our main findings illustrate that the administration of fucosylated (single or combined with Lacto-N-neoTetraose (LNnT) and other oligosaccharides) and sialylated HMOs results in marked improvements in spatial memory and an accelerated learning rate in operant tasks. Such beneficial effects of HMOs on cognition already become apparent during infancy, especially when the behavioural tasks are cognitively more demanding. When animals age, its effects become increasingly more apparent in simpler tasks as well. Furthermore, the combination of HMOs with other oligosaccharides yields different effects on memory performance as opposed to single HMO administration. In addition, an enhanced hippocampal long-term potentiation (LTP) response both at a young and at a mature age are reported as well. These results point towards the possibility that HMOs administered either in singular or combination forms have long-lasting, beneficial effects on memory and cognition in mammals.