The aim of this study was to identify short digestion-resistant peptides (SDRPs) released by pepsin digestion of the whole cow’s milk and examine their IgE reactivity and allergenicity. Raw milk was subjected to simulated gastric digestion. SDRPs were fractionated from the digests and identified by MS. Milk SDRPs were evaluated for aggregability, propensity to compete for IgE binding with individual milk allergens, and ability to bind IgG4 from allergic and milk-tolerant individuals. The majority of milk SDRPs originated from caseins (97% of peptides) and overlapped with the known IgE epitopes of cow’s milk allergens. SDRPs competed with milk proteins for binding to human IgE and readily formed aggregates. The average peptide length was 10.6 ± 3.5 amino acids. The ability to provoke allergenic in vivo responses was confirmed by skin-prick testing (SPT) in five milk-allergic subjects. This was attributed to the peptide ability to aggregate into non-covalent complexes. SDRPs are able to induce response in SPT, but only in 50% of the sera SDRPs were able to inhibit IgG4 binding to caseins. Hence, SDRPs corresponding to the mainly continuous epitopes of milk proteins induce allergenic in vivo responses in milk-allergic subjects due to aggregation.