Effects of oxygen on the glass formation of Zr41.2Ti13.8Cu12.5Ni10Be22.5 and Zr39.6Ti33.9Nb7.6Ni6.4Be12.5 alloys were studied. Our results indicated that oxygen is segregated in the precipitated Zr3NiO-type and β-Zr crystals, respectively, making the glass matrices keep good glass formation. Interestingly, as compared with the oxygen-free sample, the Zr39.6Ti33.9Nb7.6Ni6.4Be12.5 added with 2000 ppm oxygen exhibits much higher yield stress with only a little ductility loses. This founding gives us a new clue to avoid the detriment of oxygen to the to the glass formation just by designing appropriate glass composites.