Bone mineral density (BMD) is a commonly used diagnostic indicator for bone fracture risk in osteoporosis. Along with low BMD, bone fragility accounts for reduced bone quality in addition to low BMD, but there is no diagnostic method to directly assess the bone quality. In this study, we investigated changes in bone quality using the Raman spectroscopic technique. Sciatic neurectomy (NX) was performed in male C57/BL6J mice (NX group) as a model of disuse osteoporosis, and sham surgery was used as an experimental control (Sham group). Eight months after surgery, we acquired Raman spectral data from the anterior cortical surface of the proximal tibia. We also performed a BMD measurement and micro-CT measurement to investigate the pathogenesis of osteoporosis. Quantitative analysis based on the Raman peak intensities showed that the carbonate/phosphate ratio and the mineral/matrix ratio were significantly higher in the NX group than in the Sham group. There was direct evidence of alterations in the mineral content associated with mechanical properties of bone. To fully understand the spectral changes, we performed principal component analysis of the spectral dataset, focusing on the matrix content. In conclusion, Raman spectroscopy provides reliable information on chemical changes in both mineral and matrix contents, and it also identifies possible mechanisms of disuse osteoporosis.