We evaluated genetic variations in the non-structural carbohydrate (NSC) and the cell-wall components of stem in rice, sorghum, and sugar cane to assess the potential suitability of these gramineous crops for bioethanol production. For NSC, the maximum soluble sugar concentration was highest in sugar cane, followed by sorghum with sucrose. The major NSC in rice was starch, but there were wide variations in the starch to soluble sugar ratios among the cultivars. The total concentration of cell-wall components was negatively correlated with the NSC concentration, indicating competition for carbon sources. Among the cell-wall components, lignin was relatively stable within each group. The major sugar species composing hemicellulose was xylose in all crop groups, but there were differences in composition, with a higher fraction of arabinose and glucose in rice as compared to the other crops. In rice, there was less lignin than in sorghum or sugar cane; this might be advantageous for the efficient saccharification of cellulose.