It is crucial to synergistically improve the yield and quality of sweet maize by implementing precise and strategic planting methods. However, a comprehensive understanding of how increasing plant density affects the sweet maize fresh ear yield, grain-filling rate, and grain carbohydrate concentration is not fully understood. Thus, a field experiment was performed using a split-plot design in Southeast China in 2021 and 2022, involving four sweet maize varieties (MT6855 and WT2015 were compact-type varieties, XMT10 and YZ7 were flat-type varieties) and three plant densities (D1: 4.5 plants m−2; D2: 6.0 plants m−2; and D3: 7.5 plants m−2). The results showed that an increasing plant density markedly increased the fresh ear yield of sweet maize varieties (MT6855 and WT2015) over the two years. However, it did not influence the fresh ear yield of XMT10 and YZ7. Across all four varieties in 2021 and 2022, the increasing plant density decreased the sweet maize filled ear length, while it did not affect the grain soluble solid concentration and grain residue ratio. The sweet maize grain weight, the maximum grain-filling rate, and the mean grain-filling rate decreased significantly with the increase in planting density across all four varieties. However, plant density did not significantly affect the grain soluble sugar, sucrose, fructose, and starch concentrations across different varieties at most stages during the grain filling. The current study also found that the sweet maize fresh ear yield was dramatically positively correlated with ears ha−1, grains per ear, grain-filling rate, and grain starch concentration but negatively correlated with the bare plant rate. Notably, a parabolic relationship existed between the fresh ear yield and 100-grain weight. These findings suggest that optimizing the plant density, particularly with compact-type varieties, can improve the sweet maize fresh ear yield without decreasing its quality.