SARS-CoV-2 infection can induce a broad range of clinical symptoms, and the most severe cases are characterized by an uncontrolled inflammatory response with the overproduction of proinflammatory cytokines. Elevated levels of C-reactive protein, interleukin-1B, and interleukin-6 have become key signatures of severe COVID-19. For this reason, the use of 6 mg of dexamethasone has become a standard of care, although this regime may not be optimal. Even though various glucocorticoid doses have been proposed, it is still unclear which dose should be used to prevent adverse effects while at the same time reducing the inflammatory response. Here, we compared two different doses of corticosteroids in 52 elderly hospitalized patients with severe to critical COVID-19 to assess efficacy and safety. We showed that in patients receiving a higher dose of prednisone, the time to negative swab was significantly longer. Furthermore, although neither dose was correlated with the risk of death, patients receiving the high dose were more likely to have adverse events such as hyperglycemia, leukocytosis, an increase in systemic blood pressure, and others. Finally, the BMI, WBC number, and NLR value were directly related to death. In conclusion, although the optimal glucocorticoid dose is still undefined, our retrospective study supports the absence of beneficial effects in the utilization of higher doses of corticosteroids in elderly patients with severe to critical COVID-19.