Virus-specific cellular and humoral responses are major determinants for protection from critical illness after SARS-CoV-2 infection. However, the magnitude of the contribution of each of the components to viral clearance remains unclear. Here, we studied the timing of viral clearance in relation to 122 immune parameters in 102 hospitalised patients with moderate and severe COVID-19 in a longitudinal design. Delayed viral clearance was associated with more severe disease and was associated with higher levels of SARS-CoV-2-specific (neutralising) antibodies over time, increased numbers of neutrophils, monocytes, basophils, and a range of pro-inflammatory cyto-/chemokines illustrating ongoing, partially Th2 dominating, immune activation. In contrast, early viral clearance and less critical illness correlated with the peak of neutralising antibodies, higher levels of CD4 T cells, and in particular naïve CD4+ T cells, suggesting their role in early control of SARS-CoV-2 possibly by proving appropriate B cell help. Higher counts of naïve CD4+ T cells also correlated with lower levels of MIF, IL-9, and TNF-beta, suggesting an indirect role in averting prolonged virus-induced tissue damage. Collectively, our data show that naïve CD4+ T cell play a critical role in rapid viral T cell control, obviating aberrant antibody and cytokine profiles and disease deterioration. These data may help in guiding risk stratification for severe COVID-19.