Background: Veno-arterial extracorporeal membrane oxygenation (vaECMO) removal reflects a critical moment and factors of adverse outcomes are incompletely understood. Thus, we studied various patient-related factors during vaECMO removal to determine their association with outcomes. Methods: A total of 58 patients from a university hospital were included retrospectively. Demographic, clinical, and echocardiographic parameters were recorded while under vaECMO support, as well as the need for inotropic and vasoactive-inotropic scores (VIS). Successful weaning was defined as 28-day survival without reinitiation of vaECMO. Results: Patient age differed significantly between patients with a successful and a failed vaECMO weaning (54 ± 14 vs. 62 ± 12 years, p = 0.029). In univariable logistic regression, age (OR 0.952 (0.909–0.997), p = 0.038), the necessities for inotropic agents at the time of echocardiography (OR 0.333 (0.113–0.981), p = 0.046), and vaECMO removal (OR 0.266 (0.081–0.877), p = 0.030) as well as the dobutamine dose during removal (OR 0.649 (0.473–0.890), p = 0.007), were significantly associated with a successful weaning from vaECMO. Age (HR 1.048 (1.006–1.091), p = 0.024) and the VIS (HR 1.030 (1.004–1.056), p = 0.025) at the time of vaECMO removal were independently associated with survival in bivariable Cox regression. In Kaplan–Meier analysis, a VIS of >5.1 at vaECMO removal was associated with impaired survival (log-rank p = 0.025). Conclusions: In this cohort, age and the extent of vasoactive-inotropic agents were associated with adverse outcomes following vaECMO, whereas echocardiographic biventricular function during vaECMO support was not.