This study assessed the associations between psychosocial factors (social isolation, social support, financial support and emotional distress) and memory complaints during the COVID-19 pandemic. This was a secondary analysis of data extracted from the dataset of participants recruited from 151 countries for a COVID-19 related mental health and wellness study between June and December 2020. The dependent variable was memory complaint, measured using the Memory Complaint Questionnaire. The independent variables were perception of social isolation, social support, financial support, emotional distress and history of SARS-CoV-19 infection. Confounding variables were age, sex at birth, level of education, employment status, HIV status and country-income level. Multivariable logistic regression was used to determine the associations between the dependent and independent variables after adjusting for the confounders. Of the 14825 participants whose data was extracted, 2460 (16.6%) had memory complaints. Participants who felt socially isolated (AOR: 1.422; 95% CI: 1.286–1.571), emotionally distressed (AOR: 2.042; 95% CI: 1.850–2.253) and with history of SARS-CoV-19 infection (AOR: 1.369; 95% CI: 1.139–1.646) had significantly higher odds of memory complaints. Participants who perceived they had social and financial support had significantly lower odds of memory complaints (AOR: 0.655; 95% CI: 0.571–0.751). Future management of pandemics like the COVID-19 should promote access to social and financial support and reduce the risk of social isolation and emotional distress.