Over the past few decades, the financial system has engaged in abusive practices that meet the definition of fraud. Our objective is to compare the prevalence of psychological distress and levels of health-related quality of life according to having been exposed to financial fraud and its economic impact on family finances. The City of Madrid Health Survey 2017 included specific questions on exposure to financial fraud—this section was administered to half of the participants (n = 4425). Mental health need or caseness was defined by a score greater than two on the 12-item version of the Goldberg health questionnaire. Health-related quality of life was assessed by the Darmouth Coop Functional Health Assessment Charts/WONCA (COOP/WONCA). The prevalence of financial fraud was 10.8%. The prevalence rate ratio for caseness of those who experienced severe economic impact due to fraud was 1.62 (95%, CI 1.17–2.25; reference: no fraud), after adjustment by age, sex, social class, and immigrant status. Women experienced a decreased quality of life, even with a moderate impact of fraud, while men experienced a decreased quality of life related to fraud with severe economic impact. The current study contributes to a growing body of literature showing the effects of economic shocks on health as a result of financial fraud.