Despite the growing evidence of poor psychosocial adjustment, at present there is no formal method of assessment of social adjustment in patients with temporal lobe epilepsy (TLE). First, we assessed social adjustment in patients with TLE using a self-report questionnaire and compared the results with those from quality-of-life (QOL) scales. Second, we verified the influence of cognitive performance and clinical variables of epilepsy on social adjustment and QOL. We evaluated 35 people with TLE and 38 healthy controls. Patients had worse social adjustment, and it was correlated with worse perception of cognitive function. Attention and verbal memory dysfunctions were negatively correlated with social adjustment. However, there was no significant correlation between cognitive performance and QOL. Regarding clinical variables, persons with left TLE showed worse social adjustment and patients with frequent seizures showed worse QOL. These findings indicate the relevance of evaluating social adjustment and emphasize the importance of cognitive rehabilitation to improved social adjustment.