Seizures in some 30% to 40% of patients with epilepsy fail to respond to antiepileptic drugs or other treatments. While much has been made of the risks of new drug therapies, not enough attention has been given to the risks of uncontrolled and progressive epilepsy. This critical review summarizes known risks associated with refractory epilepsy, provides practical clinical recommendations, and indicates areas for future research. Eight international epilepsy experts from Europe, the United States, and South America met on May 4, 2013, to present, review, and discuss relevant concepts, data, and literature on the consequences of refractory epilepsy. While patients with refractory epilepsy represent the minority of the population with epilepsy, they require the overwhelming majority of time, effort, and focus from treating physicians. They also represent the greatest economic and psychosocial burdens. Diagnostic procedures and medical/surgical treatments are not without risks. Overlooked, however, is that these risks are usually smaller than the risks of long-term, uncontrolled seizures. Refractory epilepsy may be progressive, carrying risks of structural damage to the brain and nervous system, comorbidities (osteoporosis, fractures), and increased mortality (from suicide, accidents, sudden unexpected death in epilepsy, pneumonia, vascular disease), as well as psychological (depression, anxiety), educational, social (stigma, driving), and vocational consequences. Adding to this burden is neuropsychiatric impairment caused by underlying epileptogenic processes (“essential comorbidities”), which appears to be independent of the effects of ongoing seizures themselves. Tolerating persistent seizures or chronic medicinal adverse effects has risks and consequences that often outweigh risks of seemingly “more aggressive” treatments. Future research should focus not only on controlling seizures but also on preventing these consequences.