Secondary demyelinating diseases comprise a wide spectrum group of pathological conditions and may either be attributed to a disorder primarily affecting the neurons or axons, followed by demyelination, or to an underlying condition leading to secondary damage of the myelin sheath. In the elderly, primary demyelinating diseases of the central nervous system (CNS), such as multiple sclerosis, are relatively uncommon. However, secondary causes of CNS demyelination may often occur and in this case, extensive diagnostic workup is usually needed. Infectious, postinfectious, or postvaccinal demyelination may be observed, attributed to age-related alterations of the immune system in this population. Osmotic disturbances and nutritional deficiencies, more commonly observed in the elderly, may lead to conditions such as pontine/extrapontine myelinolysis, Wernicke encephalopathy, and demyelination of the posterior columns of the spinal cord. The prevalence of malignancies is higher in the elderly, sometimes leading to radiation-induced, immunotherapy-related, or paraneoplastic CNS demyelination. This review intends to aid clinical neurologists in broadening their diagnostic approach to secondary CNS demyelinating diseases in the elderly. Common clinical conditions leading to secondary demyelination and their clinical manifestations are summarized here, while the current knowledge of the underlying pathophysiological mechanisms is additionally presented.