Global population aging has become a continuous and irreversible trend. Most of the elderly in China prefer “aging in place” owing to the influence of traditional concepts and social welfare, but many communities, as a basic place for the elderly to live, generally lack age-friendly infrastructure facilities. Based on the 2018 China Health and Retirement Longitudinal Study database, this study applies the propensity score matching method to empirically investigate the influence of the infrastructure facilities on the health of the elderly in China. The results show that adding elevators, installing bathing facilities, supplying gas or natural gas, and changing squatting toilets into sitting toilets, positively influence the health of the elderly, but there are some differences. The order of the degree of impact on self-rated health (SRH) was elevator > toilet type > kitchen gas supply > bathing facility, while that of activities of daily living (ADL) was bathing facility > toilet type > elevator > kitchen gas supply. Elderly people with different personal characteristics and family status have different degrees of ownership for the infrastructure facilities. It is suggested that age-friendly regeneration schemes be developed according to the different impacts and demands of the facilities.