Background Although smart speaker technology is poised to help improve the health and well-being of older adults by offering services such as music, medication reminders, and connection to others, more research is needed to determine how older adults from lower socioeconomic position (SEP) accept and use this technology. Objective This study aimed to investigate the feasibility of using smart speakers to improve the health and well-being of low-SEP older adults. Methods A total of 39 adults aged between 65 and 85 years who lived in a subsidized housing community were recruited to participate in a 3-month study. The participants had a smart speaker at their home and were given a brief orientation on its use. Over the course of the study, participants were given weekly check-in calls to help assist with any problems and newsletters with tips on how to use the speaker. Participants received a pretest and posttest to gauge comfort with technology, well-being, and perceptions and use of the speaker. The study staff also maintained detailed process notes of interactions with the participants over the course of the study, including a log of all issues reported. Results At the end of the study period, 38% (15/39) of the participants indicated using the speaker daily, and 38% (15/39) of the participants reported using it several times per week. In addition, 72% (28/39) of the participants indicated that they wanted to continue using the speaker after the end of the study. Most participants (24/39, 62%) indicated that the speaker was useful, and approximately half of the participants felt that the speaker gave them another voice to talk to (19/39, 49%) and connected them with the outside world (18/39, 46%). Although common uses were using the speaker for weather, music, and news, fewer participants reported using it for health-related questions. Despite the initial challenges participants experienced with framing questions to the speaker, additional explanations by the study staff addressed these issues in the early weeks of the study. Conclusions The results of this study indicate that there is promise for smart speaker technology for low-SEP older adults, particularly to connect them to music, news, and reminders. Future studies will need to provide more upfront training on query formation as well as develop and promote more specific options for older adults, particularly in the area of health and well-being.