The worldwide uptake of COVID-19 vaccines was suboptimal throughout the pandemic; vaccine hesitancy played a principle role in low vaccine acceptance both globally and in Armenia. In order to understand the factors behind the slow vaccine uptake in Armenia, we aimed to explore the prevailing perceptions and experiences of healthcare providers and the general public related to COVID-19 vaccines. The study applied a convergent parallel mixed-methods study design (QUAL-quant) through in-depth interviews (IDI) and a telephone survey. We completed 34 IDIs with different physician and beneficiary groups and a telephone survey with 355 primary healthcare (PHC) providers. The IDIs found that physicians held variable views on the need for COVID-19 vaccination which, combined with mixed messaging in the media landscape, fueled the public’s vaccine hesitancy. The survey results were mostly consistent with the qualitative findings as 54% of physicians hypothesized that COVID-19 vaccines were rushed without appropriate testing and 42% were concerned about the safety of those vaccines. Strategies to improve vaccination rates must target the main drivers of hesitancy, such as physicians’ poor knowledge of specific vaccines and spiraling misconceptions about them. Meanwhile, timely educational campaigns with targeted messaging for the general public should address misinformation, promote vaccine acceptance, and empower their capacity to make decisions about their health.