Cannabis consumption has become the center of much debate globally. The positive public perception of the medicinal benefits of cannabis and the rise of recreational usage of cannabis necessitate dramatic changes in cannabis reform policy. As a consequence, there is an increase in cannabis legalization around the globe, although it is still facing many rejections. It is crucial to understand the factors affecting public acceptance of cannabis use to support the contextualization and success of cannabis legalization. This review aims to address consumer cultural, social and psychological factors regarding the legal use of cannabis. Based on this review, cultures influence the endorsement or rejection of cannabis use depending on political views, religious sentiments and affiliated subcultures (adult, youth and adolescent subcultures). Regarding the social factors, socioeconomic status, measured by income, education level and occupation, is a key determinant of cannabis use. The beliefs opposing cannabis legalization are due to the negative stigma surrounding cannabis use. Nevertheless, growing awareness about the pharmaceutical and therapeutic effects of cannabis has led to an increase in positive attitudes towards cannabis legalization. Thus, dissemination of cannabis use benefits reaffirmed by scientific evidence could be a strategic way to alleviate the public’s negative feedback on cannabis legalization.