Many small molecules have been identified as entry inhibitors of filoviruses. However, a lack of understanding of the mechanism of action for these molecules limits further their development as anti-filoviral agents. Here we provide evidence that toremifene and other small molecule entry inhibitors have at least three distinctive mechanisms of action and lay the groundwork for future development of anti-filoviral agents. The three mechanisms identified here include: (1) direct binding to the internal fusion loop region of Ebola virus glycoprotein (GP); (2) the HR2 domain is likely the main binding site for Marburg virus GP inhibitors and a secondary binding site for some EBOV GP inhibitors; (3) lysosome trapping of GP inhibitors increases drug exposure in the lysosome and further improves the viral inhibition. Importantly, small molecules targeting different domains on GP are synergistic in inhibiting EBOV entry suggesting these two mechanisms of action are distinct. Our findings provide important mechanistic insights into filovirus entry and rational drug design for future antiviral development.