The chalcone and quinoline scaffolds are frequently utilized to design novel anticancer agents. As the continuation of our work on effective anticancer agents, we assumed that linking chalcone fragment to the quinoline scaffold through the principle of molecular hybridization strategy could produce novel compounds with potential anticancer activity. Therefore, quinoline-chalcone derivatives were designed and synthesized, and we explored their antiproliferative activity against MGC-803, HCT-116, and MCF-7 cells. Among these compounds, compound 12e exhibited a most excellent inhibitory potency against MGC-803, HCT-116, and MCF-7 cells with IC50 values of 1.38, 5.34, and 5.21 µM, respectively. The structure–activity relationship of quinoline-chalcone derivatives was preliminarily explored in this report. Further mechanism studies suggested that compound 12e inhibited MGC-803 cells in a dose-dependent manner and the cell colony formation activity of MGC-803 cells, arrested MGC-803 cells at the G2/M phase and significantly upregulated the levels of apoptosis-related proteins (Caspase3/9 and cleaved-PARP) in MGC-803 cells. In addition, compound 12e could significantly induce ROS generation, and was dependent on ROS production to exert inhibitory effects on gastric cancer cells. Taken together, all the results suggested that directly linking chalcone fragment to the quinoline scaffold could produce novel anticancer molecules, and compound 12e might be a valuable lead compound for the development of anticancer agents.