Advanced prostate cancer is a very heterogeneous disease reflecting in diverse regulations of oncogenic signaling pathways. Aberrant spatial dynamics of epidermal growth factor receptor (EGFR) promote their dimerization and clustering, leading to constitutive activation in oncogenesis. The EphB2 and Src signaling pathways are associated with the reorganization of the cytoskeleton leading to malignancy, but their roles in regulating EGFR dynamics and activation are scarcely reported. Using single-particle tracking techniques, we found that highly phosphorylated EGFR in the advanced prostate cancer cell line, PC3, was associated with higher EGFR diffusivity, as compared with LNCaP and less aggressive DU145. The increased EGFR activation and biophysical dynamics were consistent with high proliferation, migration, and invasion. After performing single-cell RNA-seq on prostate cancer cell lines and circulating tumor cells from patients, we identified that upregulated gene expression in the EphB2 and Src pathways are associated with advanced malignancy. After dasatinib treatment or siRNA knockdowns of EphB2 or Src, the PC3 cells exhibited significantly lower EGFR dynamics, cell motility, and invasion. Partial inhibitory effects were also found in DU145 cells. The upregulation of parts of the EphB2 and Src pathways also predicts poor prognosis in the prostate cancer patient cohort of The Cancer Genome Atlas. Our results provide evidence that overexpression of the EphB2 and Src signaling pathways regulate EGFR dynamics and cellular aggressiveness in some advanced prostate cancer cells.