We demonstrate how similarity-transformed full configuration interaction quantum Monte Carlo (FCIQMC) based on the transcorrelated Hamiltonian can be applied to make highly accurate predictions for the binding curve of the beryllium dimer, marking the first case study of a molecular system with this method. In this context, the non-Hermitian transcorrelated Hamiltonian, resulting from a similarity transformation with a Jastrow factor, serves the purpose to effectively address dynamic correlation beyond the used basis set and thus allows for obtaining energies close to the complete basis set limit from FCIQMC already with moderate basis sets and computational effort. Building on results from other explicitly correlated methods, we discuss the role of the Jastrow factor and its functional form, as well as potential sources for size consistency errors, and arrive at Jastrow forms that allow for high accuracy calculations of the vibrational spectrum of the beryllium dimer.