The IMAGINE Consortium aims to bring modeling of the magnetic field of the Milky Way to the next level by using Bayesian inference. IMAGINE includes an open-source modular software pipeline that optimizes parameters in a user-defined galactic magnetic field model against various selected observational datasets. Bayesian priors can be added as external probabilistic constraints of the model parameters. These conference proceedings describe the science goals of the IMAGINE consortium, the software pipeline and its inputs, namely observational data sets, galactic magnetic field models, and Bayesian priors.