Functional and structural magnetic resonance imaging have become the most important noninvasive windows to the human brain. A major challenge in the analysis of brain networks is to establish the similarities and dissimilarities between functional and structural connectivity. We formulate a non-parametric Bayesian network model which allows for joint modelling and integration of multiple networks. We demonstrate the model’s ability to detect vertices that share structure across networks jointly in functional MRI (fMRI) and diffusion MRI (dMRI) data. Using two fMRI and dMRI scans per subject, we establish significant structures that are consistently shared across subjects and data splits. This provides an unsupervised approach for modeling of structure-function relations in the brain and provides a general framework for multimodal integration.