Beamforming approaches have recently been developed for the field of electroencephalography (EEG) and magnetoencephalography (MEG) source analysis and opened up new applications within various fields of neuroscience. While the number of beamformer applications thus increases fast-paced, fundamental methodological considerations, especially the dependence of beamformer performance on leadfield accuracy, is still quite unclear. In this article, we present a systematic study on the influence of improper volume conductor modeling on the source reconstruction performance of an EEG-data based synthetic aperture magnetometry (SAM) beamforming approach. A finite element model of a human head is derived from multimodal MR images and serves as a realistic volume conductor model. By means of a theoretical analysis followed by a series of computer simulations insight is gained into beamformer performance with respect to reconstruction errors in peak location, peak amplitude, and peak width resulting from geometry and anisotropy volume conductor misspecifications, sensor noise, and insufficient sensor coverage. We conclude that depending on source position, sensor coverage, and accuracy of the volume conductor model, localization errors up to several centimeters must be expected. As we could show that the beamformer tries to find the best fitting leadfield (least squares) with respect to its scanning space, this result can be generalized to other localization methods. More specific, amplitude, and width of the beamformer peaks significantly depend on the interaction between noise and accuracy of the volume conductor model. The beamformer can strongly profit from a high signal-to-noise ratio, but this requires a sufficiently realistic volume conductor model.