The detection of early-stage tumors in the breast by microwave imaging is challenged by both the moderate endogenous dielectric contrast between healthy and malignant glandular tissues and the spatial resolution available from illumination at microwave frequencies. The high endogenous dielectric contrast between adipose and fibroglandular tissue structures increases the difficulty of tumor detection due to the high dynamic range of the contrast function to be imaged and the low level of signal scattered from a tumor relative to the clutter scattered by normal tissue structures. Microwave inverse scattering techniques, used to estimate the complete spatial profile of the dielectric properties within the breast, have the potential to reconstruct both normal and cancerous tissue structures. However, the ill-posedness of the associated inverse problem often limits the frequency of microwave illumination to the UHF band within which early-stage cancers have sub-wavelength dimensions. In this computational study, we examine the reconstruction of small, compact tumors in three-dimensional numerical breast phantoms by a multiple-frequency inverse scattering solution. Computer models are also employed to investigate the use of exogenous contrast agents for enhancing tumor detection. Simulated array measurements are acquired before and after the introduction of the assumed contrast effects for two specific agents currently under consideration for breast imaging: microbubbles and carbon nanotubes. Differential images of the applied contrast demonstrate the potential of the approach for detecting the preferential uptake of contrast agents by malignant tissues.