We present photometry and derived redshifts from up to eleven bandpasses for 9927 galaxies in the Hubble Ultra Deep field (UDF), covering an observed wavelength range from the near-ultraviolet (NUV) to the near-infrared (NIR) with Hubble Space Telescope observations. Our Wide Field Camera 3 (WFC3)/UV F225W, F275W, and F336W image mosaics from the ultra-violet UDF (UVUDF) imaging campaign are newly calibrated to correct for charge transfer inefficiency, and use new dark calibrations to minimize background gradients and pattern noise. Our NIR WFC3/IR image mosaics combine the imaging from the UDF09 and UDF12 campaigns with CANDELS data to provide NIR coverage for the entire UDF field of view. We use aperture-matched point-spread function corrected photometry to measure photometric redshifts in the UDF, sampling both the Lyman break and Balmer break of galaxies at z~0.8-3.4, and one of the breaks over the rest of the redshift range. Our comparison of these results with a compilation of robust spectroscopic redshifts shows an improvement in the galaxy photometric redshifts by a factor of two in scatter and a factor three in outlier fraction over previous UDF catalogs. The inclusion of the new NUV data is responsible for a factor of two decrease in the outlier fraction compared to redshifts determined from only the optical and NIR data, and improves the scatter at z2. The panchromatic coverage of the UDF from the NUV through the NIR yields robust photometric redshifts of the UDF, with the lowest outlier fraction available. ; Comment: 27 pages, 17 figures, Accepted by AJ