We present an inversion method capable of robustly unfolding MeV x-ray spectra from filter stack spectrometer (FSS) data without requiring an a priori specification of a spectral shape or arbitrary termination of the algorithm. Our inversion method is based upon the perturbative minimization (PM) algorithm, which has previously been shown to be capable of unfolding x-ray transmission data, albeit for a limited regime in which the x-ray mass attenuation coefficient of the filter material increases monotonically with x-ray energy. Our inversion method improves upon the PM algorithm through regular smoothing of the candidate spectrum and by adding stochasticity to the search. With these additions, the inversion method does not require a physics model for an initial guess, fitting, or user-selected termination of the search. Instead, the only assumption made by the inversion method is that the x-ray spectrum should be near a smooth curve. Testing with synthetic data shows that the inversion method can successfully recover the primary large-scale features of MeV x-ray spectra, including the number of x-rays in energy bins of several-MeV widths to within 10%. Fine-scale features, however, are more difficult to recover accurately. Examples of unfolding experimental FSS data obtained at the Texas Petawatt Laser Facility and the OMEGA EP laser facility are also presented.