Ultrafast extreme ultraviolet and X-ray free-electron lasers are set to revolutionize many domains such as bio-photonics and materials science, in a manner similar to optical lasers over the past two decades. Although their number will grow steadily over the coming decade, their complete characterization remains an elusive goal. This represents a significant barrier to their wider adoption and hence to the full realization of their potential in modern photon sciences. Although a great deal of progress has been made on temporal characterization and wavefront measurements at ultrahigh extreme ultraviolet and X-ray intensities, only few, if any progress on accurately measuring other key parameters such as the state of polarization has emerged. Here we show that by combining ultra-short extreme ultraviolet free electron laser pulses from FERMI with near-infrared laser pulses, we can accurately measure the polarization state of a free electron laser beam in an elegant, non-invasive and straightforward manner using circular dichroism.