Yang-Mills theory on a two dimensional cylinder is studied in the hamiltonian formalism, without using gauge conditions. Since the only gauge invariant variable is the Wilson loop (holonomy) this system is equivalent to a finite dimensional system. The eigenstates and eigenvalues of the hamiltonian are found exactly.