Highly effective yet affordable non-noble metal catalysts are a key component for advances in hydrogen generation via electrolysis. The synthesis of catalytic heterostructures containing established Ni in combination with surface NiO, Ni(OH)2, and NiOOH domains gives rise to a synergistic effect between the surface components and is highly beneficial for water splitting and the hydrogen evolution reaction (HER). Herein, the intrinsic catalytic activity of pure Ni and the effect of partial electrochemical oxidation of ultra-smooth magnetron sputter-deposited Ni surfaces are analyzed by combining electrochemical measurements with transmission electron microscopy, selected area electron diffraction, X-ray photoelectron spectroscopy, and atomic force microscopy. The experimental investigations are supplemented by Density Functional Theory and Kinetic Monte Carlo simulations. Kinetic parameters for the HER are evaluated while surface roughening is carefully monitored during different Ni film treatment and operation stages. Surface oxidation results in the dominant formation of Ni(OH)2, practically negligible surface roughening, and 3–5 times increased HER exchange current densities. Higher levels of surface roughening are observed during prolonged cycling to deep negative potentials, while surface oxidation slows down the HER activity losses compared to as-deposited films. Thus, surface oxidation increases the intrinsic HER activity of nickel and is also a viable strategy to improve catalyst durability.