Structure effect of NiS and Ni3S2 nanoparticles were investigated for their electrocatalytic activity in the hydrogen evolution reaction in both acid and alkaline media. Owing to the different atomic configurations and crystalline structures, there is a hydrogen adsorption energy difference, which induces a difference in the activity. From density functional theory calculations and experimental observation, the importance of designing an electrocatalyst with an appropriate atomic configuration is evident.