H5N1 influenza viruses transmitted from poultry to humans in Asia cause high mortality and pose a pandemic threat. Viral genes important for cell tropism and replication efficiency must be identified to elucidate and target virulence factors. We applied reverse genetics to generate H5N1 reassortants combining genes of lethal A/Vietnam/1203/04 (VN1203), a fatal human case isolate, and nonlethal A/chicken/Vietnam/C58/04 (CH58) and tested their pathogenicity in ferrets and mice. The viruses' hemagglutinins have six amino acids differences, identical cleavage sites, and avian-like alpha-(2,3)-linked receptor specificity. Surprisingly, exchanging hemagglutinin and neuraminidase genes did not alter pathogenicity, but substituting CH58 polymerase genes completely attenuated VN1203 virulence and reduced viral polymerase activity. CH58's NS gene partially attenuated VN1203 in ferrets but not in mice. Our findings suggest that for high virulence in mammalian species an avian H5N1 virus with a cleavable hemagglutinin requires adaptive changes in polymerase genes to overcome the species barrier. Thus, novel antivirals targeting polymerase proteins should be developed.