We report on the improvement of the infrared optical trapping efficiency of dielectric microspheres by the controlled adhesion of gold nanorods to their surface. When trapping wavelength was equal to the surface plasmon resonance wavelength of the gold nanorods (808 nm), a 7 times improvement in the optical force acting on the microspheres was obtained. Such a gold nanorod assisted enhancement of the optical trapping efficiency enabled the intracellular manipulation of the decorated dielectric microsphere by using a low power (22 mW) infrared optical trap.