Recently, the demand for small grid-connected photovoltaic (PV) systems has been rapidly increasing; this is due to the reduction in the costs of grid-connected storage systems as compared to those of the stand-alone ones. Notably, the performance of the solar tracking system is not only depending on the types but also the region that they are set up and used. To understand how solar tracking systems work globally, we need to know their performance in each country and even the different parts of a country. In this study, two grid-connected PV systems with 250 W solar modules were used to investigate the efficient improvement of a single-axis sun tracking system in Central Vietnam. First, a mechanical tracking device with a linear actuator and a controller was designed and then its performance was comprehensively investigated with a grid-connected PV system. In addition to evaluating the energy gain by the tracking system, this study also considered the energy consumption of the linear actuator with its controller and a small grid-connected PV system; this has generally been omitted in previous works. Experimental results indicate that the total energy consumption of the tracking system was approximately 2–8% of the energy generated by the grid-connected PV system. The maximum overall energy generation was confirmed to have increased by up to 30.3% on a sunny day upon using the proposed tracking system; further, the net energy gain by using the sun tracker was ascertained to be 15.2% in average weather conditions. Based on the success of this work, we will keep experimenting with other parts of Vietnam. Also, we will collaborate with colleagues in other countries to create a guideline for understanding and using the solar tracker regionally and globally.