Kenaf (Hibiscus cannabinus L.) is an industrial crop used as a raw material in various fields and is cultivated worldwide. Compared to high potential for its utilization, breeding sector is not vigorous partially due to laborous breeding procedure. Thus, efficient breeding methods are required for varieties that can adapt to various environments and obtain optimal production. For that, identifying kenaf’s characteristics is very important during the breeding process. Here, we investigated if RGB based vegetative index (VI) could be associated with traits for biomass. We used 20 varieties and germplasm of kenaf and RGB images taken with unmanned aerial vehicles (UAVs) for field selection in early and late growth stage. In addition, measuring the stem diameter and the number of nodes confirmed whether the vegetative index value obtained from the RGB image could infer the actual plant biomass. Based on the results, it was confirmed that the individual surface area and estimated plant height, which were identified from the RGB image, had positive correlations with the stem diameter and node number, which are actual growth indicators of the rate of growth further, biomass could also be estimated based on this. Moreover, it is suggested that VIs have a high correlation with actual growth indicators; thus, the biomass of kenaf could be predicted. Interstingly, those traits showing high correlation in the late stage had very low correlations in the early stage. To sum up, the results in the current study suggest a more efficient breeding method by reducing labor and resources required for breeding selection by the use of RGB image analysis obtained by UAV. This means that considerable high-quality research could be performed even with a tight budget. Furthermore, this method could be applied to crop management, which is done with other vegetative indices using a multispectral camera.