Banana (and plantain, Musa spp.), in sub-Saharan Africa (SSA), is predominantly grown as a mixed crop by smallholder farmers in backyards and small farmlands, typically ranging from 0.2 ha to 3 ha. The crop is affected by several pests and diseases, including the invasive banana bunchy top virus (BBTV, genus Babuvirus), which is emerging as a major threat to banana production in SSA. The BBTV outbreak in West Africa was first recorded in the Benin Republic in 2010 and has spread to the adjoining territories of Nigeria and Togo. Regular surveillance, conducted as part of the containment efforts, requires the identification of banana fields for disease assessment. However, small and fragmented production spread across large areas poses complications for identifying all banana farms using conventional field survey methods, which is also time-consuming and expensive. In this study, we developed a remote sensing approach and machine learning (ML) models that can be used to identify banana fields for targeted BBTV surveillance. We used medium-resolution synthetic aperture radar (SAR), Sentinel 2A satellite imagery, and high-resolution RGB and multispectral aerial imagery from an unmanned aerial vehicle (UAV) to develop an operational banana mapping framework by combining the UAV, SAR, and Sentinel 2A data with the Support Vector Machine (SVM) and Random Forest (RF) machine learning algorithms. The ML algorithms performed comparatively well in classifying the land cover, with a mean overall accuracy (OA) of about 93% and a Kappa coefficient (KC) of 0.89 for the UAV data. The model using fused SAR and Sentinel 2A data gave an OA of 90% and KC of 0.86. The user accuracy (UA) and producer accuracy (PA) for the banana class were 83% and 78%, respectively. The BBTV surveillance teams used the banana mapping framework to identify banana fields in the BBTV-affected southwest Ogun state of Nigeria, which helped in detecting 17 sites with BBTV infection. These findings suggest that the prediction of banana and other crops in the heterogeneous smallholder farming systems is feasible, with the precision necessary to guide BBTV surveillance in large areas in SSA.