Context-dependence in mutualisms is a fundamental aspect of ecological interactions. Within plant-ant mutualisms, particularly in terms of biotic protection and pollination, research has predominantly focused on elucidating the benefits while largely overlooking potential costs. This notable gap underscores the need for investigations into the drawbacks and trade-offs associated with such mutualistic relationships. Here, we evaluated the role of pericarpial nectaries (PNs) in shaping the dynamics of ant-pollinator mutualisms. Specifically, we investigated whether ants visiting the PN of Palicourea rigida (Rubiaceae) could deter hummingbirds and disrupt pollination, ultimately influencing fruit production. Our research involved manipulative experiments and observation of ant-pollinator interactions on P. rigida plants in the Brazilian savannah. We found that visiting ants can deter hummingbirds and/or disrupt pollination in P. rigida, directly influencing fruit set. However, these results are species-specific. The presence of very aggressive, large predatory ants, such as E. tuberculatum, had a negative impact on hummingbird behavior, whereas aggressive mid-sized ants, such as C. crassus, showed no effects. Our study illuminates the multifaceted aspects of ant-plant mutualisms and underscores the importance of evaluating costs and unexpected outcomes within these ecological relationships.