Conservatism in species interaction, meaning that related species tend to interact with similar partners, is an important feature of ecological interactions. Studies at community scale highlight variations in conservatism strength depending on the characteristics of the ecological interaction studied. However, the heterogeneity of datasets and methods used prevent to compare results between mutualistic and antagonistic networks. Here we perform such a comparison by taking plant-insect communities as a study case, with data on plant-herbivore and plant-pollinator networks. Our analysis reveals that plants acting as resources for herbivores exhibit the strongest conservatism in species interaction among the four interacting groups. Conservatism levels are similar for insect pollinators, insect herbivores and plants as interacting partners of pollinators, although insect pollinators tend to have a slightly higher conservatism than the two others. Our results thus clearly support the current view that within antagonistic networks, conservatism is stronger for species as resources than for species as consumer. Although the pattern tends to be opposite for plant-pollinator networks, our results suggest that asymmetry in conservatism is much less pronounced between the pollinators and the plant they interact with. We discuss these differences in conservatism strength in relation with the processes structuring plant-insect communities.