Microbial degradation of plant cell walls is a central component of the carbon cycle and is of increasing importance in environmentally significant industries. Plant cell wall degrading enzymes have a complex molecular architecture consisting of catalytic modules and, frequently, multiple non-catalytic carbohydrate-binding modules (CBMs). It is currently unclear whether the specificities of the CBMs, or the topology of the catalytic modules, are the primary drivers for the specificity of these enzymes against plant cell walls. Here, we have evaluated the relationship between CBM specificity and their capacity to enhance the activity of GH5 and GH26 mannanases and CE2 esterases against intact plant cell walls. The data showed that cellulose and mannan binding CBMs have the greatest impact on the removal of mannan from tobacco and Physcomitrella cell walls, respectively. While the action of the GH5 mannanase was independent of the context of mannan in tobacco cell walls, a significant proportion of the polysaccharide was inaccessible to the GH26 enzyme. The recalcitrant mannan, however, was fully accessible to the GH26 mannanase appended to a cellulose binding CBM. Although CE2 esterases display similar specificities against acetylated substrates in vitro, only CjCE2C was active against acetylated mannan in Physcomitrella. Appending a mannan binding CBM27 to CjCE2C potentiated its activity against Physcomitrella walls, while a xylan binding CBM reduced the capacity of esterases to deacetylate xylan in tobacco walls. This work provides insight into the biological significance for the complex array of hydrolytic enzymes expressed by plant cell wall degrading microorganisms.