The hydrolysis of the plant cell wall by microbial glycoside hydrolases and esterases is the primary mechanism by which stored organic carbon is utilized in the biosphere, and thus these enzymes are of considerable biological and industrial importance. Plant cell wall-degrading enzymes in general display a modular architecture comprising catalytic and non-catalytic modules. The X4 modules in glycoside hydrolases represent a large family of non-catalytic modules whose function is unknown. Here we show that the X4 modules from a Cellvibrio japonicus mannanase (Man5C) and arabinofuranosidase (Abf62A) bind to polysaccharides, and thus these proteins comprise a new family of carbohydrate-binding modules (CBMs), designated CBM35. The Man5C-CBM35 binds to galactomannan, insoluble amorphous mannan, glucomannan, and manno-oligosaccharides but does not interact with crystalline mannan, cellulose, cello-oligosaccharides, or other polysaccharides derived from the plant cell wall. Man5C-CBM35 also potentiates mannanase activity against insoluble amorphous mannan. Abf62A-CBM35 interacts with unsubstituted oat-spelt xylan but not substituted forms of the hemicellulose or xylo-oligosaccharides, and requires calcium for binding. This is in sharp contrast to other xylan-binding CBMs, which interact in a calcium-independent manner with both xylo-oligosaccharides and decorated xylans.