Magnetic resonance imaging (MRI) of small animals is routinely performed in research centers. But despite its many advantages, MR still suffers from limited spatial resolution which makes the interpretation and quantitative analysis of the images difficult, particularly for small structures of interest within areas of significant heterogeneity. One possibility to address this issue is to complement the MR images with histological data, which requires reconstructing 3D volumes from a series of 2D images. A number of methods have been proposed recently in the literature to address this issue, but deformation or tearing during the slicing process often produces reconstructed volumes with visible artifacts and imperfections. In this paper, we show that a possible solution to this problem is to work with several histological volumes, reconstruct each of these separately and then compute an average. The resulting histological atlas shows structures and substructures more clearly than any individual volume. We also propose an original approach to normalize intensity values across slices, a required preprocessing step when reconstructing histological volumes. We show that the histological atlas we have created can be used to localize structures and substructures, which cannot be seen easily in MR images. We also create an MR atlas that is associated with the histological atlas. We show that using the histological volumes to create the MR atlas is better than using the MR volumes only. Finally, we validate our approach quantitatively on MR image volumes by comparing volumetric measurements obtained manually and obtained automatically with our atlases.