We present the complete construction methodology for an anatomically accurate mouse phantom made using materials which mimic the characteristics of tissue, lung, and bone for radiation dosimetry studies. Phantoms were constructed using 2 mm thick slices of tissue equivalent material which was precision machined to clear regions for insertion of lung and bone equivalent material where appropriate. Images obtained using a 3D computed tomography (CT) scan clearly indicate regions of tissue, lung, and bone that match their position within the original mouse CT scan. Additionally, radiographic films are used with the phantom to demonstrate dose mapping capabilities. The construction methodology presented here can be quickly and easily adapted to create a phantom of any specific small animal given a segmented CT scan of the animal. These physical phantoms are a useful tool to examine individual organ dose and dosimetry within mouse systems that are complicated by density inhomogeneity due to bone and lung regions.