An automated vision system, TeratomEye, was developed for the identification of three representative tissue types: muscle, gut and neural epithelia which are commonly found in teratomas formed from human embryonic stem cells. Muscle tissue, a common structure was identified with an accuracy of 90.3% with high specificity and sensitivity greater than 90%. Gut epithelia were identified with an accuracy of 87.5% with specificity and sensitivity greater than 80%. Neural epithelia which were the most difficult structures to distinguish gave an accuracy of 47.6%. TeratomEye is therefore useful for the automated identification of differentiated tissues in teratoma sections.