In 'colored-hearing' synesthesia, individuals report color experiences when they hear spoken words. If the synesthetic color experience resembles that of normal color perception, one would predict activation of parts of the visual system specialized for such perception, namely the human 'color center', referred to as either V4 or V8. Using functional magnetic resonance imaging (fMRI), we here locate the region activated by speech in synesthetes to area V4/V8 in the left hemisphere, and demonstrate overlap with V4/V8 activation in normal controls in response to color. No activity was detected in areas V1 or V2, suggesting that activity in primary visual cortex is not necessary for such experience. Control subjects showed no activity in V4/V8 when imagining colors in response to spoken words, despite overtraining on word-color associations similar to those spontaneously reported by synesthetes.