Controversies and interest are present in the associations between specific brain locations and depression or anxiety. This study investigated the association between stroke location and emotional changes in stroke patients. This prospective observational study analyzed the neuroimages and neuropsychiatric conditions of 26 patients with acute middle cerebral artery infarction. Each patient's neurological and psychiatric condition was evaluated 1 week as well as 1 month after the stroke. We found that the right superior and middle temporal gyrus was associated with anxiety at 1 month after stroke. Moreover, better mentality is associated with deterioration of anxiety within 1 month after stroke, and larger lesion volume is associated with deterioration of depression within 1 month after stroke.