Although COVID-19 is considered to be primarily a respiratory disease, SARS-CoV-2 affects multiple organ systems including the central nervous system (CNS). Yet, there is no consensus whether the virus can infect the brain, or what the consequences of CNS infection are. Here, we used three independent approaches to probe the capacity of SARS-CoV-2 to infect the brain. First, using human brain organoids, we observed clear evidence of infection with accompanying metabolic changes in the infected and neighboring neurons. However, no evidence for the type I interferon responses was detected. We demonstrate that neuronal infection can be prevented either by blocking ACE2 with antibodies or by administering cerebrospinal fluid from a COVID-19 patient. Second, using mice overexpressing human ACE2, we demonstrate in vivo that SARS-CoV-2 neuroinvasion, but not respiratory infection, is associated with mortality. Finally, in brain autopsy from patients who died of COVID-19, we detect SARS-CoV-2 in the cortical neurons, and note pathologic features associated with infection with minimal immune cell infiltrates. These results provide evidence for the neuroinvasive capacity of SARS-CoV2, and an unexpected consequence of direct infection of neurons by SARS-CoV-2.