Misdiagnosis of bacterial pneumonia is a leading cause of inappropriate antimicrobial use in hospitalized patients. We report a novel strategy of keyword abstraction from chest radiography transcripts that reliably identified patients with pneumonia misdiagnosis and opportunities for antibiotic discontinuation and/or de-escalation.