We developed a content validated computerized epilepsy treatment clinical decision support system to assist clinicians with selecting the best antiepilepsy treatments. Before disseminating our computerized epilepsy treatment clinical decision support system, further rigorous validation testing was necessary. As reliability is a precondition of validity, we verified proof of reliability first. We evaluated the consistency of the epilepsy treatment clinical decision support system in three areas including the preferred antiepilepsy drug choice, the top three recommended choices, and the rank order of the three choices. We demonstrated 100% reliability on 15,000 executions involving a three-step process on five different common pediatric epilepsy syndromes. Evidence for the reliability of the epilepsy treatment clinical decision support system was essential for the long-term viability of the system, and served as a crucial component for the next phase of system validation.