Introduction: Telemedicine is used to assess patients with stroke remotely. The extent of training necessary to use these systems is unknown. A site-independent telemedicine system (used in the STRokE DOC trial) is reliable when used by telemedicine-trained investigators. We report a prospective evaluation of telemedicine's reliability when used by nontelemedicine-trained examiners.
Materials and methods: In all, 25 patients with stroke were prospectively evaluated. Two team members (one bedside, one remote) simultaneously graded each patient using the National Institutes of Health Stroke Scale (NIHSS), modified NIHSS (mNIHSS), and modified Rankin scale. Patients followed commands of the remote telemedicine neurologist, who was untrained in, and had no experience with, telemedicine.
Results: Remote evaluations by telemedicine-naive examiners were feasible in 25 of 25 (100%) patients. One technical complication, which did not interfere with performing the examination, was noted. Median NIHSS score was 11.5. Average clinical examination took 13.9 minutes (improving from 22 to 8 minutes). Reliability was comparable with published studies, with 10/15 (67%) NIHSS and 9/11 (82%) mNIHSS items showing excellent agreement (Kappa > 0.75). Modified Rankin scale reliability was high (Kappa = 0.90). Spearman correlation (NIHSS and mNIHSS) for bedside examiner was 0.981 and for remote examiner was 0.966.
Discussion: It is reliable and valid for telemedicine-naive stroke examiners to assess clinical deficit and functional outcomes using a site-independent telemedicine system. Evaluation time decreased even with minimal telemedicine exposure. Further assessments should determine whether reliability persists with a larger pool of both untrained investigators and patients, and whether reliability improves with a dedicated training program.
Trial registration: ClinicalTrials.gov NCT00283868 NCT00390286.