Although ataxia is by definition the prominent symptom of ataxia disorders, there are various neurological signs that may accompany ataxia in affected patients. Reliable and quantitative assessment of these signs is important because they contribute to disability, but may also interfere with ataxia. Therefore we devised the Inventory of Non-Ataxia Signs (INAS), a list of neurological signs that allows determining the presence and severity of non-ataxia signs in a standardized way. INAS underwent a rigorous validation procedure that involved a trial of 140 patients with spinocerebellar ataxia (SCA) for testing of inter-rater reliability and another trial of 28 SCA patients to assess short-term intra-rater reliability. In addition, data of the ongoing EUROSCA natural history study were used to determine the reproducibility, responsiveness and validity of INAS. Inter-rater reliability and short-term test-retest reliability was high, both for the total count and for most of the items. However, measures of responsiveness, such as the smallest detectable change and the clinically important change were not satisfactory. In addition, INAS did not differentiate between subjects that were subjectively stable and those that worsened in the 2-year observation period. In summary, INAS and INAS count showed good reproducibility, but unsatisfactory responsiveness. The present analysis and published data from the EUROSCA natural history study suggest that INAS is a valid measure of extracerebellar involvement in progressive ataxia disorders. As such, it is useful as a supplement to the measures of ataxia, but not as a primary outcome measure in future interventional trials.