Vertebral deformities and spinal osteoarthritis are common disorders in elderly persons and are associated with back pain, impaired physical functioning, and loss of quality of life. The objectives of this study were to assess the impact of vertebral deformities and osteoarthritis on quality of life in a population-based sample, and to compare this with the impact of six other important chronic diseases on quality of life. The study was performed as a substudy of the Longitudinal Aging Study Amsterdam. Vertebral deformities and osteoarthritis were assessed by spinal radiographs; chronic diseases were assessed by self-report; quality of life was estimated by the SF-12, EQ-5D (EuroQol) and Qualeffo-41 (n = 336). In univariate analyses, severe osteoporosis of the vertebrae significantly worsened the physical component summary scale of the SF-12 and the total score of Qualeffo-41, while osteoarthritis of the spine did not significantly reduce quality of life. The other chronic diseases reduced quality of life, although not all changes reached statistical significance. In multivariate analyses, severe osteoporosis of the vertebrae, cardiac disease, peripheral arterial disease, and diabetes mellitus significantly reduced quality of life. In conclusion, most persons in an elderly population suffer from one or more chronic diseases, and therefore experience loss of quality of life. After adjustment for age, sex, and other chronic diseases, severe osteoporosis of the vertebrae, cardiac disease, peripheral arterial disease, and diabetes mellitus significantly reduced quality of life in the general population.