We present a newly developed high harmonic beamline for time-, angle-, and carrier-envelope phase-resolved extreme ultraviolet photoemission spectroscopy on solid targets for the investigation of ultrafast band structure dynamics in the low-fs to sub-fs time regime. The source operates at a repetition rate of 10 kHz and is driven by 5 fs few-cycle near-infrared laser pulses generating high harmonic radiation with photon energies up to 120 eV at a feasible flux. The experimental end station consists of a complementary combination of photoelectron detectors which are able to spectroscopically address electron dynamics both in real and in k-space. The versatility of the source is completed by a phase-meter which allows for tracking the carrier-envelope phase for each pulse and which is synchronized to the photoelectron detectors, thus enabling phase sensitive measurements on the one hand and the selection of single attosecond pulses for ultimate time resolution in pump-probe experiments on the other hand. We demonstrate the applicability of the source by an angle- and carrier-envelope phase-resolved photoemission measurement on a tungsten (110) surface with 95 eV extreme ultraviolet radiation.