Exploring high-κ gate dielectrics is crucial for the achievement of high-performance field-effect transistors (FETs). Here, we report the synthesis of a few-layer wide bandgap semiconductor gallium thiophosphate (GaPS4), which can be easily mechanically exfoliated from a bulk material. The few-layered GaPS4 flakes exhibit a relative dielectric constant of approximately 5.3. Two-dimensional (2D) van der Waals heterostructure FETs utilizing atomically smooth GaPS4 flakes as the top-gate dielectric layer and MoS2 as the channel material were fabricated, showing a high on-off ratio exceeding 107 with a subthreshold swing as low as 80 mV per decade. Our findings indicate that few-layer GaPS4 is a high-performance dielectric candidate for two-dimensional transistors, which enrich the high-κ 2D community and pave the way for fabricating modern electronic devices.