We study the Brownian motion of an ensemble of single colloidal particles in a random square and a quasicrystalline potential when they start from non-equlibrium. For both potentials, Brownian dynamics simulations reveal a widespread subdiffusive regime before the diffusive long-time limit is reached in thermal equilibrium. We develop a random trap model based on a distribution for the depths of trapping sites that reproduces the results of the simulations in detail. Especially, it gives analytic formulas for the long-time diffusion constant and the relaxation time into the diffusive regime. Aside from detailed differences, our work demonstrates that quasicrystalline potentials can be used to mimic aspects of random potentials.