We present direct measurements of the coherence time of a laser beam after propagation through an underdense plasma. At an intensity of 10(14) W/cm(2), a large decrease of the coherence time is observed, from 300 ps to a few picoseconds. This decrease is larger as the plasma density is increased or as the light is scattered at larger angles. The amount of temporal decorrelation as well as the effect of the plasma density, laser intensity, and scattering angle all coincide with trends observed in recent numerical simulations.