We discuss the origin of decoherence in Josephson junction qubits. We find that two level systems in the surrounding insulator cannot be the dominant source of noise in small qubits. We argue that electron traps in the Josephson barrier with large Coulomb repulsion would emit noise that agrees both in magnitude and in temperature dependence with experimental data.