We demonstrate that the temporal contrast of femtosecond light pulses is a critical parameter in laser writing inside transparent dielectrics, allowing different material modifications. In particular, anisotropic nanopores in silica glass are produced by high-contrast of 107 femtosecond Yb:KGW laser pulses rather than low-contrast of 103 Yb fiber laser pulses. The difference originates in the fiber laser storing a third of its energy in a post-pulse of up to 200 ps duration. The absorption of this low-intensity fraction of the pulse by laser-induced transient defects with relatively long lifetime and low excitation energy, such as self-trapped holes, drastically changes the kinetics of energy deposition and the type of material modification. We also demonstrate that low-contrast pulses are effective in creating lamellar birefringent structures, possibly driven by a quadrupole nonlinear current.