Research on the topic of distractor inhibition has used different empirical approaches to study how the human mind selects relevant information from the environment, and the results are controversially discussed. One key question that typically arises is how selection deals with the irrelevant information. We used a new selection task, in which participants sometimes had to respond to the distractors instead of the target. Importantly, we varied the time interval between stimuli onset and the cue that signaled participants to respond to the distractors. We analyzed RTs and error rates from responses to distractors as a function of how long the target had been processed (and the distractor ignored) before the cue required a response to the distractor (i.e., stimulus-cue SOA). The data are compatible with selection models assuming that distractor stimuli are initially activated and then deactivated. Thus, we argue for selection models assuming top down deactivation of distractor representations that work in parallel with top down activation of target representations.