In an attempt to better understand the conditions under which molecules condense onto grains in the envelopes of evolved stars, we have searched for the presence of H2O ice in the circumstellar envelopes of several evolved (OH/IR) stars. The sample of stars observed was selected on the basis of mass-loss rates, luminosities, and outflow velocities in order to cover a range of physical conditions that might affect the amount of ice present in stellar envelopes. Despite the clear presence of H2O ice around other, previously observed, evolved stars, our search in six OH/IR stars has resulted in only one clear detection, in OH 26.5 + 0.6, and the tentative detection in one other, OH 26.4-1.9. We provide column densities or upper limits for the amount of ice that is present on the grains around these stars and explore the possibility that there could be a relationship between M* or M*/L* and the H2O ice column density to explain the observations.