The quality of cargo proteins in the endoplasmic reticulum (ER) is affected by their motion during folding. To understand how the diffusion of secretory cargo proteins is regulated in the ER, we directly analyze the motion of a single cargo molecule using fluorescence imaging/fluctuation analyses. We find that the addition of two N-glycans onto the cargo dramatically alters their diffusion by transient binding to membrane components that are confined by hyperosmolarity. Via simultaneous observation of a single cargo and ER exit sites (ERESs), we could exclude ERESs as the binding sites. Remarkably, actin cytoskeleton was required for the transient binding. These results provide a molecular basis for hypertonicity-induced immobilization of cargo, which is dependent on glycosylation at multiple sites but not the completion of proper folding. We propose that diffusion of secretory glycoproteins in the ER lumen is controlled from the cytoplasm to reduce the chances of aggregation.