Radiation therapy aims at maximizing tumor control while minimizing normal tissue complication. The introduction of stereotactic treatment explores the volume effect and achieves dose escalation to tumor target with small margins. The use of ablative irradiation dose and sharp dose gradients requires accurate tumor definition and alignment between patient and treatment geometry. Patient geometry variation during treatment may significantly compromise the conformality of delivered dose and must be managed properly. Setup error and interfraction/intrafraction motion are incorporated in the target definition process by expanding the clinical target volume to planning target volume, whereas the alignment between patient and treatment geometry is obtained with an adaptive control process, by taking immediate actions in response to closely monitored patient geometry. This article focuses on the monitoring and adaptive response aspect of the problem. The term "image" in "image guidance" will be used in a most general sense, to be inclusive of some important point-based monitoring systems that can be considered as degenerate cases of imaging. Image-guided motion adaptive control, as a comprehensive system, involves a hierarchy of decisions, each of which balances simplicity versus flexibility and accuracy versus robustness. Patient specifics and machine specifics at the treatment facility also need to be incorporated into the decision-making process. Identifying operation bottlenecks from a system perspective and making informed compromises are crucial in the proper selection of image-guidance modality, the motion management mechanism, and the respective operation modes. Not intended as an exhaustive exposition, this article focuses on discussing the major issues and development principles for image-guided motion management systems. We hope these information and methodologies will facilitate conscientious practitioners to adopt image-guided motion management systems accounting for patient and institute specifics and to embrace advances in knowledge and new technologies subsequent to the publication of this article.