We combine real-time feature recognition with holographic optical tweezers to automatically trap, assemble, and sort micron-sized colloidal particles. Closed loop control will enable new applications of optical micromanipulation in biology, medicine, materials science, and possibly quantum computation.