Visual memory, mainly composed of visual long-term memory (VLTM) and visual working memory (VWM), is an important mechanism of human information storage. Since Baddeley proposed the multicomponent working memory model, the idea that VWM is independent of the VLTM system has been widely accepted. However, the new theoretical evidence suggested a close connection between VLTM and VWM. For instance, the three embedded components model describes the VLTM and VWM in the same framework, which suggests that VWM is only a distinct state of VLTM. On the one hand, the operating function of VWM is supported by the persistence of VLTM. On the other hand, the evidence from neuroimaging studies shows that VWM and VLTM tasks activate some same brain areas. In addition, the whole visual memory system shows a trend of processing from early visual cortex to prefrontal cortex. The present article not only reviews the current studies about the relationship between VLTM and VWM but also gives some forecasts for future studies.