Hemorrhagic duodenal ulcers should primarily be controlled by endoscopy. In cases of recurrent bleeding or if bleeding cannot be controlled endoscopically, open surgery is the gold standard. Rarely, atypical origin of arteries or additional atypical arteries may lead to further unexpected hemorrhagic recurrences and angiography with surgical intervention is the treatment of choice. In this article a rare case of an atypical visceral artery connecting the coeliac trunk and the gastroduodenal artery leading to recurrent bleeding from a duodenal ulcer is presented.