Granulocytic sarcoma (GS) is an extramedullary tumor composed of immature myeloid cells, typically occurring during the course of acute myelogenous leukemia. Non-leukemic GS, that is, GS with no evidence of overt leukemia and no previous history of leukemia, is very rare, and even more unusual is nonleukemic GS of the bile duct. We report a case of nonleukemic GS of the bile duct. The patient was initially misdiagnosed as a bile duct carcinoma arising in the hilum of the liver (so-called Klatskin tumor), and received a right lobectomy of the liver. Histological examination of the tumor yielded the diagnosis of GS, and the bone marrow biopsy did not show any evidence of leukemia. Considering the risk of subsequent development of overt leukemia, the patient was treated with two cycles of combination chemotherapy as used in the cases of acute myelogenous leukemia. To date, he has remained free of disease 15 months after treatment.