Mammalian histone deacetylases (HDACs) are a class of enzymes that play important roles in biological pathways. Existing HDAC inhibitors target multiple HDACs without much selectivity. Inhibitors that target one particular HDAC will be useful for investigating the biological functions of HDACs and for developing better therapeutics. Here, we report the development of HDAC11-specific inhibitors using an activity-guided rational design approach. The enzymatic activity and biological function of HDAC11 have been little known, but recent reports suggest that it has efficient defatty-acylation activity and that inhibiting it could be useful for treating a variety of human diseases, including viral infection, multiple sclerosis, and metabolic diseases. Our best inhibitor, SIS17, is active in cells and inhibited the demyristoylation of a known HDAC11 substrate, serine hydroxymethyl transferase 2, without inhibiting other HDACs. The activity-guided design may also be useful for the development of isoform-specific inhibitors for other classes of enzymes.