Anemoside B4 (AB4), a triterpenoidal saponin from Pulsatilla chinensis, shows significant anti-inflammatory activity, and may be used for treating inflammatory bowel disease (IBD). Nevertheless, its application is limited due to its high molecular weight and pronounced water solubility. To discover new effective agents for treating IBD, we synthesized 28 AB4 derivatives and evaluated their cytotoxic and anti-inflammatory activities in vitro. Among them, A3-6 exhibited significantly superior anti-inflammatory activity compared to AB4. It showed a significant improvement in the symptoms of DSS-induced colitis in mice, with a notably lower oral effective dose compared to AB4. Furthermore, we discovered that A3-6 bound with pyruvate carboxylase (PC), then inhibited PC activity, reprogramming macrophage function, and alleviated colitis. These findings indicate that A3-6 is a promising therapeutic candidate for colitis, and PC may be a potential new target for treating colitis.