A new lindenane sesquiterpene glucoside named yinxiancaoside A (1), a new, rare bidesmosidic megastigmane sesquiterpene glucoside named yinxiancaoside B (5), and three known sesquiterpene glucosides, chloranoside A (2), pisumionoside (3), and sarcaglaboside A (4), were isolated from the whole plant of Chloranthus japonicus Sieb. The structures of the new compounds were established by an extensive study of their spectral data, especially 1D- and 2D-NMR. The cytotoxic activity of the isolated compounds against human hepatoma (Hepg-2), human ovarian carcinoma (OV420), and human breast cancer (MCF-7) cells was investigated.