Infectious hematopoietic necrosis virus (IHNV) infects salmonid fish, resulting in high mortality and serious economic losses to salmonid aquaculture. Therefore, an effective IHNV vaccine is urgently needed. To select an inactivation agent for the preparation of an effective IHNV vaccine, rainbow trout were immunized with mineral oil emulsions of IHNV vaccines inactivated by formaldehyde, binary ethylenimine (BEI), or β-propiolactone (BPL). The fish were challenged 8 weeks after vaccination, and their IgM antibody response and relative percent survival (RPS) were evaluated. The results show that formaldehyde, BEI, and BPL abolished IHNV HLJ-09 infectivity within 24, 48, and 24 h at final concentrations of 0.2%, 0.02%, and 0.01%, respectively. The mean levels of specific IgM, both in serum and mucus (collected from the skin surface and gills), for the three immunized groups (from high to low) ranked as follows: the BPL group, BEI group, and formaldehyde group. From weeks 5 to 9, the mean log2 serum titers of IgM in the BPL group were significantly higher compared with those of the other groups (p < 0.05) during the 9 weeks of observation after vaccination (immunized at weeks 0 and6). Mucus OD490 values of the BPL group were significantly higher compared with those of the other groups (p < 0.05) when reaching their peak at weeks 5 and 8, but the difference between the formaldehyde and BEI groups was not significant (p > 0.05). The BPL-inactivated whole-virus vaccine had the greatest protective effect on the rainbow trout after challenge by an intraperitoneal injection of live IHNV, with an RPS rate of 91.67%, which was significantly higher compared with the BEI (83.33%) and formaldehyde (79.17%) groups. These results indicate that the BPL-inactivated IHNV oil-adjuvant vaccine was more effective than the formaldehyde- or BEI-inactivated vaccines. The results of this study provide an important foundation for further studies on inactivated IHNV vaccines.