Secondary neutron ambient dose equivalents per the treatment absorbed dose in passive carbon-ion and proton radiotherapies were measured using a rem meter, WENDI-II at two carbon-ion radiotherapy facilities and four proton radiotherapy facilities in Japan. Our measured results showed that (1) neutron ambient dose equivalent in carbon-ion radiotherapy is lower than that in proton radiotherapy, and (2) the difference to the measured neutron ambient dose equivalents among the facilities is within a factor of 3 depending on the operational beam setting used at the facility and the arrangement of the beam line, regardless of the method for making a laterally uniform irradiation field: the double scattering method or the single-ring wobbling method. The reoptimization of the beam line in passive particle radiotherapy is an effective way to reduce the risk of secondary cancer because installing an adjustable precollimator and designing the beam line devices with consideration of their material, thickness and location, etc., can significantly reduce the neutron exposure. It was also found that the neutron ambient dose equivalent in passive particle radiotherapy is equal to or less than that in the photon radiotherapy. This result means that not only scanning particle radiotherapy but also passive particle radiotherapy can provide reduced exposure to normal tissues around the target volume without an accompanied increase in total body dose.