In malaria and several other important infectious diseases, high prevalence occurs concomitantly with incomplete immunity. This apparent paradox poses major challenges to malaria elimination in highly endemic regions, where asymptomatic Plasmodium falciparum infections are present across all age classes creating a large reservoir that maintains transmission. This reservoir is in turn enabled by extreme antigenic diversity of the parasite and turnover of new variants. We present here the concept of a threshold in local pathogen diversification that defines a sharp transition in transmission intensity below which new antigen-encoding genes generated by either recombination or migration cannot establish. Transmission still occurs below this threshold, but diversity of these genes can neither accumulate nor recover from interventions that further reduce it. An analytical expectation for this threshold is derived and compared to numerical results from a stochastic individual-based model of malaria transmission that incorporates the major antigen-encoding multigene family known as var. This threshold corresponds to an "innovation" number we call Rdiv; it is different from, and complementary to, the one defined by the classic basic reproductive number of infectious diseases, R0, which does not readily is better apply under large and dynamic strain diversity. This new threshold concept can be exploited for effective malaria control and applied more broadly to other pathogens with large multilocus antigenic diversity.