We present the threshold N(3)LO perturbative QCD corrections to the rapidity distributions of dileptons in the Drell-Yan process and Higgs boson in gluon fusion. Sudakov resummation of QCD amplitudes, renormalization group invariance, and the mass factorization theorem provide useful guidelines to obtain them in an elegant manner. We use various state of the art three loop results that have been recently available to obtain these distributions. For the Higgs boson, we demonstrate numerically the importance of these corrections at the LHC.