We report selectively plasmon-mediated nonradiative energy transfer between quantum dot (QD) emitters interacting with each other via Förster-type resonance energy transfer (FRET) under controlled plasmon coupling either to only the donor QDs (i.e., donor-selective) or to only the acceptor QDs (i.e., acceptor-selective). Using layer-by-layer assembled colloidal QD nanocrystal solids with metal nanoparticles integrated at carefully designed spacing, we demonstrate the ability to enable/disable the coupled plasmon-exciton (plexciton) formation distinctly at the donor (exciton departing) site or at the acceptor (exciton feeding) site of our choice, while not hindering the donor exciton-acceptor exciton interaction but refraining from simultaneous coupling to both sites of the donor and the acceptor in the FRET process. In the case of donor-selective plexciton, we observed a substantial shortening in the donor QD lifetime from 1.33 to 0.29 ns as a result of plasmon-coupling to the donors and the FRET-assisted exciton transfer from the donors to the acceptors, both of which shorten the donor lifetime. This consequently enhanced the acceptor emission by a factor of 1.93. On the other hand, in the complementary case of acceptor-selective plexciton we observed a 2.70-fold emission enhancement in the acceptor QDs, larger than the acceptor emission enhancement of the donor-selective plexciton, as a result of the combined effects of the acceptor plasmon coupling and the FRET-assisted exciton feeding. Here we present the comparative results of theoretical modeling of the donor- and acceptor-selective plexcitons of nonradiative energy transfer developed here for the first time, which are in excellent agreement with the systematic experimental characterization. Such an ability to modify and control energy transfer through mastering plexcitons is of fundamental importance, opening up new applications for quantum dot embedded plexciton devices along with the development of new techniques in FRET-based fluorescence microscopy.