Nonreciprocity in acoustics is of paramount importance in many practical applications and has been experimentally realized using nonlinear media, moving fluids, or time modulation, which regrettably suffer from large volumes and high-power consumption, difficulty in integration, and inevitable vibrations or phase noise. In modern Hamiltonian theory, the violation of system's reciprocity can be achieved via asymmetric Peierls phases, which typically involves with non-Hermiticity or time-reversal symmetry breaking. Here, we propose a framework for designing nonreciprocal acoustic devices based on the asymmetric Peierls phases that can be fully controlled via active acoustic components. The fully controlled Peierls phases enable various high-performance acoustic devices, including non-Hermitian extensions of isolators, gyrators, and circulators, which are otherwise impossible in previous approaches that are bound by Hermiticity or passivity. We reveal that the transmission phases in isolators are equivalent to the Peierls phase plus a constant. The nonreciprocal phase delay in gyrators and the unirotational transmission behavior in circulators result from the gauge-invariant Aharonov-Bohm phases determined by Peierls phases. Our work not only uncovers multiple intriguing physics related to Peierls phases but also provides a general approach to compact, integratable, nonreciprocal acoustic devices.