We propose an adiabatic reweighting algorithm for computing the free energy along an external parameter from adaptive molecular dynamics simulations. The adaptive bias is estimated using Bayes identity and information from all the sampled configurations. We apply the algorithm to a structural transition in a cluster and to the migration of a crystalline defect along a reaction coordinate. Compared to standard adaptive molecular dynamics, we observe an acceleration of convergence. With the aid of the algorithm, it is also possible to iteratively construct the free energy along the reaction coordinate without having to differentiate the gradient of the reaction coordinate or any biasing potential.