Metal halide perovskites (MHPs) are solution-processed materials with exceptional photoconversion efficiencies that have brought a paradigm shift in photovoltaics. The nature of the peculiar optoelectronic properties underlying such astounding performance is still controversial. The existence of ferroelectricity in MHPs and its alleged impact on photovoltaic activity have fueled an intense debate, in which unanimous consensus is still far from being reached. Here we critically review recent experimental and theoretical results with a two-fold objective: we argue that the occurrence of ferroelectric domains is incompatible with the A-site cation dynamics in MHPs and propose an alternative interpretation of the experiments based on the concept of ferroelasticity. We further underline that ferroic behavior in MHPs would not be relevant at room temperature or higher for the physics of photogenerated charge carriers, since it would be overshadowed by competing effects like polaron formation and ion migration.