Predicting explorative motor learning using decision-making and motor noise

PLoS Comput Biol. 2017 Apr 24;13(4):e1005503. doi: 10.1371/journal.pcbi.1005503. eCollection 2017 Apr.

Abstract

A fundamental problem faced by humans is learning to select motor actions based on noisy sensory information and incomplete knowledge of the world. Recently, a number of authors have asked whether this type of motor learning problem might be very similar to a range of higher-level decision-making problems. If so, participant behaviour on a high-level decision-making task could be predictive of their performance during a motor learning task. To investigate this question, we studied performance during an explorative motor learning task and a decision-making task which had a similar underlying structure with the exception that it was not subject to motor (execution) noise. We also collected an independent measurement of each participant's level of motor noise. Our analysis showed that explorative motor learning and decision-making could be modelled as the (approximately) optimal solution to a Partially Observable Markov Decision Process bounded by noisy neural information processing. The model was able to predict participant performance in motor learning by using parameters estimated from the decision-making task and the separate motor noise measurement. This suggests that explorative motor learning can be formalised as a sequential decision-making process that is adjusted for motor noise, and raises interesting questions regarding the neural origin of explorative motor learning.

Publication types

  • Research Support, Non-U.S. Gov't

MeSH terms

  • Adult
  • Algorithms
  • Computational Biology
  • Decision Making / physiology*
  • Female
  • Humans
  • Learning / physiology*
  • Male
  • Models, Neurological*
  • Motor Activity / physiology*
  • Psychomotor Performance / physiology*
  • Young Adult

Grants and funding

This work was supported by an European Research Council starter grant to JMG (MotMotLearn: 637488), https://erc.europa.eu. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.