Inferring action structure and causal relationships in continuous sequences of human action

Cogn Psychol. 2015 Feb:76:30-77. doi: 10.1016/j.cogpsych.2014.10.001. Epub 2014 Dec 18.

Abstract

In the real world, causal variables do not come pre-identified or occur in isolation, but instead are embedded within a continuous temporal stream of events. A challenge faced by both human learners and machine learning algorithms is identifying subsequences that correspond to the appropriate variables for causal inference. A specific instance of this problem is action segmentation: dividing a sequence of observed behavior into meaningful actions, and determining which of those actions lead to effects in the world. Here we present a Bayesian analysis of how statistical and causal cues to segmentation should optimally be combined, as well as four experiments investigating human action segmentation and causal inference. We find that both people and our model are sensitive to statistical regularities and causal structure in continuous action, and are able to combine these sources of information in order to correctly infer both causal relationships and segmentation boundaries.

Keywords: Action segmentation; Bayesian inference; Causal inference; Event segmentation; Rational analysis; Statistical learning.

Publication types

  • Research Support, Non-U.S. Gov't
  • Research Support, U.S. Gov't, Non-P.H.S.

MeSH terms

  • Association Learning*
  • Bayes Theorem
  • Cues
  • Humans
  • Models, Psychological
  • Motion Perception*
  • Motor Activity
  • Pattern Recognition, Visual*
  • Problem Solving
  • Thinking*
  • Young Adult