Reading your own lips: Common-coding theory and visual speech perception

  • PDF / 226,475 Bytes
  • 5 Pages / 595.276 x 790.866 pts Page_size
  • 18 Downloads / 155 Views

DOWNLOAD

REPORT


BRIEF REPORT

Reading your own lips: Common-coding theory and visual speech perception Nancy Tye-Murray & Brent P. Spehar & Joel Myerson & Sandra Hale & Mitchell S. Sommers

Published online: 7 November 2012 # Psychonomic Society, Inc. 2012

Abstract Common-coding theory posits that (1) perceiving an action activates the same representations of motor plans that are activated by actually performing that action, and (2) because of individual differences in the ways that actions are performed, observing recordings of one’s own previous behavior activates motor plans to an even greater degree than does observing someone else’s behavior. We hypothesized that if observing oneself activates motor plans to a greater degree than does observing others, and if these activated plans contribute to perception, then people should be able to lipread silent video clips of their own previous utterances more accurately than they can lipread video clips of other talkers. As predicted, two groups of participants were able to lipread video clips of themselves, recorded more than two weeks earlier, significantly more accurately than video clips of others. These results suggest that visual input activates speech motor activity that links to word representations in the mental lexicon. Keywords Visual word recognition . Models of visual word recognition and priming . Motor control . Motor planning/ programming

The discovery of “mirror neurons” that respond both when a movement is made and when the same movement is observed has increased interest in the interaction between action and N. Tye-Murray (*) : B. P. Spehar Department of Otolaryngology, Washington University School of Medicine, Campus Box 8115, 660 South Euclid Avenue, St. Louis, MO 63124, USA e-mail: [email protected] J. Myerson : S. Hale : M. S. Sommers Department of Psychology, Washington University, St. Louis, MO, USA

perception (Fadiga & Craighero, 2003; Rizzolatti & Craighero, 2004) and has focused attention on people’s sometimes surprising ability to recognize a recording of an earlier action as being self- rather than other-generated (e.g., Knoblich & Prinz, 2001; Repp & Knoblich, 2004). This ability is of interest because it provides support for the theory that individuals’ motor plans and their perceptions of observed actions are represented in a common code (Hommel, Müsseler, Aschersleben, & Prinz, 2001; Prinz, 1997), a theory with particular relevance for speech perception (Galantucci, Fowler, & Turvey, 2006). Commoncoding theory posits that when perceiving an action, an individual activates the same representations of motor plans that would be activated if one were actually performing, or even just planning, the action. Similarly, the motor theory of speech perception assumes that when individuals perceive speech, they do so by accessing the motor codes for speech gestures (for a review, see Galantucci et al., 2006). Although a strong version of the motor theory, in which this process provides the sole or primary basis for speech perception, has been shown to be inc