To access the full text documents, please follow this link: http://hdl.handle.net/10230/24975

Beat gestures modulate auditory integration in speech perception
Biau, Emmanuel, 1985-; Soto-Faraco, Salvador, 1970-
Spontaneous beat gestures are an integral part of the paralinguistic context during face-to-face conversations. Here we investigated the time course of beat-speech integration in speech perception by measuring ERPs evoked by words pronounced with or without an accompanying beat gesture, while participants watched a spoken discourse. Words accompanied by beats elicited a positive shift in ERPs at an early sensory stage (before 100 ms) and at a later time window coinciding with the auditory component P2. The same word tokens produced no ERP differences when participants listened to the discourse without view of the speaker. We conclude that beat gestures are integrated with speech early on in time and modulate sensory/phonological levels of processing. The present results support the possible role of beats as a highlighter, helping the listener to direct the focus of attention to important information and modulate the parsing of the speech stream.
This research was supported by the Spanish Ministry of Science and Innovation (PSI2010-15426 and Consolider INGENIO CSD2007-00012), Comissionat per a Universitats i Recerca del DIUE-Generalitat de Catalunya (SRG2009-092), and the European Research Council (StG-2010 263145).
-Speech processing
-Gestures
-Audiovisual integration
-ERPs
© Elsevier http://dx.doi.org/10.1016/j.bandl.2012.10.008
Article
Article - Accepted version
Elsevier
         

Show full item record

Related documents

Other documents of the same author

Biau, Emmanuel, 1985-; Torralba, Mireia; Fuentemilla, Lluis; De Diego Balaguer, Ruth; Soto-Faraco, Salvador, 1970-
Biau, Emmanuel, 1985-; Morís Fernández, Luis, 1982-; Holle, Henning; Ávila, César; Soto-Faraco, Salvador, 1970-
Fromont, Lauren A.; Soto-Faraco, Salvador, 1970-; Biau, Emmanuel, 1985-
Ikumi Montserrat, Nara, 1986-; Soto-Faraco, Salvador, 1970-
 

Coordination

 

Supporters