The role of visual spatial attention in audiovisual speech perception |
|
| Abstract | Auditory and visual information is integrated when perceiving speech, as evidenced by the McGurk effect in which viewing an incongruent talking face categorically alters auditory speech perception. Audiovisual integration in speech perception has long been considered automatic and pre-attentive but recent reports have challenged this view. Here we study the effect of visual spatial attention on the McGurk effect. By presenting a movie of two faces symmetrically displaced to each side of a central fixation point and dubbed with a single auditory speech track, we were able to discern the influences from each of the faces and from the voice on the auditory speech percept. We found that directing visual spatial attention towards a face increased the influence of that face on auditory perception. However, the influence of the voice on auditory perception did not change suggesting that audiovisual integration did not change. Visual spatial attention was also able to select between the faces when lip reading. This suggests that visual spatial attention acts at the level of visual speech perception prior to audiovisual integration and that the effect propagates through audiovisual integration to influence auditory perception. |
| Keywords | Speech perception; Multisensory; Attention; McGurk effect |
| Type | Journal paper [With referee] |
| Journal | Speech Communication |
| Year | 2009 Month February Vol. 51 No. 2 pp. 184-193 |
| Publisher | Elsevier |
| ISBN / ISSN | 0167-6393 |
| Electronic version(s) | [pdf] |
| Publication link | http://www.elsevier.com/wps/find/journaldescription.cws_home/505597/description#description |
| BibTeX data | [bibtex] |
| IMM Group(s) | Intelligent Signal Processing |