雑誌文献を検索します。書籍を検索する際には「書籍検索」を選択してください。

検索

書誌情報 詳細検索 by 医中誌

Japanese

Ventriloquism and Audio-visual Integration of Voice and Face Kazuhiko Yokosawa 1 , Shoko Kanaya 1 1Department of Psychology,Graduate School of Humanities and Sociology,The University of Tokyo Keyword: ventriloquism , ventriloquist effect , audio-visual integration , McGurk effect , face perception pp.771-777
Published Date 2012/7/1
DOI https://doi.org/10.11477/mf.1416101240
  • Abstract
  • Look Inside
  • Reference

Abstract

 Presenting synchronous auditory and visual stimuli in separate locations creates the illusion that the sound originates from the direction of the visual stimulus. Participants' auditory localization bias,called the ventriloquism effect,has revealed factors affecting the perceptual integration of audio-visual stimuli. However,many studies on audio-visual processes have focused on performance in simplified experimental situations,with a single stimulus in each sensory modality. These results cannot necessarily explain our perceptual behavior in natural scenes,where various signals exist within a single sensory modality. In the present study we report the contributions of a cognitive factor,that is,the audio-visual congruency of speech,although this factor has often been underestimated in previous ventriloquism research. Thus,we investigated the contribution of speech congruency on the ventriloquism effect using a spoken utterance and two videos of a talking face. The salience of facial movements was also manipulated. As a result,when bilateral visual stimuli are presented in synchrony with a single voice,cross-modal speech congruency was found to have a significant impact on the ventriloquism effect. This result also indicated that more salient visual utterances attracted participants' auditory localization. The congruent pairing of audio-visual utterances elicited greater localization bias than did incongruent pairing,whereas previous studies have reported little dependency on the reality of stimuli in ventriloquism. Moreover,audio-visual illusory congruency,owing to the McGurk effect,caused substantial visual interference to auditory localization. This suggests that a greater flexibility in responding to multi-sensory environments exists than has been previously considered.


Copyright © 2012, Igaku-Shoin Ltd. All rights reserved.

基本情報

電子版ISSN 1344-8129 印刷版ISSN 1881-6096 医学書院

関連文献

もっと見る

文献を共有