PERCEPTION OF SPEECH USING AUDIO VISUAL AND REPLICA FOR STUDENTS OF SULTAN AGENG TIRTAYASA UNIVERSITY

Ediwarman Ediwarman, Syafrizal Syafrizal, John Pahamzah

Abstract


This paper exmined the perception of speech using audio visual and replica for students of Sultan Ageng Tirtayasa Univesity. This research was aimed at discussing face-to-face conversation or speech felt by the ears and eyes.  The prerequisites for audio-visual perception of speech by using ambiguous perceptual sine wave replicas of natural speech as auditory stimuli are studied in details. When the subjects were unaware that auditory stimuli were speech, they only showed a negligible integration of auditory and visual stimuli. The same subjects learn to feel the same auditory stimuli as speech; they integrate auditory and visual stimuli in the same way as natural speech. These research result suggests a special mode of perception of multisensory speech.


Full Text:

PDF

References


Calvert, G. (2001). Cross-modal processing in the human brain: insights from functional neuroimaging studies. Cerebral Cortex, 11, 1110–1123.

Hietanen, J. K., Manninen, P., Sams, M., & Surakka, V. (2001). Does audiovisual speech perception use information about facial configuration? European Journal of Cognitive Psychology, 13, 395–407.

Jones, J. A., & Munhall, K. G. (2003). The effects of separating auditory and visual sources on audiovisual integration of speech. Canadian Acoustics, 25(4), 13–19.

Kamachi, M., Hill, H., Lander, K., & Vatikiotis-Bateson, E. (2003). ‘Putting the face to the voice’: matching identity across modality. Current Biology, 13, 1709–1714.

MacDonald, J., & McGurk, H. (2011). Visual influences on speech perception processes. Perception and Psychophysics, 24(3), 253–257.

Massaro, D. W. (1998). Perceiving talking faces. Cambridge, MA: MIT Press.

McGurk, H., & MacDonald, J. (1976). Hearing lips and seeing voices. Nature, 264, 746–748.

Treisman, Anne and Gelade, Garry. (1980). A feature-integration theory of attention. Cognitive Psychology, Vol. 12, No. 1, pp. 97-136.




DOI: https://doi.org/10.30743/jol.v3i2.3695

Refbacks

  • There are currently no refbacks.


Fakultas Sastra
Universitas Islam Sumatera Utara (UISU)
Jln. Sisingamangaraja Teladan Barat Medan, Indonesia
Phone: +627869911  | e-mail: journal_language@sastra.uisu.ac.id