THE ROLE AND SIGNIFICANCE OF LIP-READING

Tamara Kovačević, Ljubica Isaković

DOI Number
https://doi.org/10.22190/TEME230125057K
First page
923
Last page
928

Abstract


Lip-reading is a complex psychophysiological process, which involves the visual perception of oral movements, their kinaesthetic memorisation, and the psychological act of recognising (identifying) words for their better understanding. The need of each person to supplement and clarify the received message is emphasised by the careful observation of the face and lips, especially in unfavourable environmental conditions. The main aim of the study is to point to the role, importance, specific features, and the benefits and limitations of lip-reading through the review of available literature. The methods of analysis and evaluation were applied to the relevant available literature. Numerous pieces of data on the characteristics, factors and features which affect lip-reading were obtained. Lip-reading, i.e. the ability to understand speech on the basis of observing the movements of speech organs is a very specific skill. It is one of the components of speech development, and it represents a part of the communication speech chain which comprises the speaker and the one who reads speech. It has a manifold application in the transcription of speech in cases when sound is not available. What can have a negative impact on the perception of speech is the possibility of sound and lip movements not being synchronised. It is of particular significance for deaf persons and persons hard of hearing who rely on this process fully in their everyday communication, which makes it easier for them to receive information from their surroundings. It enables their better communication, education, independence and coping in their daily functioning.


Keywords

lip-reading, speech-reading, communication, speech, the deaf and hard of hearing.

Full Text:

PDF

References


Andersson, U., & Lidestam, B. (2005). Bottom–Up Driven Speechreading in a Speechreading Expert: The Case of AA (JK023). Ear and Hearing, 26(2), 214–224. doi.org/10.1097/00003446-200504000-00008

Bradarić-Jončić, S. (1998). Neka obilježja čitača i govornika o kojima ovisi uspješnost vizualne percepcije govora u gluhih osoba [Some Lip-reader's and Talker's Characteristics Influencing Lip-reading Achievement]. Hrvatska revija za rehabilitacijska istraživanja, 34(1), 1-12.

Campbell, R., & Mohammed, T. E. (2010). Speechreading for information gathering: A survey of scientific sources. Deafness Cognition And Language Research Centre (DCAL). Division of Psychology and Language Sciences, University College London. doi: 10.1044/1092-4388(2012/12-0039

Chamberlain, C., & Mayberry, R. (2008). American Sign Language syntactic and narrative comprehension in skilled and less skilled readers: Bilingual and bimodal evidence for the linguistic basis of reading. Applied Psycholinguistics, 29(3), 367-388. doi.org/10.1017/S014271640808017X

Chung, J. S., & Zisserman, A. (2016). Lip reading in the Wild. In Asian conference on computer vision (pp. 87-103). Springer, Cham. doi: 10.1109/CVPR.2017.367.

Chung, J.S, Senior, A., Vinyals, O., & Zisserman, A. (2017). Lip reading sentences in the Wild. In Proceedings of the IEEE conference on computer vision and pattern recognition (pp. 6447-6456).

Dimić, D. & Dimić, N. D. (2003). Funkcija čitanja govora sa usana [The function of lipreading]. Beograd: Društvo defektologa Srbije i Crne Gore.

Dell'Aringa, A. H., Adachi, E. S., & Dell'Aringa, A. R. (2007). Lip reading role in the hearing aid fitting process. Brazilian Journal of Otorhinolaryngology, 73(1), 95–99. doi.org/10.1016/s1808-8694(15)31129-0

Goebel, S. L. (2013). Effects of type of context on use of context while lipreading and listening. Independent Studies and Capstones. Paper 677. Program in Audiology and Communication Sciences. Washington: University School of Medicine. http://digitalcommons.wustl.edu/pacs_capstones/677

Goldschen, A. J., Garcia, O. N., & Petajan, E. D. (1996). Rationale for Phoneme-Viseme Mapping and Feature Selection in Visual Speech Recognition. In: Stork, D.G., Hennecke, M.E. (eds) Speechreading by Humans and Machines. NATO ASI Series, vol 150. Springer, Berlin, Heidelberg. doi.org/10.1007/978-3-662-13015-5_39

Isakovic, Lj. & Kovacevic, T. (2015). Комуникација глувих и наглувих-могућности и ограничења у образовању [Communication of the deaf and hard of hearing-the possibilities and limitations in education]. Teme, 39(4), 1495−1514.

Isaković, Lj., Kovačević, T. & Dimić, N. (2016). Lip-reading with deaf and hard of hearing preschool children. In: S. Nikolic, R. Nikić, V. Ilankovic (Eds.) Early Intervention in Special Education and Rehabilitation, 195 – 207. University of Belgrade, Faculty of Special Education and Rehabilitation

Kovačević, T. & Isaković, Lj. (2019). Oblici neverbalne i verbalne komunikacije gluve i nagluve dece predškolskog uzrasta uzrasta [Forms of Non-verbal and Verbal Communication in Deaf and Hard of hearing Children of Preschool Age]. Baština, 49, 433-453. doi: 10.5937/bastina1949433K

Kovačević, T. & Isaković, Lj. (2020). Usvajanje znakovnog jezika kod gluve i nagluve dece predškolskog uzrasta [Adoption of the Sign Language with Deaf and Hard of hearing Preschool Children]. Baština, 51, 513-535.doi: 10.5937/bastina30-267

Kyle, F. E., Campbell, R., Mohammed, T., Coleman, M., & MacSweeney, M. (2013). Speechreading Development in Deaf and Hearing Children: Introducing the Test of Child Speechreading. Journal of Speech, Language and Hearing Research, 56, 416-426. doi: 10.1044/1092-4388(2012/12-0039)

Luce, P. A., & Pisoni, D. B. (1998). Recognizing Spoken Words: The Neighborhood Activation Model. Ear & Hearing, 19(1), 1-36. doi.org/10.1097/00003446-199802000-00001

McGurk, H. & MacDonald, J. (1976). Hearing Lips and Seeing Voices. Nature, 264, 746–748. doi.org/10.1038/264746a0

Oliveira,L.N., Soares, A. D. & Chiari,B.M.(2014). Speechreading as a Communication Mediator. CoDAS, 26(1), 53–60.

Ortiz, I. R. R. (2008). Lipreading in the Prelingually Deaf: What makes a Skilled Speechreader? The Spanish Journal of Psychology, 11(2), 488-502. doi: 10.4236/ce.2019.104053

Pinheiro, A. M. V., Rocha-Toffolo, A. C., & Vilhena, D. A. (2020). Reading strategies for the profoundly deaf Libras users: Benefi ts of speech and lip reading for strengthening linguistic skills. Estudos de Psicologia (Campinas), 37, e190003. dx.doi.org/10.1590/1982-0 275202037e190003

Saraswati, G. W., Winarsih, S., Anisa, N., Rokhman, N., & Supriyanto, C. (2019). Developing BacaBicara: An Indonesian Lipreading System as an Independent Communication Learning for the Deaf and Hard-of-Hearing. International Journal of Emerging Technologies in Learning, 14(4), (44-57). doi.org/10.3991/ijet.v14i04.9578

Shang, D., Zhang, X., Xu, X., & Peng, X. (2018). Speaker Recognition Based on Lip-reading: An Overview. ICNCC 2018: Proceedings of the 2018 VII International Conference on Network, Communication and Computing (247–251). doi.org/10.1145/3301326.3301388

Soto-Faraco, S., Navarra, J., Weikum, W. M., Vouloumanos, A., Sebastián-Gallés, N., & Werker, J.F. (2007). Discriminating languages by speechreading. Perception & Psychophysics. 69(2), 218-231. doi.org/10.3758/BF03193744

Soto-Faraco, S., Calabresi, M., Navarra, J., Werker, J. F. & Lewkowicz, D. J. (2012). The development of audiovisual speech perception. In A. Bremner, D. J. Lewkowicz, & C. Spence (Eds.), Multisensory Development (Chap 9, pp. 207-228). Oxford: Oxford University Press. doi:10.1093/acprof:oso/9780199586059.003.0009

Spehar, B., Goebel, S., & Tye-Murray, N. (2015). Effects of Context Type on Lipreading and Listening Performance and Implications for Sentence Processing. Journal of speech, language and hearing research: Journal of Speech, Language and Hearing Research, 58(3), 1093–1102. doi.org/10.1044/2015_JSLHR-H-14-0360

Sweetow, R.W. & Sabes, J. H. (2006). The Need for and Development of an Adaptive Listening and Communication Enhancement (LACE TM) Program. Journal of the American Academy of Audiology. 17, 538–558. doi.org/10.3766/jaaa.17.8.2

Trussell, J. W., & Easterbrooks, S. R. (2017). Morphological Knowledge and Students Who Are Deaf or Hard-of-hearing: A Review of the Literature. Communication Disorders Quarterly, 38(2) 67-77. dx.doi.org/10.1177%2F1525740116644889

Tye-Murray, N. (2014). Foundations of aural rehabilitation: Children, adults, and their family members. Canada: Nelson Education, Scarborough, ON, Canada

Ugwuanyi, L. T., & Adaka, T. A. (2015). Effect of Auditory Training on Reading Comprehension of Children with Hearing Impairment in Enugu State. International Journal of Special Education, 30(1), 58–63

Wickware, A. (2014). The Impact of Speechreading Programs on Adults with Hearing Loss: Literature Review. National Speechreading Project CHHA-AMEC.




DOI: https://doi.org/10.22190/TEME230125057K

Refbacks

  • There are currently no refbacks.


© University of Niš, Serbia
Creative Commons licence CC BY-NC-ND
Print ISSN: 0353-7919
Online ISSN: 1820-7804