Requirements and Needs for Captioning Audio-Visual Content for Deaf and Hard of Hearing Pupils

  • Vesna S Radovanović Univerzitet u Beogradu, Fakultet za specijalnu edukaciju i rehabilitaciju, Odeljenje za surdologiju
  • Jasmina Kovačević
  • Ivana Ristić
Keywords: captioning, deaf and hard of hearing pupils, assistive technologies, verbatim translation, custom translation

Abstract


Caption technology for deaf and hard of hearing translates the same spoken language into written language, including not only a textual recording of speech but also a description of background sounds. The literature states that the effects of captioned audio-visual content are conditioned by the level and speed of reading and that the understanding of the captioned material depends on the complexity of the text as well. The central question regarding captioning for deaf and hard of hearing is whether to literally translate audio recordings or to adapt them. While the deaf prefer the first option, research findings show that comprehension is greater if the text is simplified. The aim of the research was to determine the contribution of captioning to the understanding of audio-visual content among deaf and hard of hearing pupils of different levels of education by reviewing recent literature in this field. Papers related to the contribution of captioning to the understanding of content in deaf and hard of hearing pupils were primarily searched through the Google Scholar database in order to narrow the research to journals with the largest number of papers on this topic: American Annals of Deaf, Brain Sciences, Deafness & Educational International, Journal of Deaf Studies and Deaf Education, Philosophy and Practice, The Journal of Specialized Translation Library. Ten papers that met the selection criteria were analyzed, with the largest number of papers focusing on primary school pupils. A statistically significant advantage in understanding captions with custom translation was found in one analyzed study, while the results of the other authors were statistically significant only in the domain of vocabulary, in the effects of captions vs. audio-visual content and in the effects of captions vs. sign language translation. The use of captioned material in the implementation of curriculum of many school subjects would provide important information that could improve the quality of teaching for deaf and hard of hearing pupils whether they attend inclusive or residential schools.

References

Радовановић, В. (2016). Асистивне технологије за глуве и наглуве. Београд: Универзитет у Београду, Факултет за специјалну едукацију и рехабилитацију – ИЦФ.

Anderson-Inman, L., Terrazas-Arellanes, F. E., Slabin, U. (2009). Supported eText in captioned videos: A comparison of expanded versus standard captions on student comprehension of educational content. Journal of Special Education Technolo-gy, 24 (3), 21–34. doi: https://doi.org/10.1177/016264340902 400303

Bean, R. M. & Wilson, R. M. (1989). Using closed-captioned television to teach reading to adults. Reading Research and Instruction, 28 (4), 27–37.

Cambra, C., Leal, A., Silvestre, N. (2010). How deaf and hearing adolescents com-prehend a televised story. Deafness & Education International, 12 (1), 34–51. doi: 10.1179/146431510X12626982043606

Cambra, C., Silvestre, N., Leal, A. (2009). Comprehension of television messages by deaf students at various stages of education. American Annals of the Deaf, 153 (5), 425–434. doi:10.1353/aad.0.0065

D’Ydewalle, G., Warlop, L., Van Rensbergen, J. (1989). Differences between young and oldren adults in the division over different sources of TV information. Me-dienpsychologie: Zeitschrift für Individual und Massenkommunikation, 1, 42–57.

Garza, T. (1991). Evaluating the use of captioned video materials in advanced for-eign language learning. Foreign Language Annals, 24 (3), 239–258.

Gernsbacher, M. A. (2015). Video captions benefit everyone. Policy Insights from the Behavioral and Brain Sciences, 2 (1), 195–202. doi: 10.1177/23727322156 02130

Gregory, S. & Sancho-Aldridge, J. (1998). Dial 888: Subtitling for deaf children. London: Independent Television Commission.

Gürkans, A. (2019). Subtitling for the deaf and the hard-of-hearing: A reception study in the Turkish context (Doctoral dissertation). University College London: Centre for Translation Studies, London. Preuzeto 25. 3. 2021. sa: https://discovery.ucl.ac.uk/id/eprint/10087904/8/Gurkan_10087904_thesis_redacted.pdf

Iriarte, M. M. (2017). The reception of subtitling by the deaf and hard of hearing. (Doctoral thesis). Autonomous University of Barcelona, Barcelona. Preuzeto 26. 3. 2021. sa: https://ddd.uab.cat/pub/tesis/2017/hdl_10803_403811/mm i1de1.pdf

Jelinek Lewis, M. & Jackson, D. (2001). Television literacy: comprehension of pro-gram content using closed captions for the deaf. Journal of Deaf Studies and Deaf Education, 6 (1), 43–53. doi: 10.1093/deafed/6.1.43

Karić, J., Ristić, S., Medenica, S., Tadić, V., Slavnić, S. (2012). Karakteristike gluvih i nagluvih učenika. Vojnosanitetski pregled, 69 (10), 846–852. doi: 10.2298/VSP1210846K

Koskinen, P. S., Wilson, R. M., Jensema, C. J. (1986). Closed-captioned television: A new tool for reading instruction. Reading World, 24 (4), 1–7.

Kruger, J. L. & Steyn, F. (2013). Subtitles and eye tracking: reading and perfor-mance. Reading Research Quarterly, 49 (1), 105–120. doi:10.1002/rrq.59

Meyer, M. J. & Lee, Y. B. (1995). Closed-captioned prompt rates: their influence on reading outcomes. In: Proceedings of the 1995 Annual National Convention of the Association for Educational Communications and Technology (AECT). Preuzeto 23. novembra 2011. sa: http://eric.ed.gov/?id=ED383326

Neves, J. (2008). 10 fallacies about subtitling for the d/Deaf and the hard of hearing. The Journal of Specialised Translation, 10, 128–143.

Norwood, M. J. (1988). Captioning for deaf people: An historical overview. In: J. E. Harkins & B. M. Virvan (Eds.), Speech to text: Today and tomorow (133–138). Washington: Proceedings of a conference at Gallaudet University.

Omoniyi, T. T. (2013). Impact of captioned video instruction on Nigerian Hearing impaired pupils’ performance in English. Library Philosophy and Practice (e-journal). 854. Preuzeto 30. 3. 2021. sa: https://digitalcommo ns.unl.edu/cgi/viewcontent.cgi?article=1909&context=libphilprac

Parlato, S. J. (1985). Re-discovering films with captions. Teaching English to Deaf and Second Language Students: An official journal of the section of English teach-ers of the Deaf, 3 (1), 17–20.

Romero-Fresco, P. (2015). The reception of subtitles for the deaf and hard of hear-ing in Europe: UK, Spain, Italy, Poland, Denmark, France and Germany. Bern: Pe-ter Lang.

Stinson, M. S. & Stevenson, S. (2013). Effects of expanded and standard captions on deaf college students' comprehension of educational videos. American Annals of the Deaf, 158 (4), 453–467. doi: 10.1353/aad.2013.0033

Tamayo, A. & Chaume, F. (2017). Subtitling for D/deaf and hard-of-hearing chil-dren: current practices and new possibilities to enhance language develop-ment. Brain sciences, 7 (7), 75. doi: 10.3390/brainsci7070075

Ward, P., Wang, Y., Paul, P., Loeterman, M. (2007). Near-verbatim captioning versus edited captioning for students who are deaf or hard of hearing: A preliminary inves-tigation of effects on comprehension. American Annals of the Deaf, 152 (1) 20–28. doi: https://doi.org/10.1353/aad.2007.0015

Yoon, J. O. & Kim, M. (2011). The effects of captions on deaf students’ content comprehension, cognitive load, and motivation in online learning. American Annals of the deaf, 156 (3), 283–289. doi: 10.1353/aad.2011.0026

Zarate, S. & Eliahoo, J. (2014). Word recognition and content comprehension of subtitles for television by deaf children. The Journal of Specialised Translation, 21, 133–152.

Published
2021/09/10
Section
Review Paper