Speaker Recognition Based On Auditory Impression: The Role Of Familiarity With The Speaker And Language
Keywords:
forensics, perception, identification, speech, familiarity
Abstract
Speech is a fundamental means of interpersonal communication. Speaker identification based on voice and speech can be analysed through two perspectives, expert listening by trained phoneticians, for the purpose of forensic speaker identification and naïve listeners. Factors related to the success of identification often include prior familiarity with the speaker and the language they speak. The aim of the research was to determine the connection between speaker recognition based on the auditory impression of their voice and speech, prior familiarity with the speaker, and knowledge of the language they speak. The sample consisted of 218 female students. An instrument was specially designed for the purposes of this research. Prior familiarity with the speaker was only associated with recognizing female English speaker, while statistical analysis did not confirm the significance of recognizing speakers based on whether the listeners knew the foreign language of the speakers. Given that the research findings did not consistently support the hypothesis regarding the connection between prior familiarity with the speaker and the language they speak, and the success of speaker identification, it is necessary for future research to focus on examining the connection between recognizing speakers and the acoustic characteristics of their voice and speech.
References
Alkhatib, B., & Kamal Eddin, M. M. W. (2020). Voice Identification Using MFCC and Vector Quantization. Baghdad Science Journal, 17(3), 1019–1028. https://doi.org/10.21123/bsj.2020.17.3(Suppl.).1019
Babić, I., Otuzbir, S., & Hodžić, I. (2017). The Significance of the Forensic Phonetic in the Voice Identification as an Effective Protection and Safety Measure. Nauka i tehnologija, 5(9), 157–165.
Baumann, O., & Belin, P. (2010). Perceptual scaling of voice identity: Common dimensions for different vowels and speakers. Psychological Research, 74(1), 110–120. https://10.1007/ s00426-008-0185-z
Didla, G. S. (2020). A Review of Voice Disguise in a Forensic Phonetic Context. International Journal of English Literature and Social Sciences, 5(3), 721–725. https://doi.org/10.22161/ijels.53.25
Goggin, J., Thompson, C., Strube, G., & Simental, L. (1991). The role of language familiarity in voice identification. Memory and Cognition, 19(5), 448–458.
Hansen, J.H.L., & Hasan, T. (2015). Speaker Recognition by Machines and Humans: A tutorial review. IEEE Signal Processing Magazine, 32(6), 74–99. https://doi.org /10.1109/MSP.2015.2462851
Islam, R., Abdel-Raheem, E., & Tarique, M. (2022). A Novel Pathological Voice Identification Technique through Simulated Cochlear Implant Processing Systems. Applied Sciences, 12(5), 2398. https://doi.org/10.3390/app12052398
Jenkins, R. E., Tsermentseli, S., Monks, C. P, Robertson, D. J., Stevenage, S. V., Symons, A. E., & Davis, J. P. (2021). Are super-face-recognisers also super-voice recognisers? Evidence from cross-modal identification tasks. Applied Cognitive Psychology, 35(3), 590–605. https://doi.org/10.1002/acp.3813
Kreiman, J., & Papcun, G. (1991). Comparing discrimination and recognition of unfamiliar voices. Speech Communication, 10 (3), 265–275. https://doi.org/10.1016/0167-6393(91)90016-M
Kreiman, J., & Sidtis, D. (2011). Foundations of voice studies: An interdisciplinary approach to voice production and perception. John Wiley & Sons.
Lavan, N., Merriman, S.E., Ladwa, P., Burston, L.F., Knight, S., & McGettigan, C. (2020). 'Please sort these voice recordings into 2 identities': Effects of task instructions on performance in voice sorting studies. British Journal of Psychology, 111(3), 556–569. https://doi.org/10.1111/bjop.12416
Lindh, J. (2017). Forensic Comparison of Voices, Speech and Speakers Tools and Methods in Forensic Phonetics. [PhD thesis, University of Gothenburg - Department of Philosophy, Linguistics and Theory of Science]. http://hdl.handle.net/2077/52188
Morrison, G., & Enzinger, E. (2019). Multi-laboratory evaluation of forensic voice comparison systems under conditions reflecting those of a real forensic case (forensic_eval_01) – Introduction. Speech Communication, 85, 119–126. https://doi.org/10.1016/j.specom.2019.06.007
Mukattash, B. (2016). The Role of Forensic Phonetics in Legal Investigation: A Case Study of Two Speaker-Identified/Unidentified Recorded Samples. Journal of Literature, Languages and Linguistics, 29, 31–37.
Nygaard, L. (2005). Perceptual integration of linguistic and nonlinguistic properties of speech. In: The Handbook of Speech Perception. Blackwell Publishing, 390–413.
Perrachione, T., & Wong, P. (2007). Learning to recognize speakers of a non-native language: Implications for the functional organization of human auditory cortex. Neuropsychologia, 45(8), 1899–1910. http://doi.org/ 10.1016/j.neuropsychologia.2006.11.015
Petrini, K., & Tagliapietra, S. (2008). Cognitive Maturation and the Use of Pitch and Rate Information in Making Similarity Judgments of a Single Talker. Journal of Speech, Language, and Hearing Research, 51(2), 485–501. https://doi.org/10.1044/1092-4388(2008/035)
Philippon, A. C., Cherryman, J., Bull, R., & Vrij, A. (2007). Earwitness identification performance: The effect of language, target, deliberate strategies and indirect measures. Applied Cognitive Psychology, 21(4), 539–550. https://doi.org/10.1002/acp.1296
Sharma, P. & Sahu, N. (2018). A Review and Analysis of Voice Identification System. International Journal of Innovative Knowledge Concepts, 6(5), 189–191. https://doi.org/11.25835/IJIK-54
Šešum, M (2013). Komparativna analiza formantnih struktura glasova sestara i glasova monozigotnih bliznakinja. Beogradska defektološka škola, 19(3), 515–527.
Šešum, M. (2021). Forenzička fonetika-identifikacija govornika. U S. Knežević (Ur.), Forenzičko računovodstvo, istražne radnje, ljudski faktor i primenjeni alati (str. 828–859). Univerzitet u Beogradu - Fakultet organizacionih nauka.
Šešum, M., & Kovačević, J. (2015). Forenzička fonetika. Vodič za primenu Zakonika o krivičnom postupku Republike Srbije. Grafolik.
Van Lancker, D., & Kreiman, J., (1987). Voice discrimination and recognition are separate abilities. Neuropsychologia, 25(5), 829–834. https://doi.org/10.1016/0028-3932(87)90120-5
Wester, M. (2012). Talker discrimination across languages. Speech Communication, 54(6), 781–790. https://doi.org/10.1016/j.specom.2012.01.006
Winters, S., Levi, S., & Pisoni, D. (2008). Identification and discrimination of bilingual talkers across languages. The Journal of the Acoustical Society of America, 123(6), 4524–4538. https://doi.org/10.1121/1.2913046
Zhou, Y., Liu, Y., & Niu, H. (2022). Perceptual Characteristics of Voice Identification in Noisy Environments. Applied Sciences, 12(23), 12129. https:// doi.org/10.3390/app122312129
Babić, I., Otuzbir, S., & Hodžić, I. (2017). The Significance of the Forensic Phonetic in the Voice Identification as an Effective Protection and Safety Measure. Nauka i tehnologija, 5(9), 157–165.
Baumann, O., & Belin, P. (2010). Perceptual scaling of voice identity: Common dimensions for different vowels and speakers. Psychological Research, 74(1), 110–120. https://10.1007/ s00426-008-0185-z
Didla, G. S. (2020). A Review of Voice Disguise in a Forensic Phonetic Context. International Journal of English Literature and Social Sciences, 5(3), 721–725. https://doi.org/10.22161/ijels.53.25
Goggin, J., Thompson, C., Strube, G., & Simental, L. (1991). The role of language familiarity in voice identification. Memory and Cognition, 19(5), 448–458.
Hansen, J.H.L., & Hasan, T. (2015). Speaker Recognition by Machines and Humans: A tutorial review. IEEE Signal Processing Magazine, 32(6), 74–99. https://doi.org /10.1109/MSP.2015.2462851
Islam, R., Abdel-Raheem, E., & Tarique, M. (2022). A Novel Pathological Voice Identification Technique through Simulated Cochlear Implant Processing Systems. Applied Sciences, 12(5), 2398. https://doi.org/10.3390/app12052398
Jenkins, R. E., Tsermentseli, S., Monks, C. P, Robertson, D. J., Stevenage, S. V., Symons, A. E., & Davis, J. P. (2021). Are super-face-recognisers also super-voice recognisers? Evidence from cross-modal identification tasks. Applied Cognitive Psychology, 35(3), 590–605. https://doi.org/10.1002/acp.3813
Kreiman, J., & Papcun, G. (1991). Comparing discrimination and recognition of unfamiliar voices. Speech Communication, 10 (3), 265–275. https://doi.org/10.1016/0167-6393(91)90016-M
Kreiman, J., & Sidtis, D. (2011). Foundations of voice studies: An interdisciplinary approach to voice production and perception. John Wiley & Sons.
Lavan, N., Merriman, S.E., Ladwa, P., Burston, L.F., Knight, S., & McGettigan, C. (2020). 'Please sort these voice recordings into 2 identities': Effects of task instructions on performance in voice sorting studies. British Journal of Psychology, 111(3), 556–569. https://doi.org/10.1111/bjop.12416
Lindh, J. (2017). Forensic Comparison of Voices, Speech and Speakers Tools and Methods in Forensic Phonetics. [PhD thesis, University of Gothenburg - Department of Philosophy, Linguistics and Theory of Science]. http://hdl.handle.net/2077/52188
Morrison, G., & Enzinger, E. (2019). Multi-laboratory evaluation of forensic voice comparison systems under conditions reflecting those of a real forensic case (forensic_eval_01) – Introduction. Speech Communication, 85, 119–126. https://doi.org/10.1016/j.specom.2019.06.007
Mukattash, B. (2016). The Role of Forensic Phonetics in Legal Investigation: A Case Study of Two Speaker-Identified/Unidentified Recorded Samples. Journal of Literature, Languages and Linguistics, 29, 31–37.
Nygaard, L. (2005). Perceptual integration of linguistic and nonlinguistic properties of speech. In: The Handbook of Speech Perception. Blackwell Publishing, 390–413.
Perrachione, T., & Wong, P. (2007). Learning to recognize speakers of a non-native language: Implications for the functional organization of human auditory cortex. Neuropsychologia, 45(8), 1899–1910. http://doi.org/ 10.1016/j.neuropsychologia.2006.11.015
Petrini, K., & Tagliapietra, S. (2008). Cognitive Maturation and the Use of Pitch and Rate Information in Making Similarity Judgments of a Single Talker. Journal of Speech, Language, and Hearing Research, 51(2), 485–501. https://doi.org/10.1044/1092-4388(2008/035)
Philippon, A. C., Cherryman, J., Bull, R., & Vrij, A. (2007). Earwitness identification performance: The effect of language, target, deliberate strategies and indirect measures. Applied Cognitive Psychology, 21(4), 539–550. https://doi.org/10.1002/acp.1296
Sharma, P. & Sahu, N. (2018). A Review and Analysis of Voice Identification System. International Journal of Innovative Knowledge Concepts, 6(5), 189–191. https://doi.org/11.25835/IJIK-54
Šešum, M (2013). Komparativna analiza formantnih struktura glasova sestara i glasova monozigotnih bliznakinja. Beogradska defektološka škola, 19(3), 515–527.
Šešum, M. (2021). Forenzička fonetika-identifikacija govornika. U S. Knežević (Ur.), Forenzičko računovodstvo, istražne radnje, ljudski faktor i primenjeni alati (str. 828–859). Univerzitet u Beogradu - Fakultet organizacionih nauka.
Šešum, M., & Kovačević, J. (2015). Forenzička fonetika. Vodič za primenu Zakonika o krivičnom postupku Republike Srbije. Grafolik.
Van Lancker, D., & Kreiman, J., (1987). Voice discrimination and recognition are separate abilities. Neuropsychologia, 25(5), 829–834. https://doi.org/10.1016/0028-3932(87)90120-5
Wester, M. (2012). Talker discrimination across languages. Speech Communication, 54(6), 781–790. https://doi.org/10.1016/j.specom.2012.01.006
Winters, S., Levi, S., & Pisoni, D. (2008). Identification and discrimination of bilingual talkers across languages. The Journal of the Acoustical Society of America, 123(6), 4524–4538. https://doi.org/10.1121/1.2913046
Zhou, Y., Liu, Y., & Niu, H. (2022). Perceptual Characteristics of Voice Identification in Noisy Environments. Applied Sciences, 12(23), 12129. https:// doi.org/10.3390/app122312129
