Мodels of Lexical Semantics in the Algorithms for Natural Language Processing
Abstract
The aim of this study was to determine whether some of the approaches of lexical semantics for studying word meaning could be identified in word2vec and recurrent neural networks (RNN), the algorithms for natural language processing (NLP). Linguistic concepts from the field of lexical semantics were decompositional, holistic and relational. Although it is assumed that algorithms for natural language processing cannot be written only on the basis of mathematical knowledge, but also linguistic, this analysis was carried out so as to determine the exact models used in the above-mentioned algorithms.
References
Aggarwal, Ch. C. (2018). Neural Networks and Deep Learning. New York: Springer.
Barr, A. & Feigenbaum, E. A. (1981). The Handook of Artificial Intelligence 1. Stanford, California: HeurisTech Press – Los Althos, California: William Kaufmann, Inc.
Boden, M. (2001). A Guide to Recurrent Neural Networks and Backpropagation. In: A. Holst (Ed.), The DALLAS Project (17‒26). Kista: Swedish Institute of Computer Science.
Chomsky, А. N. (2002). Syntactic Structures (2nd edition). Berlin and New York: Mouton de Gruyter.
Fillmore, Ch. J. (1982). Frame Semantics. In: The Linguistic Society of Korea (Eds.), Linguistics in the Morning Calm (111‒137). Seoul: Hanshin Publishing Company.
Firth, J. R. (1935). The Technique of Semantics. Transactions of the Philological Society, 1 (34), 36‒72. doi: 10.1111/j.1467-968X .1935.tb01254.x
Geeraerts, D. (2010). Theories of Lexical Semantics. Oxford: Oxford University Press.
Goyal, P., Pandey, S., Jain, K. (2018). Deep Learning for Natural Language Processing: Creating Neural Networks with Python. New York: Apress.
Katz, J. J. & Fodor, J. A. (1963). The Structure of a Semantic Theory. Language, 2 (39), 170‒210. doi: 10.2307/411200
Lyons, J. (1977). Semantics 1. Cambridge: Cambridge University Press.
Manojlović, V. V. (2007). Osnovi računarske tehnike, Deo 1: Podaci i operacije (2. izdanje). Beograd: Akademska misao.
Mikolov, T., Karafiat, M., Burget, L., Cernocky, J., Khundanpur, S. (2010). Recurrent Neural Network Based Language Model. In: T. Kobayashi, K. Hirose, S. Nakamura (Eds.), 11th Annual Conference of the International Speech Communication Association (1045‒1048). Makuhari: Interspeech.
Mikolov, T., Chen, K., Corrado, G., Dean, J. (2013а). Efficient Estimation of Word Representations in Vector Space. In: Proceedings of Workshop at International Conference on Learning Representations. Доступно на: https://iclr.cc/archive/2013/workshop-proceedings.html.
Mikolov, T., Sutskever, I., Chen, K., Corrado, G., Dean, J. (2013b). Distributed Representations of Words and Phrases and Their Compositionality. In: C. J. C. Burges, L. Botou, M. Welling, Z. Ghahramani, K. Q. Weinberger (Eds.), Proceedings of the 26th International Conference on Neural Information Processing Systems, Volume 2 (3111‒3119). New York: Curran Associates Inc.
Nida, E. A. (1975). Componential Analysis of Meaning. The Hague: Mouton Publishers.
Patel, K. & Bhattacharyya, P. (2017). Towards Lower Bounds on Number of Dimensions for Word Embeddings. In: G. Kondrak & T. Watanabe (Eds.), Proceedings of the Eighth International Joint Conference on Natural Language Processing, Volume 2: Short Papers (31‒36). Taipei: Asian Federation of Natural Language Processing.
Prćić, T. (2016). Semantika i pragmatika reči (3. elektronsko izdanje). Novi Sad: Filozofski fakultet. Доступно на: http://digitalna.ff.uns.ac.rs/sites/default/files/db/books/978-86-6065-356-9.pdf.
Turing, A. M. (1950). Computing Machinery and Intelligence. Mind, 59 (236), 433–460. https://doi.org/10.1093/mind/LIX.236.433
Wittgenstein, L. (1986). Philosophical Investigations. Oxford: Basil Blackwell.
The details about the publication policy, including copyright and licensing, are available at: