Примена предиктивне аналитике у енглеском за посебне намене на основу студентских текстова

Dragana Božić Lenard; Gabriela Chmelíková

doi:10.5937/zrffp49-22827

Dragana Božić Lenard Sveučilište Josipa Jurja Strossmayera u Osijeku, Fakultet elektrotehnike, računarstva i informacijskih tehnologija, Osijek
Gabriela Chmelíková Slovački tehnički univerzitet, Materijalno-tehnološki fakultet u Trnavi, Centar za jezike, humanistiku i sport

DOI: https://doi.org/10.5937/zrffp49-22827

Ključne reči: success prediction||, ||предвиђање успеха, application||, ||примена, LIWC||, ||LIWC, final grades||, ||оцењивање, ESP||, ||енглески за посебне намене, students’ biographies||, ||биографије студената,

Sažetak

Оштра конкуренција приликом уписа на реномиране универзитете и запошљавања у угледним компанијама створила је потребу за профилисањем потенцијалних кандидата са циљем одабира најбољих. Наше истраживање има за циљ да предвиди потенцијал успешности студената, то јест њихове оцене из курсева енглеског за посебне намене. Укупно 292 студента са Факултета електротехнике, рачунарства и информацијских технологија у Осијеку у Хрватској и 150 студената са Материјално-технолошког факултета у Трнави у Словачкој добровољно су учествовали у истраживању и доставили своје кратке биографије. Њихове биографије анализиране су софтвером (LIWC), а добијени резултати, у форми необрађених бројки, унети су у апликацију посебно креирану за ове потребе. На основу унетих података, апликација је рачунала студентске оцене из наведених курсева које су затим поређене са стварним оценама студената. Истраживањем је потврђен висок степен ефикасности апликације будући да је тачно предвидела оцене у 75% случајева, док су код још 12% оцене приближно прогнозиране, то јест предвиђена оцена била је за један виша или нижа од стварне.

Reference

Baker, C. (2010). The impact of instructor immediacy and presence for online student affective learning, cognition, and motivation. Journal of Educators Online, 7 (1), 1–30.

Biesen, J. N., Schooler, D. E., Smith, D. A. (2015). What a Difference a Pronoun Makes I/We Versus You/Me and Worried Couples’ Perceptions of Their Interaction Quality. Journal of Language and Social Psychology, 35 (2), 180–205.

Božić Lenard, D., Liermann-Zeljak, Y., Ferčec, I. (2018). A redefined approach to student assessment based on essay writing in ESP. Collection of Papers of the Faculty of Philosophy in Priština, 48 (3), 5–36. doi:10.5937/ZRFFP48-18665

Burstein, J., Chodorow, M., Leacock, C. (2004). Automated essay evaluation: The Criterion online writing system. AI Magazine, 25, 27–36.

Burstein, J., Marcu, D., Knight, K. (2003). Finding the WRITE Stuff: Automatic Identification of Discourse Structure in Student Essays. IEEE Intelligent Systems: Special Issue on Natural Language Processing, 18 (1), 32–39.

Choi, M. (2017). Use of English Articles by Korean Students. Culminating Projects in English, 109. https://repository.stcloudstate.edu/engl_etds/109.

Chung, C., Pennebaker, J. (2007). The Psychological Functions of Function Words. In: Fiedler, K. (ed.) (2007). Social Communication. New York: Psychology Press, 343–359.

Coxhead, A. & Nation, I. S. P. (2001). The specialized vocabulary of English for academic purposes. In: J.Flowerdew, & M. Peacock (Eds.), Research Perspectives on English for Academic Purposes (252–267). Cambridge: Cambridge University Press.

Crossley, S. A., Kyle, K., McNamara, D. S. (2016). The development and use of cohesive devices in L2 writing and their relations to judgments of essay quality. The Journal of Second Language Writing, 32, 1–16.

Crossley, S. A. & McNamara, D. S. (2016). Say more and be more coherent: How text elaboration and cohesion can increase writing quality. Journal of Writing Research, 7 (3), 351–370.

Crossley, S. A., McNamara, D. S. (2012). Predicting second language writing proficiency: The role of cohesion, readability, and lexical difficulty. Journal of Research in Reading, 35 (2), 115–135.

Crossley, S. A. & McNamara, D. S. (2011). Understanding expert ratings of essay quality: Coh- Metrix analyses of first and second language writing. International Journal of Continuing Engineering Education and Life-Long Learning, 21, 170–191.

Crossley, S. A., Muldner, K., McNamara, D. S. (2016). Idea generation in student writing: Computational assessments and links to successful writing. Written Communication, 33 (3), 328–354.

Crossley, S. A., Roscoe, R., McNamara, D. S. (2014). What is successful writing? An investigation into the multiple ways writers can write successful essays. Written Communication, 31 (2), 184–215.

Córdoba Cubillo, P., Solís Hernández, M. (2015). The influence of grammar on English learners’ writing accuracy at the school of modern languages. Káñina, Rev. Artes y Letras, Univ. Costa Rica, 2, 107–121.

Daller, M.H., Xue, H. (2009). Vocabulary Knowledge and Academic Success: a Study of Chinese Students in UK Higher Education. In: B.Richards M. H.Daller, D. Malvern , P. Meara J. Milton, J. Treffers-Daller (Eds), Vocabulary Studies in First and Second Language Acquisition (179–193). London: Palgrave Macmillan.

Deane, P. (2013). On the relation between automated essay scoring and modern views of the writing construct. Assessing Writing, 18, 7–24.

Demmans, E., C., Phirangee, K. Hewitt, J. (2017). The Interplay Between Students’ Usage of Pronouns and Community Levels in Online Courses. Presented at the American Educational Research Association (AERA) San Antonio, TX, USA: Annual Meeting.

Dietz-Uhler, B. & Hurn, J. E. (2013). Using learning analytics to predict (and improve) students success: a faculty perspective. Journal of Interactive Online Learning, 12 (1), 17–26.

Elliott, S. (2003). Intellimetric: From Here to Validity. In: M.Shermis & J. Burstein (Eds.), Automated essay scoring: A cross-disciplinary perspective (71–86). Hillsdale, NJ: Lawrence Erlbaum Associates.

Heylighen, F. & Dewaele, J. M. (2002). Variation in the contextuality of language: an empirical measure. Foundations of Science, 6, 293–340.

Hulstijn, J. H., Van Gelderen, A., Schoonen, R. (2009). Automatization in second language acquisition: What does the coefficient of variation tell us? Applied Psycholinguistics, 30 (4), 555–582.

Kacewicz, E., Pennebaker, J. W., Davis, M., Jeon, M., Graesser, A. C. (2014). Pronoun use reflects standings in social hierarchies. Journal of Language and Social Psychology, 33 (2), 125–143.

Kellogg, R., Whiteford, A. (2009). Training advanced writing skills: The case for deliberate practice. Educational Psychologist, 44, 250–266.

Kim, M., Crossley, S. A. (2018). Modeling Second Language Writing Quality: A Structural Equation Investigation of Lexical, Syntactic, and Cohesive Features in Source-Based and Independent Writing. Assessing Writing, 37, 39–56.

Kim, M., Crossley, S. A., Kyle, K. (2018). Lexical sophistication as a multidimensional phenomenon: Relations to second language lexical proficiency, development, and writing quality. The Modern Language Journal, 102 (1), 120–141.

Kyle, K., Crossley, S. A. (2017). Assessing syntactic sophistication in L2 writing: A usage-based approach. Language Testing, 34 (4), 513–535.

Leo, K. (2012). Investigating Cohesion and Coherence Discourse Strategies of Chinese Students with Varied Lengths of Residence in Canada. Tesl Canada Journal, 29 (6), 157–179.

Meurers, D. (2013). Natural language processing and language learning. In: C. A. Chapelle (Ed.), The Encyclopedia of Applied Linguistics (1–13). New York, NY: Blackwell Publishing Ltd.

McNamara, D. S., Crossley, S. A., McCarthy, P. M. (2010). The linguistic features of quality writing. Written Communication, 27 (1), 57–86.

McNamara, D. S., Crossley, S. A., Roscoe, R. (2013). Natural Language Processing in an Intelligent Writing Strategy Tutoring System. Behavior Research Methods, 45 (2), 499–515.

McNamara, D. S., Crossley, S. A., Roscoe, R., Allen, L., Dai, J. (2015). A hierarchical classification approach to automated essay scoring. Assessing Writing, 23 (1), 35–59.

Morris, L., Cobb, T. (2004). Vocabulary profiles as predictors of the academic performance of Teaching English as a Second Language trainees. System, 32, 75–87.

Nisbett, R. E., Peng, K., Choi, I., Norenzayan, A. (2001). Culture and systems of thought: Holistic versus analytic cognition. Psychological Review, 108, 291–310.

Parkinson, J., Musgrave, J. (2014). Development of noun phrase complexity in the writing of English for Academic Purposes students. Journal of English for Academic Purposes, 14 (2), 48–59.

Pennebaker, J. W. (2013). The Secret Life of Pronouns: What Our Words Say About Us. New York: Bloomsbury Press.

Pennebaker, J. W. & Chung, C. K. (2007). Expressive writing, emotional upheavals, and health. In: H. Friedman & R. Silver (Eds.), Handbook of health psychology (263–284). New York: Oxford University Press.

Pennebaker, J. W., Chung, C. K., Frazee, J., Lavergne, G. M., Beaver, D. I. (2014). When Small Words Foretell Academic Success: The Case of College Admissions Essays. PloS ONE, 9 (12), https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4281205/

Picciano, A. G. (2014). Big data and learning analytics in blended learning environments: benefits and concerns. International Journal of Artificial Intelligence and Interactive Multimedia, 2 (7), 35–43.

Rabow, M. W., Wrubel, J. R., Rachel, N. (2009). Promise of professionalism: Personal mission statements among a national cohort of medical students. Annals of Family Medicine, 7, 336–342.

Rass, R. A. (2015). Challenges Face Arab Students in Writing Well-Developed Paragraphs in English. English Language Teaching, 8 (10), 49–59.

Robinson, R.L., Navea, R., Ickes, W. (2013). Predicting final course performance from students’ written self-introductions; A LIWC analysis. Journal of Language and Social Psychology, 32, 481–491.

Roessingh, H., Elgie, S. (2009). Early language and literacy development among young English language learners: Preliminary insights from a longitudinal study. TESL Canada Journal, 26, 24–45.

Siemens, G., Long, P. (2011). Penetrating the fog: Analytics in learning and education. EDUCAUSE Review, 46 (5), 31–40.

Taguchi, N., Crawford, W., Wetzel, D. Z. (2013). What linguistic features are indicative of writing quality? A case of argumentative essays in a college composition program. TESOL Quarterly, 47, 420–430.

Tinto, V., Pusser, B. (2006). Moving from theory to action: Building a model of institutional action for student success. Paper presented at the National Symposium on Postsecondary Student Success, Washington, DC. Retrieved from https://nces.ed.gov/npec/pdf/Tinto_Pusser_Report.pdf

Turner, R., Nicholson, S. (2011). Reasons selectors give for accepting and rejecting medical applicants before interview. Medical Education, 45, 298–307.

Varner, L. K., Roscoe, R. D., McNamara, D. S. (2013). Evaluative misalignment of 10th-grade student and teacher criteria for essay quality: An automated textual analysis. Journal of Writing Research, 5 (1), 35–59.

Vinogradova, O. I., Lyashevskaya, O. N., Panteleeva I. M. (2017). Multi-level student essay feedback in a learner corpus. Computational Linguistics and Intellectual Technologies - Proceedings of the International Conference “Dialogue 2017”, 1 (16), 373–386.

Walfish, S., Moreira, J. (2005). Relative weighting of admission variables in marriage and family therapy graduate programs. American Journal of Family Therapy, 33, 395–402.

Wang, S. & Slater, T. (2016). Syntactic Complexity of EFL Chinese Students’ Writing, English Language and Literature Studies, 6 (1), 81–86.

Wang, S., Beckett, G. H. (2017). “My Excellent College Entrance Examination Achievement” — Noun Phrase Use of Chinese EFL Students’ Writing. Journal of Language Teaching and Research, 8 (2), 271–277.

Waugh, C.E., Fredrickson, B.L. (2006). Nice to know you: Positive emotions, self-other overlap, and complex understanding in the formation of new relationships. The Journal of Positive Psychology, 1, 93–106.