Výzkum v didaktice cizích jazyků VIII

Kapitola

Automatická evaluace textu ve zpětné vazbě na akademické psaní v angličtině: zpráva o pilotáži

Rok vydání: 2025

https://doi.org/10.5817/CZ.MUNI.P280-0864-2025-2

Abstrakt

Tato pilotní studie zkoumá jazykový dopad automatizované zpětné vazby založené na umělé inteligenci na akademické psaní studentů – budoucích učitelů angličtiny. V rámci kvaziexperimentální intervence ve výuce byly shromážděny písemné práce před a po intervenci a také odpovědi studentů v dotazníku, aby byly vyhodnoceny jazykové změny a vnímání zpětné vazby. Předběžné výsledky naznačují, že automatizovaná zpětná vazba podporuje zlepšení v syntaktické a gramatické komplexitě a zároveň zvyšuje povědomí studentů o formě a struktuře textu. Tyto poznatky ukazují na potenciál využití nástrojů automatizované zpětné vazby k obohacení výuky psaní v angličtině a k rozvoji didaktiky angličtiny na terciární úrovni.

Klíčová slova

automatizované hodnocení psaní, zlepšování dovednosti psaní, mechanismy zpětné vazby, učitelská vs. automatizovaná zpětná vazba, angličtina jako cizí jazyk


Reference

Biber, D., Gray, B., & Poonpon, K. (2011). Should we use characteristics of conversation to measure grammatical complexity in L2 writing development? TESOL Quarterly, 45(1), 5–35. https://doi.org/10.5054/tq.2011.244483

Biber, D., & Gray, B. (2016). Grammatical complexity in academic English: Linguistic change in writing. Cambridge University Press. https://doi.org/10.1017/CBO9780511920776

Cotos, E. (2014). Automated writing evaluation. In Genre-based automated writing evaluation for L2 research writing (pp. 40–64). Palgrave Macmillan. https://doi.org/10.1057/9781137333377_3

Council of Europe. (2020). Common European framework of reference for languages: Learning, teaching, assessment – Companion volume. Council of Europe Publishing. https://rm.coe.int/common-european-framework-of-reference-for-languages-learning-teaching/16809ea0d4

Creswell, J. W., & Plano Clark, V. L. (2006). Designing and conducting mixed methods research. SAGE Publications.

Cunningham, K. J. (2019). Student perceptions and use of technology-mediated text and screencast feedback in ESL writing. Computers and Composition, 52, 222–241. https://doi.org/10.1016/j.compcom.2019.02.003

Dörnyei, Z. (2007). Research methods in applied linguistics. Oxford University Press.

Dörnyei, Z., & Taguchi, T. (2009). Questionnaires in second language research: Construction, administration, and processing (2nd ed.). Routledge. https://doi.org/10.4324/9780203864739

Finlay, L. (2002). "Outing" the researcher: The provenance, process, and practice of reflexivity. Qualitative Health Research, 12(4), 531–545. https://doi.org/10.1177/104973202129120052

Fleckenstein, J., Liebenow, L. W., & Meyer, J. (2023). Automated feedback and writing: A multi-level meta-analysis of effects on students' performance. Frontiers in Artificial Intelligence, 6, 1162454. https://doi.org/10.3389/frai.2023.1162454

Flick, U. (2018). An introduction to qualitative research (6th ed.). SAGE Publications.

Greener, I. (2011). Designing social research: A guide for the bewildered. SAGE Publications. https://doi.org/10.4135/9781446287934

Gopalan, M., Rosinger, K., & Ahn, J. B. (2020). Use of quasi-experimental research designs in education research: Growth, promise, and challenges. Review of Research in Education, 44(1), 218–243. https://doi.org/10.3102/0091732X20903302

Hoang, G. T. L., & Kunnan, A. J. (2016). Automated essay evaluation for English language learners: A case study of MY Access. Language Assessment Quarterly, 13(4), 359–376. https://doi.org/10.1080/15434303.2016.1230121

Hyland, K. (2004). Genre and second language writing. University of Michigan Press. https://doi.org/10.3998/mpub.23927

Krippendorff, K. (2004). Content analysis: An introduction to its methodology (2nd ed.). SAGE Publications.

Koltovskaia, S. (2020). Student engagement with automated written corrective feedback (AWCF) provided by Grammarly: A multiple case study. Assessing Writing, 44, 100450. https://doi.org/10.1016/j.asw.2020.100450

Krueger, R. A. (2014). Focus groups: A practical guide for applied research. SAGE Publications.

Liao, H.-C. (2016). Using automated writing evaluation to reduce grammar errors in writing. ELT Journal, 70(3), 308–319. https://doi.org/10.1093/elt/ccv058

Lu, X. (2010). Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics, 15(4), 474–496. https://doi.org/10.1075/ijcl.15.4.02lu

Lu, X. (2012). The relationship of lexical richness to the quality of ESL learners’ oral narratives. The Modern Language Journal, 96(2), 190–208. https://doi.org/10.1111/j.1540-4781.2011.01232.x

Muftah, M. (2023). Data-driven learning (DDL) activities: Do they truly promote EFL students’ writing skills development? Education and Information Technologies, 28, 13179–13205. https://doi.org/10.1007/s10639-023-11620-z

Nasseri, M., & Lu, X. (2019). LCA-AW: Lexical Complexity Analyzer for Academic Writing (version 2.1). Zenodo. https://doi.org/10.5281/zenodo.2537862

Norris, J. M., & Ortega, L. (2009). Towards an organic approach to investigating CAF in instructed SLA: The case of complexity. Studies in Second Language Acquisition, 30(4), 555–578. https://doi.org/10.1093/applin/amp044

Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 42, 533–544. https://doi.org/10.1007/s10488-013-0528-y

Parra G., L., & Calero S., X. (2019). Automated writing evaluation tools in the improvement of the writing skill. International Journal of Instruction, 12(2), 209–226. https://doi.org/10.29333/iji.2019.12214a

Poland, B. D. (1995). Transcription quality as an aspect of rigor in qualitative research. Qualitative Inquiry, 1(3), 290–310. https://doi.org/10.1177/107780049500100302

Ranalli, J. (2018). Automated written corrective feedback: How well can students make use of it? Computer Assisted Language Learning, 31(7), 653–674. https://doi.org/10.1080/09588221.2018.1428994

Read, J. (2000). Assessing vocabulary. Cambridge University Press.

Reynolds, B. L., Kao, C.-W., & Huang, Y.-Y. (2021). Investigating the effects of perceived feedback source on second language writing performance: A quasi-experimental study. The Asia-Pacific Education Researcher, 30, 585–595. https://doi.org/10.1007/s40299-021-00597-3

Silverman, D. (2005). Doing qualitative research (2nd ed.). SAGE Publications.

Shermis, M. D., & Burstein, J. (Eds.). (2013). Handbook of automated essay evaluation: Current applications and new directions. Routledge. https://doi.org/10.4324/9780203122761

Wang, Z. (2022). Computer-assisted EFL writing and evaluations based on artificial intelligence: A case from a college reading and writing course. Library Hi Tech, 40(1), 80–97. https://doi.org/10.1108/LHT-05-2020-0113

Zhang, Z., & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90–102. https://doi.org/10.1016/j.asw.2018.02.004