Výzkum v didaktice cizích jazyků VIII
KapitolaAutomatická evaluace textu ve zpětné vazbě na akademické psaní v angličtině: zpráva o pilotáži
Rok vydání: 2025https://doi.org/10.5817/CZ.MUNI.P280-0864-2025-2
Abstrakt
Tato pilotní studie zkoumá jazykový dopad automatizované zpětné vazby založené na umělé inteligenci na akademické psaní studentů – budoucích učitelů angličtiny. V rámci kvaziexperimentální intervence ve výuce byly shromážděny písemné práce před a po intervenci a také odpovědi studentů v dotazníku, aby byly vyhodnoceny jazykové změny a vnímání zpětné vazby. Předběžné výsledky naznačují, že automatizovaná zpětná vazba podporuje zlepšení v syntaktické a gramatické komplexitě a zároveň zvyšuje povědomí studentů o formě a struktuře textu. Tyto poznatky ukazují na potenciál využití nástrojů automatizované zpětné vazby k obohacení výuky psaní v angličtině a k rozvoji didaktiky angličtiny na terciární úrovni.
Klíčová slova
automatizované hodnocení psaní, zlepšování dovednosti psaní, mechanismy zpětné vazby, učitelská vs. automatizovaná zpětná vazba, angličtina jako cizí jazyk
Reference
Biber, D., Gray, B., & Poonpon, K. (2011). Should we use characteristics of conversation to measure grammatical complexity in L2 writing development? TESOL Quarterly, 45(1), 5–35. https://doi.org/10.5054/tq.2011.244483
Biber, D., & Gray, B. (2016). Grammatical complexity in academic English: Linguistic change in writing. Cambridge University Press. https://doi.org/10.1017/CBO9780511920776
Cotos, E. (2014). Automated writing evaluation. In Genre-based automated writing evaluation for L2 research writing (pp. 40–64). Palgrave Macmillan. https://doi.org/10.1057/9781137333377_3
Council of Europe. (2020). Common European framework of reference for languages: Learning, teaching, assessment – Companion volume. Council of Europe Publishing. https://rm.coe.int/common-european-framework-of-reference-for-languages-learning-teaching/16809ea0d4
Creswell, J. W., & Plano Clark, V. L. (2006). Designing and conducting mixed methods research. SAGE Publications.
Cunningham, K. J. (2019). Student perceptions and use of technology-mediated text and screencast feedback in ESL writing. Computers and Composition, 52, 222–241. https://doi.org/10.1016/j.compcom.2019.02.003
Dörnyei, Z. (2007). Research methods in applied linguistics. Oxford University Press.
Dörnyei, Z., & Taguchi, T. (2009). Questionnaires in second language research: Construction, administration, and processing (2nd ed.). Routledge. https://doi.org/10.4324/9780203864739
Finlay, L. (2002). "Outing" the researcher: The provenance, process, and practice of reflexivity. Qualitative Health Research, 12(4), 531–545. https://doi.org/10.1177/104973202129120052
Fleckenstein, J., Liebenow, L. W., & Meyer, J. (2023). Automated feedback and writing: A multi-level meta-analysis of effects on students' performance. Frontiers in Artificial Intelligence, 6, 1162454. https://doi.org/10.3389/frai.2023.1162454
Flick, U. (2018). An introduction to qualitative research (6th ed.). SAGE Publications.
Greener, I. (2011). Designing social research: A guide for the bewildered. SAGE Publications. https://doi.org/10.4135/9781446287934
Gopalan, M., Rosinger, K., & Ahn, J. B. (2020). Use of quasi-experimental research designs in education research: Growth, promise, and challenges. Review of Research in Education, 44(1), 218–243. https://doi.org/10.3102/0091732X20903302
Hoang, G. T. L., & Kunnan, A. J. (2016). Automated essay evaluation for English language learners: A case study of MY Access. Language Assessment Quarterly, 13(4), 359–376. https://doi.org/10.1080/15434303.2016.1230121
Hyland, K. (2004). Genre and second language writing. University of Michigan Press. https://doi.org/10.3998/mpub.23927
Krippendorff, K. (2004). Content analysis: An introduction to its methodology (2nd ed.). SAGE Publications.
Koltovskaia, S. (2020). Student engagement with automated written corrective feedback (AWCF) provided by Grammarly: A multiple case study. Assessing Writing, 44, 100450. https://doi.org/10.1016/j.asw.2020.100450
Krueger, R. A. (2014). Focus groups: A practical guide for applied research. SAGE Publications.
Liao, H.-C. (2016). Using automated writing evaluation to reduce grammar errors in writing. ELT Journal, 70(3), 308–319. https://doi.org/10.1093/elt/ccv058
Lu, X. (2010). Automatic analysis of syntactic complexity in second language writing. International Journal of Corpus Linguistics, 15(4), 474–496. https://doi.org/10.1075/ijcl.15.4.02lu
Lu, X. (2012). The relationship of lexical richness to the quality of ESL learners’ oral narratives. The Modern Language Journal, 96(2), 190–208. https://doi.org/10.1111/j.1540-4781.2011.01232.x
Muftah, M. (2023). Data-driven learning (DDL) activities: Do they truly promote EFL students’ writing skills development? Education and Information Technologies, 28, 13179–13205. https://doi.org/10.1007/s10639-023-11620-z
Nasseri, M., & Lu, X. (2019). LCA-AW: Lexical Complexity Analyzer for Academic Writing (version 2.1). Zenodo. https://doi.org/10.5281/zenodo.2537862
Norris, J. M., & Ortega, L. (2009). Towards an organic approach to investigating CAF in instructed SLA: The case of complexity. Studies in Second Language Acquisition, 30(4), 555–578. https://doi.org/10.1093/applin/amp044
Palinkas, L. A., Horwitz, S. M., Green, C. A., Wisdom, J. P., Duan, N., & Hoagwood, K. (2015). Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Administration and Policy in Mental Health and Mental Health Services Research, 42, 533–544. https://doi.org/10.1007/s10488-013-0528-y
Parra G., L., & Calero S., X. (2019). Automated writing evaluation tools in the improvement of the writing skill. International Journal of Instruction, 12(2), 209–226. https://doi.org/10.29333/iji.2019.12214a
Poland, B. D. (1995). Transcription quality as an aspect of rigor in qualitative research. Qualitative Inquiry, 1(3), 290–310. https://doi.org/10.1177/107780049500100302
Ranalli, J. (2018). Automated written corrective feedback: How well can students make use of it? Computer Assisted Language Learning, 31(7), 653–674. https://doi.org/10.1080/09588221.2018.1428994
Read, J. (2000). Assessing vocabulary. Cambridge University Press.
Reynolds, B. L., Kao, C.-W., & Huang, Y.-Y. (2021). Investigating the effects of perceived feedback source on second language writing performance: A quasi-experimental study. The Asia-Pacific Education Researcher, 30, 585–595. https://doi.org/10.1007/s40299-021-00597-3
Silverman, D. (2005). Doing qualitative research (2nd ed.). SAGE Publications.
Shermis, M. D., & Burstein, J. (Eds.). (2013). Handbook of automated essay evaluation: Current applications and new directions. Routledge. https://doi.org/10.4324/9780203122761
Wang, Z. (2022). Computer-assisted EFL writing and evaluations based on artificial intelligence: A case from a college reading and writing course. Library Hi Tech, 40(1), 80–97. https://doi.org/10.1108/LHT-05-2020-0113
Zhang, Z., & Hyland, K. (2018). Student engagement with teacher and automated feedback on L2 writing. Assessing Writing, 36, 90–102. https://doi.org/10.1016/j.asw.2018.02.004