18. mezinárodní vědecká konference Didaktická konference 2025. Sborník recenzovaných příspěvků

Kapitola

Abstrakt

The emergence of generative systems capable of autonomous content creation and cognitive simulation marks a structural fracture in educational technology, moving far beyond earlier tools that simply supported instruction. This paper scrutinizes the dual nature of AI in education, contrasting the potential of the "Personal Tutor" model against the serious risks of "epistemic instability" and the violation of children’s data rights. Grounded in strict governance frameworks—including the EU AI Act, GDPR, and the 5Rights Foundation’s Design Code—I argue that education must be classified and treated as a "high-risk" domain. By synthesizing recent empirical data on self-regulated learning with critical theories of AI sovereignty, the analysis demonstrates that uncritical adoption threatens to erode student agency. Consequently, I propose a "Pedagogy First" approach that shifts the focus from policing students to empowering them through verification literacy, the adoption of Open Technologies, and "ethics-by-design" principles.

Klíčová slova

Artificial Intelligence; Generative AI; AI Ethics; EU AI Act; Open Technologies


Reference

5Rights Foundation. (2023). Children & AI design code: A protocol for the development and use of AI systems that impact children. https://5rightsfoundation.com/uploads/Children-and-AI-Design-Code.pdf

Ahinsa Dialogues. (2025). Seventh Ahinsa Dialogues: Introduction AI and education. https://ahinsadialogues.com/

Bostrom, N. (2014). Superintelligence: Paths, dangers, strategies. Oxford University Press.

Brand, A., & Loitzsch, V. (2024, December 13). Using AI to shape schools: M.E.T.A - A new program for teacher training. Robert Bosch Stiftung. https://www.bosch-stiftung.de/en/storys/using-ai-shape-schools

Carden, G., & Freeman, J. (Eds.). (2025). AI and the future of universities (Report 193). Higher Education Policy Institute. https://www.hepi.ac.uk/2023/09/01/ai-and-the-future-of-universities/

Chatfield, T. (2025). AI and the future of pedagogy [White Paper]. Sage. https://doi.org/10.4135/wp520172

Cobo, C., Almeida, R., & Chiran, L. (2025, October 8). Empowering adult learners: Navigating digital skills in the AI era. World Bank Blogs. https://blogs.worldbank.org/en/education/empowering-adult-learners-navigating-digital-skills-ai-era

De Loera, J. (2025, October 13). Democratic proofs or fake proofs? [Interview]. Epoch AI. https://epochai.org/blog/democratic-proofs-or-fake-proofs-jesus-de-loera

Department of Education Ireland. (2025). Guidance on artificial intelligence in schools (Version 1). An Roinn Oideachais. https://www.gov.ie/en/publication/guidance-on-artificial-intelligence-in-schools/

EducationalAI Consortium. (2025). Ethical & legal guide on the responsible integration of AI in education. Co-funded by the European Union. https://educational-ai.eu/

Ellak-Editor. (2025, October 12). Προς έναν “Προσωπικό Δάσκαλο” με Τεχνητή Νοημοσύνη [Towards a "personal teacher" with AI]. GFOSS / Open Technologies Alliance. https://edu.ellak.gr/2025/10/12/pros-enan-prosopiko-daskalo-me-techniti-noimosini/

European Association of Distance Teaching Universities (EADTU). (2025). Personalisation of education: Enhancing equity, learner agency and academic success. https://eadtu.eu/home/policy-areas/personalisation-of-education

European Commission. (2025a). Apply AI strategy: Shaping Europe’s digital future. https://digital-strategy.ec.europa.eu/en/policies/apply-ai-strategy

European Commission. (2025b). Artificial intelligence: Shaping Europe’s digital future. https://digital-strategy.ec.europa.eu/en/policies/artificial-intelligence

European Data Protection Supervisor. (2025, October 28). Orientations on the use of generative AI and personal data protection (Version 2). https://edps.europa.eu/data-protection/our-work/publications/guidelines/orientations-use-generative-ai-and-personal-data_en

Flaherty, C. (2025, August 29). How AI is changing—not ‘killing’—college: Key findings from Inside Higher Ed’s student survey. Inside Higher Ed. https://www.insidehighered.com/news/student-success/life-after-college/2025/08/29/how-ai-changing-not-killing-college

Frey, C. B. (2019). The technology trap: Capital, labor, and power in the age of automation. Princeton University Press. https://doi.org/10.1515/9780691191959

Hill, K., & Valentino-DeVries, J. (2025, November 23). What OpenAI did when ChatGPT users lost touch with reality. The New York Times. https://www.nytimes.com/2025/11/23/technology/openai-chatgpt-users-risks.html

Huang, R., Yin, Y., Zhou, N., & Lang, F. (2025). Artificial intelligence in K-12 education: An umbrella review. Computers and Education: Artificial Intelligence. https://doi.org/10.1016/j.caeai.2025.100519

Humayoon, J. (2025). Rebuilding the foundations for the AI age: A policy framework for European education reform. Futurium, European Commission. https://futurium.ec.europa.eu/en/apply-ai-alliance/library/rebuilding-foundations-ai-age

Jaźwińska, K., & Chandrasekar, A. (2025, March 6). AI search has a citation problem. Columbia Journalism Review. https://www.cjr.org/tow_center/ai-search-has-a-citation-problem.php

Korinek, A. (2025). Generative AI for economic research: Use cases and implications for economists (NBER Working Paper No. 30957). National Bureau of Economic Research. https://www.nber.org/papers/w30957

Lee, V. R. (2025, September 29). What parents need to know about AI in the classroom. Stanford HAI. https://hai.stanford.edu/news/what-parents-need-know-about-ai-classroom

Lu, M. (2025, October 8). Rethinking student assessment in the age of AI. University World News. https://www.universityworldnews.com/post.php?story=20251007135323287

Luo, X., Wang, S., & Hew, K. F. (2025). Development and implementation of a Generative AI-based personalized recommender system to improve students' self-regulated learning and academic performance. Computers & Education. https://doi.org/10.1016/j.compedu.2025.105486

McGee, N. J., Kozleski, E., Lemons, C. J., & Hau, I. C. (2025). AI + learning differences: Designing a future with no boundaries. Stanford Accelerator for Learning. https://accelerator.stanford.edu/ai-learning-differences-white-paper/

Miao, F., Holmes, W., Huang, R., & Zhang, H. (2021). AI and education: Guidance for policy-makers. UNESCO. https://unesdoc.unesco.org/ark:/48223/pf0000376709

Michaelidou, A. (2025, October 16). Speech by the Minister of Education, Sport and Youth at the Conference "Artificial Intelligence and Education". Republic of Cyprus. http://enimerosi.moec.gov.cy/ypp19215a

Napkin AI. (2025). Napkin AI (Beta version) [Generative AI visualization tool]. https://napkin.ai

Ó Ceallaigh, T. J., Ergunay, O., Szplit, A., & van Beveren, P. (2025, October 7). Future-proofing teachers: The new essentials for an era of AI. European School Education Platform. https://school-education.ec.europa.eu/en/insights/viewpoints/future-proofing-teachers-new-essentials-era-ai

Ono, K. (2025). Why predicting problem difficulty is so hard [Interview transcript]. Epoch AI. https://epochai.org/blog

Purser, R. (2025, December 1). AI is destroying the university and learning itself. Current Affairs. https://www.currentaffairs.org/news/ai-is-destroying-the-university-and-learning-itself

Reich, J. (2025, October 3). What past education technology failures can teach us about the future of AI in schools. The Conversation. https://doi.org/10.64628/AAI.vvdntn96m

Retalis, S. (2025, October 19). Building AI literacy in education: Inside the AILit framework shaping education’s future. Medium. https://medium.com/@retaliss/building-ai-literacy-in-education-inside-the-ailit-framework-shaping-educations-future-191c0b3b3b3b

Salden, P. (2025, October 8). Universities need AI sovereignty to protect free thought. University World News. https://www.universityworldnews.com/post.php?story=20251007144809805

SURF. (2025). SURF tech trends 2026. https://www.surf.nl/en/themes/futuring/tech-trends

Teacher Task Force. (2025). Promoting and protecting teacher agency in the age of artificial intelligence: Position paper. UNESCO. https://teachertaskforce.org/knowledge-hub/promoting-and-protecting-teacher-agency-age-artificial-intelligence-quick-guide

UNESCO. (2024). Rethinking student assessment in the age of AI. https://www.unesco.org/en/articles/whats-worth-measuring-future-assessment-ai-age

Varga-Atkins, T., Saunders, S., Beckingham, S., Hartley, P., Keshishi, N., Lacković, N., Li, N., Lindsay, R., Wen, R., & Winder, I. (2025). Educators’ guide to multimodal learning and generative AI. University of Liverpool, Centre for Innovation in Education. https://www.liverpool.ac.uk/media/livacuk/centre-for-innovation-in-education/staff-guides/educators-guide-to-multimodal-learning-and-generative-ai.pdf

Watermeyer, R., Lanclos, D., & Phipps, L. (2025, October 1). AI won’t save higher education. It will further divide it. University World News. https://www.universityworldnews.com/post.php?story=20250930113203923

Wrzesinski, E. K. (2025). Navigating new technology: A phenomenological study into technology coaches' experiences during AI expansion in schools (Doctoral dissertation). Louisiana State University. https://repository.lsu.edu/gradschool_dissertations/6910/