The main goal of this study was to develop and validate an LLM-based framework for analyzing K-12 AI classroom instruction videos to gain insights into learning theories, pedagogical approaches, learning tools, and AI literacy outcomes.
Methods: The study analyzed 98 AI classroom instruction videos from Chinese K-12 schools using an LLM-based framework. This involved converting videos to text, using GPT-4 to analyze the content, and comparing results with manual analysis. The researchers also conducted statistical analyses and clustering to identify patterns in teaching approaches.
Key Findings:
- LLM-based analysis showed over 90% consistency with manual analysis
- Only 35.71% of lessons addressed higher-level AI skills like evaluation and creation
- AI ethics were covered in just 5.1% of lessons
- AI classroom instruction was categorized into conceptual (50%), heuristic (18.37%), and experimental (31.63%) types
- Combining Project-based/Problem-based learning with Collaborative learning was most effective for developing advanced AI literacy skills
Implications: The findings highlight significant gaps in current K-12 AI education practices, particularly in teaching advanced AI skills and ethics. They suggest a need for more balanced curricula and innovative teaching methods to enhance AI literacy.
Limitations: The study relied primarily on dialogue data, which may not capture all aspects of classroom dynamics. It also focused on publicly available videos, which may not represent the full spectrum of AI education approaches globally.
Future Directions: Future research should incorporate multi-modal data analysis, conduct longitudinal studies on AI literacy development, and explore ways to better integrate AI ethics and advanced skills into K-12 curricula.
Title and Authors: "Analyzing K-12 AI education: A large language model study of classroom instruction on learning theories, pedagogy, tools, and AI literacy" by Di Wu, Meng Chen, Xu Chen, and Xing Liu
Published on: September 17, 2024
Published by: Computers and Education: Artificial Intelligence