The main goal was to develop and validate an AI literacy diagnostic tool for elementary school students while establishing a framework for AI literacy content in K-12 education.
Methods:
- Developed an AI literacy content framework through literature review and expert Delphi validation (n=15)
- Created 24 modular questions based on the framework
- Conducted two rounds of expert content validation (n=15)
- Tested the tool with 287 sixth-grade students initially
- Conducted additional testing with 293 sixth-grade students after modifications
Key Findings:
- Developed a reliable AI literacy assessment tool with high internal consistency (KR-20 score > 0.81)
- Created a comprehensive AI literacy framework covering three major areas: understanding AI concepts, understanding how AI works, and understanding AI ethics
- Female students showed higher AI literacy scores than male students
- The tool demonstrated good content validity and appropriate difficulty levels for elementary students
Implications:
- Provides an objective measurement tool for AI literacy
- Helps identify students' knowledge gaps in AI education
- Supports curriculum development and educational policy decisions
- Enables targeted improvement of AI education programs
Limitations:
- Limited question types due to platform constraints
- Unable to establish applicable cut-off scores
- Cannot fully measure all aspects of AI literacy, particularly software-related skills
- Focus primarily on knowledge-based assessment
Future Directions:
- Develop Computer Based Test (CBT) versions of the tool
- Research more universal and general AI literacy measures
- Create analytical dashboards for result visualization
- Study educational methods to utilize diagnostic results effectively
- Develop learning content based on diagnostic results
Title and Authors: "Developing an AI literacy diagnostic tool for elementary school students" by Kimin Chung, Soohwan Kim, Yeonju Jang, Seongyune Choi, and Hyeoncheol Kim
Published On: October 3, 2024
Published By: Education and Information Technologies