Systematic review reveals K-12 AI education evaluations predominantly focus on summative assessments of machine learning concepts in informal settings, highlighting the need for more comprehensive and early-stage formal education approaches.

Objective: To analyze and understand the evaluation approaches, learning outcomes, and methodological trends in K-12 AI education from 2013 to 2022.

Methods:

• Systematic review of 36 empirical studies
• Analysis focused on research methods, sample sizes, evaluation types, learning outcomes, and evaluation contexts
• Used Kitchenham's systematic review process comprising planning, conducting, and reporting phases
• Searched multiple databases including ERIC, Science Direct, ACM Digital Library, and IEEE Xplore

Key Findings:

• Most evaluations were summative and conducted in informal settings
• Focus primarily on secondary education (middle and high school)
• Heavy emphasis on machine learning concepts over other AI topics
• Predominant use of self-report surveys and quantitative methods
• Limited attention to early education stages and formal learning environments

Implications:

• Highlights need for more comprehensive evaluation approaches
• Suggests importance of introducing AI education earlier in formal settings
• Emphasizes necessity for diverse assessment methods
• Identifies gaps in current evaluation practices

Limitations:

• Limited timeframe (2013-2022)
• Some studies lacked specific details about AI technologies
• Focus mainly on informal educational settings
• Predominance of pre-experimental designs without control groups

Future Directions:

• Expand research to early learning stages in formal settings
• Develop more rigorous experimental designs
• Implement more qualitative and mixed-method approaches
• Broaden evaluation scope beyond machine learning concepts
• Create age-appropriate evaluation methods for younger learners

Title and Authors: "A systematic review of the evaluation in K-12 artificial intelligence education from 2013 to 2022" by Keunjae Kim and Kyungbin Kwon

Published On: March 31, 2024

Published By: Interactive Learning Environments