Analyzing Strategies in MATHia with BERT

Academic Article

Examines how students choose and adapt math strategies in MATHia, using BERT-based analysis to better understand successful and unsuccessful strategy use.

Visit Resource
This link will take you to an external website.
Purpose/Abstract

Understanding how students use math strategies is important to help us build tools and techniques that improve cognitive flexibility in students, i.e., to select strategies that are appropriate and efficient for a problem. In this work, we focus on instructional content within MATHia, where students choose between strategies that were previously taught to them independently. Some problems favor one strategy over the other, giving us the opportunity to understand how/if students learn to pay attention to problem characteristics that suggest one strategy over the other. Using data from over 600 schools, we show that students find it hard to adapt their strategies to suit a problem. Further, we learn a BERT model to learn embeddings for strategies, develop a prediction task to distinguish between successful and unsuccessful strategies, and analyze its results to reveal deeper insights into student strategies.

Citation
Magar, A.T., Fancsali, S.E., Rus, V., Murphy, A., Ritter, S., Venugopal, D. (2025). Analyzing Strategies in MATHia with BERT. In: Cristea, A.I., Walker, E., Lu, Y., Santos, O.C., Isotani, S. (eds) Artificial Intelligence in Education. AIED 2025. Lecture Notes in Computer Science, vol 15882. Springer, Cham. https://doi.org/10.1007/978-3-031-98465-5_15

Areas researched: Student Learning, AI

Previous
Previous

Why Khan Academy will be using “skills to proficient” to measure learning outcomes (and you should too!)

Next
Next

A Progress Report & Roadmap for A/B Testing at Scale with UpGrade