A Progress Report & Roadmap for A/B Testing at Scale with UpGrade
This paper serves as a progress report and roadmap for UpGrade, an open source A/B testing platform for digital experimentation in educational technologies. The UpGrade roadmap focuses on reducing barriers to user onboarding and rapidly providing value to the learning engineering community by leveraging existing technical standards. We briefly describe UpGrade, lay out our roadmap, and discuss several planned UpGrade features. We intend for this paper to spark discussion and feedback from the learning engineering community as to course corrections for the roadmap, standards that can be fruitfully leveraged, and features that would enable more educational technologies to rigorously, experimentally test product improvements and evaluate educational effectiveness.