Mixed Reality for Learning Programming


Project Description

We are a group of undergraduate researchers from Georgia Tech leveraging mixed reality (MR) to help students learn coding more easily and with more fun. We have developed an MR coding learning platform (currently implemented using Apple’s ARKit 2 on iOS), with a physical user-configurable coding game board. Our preliminary results demonstrate a strong potential for our research ideas.

Our approach could provide major benefits over conventional augmented reality (AR) approaches for learning coding and debugging:

  1. allowing teachers to tailor the platform to their instructional needs, and spark creativity and engagement among students in designing programming problems that interest them;
  2. enabling students to physically interact with a program, concretizing coding errors and providing real-time visual feedback to aid students’ program understanding and reduce cognitive load.


Joonyoung Kim, Sudeep Agarwal, Kristina Marotta, Siwei Li, Jonathan Leo, Duen Horng (Polo) Chau
"Mixed Reality for Learning Programming" Proceedings of the 18th ACM Conference on Interaction Design and Children, Jun. 2019.
🏆Honorable Mention
Nathan Dass, Joonyoung Kim, Sam Ford, Sudeep Agarwal, Duen Horng (Polo) Chau
"Augmenting Coding: Augmented Reality for Learning Programming" Proceedings of the Sixth International Symposium of Chinese CHI Pages 156-159, Apr. 2018.
🏆Best Poster


Next Steps

Media Coverage


Joonyoung Kim

Sudeep Agarwal

Kristina Marotta

Siwei Li

Jonathan Leo

Polo Chau