Our inspirations

Background

In 2022, the introduction of ChatGPT [1], a conversational AI chatbot, marked a significant milestone in the development of Large Language Models (LLMs), fostering rapid progress in this field [2]. The accessibility of these models has been further enhanced by platforms such as Hugging Face [3], which provides APIs facilitating the integration of AI chatbot into various applications. These integrations have significantly improved user experiences by enabling real-time feedback and interactive learning. Simultaneously, extended reality (XR) technology has gained considerable attention, with major companies like Meta and Apple investing heavily in VR/AR/MR technologies [4]. Market analyses predict a compound annual growth rate of approximately 30% for mixed reality headsets by 2030 [5], suggesting a future where these technologies become affordable for widespread use. This backdrop sets the stage for our project to explore the viability of a mixed reality application that offers an immersive and interactive spatial experience.

Motivation

During the COVID-19 pandemic, mandatory home confinement disrupted traditional educational environments, compelling students to transition to online platforms like Zoom [6] for their studies. This shift highlighted significant challenges in student-teacher interactions, notably the online interaction are limited to verbal and visual. Other interaction such as motion were not feasible. These barriers significantly hindered effective learning. While the market offers numerous applications tailored for corporate use, such as Microsoft’s Dynamics 365 Remote Assist [7] for remote technical support and training, Microsoft Mesh [8] for collaborative spaces, and Varjo Reality Cloud [9] for 3D object interaction in product design and engineering, educational sectors have seen limited development in interactive learning technologies. This project seeks to fill this gap by providing an immersive and interactive educational tool that ad- dresses the unique needs of remote learning environments. By leveraging mixed reality technology, the application aims to improve accessibility and foster a more engaging online educational experience.