Challenges

Camera accessibility on Meta Quest Pro

Figure shows the photo captured on headset using unity class – screen capture. Extracted from the localhost server, showing incapability of capturing AR environment over headset.

The camera quality and computational power of the Meta Quest Pro headset are crucial for the application’s performance. While preliminary testing has been conducted, the hardware’s performance remains uncertain. Due to potential hardware limitations and privacy concerns arising from global data privacy trends, Meta has not yet released the camera’s specifications and accessibility to developers. This presents a significant limitation for the development of the AR recognition. Therefore, the team will explore alternative solutions to optimize the application’s performance, such as reducing the quality of 3D models or utilizing external cameras for AR features.

Evolving Nature of VR/AR/MR Technologies

The second challenge stems from the dynamic nature of VR/MR/AR technologies. The team has faced difficulties due to the deprecation of several packages and libraries, some of which are essential components of Unity, for instance the frequent changing of Hugging Face API for input/output format of the text request and response. This has significantly hindered progress and could affect the software’s durability and marketability. In response, our team plans to restructure the system into a modular format. This modular approach will facilitate seamless updates and adaptations, allowing for more resilient development in response to future changes in technology and the deprecation of used packages and tools.