Gwangju Institute of Science and Technology and MIT Researchers Develop a Natural and Comfortable “Seamless-walk” Virtual Reality Locomotion System

Urban real-world environments have limited physical space for foot-based locomotion and present challenges to natural VR locomotion (since virtual environments are much larger than the corresponding real-world environment), a fact that has been noted in past studies (Mandal 2013; Pai and Kunze 2017). To compensate for this challenge, efficient virtual reality (VR)-based locomotion techniques have been proposed to enable natural and immersive locomotion experiences akin to walking in large, virtual environments. However, the VR locomotion systems often require attaching an equipment to the body or video-recording the user’s body pose. This leads to discomfort caused by equipment size and discontinuous adjustment as well as privacy concerns related to capturing the entire body without blind spots. Against this backdrop, researchers from Gwangju Institute of Science and Technology (GIST), Korea in collaboration with researchers from Massachusetts Institute of Technology Computer Science and Artificial Intelligence Laboratory (MIT CSAIL), USA developed a novel foot-based VR locomotion system, called “Seamless-walk,” that offers a more natural and comfortable locomotion experience without requiring the use of any walking equipment or a video of the user’s body pose during walking or interaction with objects using their hands.

In their recent article published online on 17 January 2023 in the journal Virtual Reality, the researchers, led by Dr. Kyung-Joong Kim, Associate Professor at GIST, have detailed the development of the VR locomotion system. “When we started collaborating with MIT, they introduced an interesting new sensor called the ‘intelligent carpet.’ In our view, it was a great opportunity as well as a challenge for us since it had not been developed for any specific application. Therefore, we wanted to make something practical and interesting with this sensor and our AI technology,” explains Dr. Kim. “Accordingly, we decided to develop a VR game controller with the ‘intelligent carpet’ sensor that would be useful in VR gaming.”

Latest Insights: The Metaverse as the Great Diversity Experiment

“Seamless-walk” has both immediate and long-term potential applications. “In the long run, we believe that our technology could be used in healthcare. ‘Seamless-walk’ is not only a VR gamepad but also a gait recognition and analysis method,” says Dr. Kim.

Seamless-walk works in the following manner: the intelligent carpet captures high-resolution foot pressure imprints in real time as the user moves around by measuring the applied pressure through resistance changes. The footprint information is then fed into a machine learning model that extracts the strong pressure points using a technique called “K-means clustering.” In this method, the pressure points are divided into two clusters, corresponding to the user’s left and right feet. From these clusters, the user’s body direction and foot intervals are then extracted to estimate the angle and movement speed.

Moreover, Seamless-walk has a modular structure that enables a scalable and inexpensive installation of a touch sensing platform. The team conducted tests on 80 individuals using Seamless-walk in a 3D virtual world exploration game, demonstrating that the novel technology of the system guarantees an immersive, natural, and comfortable experience. At the same time, it does not compromise the overall VR experience, outperforming existing VR locomotion methods.

AiThority: The Use of AI in Hollywood

[To share your insights with us, please write to sghosh@martechseries.com]