Improving the immersion in a virtual reality batting simulator with real-time performance capture and haptics

Abstract

This research is based on the design and implementation of a system that enables a player to engage in a virtual reality (VR) game with better immersion. The research was informed by the idea that real-time motion capture may improve the player’s immersion. Starting with the general topic on “Improving the immersion in virtual reality”, the researcher sought for ways to identify the problems with immersion that occur in VR. While playing VR games available in the market (during the year 2016), a common problem was observed: The user’s avatar (virtual agent) was not completely visible to the player as most of the games were played using controllers such as a head-mounted display and hand-held remote controllers with motion trackers. The tracking from these devices has limitations to generate real-time animation for the user’s virtual body. This research attempts to solve this problem by developing a technology to achieve full-body motion capture and establish performance capture in real-time within a VR game. This involves designing a system that utilizes effective technologies for 3D imaging and transmission with less latency and good haptic feedback. The research attempts to measure immersion by improving an existing measuring instrument (Witmer and Singer, 1998), that has been used by the US military, to measure the immersion by conducting experiments engaging humans to use the system. The research’s user-based studies involved collecting both qualitative and quantitative measures from 45 users in 2 phases of experimentation. Overall, it was found that the inclusion of performance capture has increased the immersion for the users.