Disney experiment lets you catch real objects in virtual reality8 months, 2 days ago
We’re still getting used to the immersive magical virtual reality offers, but a new experimentation from Disney Research pushes the technology into another realm: interaction with real objects while in VR.
A demonstration of the experiment was disclosed on Monday via video( below) that shows a VR headset wearer accurately catching a real ball thrown at him. However, the VR headset wearer can’t see the real ball. Instead he’s reacting to a virtual ball that is tracked to correspond to the real-world object.
The tracking was achieved use the OptiTrack Flex 13 motion capture camera, which tracked the ball as well as the catcher’s hands and head at approximately 120 frames per second. Although it’s not readily apparent in the video, the hardware is an Oculus Rift headset and the team used Unity software to render the virtual surrounding.
“While small latencies exist in our system and objects such as the user’s hands are rendered abstractly, our system allows users to be quite adept at catching balls while in VR, ” reads Disney Research’s paper[ PDF] that lays out the detailed proof of theory. “Thus, combining virtual and physical dynamic interactions to enrich virtual reality experiences is feasible.”
This kind of experimentation using real objects in combination with VR is on the rise, most recently with the emergence of HTC Vive trackers, which can be affixed to real world objects.
Although Disney Research doesnt theorize on what else is likely to be utilizing this method, it’s not hard to imagine future VR team games, interactive presentations and even educational applications that use real world objects.
Or, dare we dream, maybe even some Star Wars pertained mixed reality experiences in the future. Jedi developing anyone?
And if you really want to go long on futurecasting, this may also be an early look at a real Star Trek holodeck, a fictional room that allows users to feel real impacts from virtual objects.
Whether we get there through haptic feedback suits, real world object tracking, or perhaps a combination of the two, Disney Research’s experimentation is yet another indication that we’re just at the beginning of a number of exciting experiments in VR that may help it become, as many are predicting, the final computing platform.