Updated 08:47 PM EDT, Wed, Apr 24, 2024

NASA Uses Kinect, Oculus Rift to Control Robots

  • +
  • -
  • Sign up to receive the lastest news from LATINONE

NASA is using technology available to gamers as a way to control a robotic arm, exhibiting how the advanced technology found in video game systems can be used for practical applications.

In a video posted by NASA's Jet Propulsion Lab, a technician is shown controlling a robotic arm using the Xbox One Kinect along with the Oculus Rift VR headset. NASA claims that the Human Interfaces Division of the Jet Propulsion Lab found a way to combine the two devices to use them to operate the robot successfully:

"Using the new Xbox One Kinect sensor, we are able to manipulate the JACO robot arm in real time. By combining position tracking from the Kinect and rotational tracking with the Oculus, we provide a first-person view for the operator," explains NASA. 

In the video, a NASA engineer is seen wearing the Oculus Rift, using it along with the Kinect to control a robotic arm to pick up a block. This is much more efficient than using a traditional rig for controlling robots. The Oculus Rift uses first-person perspective for operators to increase accuracy, as well as motion controls so that the robotic arm can mimic the operator's arm. NASA also revealed how this unique setup could be applied in future research, including work done on the International Space Station:

"Future work will include integrating sensor array data into the scene and translating our research to the Robonaut 2 humanoid on the International Space Station."

NASA also explained how present robotic technology can suffer from delays due to the long distances between the robots and the operators. This new system can reduce that delay as well as get rid of unpredictable actions by the robot in use, according to NASA.

"Traditional control systems become unpredictable and unresponsive in the presence of time delay ... Our system decreases perceived time delay by allowing the user to control the spacecraft at a predicted future state. By predicting and displaying a range of expected future states, safe operation is possible within the modeled uncertainty of the spacecrafts' behavior."

It will be interesting to see if regular video gamers are able to unlock the ability to use the Kinect and Oculus Rift to control machines and possibly create a new type of game where players control a robot using motion controls. Perhaps a new generation of Battlebots will come from this breakthrough.

© 2015 Latin One. All rights reserved. Do not reproduce without permission.
  • Sign up to receive the lastest news from LATINONE
Close

Curiosidades

Real Time Analytics