Eye Tracking: The Secret of Your Eyes

Did you know that with HMDs we can collect information about your eyes? Of course, this always happens with user consent: just read the legal statements carefully before starting an app! However, not all HMDs can gather this kind of information—it’s a matter of both software and hardware! Let’s delve deeper into it!

Depending on the model and brand of the HMD, several essential components are required:

• Infrared Cameras: These are integrated into the HMD around the lenses. They must be high resolution to capture accurate images of the eyes in real time.
• Infrared LEDs: These LEDs emit light that is imperceptible to the user but visible to the infrared cameras. The LEDs help the cameras capture the best images of the eyes.
• Real-Time Image Processor: This processor uses algorithms to identify and track the position of the pupils and the corneal reflexes in real time with low latency to ensure accurate results.
• Optomechanical and Lens Components: The lenses of the HMD should be designed to provide a clear vision. Some models can adjust the position of the cameras and LEDs to fit each specific user.
• Movement and Position Sensors: These sensors, although optional, are helpful for gathering additional information such as the position and movement of the HMD in the virtual environment.
• Calibration Interface: For more precise results, some HMDs include a calibration interface to adapt the technology to each specific user. When eye tracking is activated, the interface measures the distance between the pupils and requires the user to look at specific points on a 2D plane.

Some HMDs that have integrated eye tracking technology include the HTC Vive Pro Eye, Meta Quest Pro, and Varjo VR-3.

With the hardware, each model offers certain features that can be implemented into our applications. This is why it’s essential to check the hardware we are going to use, as some devices may not provide all the features we need. Let’s explore some uses:

• Data Collection: For research or marketing purposes, eye data can reveal where users are looking. This data is analyzed to draw conclusions in studies or improve the application and its usability.
• Types of Interaction: Similar to how controllers are tracked to know where you point and which button you press, the gaze can serve as a pointer to move objects, select options, teleport, and more. This also improves accessibility for people with motor disabilities.
• Foveated Rendering: This technique enhances graphic rendering by focusing high resolution on the area you are looking at, while rendering the peripheral areas at a lower resolution.

Now that you’ve seen the many uses of eye tracking, it’s time to consider if it’s safe for you as a user. It depends on the study or application, of course! However, whenever eye tracking is included, it should be stated in the legal documentation because eye tracking data can identify you, similar to an identification number! The study must have strict procedures to collect and analyze the data to avoid identifying you. So, don’t worry if the legal statements are correctly presented! Ultimately, you always have the choice because your eyes are yours!

If you are interested in how a proper study works, you can take a look at our study: “Towards Learner Performance Evaluation In Ivr Learning Environments Using Eye-Tracking And Machine-Learning”.

Have you ever used eye tracking in an application? Do you feel comfortable with this technology? Let us know in the comments!

#VirtualReality #VR #EyeTracking #HMD #EyeTrackingTechnology #FoveatedRendering #VirtualRealityResearch #AccessibilityInVR #InfraredCameras #MachineLearningInVR