- insight in the visual scan pattern of pilots in training?
- objective information on pilots’ scan patterns to support training feedback and debriefing?
- to make the pilot’s scan pattern visible to them?
Pilots’ visual scan behaviour is an important aspect of flying and can be difficult to learn, especially for pilots in training for their first type rating. Some students require extra training because their scan patterns are incorrect. However, the current training instruments lack objective information about the pilots’ scan behaviour. Instructors can base their feedback only on the pilots’ movements, the results in the simulation, and by asking about flight parameters to estimate their scan behaviour. Available information about visual scan patterns remains subjective.
That’s why flight instructors want to observe the visual scan patterns of their students in real-time, in order to improve the training results.
We developed Augmented Eye, an innovative application which presents the pilot’s visual scan behaviour to the instructor. This shows the instructor in real-time what his student is looking at. The eyes of the students are being tracked with a device that is connected to the simulator, which makes the application non-intrusive for the pilot. The instructor receives this information either projected as an overlay on the physical world through Augmented Reality technology, or on a tablet. In this way, the pilot is not distracted by seeing his own scan patterns, but the instructor can still see everything he was able to see before, but now including the pilot’s visual scan patterns.
Using the Augmented Eye in your training can result in more efficiency (students learn faster) and effectiveness (improved scan patterns). Experienced instructors rated Augmented Eye highly and found it to be of significant added value to their training and feedback.
- We make the invisible visible
- Objective visual scan pattern information supports the instructor
- The presentation of the data can be tailored to the training scenario by using Learning Analytics
We are working on various options to extend the application and tailor it to your needs and preferences, e.g. tracking the eyes of both pilot and co-pilot, connect EEG to measure the pilot’s alertness, data processing, a debrief tool, connection with sim data, etc.
Interested in our vision about the future development? You can read our blog on putting innovation to work for real training needs.
Video Clips
Related Issues
- beginning pilots
- competency training
- enhance training efficiency pilots
- eye tracking in pilot training
- eye tracking in the cockpit
- flight simulator training
- HoloLens application
- innovative simulation training pilots
- neuroergonomics
- novice pilots
- pilot eye behaviour
- pilot gaze behaviour
- pilot visual scanning patterns
- student pilot