The advancement of aircraft ISR, threat detection and targeting sensors, has complicated the cockpit pilot demand to effectively utilize the information. ?New display technology integrated into the pilots helmet enables effective situational awareness through virtual displays and applied overlays. ?However, such displays require accurate and low-latency helmet orientation measurements. ?Systems which are easily adaptable to various helmets and aircraft are essential for broad military use. The Adsys Controls Cockpit Passive Optical Helmet Tracker (CPOHT) does not involve any substantial modifications to the helmet, or mounting of any additional electronic components and sensors, and can be used with any helmet on the market. CPOHT passive tags applied to the helmet and cameras mounted in the cockpit. The proposed system addresses such challenges as image ambiguity (data association), cockpit mounting and environment constraints (camera locations, choice of lens, tag locations on the helmet, etc.), and system calibration. Our approach provides disambiguation which enables unique and reliable identification of the helmet mounted tags. Image processing will be performed leveraging our existing video processing capabilities allowing for low-latency computation with minimal system impact to the aircraft.
Benefit:The CPOHT system will provide a low-cost solution for a broad range of vehicles, helmets and mission sets enabling next generation cockpit situational displays. ?In addition to military applications, the proposed technology can be utilized in commercial and law enforcement applications (e.g. directing gimbaled video equipment line of sight, search spot light, general inexpensive HMD applications, such as Google Glass or Epson Moverio), augmented virtual reality (VR) systems including videogame and entertainment industry, training, architectural design, and medical applications. The technology can also be directly applied to a general object orientation tracking and be used in targeting systems and other similar applications requiring object attitude knowledge.