TERI will develop and demonstrate a Transportable Multi-Modal Interface Device (TM2ID) that provides the soldier enhanced operational capabilities as part of the Objective Force, including the Future Combat System (FCS) and Objective Force Warrior programs. This TM2ID will be capable of field mission planning and rehersal as a lightweight, portable computing device similar to the OFW Soldier Land Warrior (LW) System. TERI proposes an interface that uses speech, eye-gaze, display and 3-D audio technologies without adding additional weight or bulky add-ons to a commercial handheld computer. The unit provides a set of interactive multi-modal interfaces for high level commands and interface bandwidth to communicate commands, conduct training, situation awareness and mission planning. Phase I objectives include an engineering design and feasibility demonstration of key technologies for the TM2ID. In order to support a higher level of soldier performance, these technologies will exploit Embedded Training (ET) as a means of soldier enhancement. This research effort will mature several technology breakthroughs as an enhancement to natural language speech and understanding linguistics that permit the soldier to perform the mission functions projected in the future Objective Force Warrior (OFW) with a TM2ID. These mission functions include the C3 required for mounted and dismounted tactical: situation assessment (enemy and friendly), planning, execution, status reporting, location reporting, synchronized action, reconnaissance and physical/psychological well-being. Innovative use of voice technology is integrated with intelligent Tactical Operation Aids (TOAs) to overcome error and coordinate the Multi-Modal Interface (MMI) components to improve situation awareness and computing device control. This intelligent interface approach responds to the "intent" of the warrior, so that his mission tasks can be attended without restricting his posture, movement, effectiveness, efficiency or lethality in dynamic mission environments. Speech, auditory, touch and visual I/O is to be seamlessly incorporated with the TM2ID, using intelligent TOAs, providing a cooperative modality that is user friendly and intuitive. A common universal interface architecture will be integrated among the TM2ID components and Embedded Training applications, to offer a Joint Technical Architecture-Army (JTA-A) and commercial compliant solution. Both commercial civilian and military users are awaiting the next generation TM2ID that incorporates the best features of lightweight, low power handheld computing devices with advanced hands-free multi-modal interface options such as speech, facial movement and 3-D audio technologies. The first product will be an integrated handheld TM2ID with advanced mission planning, automatic information push/pull, and MMI component features that will significantly help the field soldiers decision making capabilities. The unit will take advantage of research results from Phase I and II to provide the most advanced display, speech and audio functionality providing sight, sound and voice integrated modalities
