VR based training systems have the advantage of being portable, deployable and reconfigurable and can thus provide effective training in the field where itÂ’s most needed. Regrettably, these systems have not yet been shown to be effective in providing positive training transfer in real world applications. Analysis of such systems suggests that in order to be effective, they must fully integrate the wide range of sensory cues associated with performing complex tasks. The objective of this effort is to develop the requisite science and technology for incorporating effective auditory cues in VR based training systems. Through the application of rigorous experimental research, an auditory display science will be established providing guidelines for auditory scene design. These guidelines will establish best practices in the use of real auditory cues, metaphoric cues and also will also establish fidelity requirements in order to maximize training effectiveness. Technology development will provide the capability to encode these best practices into auditory scene design tools for VR based training systems. The tools will enable personnel in the field to develop training scenarios in an interactive, guided process that ensures that best practices in auditory scene design are adhered to so that the training effectiveness is ensured.
Benefit: Properly designed spatial audio displays are an important component in creating effective training simulation systems. However, there are practical difficulties involved in deploying such systems in operational settings. One important problem is providing the capability for personnel to adapt auditory cues in order to contextualize content while still maintaining good auditory design. This is important because trainers require the capability to modify training scenarios by customizing the content. Unfortunately, good auditory display design requires specialized knowledge that is not readily available in the field. Another problem is that, unlike visual displays, the performance of a spatial audio display system is affected by individual differences among listeners due to variations is physiology and localization ability. Auditory displays must therefore be individualized for each listener. Current techniques for doing this require specialized equipment, anechoic conditions and a significant amount of time making them impractical for real-world use. The proposed optimized auditory display technology promises to address these problems and enable the widespread use of spatial audio displays in training simulation systems. The proposed approach will enable the encoding of empirically validated, auditory scene design best practices into an auditory scenario design tool. This will, in effect, create a direct path for the knowledge gained from experimental study in training effectiveness to be directly incorporated into training simulation systems. The problem of listener individualization will also be addressed through the use of a best-fit display customization technique. Display performance will be optimized for a specific listener by modifying display parameters. The process will require no specialized equipment and will take 5-10 minutes to complete.
Keywords: Virtual Reality, auditory display, Training, CQB for MOU