Virtual-reality games to assess and habilitate auditory spatial awareness Auditory spatial awareness (ASA) is the critically important skill of using sound to understand extrapersonal space and its content. Both explicit (sound localization) and implicit (environmental awareness) aspects of ASA contribute to everyday listening, effort, fatigue, and spatial attention. Because hearing alone provides spatial information in all directions, ASA is critical for awareness outside the visual field and for the experience of sensory immersion in both natural and virtual scenes. Self-report studies suggest that hearing impairment, aging, and device use can negatively impact ASA, but the current lack of tools for objective psychophysical assessment in realistic spatial scenes remains a significant barrier to progress in this area. This Phase I STTR proposal tests the feasibility of using virtual-reality (VR) technology to quantify ASA in simulated but perceptually immersive auditory scenes. Software for 3D audio rendering over earphones and over loudspeaker arrays will be modified to work with established psychophysical paradigms in order to assess listeners sensitivity to room acoustics and to changes in dynamic auditory scenes. Psychophysical measures will be presented in the context of a simple VR game using a high-frame-rate head-mounted display that tracks head movements in real time. Behavioral testing will involve both earphone and free-field presentation. Earphone testing will present spatial sound in rendered 3D space using VisiSonics RealSpace 3D software. A commercial advantage of the earphone-based approach is its low cost of implementation in standard research and clinical facilities. In contrast, free-field testing will use a high-resolution loudspeaker array to provide naturally accurate spatial cues for each listener. This approach will eventually facilitate testing with hearing aids and cochlear implants that may not be compatible with earphone presentation. If successful, the technology developed via this proposal will ultimately provide quantitative psychophysical measures (e.g., thresholds) of ASA for comparison across diverse pediatric and adult patient populations, across signal processing algorithms for hearing aids, cochlear implants, and 3D audio technology, and across time points in longitudinal studies of ASA habilitation in neurological and audiological patients. Work in Phase II will develop a commercial prototype suitable to such applications and assess performance across diverse populations of listeners. Commercial impact is anticipated in clinical settings, in the design and evaluation of clinical devices, and in perception research for basic science, entertainment, and gaming itself.
Public Health Relevance Statement: Auditory spatial awareness (ASA) is the ability to use sound to understand the space around a listener, and is a vital component of situational awareness. Because ASA involves the perception of natural scenes that are difficult to study in laboratory experiments, its characteristics, development, and pathologies remain poorly understood. This Phase I proposal develops virtual-reality technology that will allow objective measurement of ASA in simulated but realistic auditory scenes.
Project Terms: Acoustics; Address; Adult; Aging; Algorithms; Area; Attention; Auditory; auditory processing; Awareness; base; Basic Science; behavior test; Bilateral; Characteristics; Childhood; Clinical; clinical application; Clinical assessments; Clinical Treatment; Cochlear Implants; Complex; Computer software; Conductive hearing loss; cost; Cues; Custom; design; Development; Devices; Environment; Excision; experience; experimental study; Fatigue; field study; Foundations; Future; game development; Goals; Habilitation; Head; Head Movements; Hearing; Hearing Aids; hearing impairment; Hybrids; Immersion Investigative Technique; Impairment; Individual; Injury; Knowledge; Laboratories; laboratory experiment; Longitudinal Studies; Measurement; Measures; Modeling; multisensory; Neurologic; Participant; Pathology; patient population; Patient Self-Report; Patients; Perception; Performance; Phase; Population; Population Heterogeneity; Procedures; prototype; Psychophysics; Recording of previous events; Research; research clinical testing; Resolution; Sensory; signal processing; skills; Small Business Technology Transfer Research; sound; Sound Localization; Source; Stimulus; System; Technology; Testing; Time; tool; Validation; virtual; virtual reality; Visual Fields; Work; young adult
