Current multi-touch pressure sensitive Commercial Off The Shelf (COTS) hardware and software (e.g., Apple iPhones, Android Phones, etc.) allow users to seamlessly interact with software applications using gestures, but underutilize their potential by only employing a limited set of Human Computer Interactions (HCI) (e.g., panning, zooming, etc.) Multi-touch pressure sensitive hand movements, hereafter called gestures, combined with real-time physics can result in more realistic and intuitive software applications. JHTs goal is to research, define, and develop reusable real-time physics, navigation, and meta gestures API software and standards for use in training, simulations, architectural design, and entertainment software applications on COTS multi-touch hardware.
Benefit: JHT anticipates the exploratory study will clearly define parameters and metrics to develop a reusable real-time gestures API. The most substantial benefits of the effort are determining the feasibility of our approach to provide intuitive and reusable HCI for users, reduce training gaps and costs for expensive operator and maintenance equipment training, and expand accessibility to these technologies for training, simulation, architectural design, and entertainment software applications. We also anticipate benefits beyond those realized by current gesture methods and expect this program will provide a path forward to create the next frontier of innovation in the HCI field. Simulation of equipment for training in various industries is becoming a necessity to provide a scalable solution reaching a larger audience at cost effective rates. This market spans numerous industries requiring operator and maintenance training solutions including defense, energy, education, industrial production, communications, and transport. Developing and commercializing proposed gestures API for games would provide new/expanded experiences for users that anticipate evolution beyond mouse, keyboard, and the limited set of available gestures. Games could be developed in-house using the gestures API and sold as products or game companies could purchase licenses for the gestures API to enhance existing and new titles.
Keywords: multi-touch, pressure sensitive, Meta-gesture physics, Navigation, meta gestures API, and pressure sensitive.