SBIR-STTR Award

Our Fused-Realities-Assessments-Modules (FRAM) as self-contained deployable add-ons enables innovative new levels and types of automated quantification strategies for combining human and system performance in real-time for fused performance monitoring and after-action-review purposes. FRAM accomplishes this by fusing output of normative models of behaviors (cognitive/procedural/team), human states (affective/physiological/brain-computer-interfaces/Neuroergonomics), system states (operational vehicle states and/or simulation models), and contextual situation states (live/virtual/constructive/serious-game scripts/scenarios). FRAMs novel model captures differences in cognitive and procedural behaviors by innovative conceptualizations that extends and evolves Mission-Essential-Competencies (MECs) and Principles of Performance Measurement (Dwyer and Salas 2000) constructs by evolving validated team performance measurement models and methods to include the air-platform system itself as a pseudo team member 0x9D ! We posit that many of the current validated team training models and methods that hold air-platform systems as a constant, can be extended and evolved by allowing the air-platform systems to be varied and objectively measured within military requirements constructs similarly to other human team members. Adverse air-platform system traits manifest analogously as team weaknesses; which can be identified, documented, and corrected early in development cycles, saving lives, increasing effectiveness, increasing ease-of-use across a range of skill-levels, and providing multiple levels and types of extensive cost savings.

Benefit:
Our Fused Realities Assessments Modules (FRAM) are self-contained deployable add-ons modules designed for use with operational systems and simulation systems to enable automation of combined human-systems performance assessments on the basis of intelligently fused sources of real-time information derived from normative behavior models, the human operator, the system, and the situational context. -- Anticipated benefits and advantages include but are not limited to: -- * -- FRAM enables generation of detailed and easy to understand records of test sorties so that potentially adverse system traits can be identified, documented, as well as identification and documentation of successful combined human system level synergies that can be exploited to the advantage of our warfighters. * -- FRAM as part of well designed simulation based acquisition, test and evaluation, and experimental R&D processes provides the foundational basis for scientific predictions on how adverse traits, if left unmitigated, could affect system performance in operational tactical environments with normal fleet user characteristics. * -- FRAM Product Level Support for Military Users including QuickStart Chart, User and Developer Level Documentation along with Tutorials, Use Case Histories ,and Success Templates to aid in wide scale use of FRAM end to end for concept to operational fielding and reused during upgrades. * -- FRAM is envisioned to provide dramatic enhancements for UAV and UCAV simulation based design and development processes for new platforms, and for upgrades to existing UAVs, UCAVs, and manned aircraft. * -- FRAM deployment and commercialization models includes Royalty Free Use by Government Labs and Organizations along with submission as candidates Standards for IEEE and other appropriate organizations towards supporting OpenSource Standards and Use; * -- FRAM enables dual uses beyond our primary military goals for air platform military users to non-military commercial application opportunities for combined human-system testing of operational systems industrial settings such as automobiles, aircraft, information systems, and consumer products;

Keywords:
Brain Computer Interfaces, Brain Computer Interfaces, Human State Data, , distributed systems, Automatic Performance Assessment, Normative Behavioral Models,, Human-Systems , After Action Review, Operational Systems

Our Fused-Realities-Assessments-Modules(FRAM) enables innovative new levels and types of automated quantification strategies for combining human and system performance in real-time for fused performance monitoring and after-action-review purposes. FRAM accomplishes this by fusing output of normative models of behaviors (cognitive/procedural/team), human states (physiological/affective), system states (simulation models and/or operational vehicle states), and contextual situation states (live/virtual/constructive/serious-game scripts/scenarios). Innovatively all of the monitored states data streams can be visualized and analyzed separately, and/or grouped and customized for specific assessments. Our scientific combined model is technologically implemented on Commercial-Off-The-Shelf (COTS) laptops/tablets with inexpensive COTS sensors, along with innovative translation and interface software modules between the operator controller interface and the virtual simulation environment (or operational system). FRAMs modular architecture enables technological customizations as an add-on self-contained deployable suite to existing simulations, serious-games, and operational systems. FRAM transition priorities include automated combined human and UxV system interfaces performance assessments capacities added onto existing popular open-source advanced simulations enables objective assessments for best-of-breed 0x9D interface selections, along with future evolutions of the UxV operator controller interfaces. After ensuring the validity of our combined model assessment science in militarily relevant scenarios, we envision supporting parallel evolutions of standards and associated human training for all UxV interfaces.

Benefit:
Our Fused Realities Assessments Modules (FRAM) are self-contained deployable add-ons modules designed for use with operational systems and simulation systems to enable automation of combined human-systems performance assessments on the basis of intelligently fused sources of real-time information derived from normative behavior models, the human operator, the system, and the situational context. Pragmatically, our Phase-II technology transition efforts are configured as a FRAM suite for UxV operator controller interface assessments and support for evolutions. -- Anticipated benefits and advantages include but are not limited to: -- * -- FRAM is envisioned to provide dramatic enhancements for UGV, UAV and UCAV simulation based design and development processes for new platforms, and for upgrades to existing and new UGV, UAVs, UCAVs, and manned aircraft, ground vehicles, and others. Sequentially, FRAM UxV suite applications includes empirical research towards scientific objective selections between existing operator control interfaces for controlling SUAS, UGV, and Unattended Sensors; optimization of interface display options; and iterative agile developments supportive of assessments of hybrids and evolutions for human-robotic interfaces. * -- FRAM as part of well designed simulation based acquisitions, tests and evaluations, and experimental R&D processes provides the foundational basis for scientific predictions on how adverse traits, if left unmitigated, could affect system performance in operational tactical environments with normal fleet user characteristics. * -- FRAM enables generation of detailed and easy to understand records of test sorties so that potentially adverse system traits can be identified, documented, as well as identification and documentation of successful combined human system level synergies that can be exploited to the advantage of our warfighters. * -- FRAM Product Level Suite Support for Military Users including QuickStart Chart, User and Developer Level Documentation along with Tutorials, Use Case Histories ,and Success Templates to aid in wide scale use of FRAM end to end for concept to operational fielding and reused during upgrades, and new systems development. * -- FRAM deployment and commercialization models includes Royalty Free Use by Government Labs and Organizations along with submission of selected software constructs as candidates Standards for IEEE and other appropriate organizations towards supporting OpenSource Standards and wide spread use; * -- FRAM enables dual uses beyond our primary military goals for SUAS, UGV platform and unattended sensor military users to non-military commercial application opportunities for combined human-system testing of operational systems and industrial settings inclusive of automobiles, aircraft, information systems, and consumer products.

Keywords:
Information Systems, Human State Data, distributed systems, Human Systems , After Action Review, Air Platform, Normative Behavioral Models, Automatic Performance Assessment, Operational Systems