This proposal presents a unique technical opportunity for NAVSEA to build on an existing body of knowledge to create both metrics and the quantifying techniques used to assess model performance. DDI has pioneered the development of complex dynamic simulation models for the USN over the past eight years, many under the SBIR program. During this time, DDI has often provided V&V assurances to its software users as well as examined third-party software developed by others, including client-server applications. DDI's strength, however, lies in its extensive experience in judging the validity of complex models and modeling systems and in its experience in the development of metrics for the most complex type of simulation models, those involving multiple, non-linear feedback relationships with multi-variable interdependencies. DDI intends to apply its expertise into the development of a method for determining and describing the degree to which intricate simulations emulate reality. DDI will categorize specific purposes for model use; identify critical aspects models must satisfy for validity; and, define metrics to measure model performance. In addition, DDI will identify potential approaches for quantifying model performance against such metrics and demonstrate how at least one of the approaches might be applied in practice.
