The Small Business Innovation Research (SBIR) Phase I research project aims to create a toolkit embodying cognitive capabilities for use in developing intelligent agents. These agents would provide human-like interactions with software, for desktop productivity, research, and gaming domains, by observing human interactions with the system and mimicking those interactions. Current approaches for embedding intelligent agents such as finite state machines and rule-based systems are often limited by either brittleness, or by difficulties in knowledge engineering, or often by both. In contrast, state of the art cognitive modeling approaches combine symbolic rule-based approaches with numeric statistical machine learning techniques, and do so in a computationally scalable way. The specific research objectives are: 1) exploring variations in instance-based learning techniques and their ability to simulate human learning and their computational implications; 2) examining using an expert system to elicit knowledge and produce a task skeleton for organizing knowledge; 3) exploring plan recognition techniques for mapping a stream of human behavior onto the elicited task structure; 4) exploring the extraction of strong knowledge from segmented human performance data through statistical learning techniques; and 5) developing techniques for remediating developed systems so that deficiencies noted can be translated directly into improved agent behavior. The proposed toolkit will automate computer desktop tasks, thereby enhancing productivity, and will produce gaming agents without programming, thereby satisfying the need for greater numbers of robust, believable non-player characters. For the currently installed base of PCs is estimated at 898 million units, with yearly worldwide sales at 190 million units, and with the worldwide gaming market estimated at approximately $20 billion, the proposed work will provide easier automation - through observing competent behavior rather than through programming - to both of these markets. The proposed technology is applicable to other domains not addressed specifically in this proposal such as the assistive market to produce an assistant for the handicapped that learns typical sequences of interface actions and offers to complete those actions. Additionally, the technology can also aid in building training systems where the task is collaborative and the cost of using human team mates is prohibitive
