Multi-agent control and intelligent sensor allocation with Genetic Programming and Reinforcement Learning
Award last edited on: 3/15/2007

Sponsored Program
Awarding Agency
DOD : Navy
Total Award Amount
Award Phase
Solicitation Topic Code
Principal Investigator
Paolo Gaudiano

Company Information

Icosystem Corporation

10 Fawcett Street
Cambridge, MA 02138
   (617) 520-1000

Research Institution

Massachusetts Institute of Technology

Phase I

Contract Number: N00014-02-M-0266
Start Date: 7/1/2002    Completed: 2/1/2003
Phase I year
Phase I Amount
The US Navy has identified the need to develop quantitative frameworks to solve a variety of challenging problems, including sensor management and allocation, and adaptive flight control of Unmanned Air Vehicle (UAV) swarms. In collaboration with the MIT AI Lab, we propose to develop a framework that combines Reinforcement Learning (RL) and Genetic Programming (GP) to evolve adaptive solutions to these problems. The RL+GP framework will scale up to realistic problems, and will be analytically tractable. The proposed framework will also make it possible to conveniently incorporate domain-specific information, giving it the capability to develop "customized" solutions to each problem at hand. We will also develop an Agent-Based simulator of swarms of UAVs, and use the simulator as a testbed for the RL+GP framework. The simulator will allow testing of various sensor configurations, specification of UAV missions, and will include the ability to simulate a variety of normal and adverse scenarios. The simulator will also serve as a tool for visualization and for quantitative evaluation of the proposed framework or other flight control and sensory allocation technologies. The RL+GP framework combines the power of learning and of evolutionary computation, but is analytically tractable and simplifies the process of encoding domain information, more so than other adaptive frameworks. Coupled with the Agent-Based UAV simulator, we expect this framework to be applicable to a wide variety of problems of military and commercial interest.

Genetic Programming, Agent-Based Modeling, Swarm Intelligence, Evolutionary Computing, Reinforcement Learning, Sensors, Uav, Distributed Contro

Phase II

Contract Number: ----------
Start Date: 00/00/00    Completed: 00/00/00
Phase II year
Phase II Amount