SBIR-STTR Award

This Small Business Innovation Research Phase I project will develop new technology that will enable precise search of sports videos. Users will be able to search for specific players, teams, and plays from large archives of recorded video sports broadcasts. The proposed research will build on early results of a sports video search engine developed by the team at MIT. The approach combines semantic information mined from speech transcriptions with visual information extracted using video analysis algorithms. The proposed research will extend the existing software algorithms that have been developed for baseball video to other professional and college sports. Additional software tools will be developed to increase the accuracy of the search system, and new user interfaces based on natural language processing algorithms will be designed to enable simplified user access to video. The anticipated result of this research is a method for accurate video search and indexing that enables queries by natural language and requires significantly less human labor to initially tag video than existing techniques. The broader impact of this research comes from the commercialization of this technology as a service layer which provides search and indexing solutions to multiple market segments that together represent a multibillion dollar industry in the United States. The research meets the needs of at least three market segments: (1) Sports professionals, who will gain powerful video access tools enabling better player evaluation, recruiting, coaching, and game analysis; (2) Sports news providers, who will be able to link news stories to related video clips thereby adding value to their media offerings; (3) Sports fans, who will be able to search and browse sports video archives with ease, providing new opportunities for advertising. Initial market research suggests that the access enabled by this technology would have broad impact on how sports video is used. Furthermore, the approach may later be extended to apply beyond sports to other video domains

This award is funded under the American Recovery and Reinvestment Act of 2009 (Public Law 111-5). The Small Business Innovation Research (SBIR) Phase II project objective is to commercialize a novel technology for indexing video. The company's approach automatically integrates information from speech, text, and video through algorithms that generate rich semantic indexes for video. The Phase I results show that this approach can be incorporated into a system that indexes video with high accuracy and at a fraction of the cost of currently used methods. Further, during the Phase I research, the company has identified a large and growing consumer market (sports video) in which the technology can be applied. The technical objectives of the Phase II proposal focus on working with such partners to roll out initial Bluefin-powered applications, such as content-based search and video-enriched fantasy sports. Such applications are currently not feasible because of the low accuracy of automated indexing methods and the high cost of manual approaches to indexing video. Millions of hours of new video content are coming online every month, feeding an exploding demand and reshaping the nature of the Internet. Just as text-oriented search engines were necessary to empower users to find what they needed during the first phase of the text-centric Internet, a new generation of technology will be necessary to organize and effectively find content in the fast-approaching video-dominated era of the Internet. Bluefin Lab is pioneering a new approach to video organization and search by commercializing cross-modal algorithms developed in Academe. While this differentiated technology can be leveraged in several target markets, the company's initial focus is on sports media where it will power a unique experience for video search, video-enhanced fantasy sports, and other video-centric applications.