Now Available: Innovators Under 35 2013 See The 2013 List »

Credit: Xian-Sheng Hua
Xian-Sheng Hua, 34
Enhancing video search
Microsoft Research Asia
The amount of video on the Web is growing at an incredible rate. Effectively searching online video, however, remains difficult. Microsoft researcher Xian-Sheng Hua hopes to crack the problem by teaching computers to recognize objects, scenes, events, and other elements of digital images.
Hua uses machine-learning techniques and annotated videos to train computers to automatically categorize new videos. While this general approach isn't new, Hua's system permits multiple labels for each video segment--and relies not only on specified tags applied by experts but also on descriptions written by large numbers of grassroots Internet users. These user-generated tags are gathered by means of online games, "pay for labeling" schemes, analysis of how people search for video, or other methods. Hua applies some automated filters to the labels to ensure their quality.
The system, which runs online, is first trained on videos tagged by experts; it's then periodically updated and retrained using the grassroots labels. This "online active learning" makes the algorithm more accurate and several times faster than previous systems; applying multiple labels to each video increases the speed further. The technology should aid searches for still images, too. Some of the techniques involved are already being incorporated into Microsoft's Live Search Video. Ultimately, Hua says, the technology should improve not only online video and image searches but also video surveillance and digital media management. --Erika Jonietz
2008 TR35 Winners
Blaise Agüera y Arcas
Building immersive 3-D environments
Dries Buytaert
Simple, flexible Web publishing
Jenova Chen
Gaming with the flow
Tanzeem Choudhury
Inferring social networks automatically
Jack Dorsey
Personal updates made simple
Stefanus Du Toit
Programming for parallel processors
Seth Hallem
Deconstructing software to find bugs
Xian-Sheng Hua
Enhancing video search
Sundar Iyer
Making memory at Internet speed
Farinaz Koushanfar
Locking microchips to prevent piracy
Johnny Lee
Streamlining human-computer interactions
Meredith Ringel Morris
Searching websites jointly
Andrew Ng
Building household robots
Adam Smith
Making sense of e-mail madness
JB Straubel
Engineering electric sports cars
Eric Wilhelm
Putting DIY projects online
Robert Wood
Building robotic flies