Google’s UK-based Deepmind division fed an AI system 5,000 hours of TV content to teach it lipreading. By learning from the content, the AI is now performing better than a professional lip-reader. It was successful in accurately reading 46.8% of words from 200 random clips.
This project is a combined effort from DeepMind and the University of Oxford. Researchers involved with the project gave the system content from six TV programs that aired between January 2010 and December 2015.
When a professional lip-reader was given the same 200 random clips, they only had a 12.4% decipher rate.
