Google has asked users to help in the experimental project LipSync to teach the artificial intelligence system. Participants are required to perform an excerpt of the popular song Dance Monkey by Australian singer Tones and I to the background.
LipSync service is based on YouTube for Chrome browser. The system records video of the singing user and sends it to a Google server with AI system.
Interestingly, the sound is not recorded in this case, for developers it is the video sequences that are important. A special card is created for the participant’s memory, where the accuracy of the performance is evaluated. You can save the card, share it in social networks and “call” friends to the competition.
Google plans to use the videos to teach AI how the human face moves during speech, in other words – speech mimicry.