Would you like to see yourself speaking Japanese, German or Hindi? With this new AI, it is possible. The American company HeyGen is a platform for automatic video generation using artificial intelligence. The Californian start-up launched its video translation function on September 7, causing a general stir on the networks.
How does HeyGen AI video translation work?
The tool, simply called “Video Translate,” is an artificial neural network, which means it is a system whose operation is modeled and inspired by biological neurons.
To use the HeyGen video translator, simply upload a video of more than 30 seconds where the person speaks in one of the 7 languages supported by the AI: English, Spanish, French, Italian, Portuguese, German, Hindi and Polish. What is especially striking about this technology is the lip synchronization, since both the tone of voice and the facial expressions of the speaker remain very faithful to the original version.
Our video translation feature is officially LIVE!
Tips for best results:
– Use images that do not have background noise, music or sound effects.
– Use images that only show one person speaking.Try it here: https://t.co/ahh4QsTSdk https://t.co/xKun9ocp6U
– HelloGen (@HeyGen_Official) September 7, 2023
>> Also read: Reading the mind: the advancement of AI
The companies ElevenLabs or Meta Plateforms, the parent company of Facebook, had also already launched artificial intelligence tools for automatic voice cloning and automatic transcription of speeches in several languages. However, none allows these two functionalities to be combined into one, as HeyGen does.
In the context of the strikes of Hollywood screenwriters and actors (SAG-AFTRA Strike) fighting for a reform of copyright agreements and regulation of the use of artificial intelligence, the launch of this technology can effectively confirm fears and the need for regulation requested by actors, the film dubbing industry or translators, among others.
