Sunday, October 1, 2023

“HeyGen” AI allows a person to automatically speak in different languages

Would you like to see yourself speaking Japanese, German or Hindi? With this new AI, it is possible. The American company HeyGen is a platform for automatic video generation using artificial intelligence. The Californian start-up launched its video translation function on September 7, causing a general stir on the networks.

How does HeyGen AI video translation work?

The tool, simply called “Video Translate,” is an artificial neural network, which means it is a system whose operation is modeled and inspired by biological neurons.

To use the HeyGen video translator, simply upload a video of more than 30 seconds where the person speaks in one of the 7 languages ​​supported by the AI: English, Spanish, French, Italian, Portuguese, German, Hindi and Polish. What is especially striking about this technology is the lip synchronization, since both the tone of voice and the facial expressions of the speaker remain very faithful to the original version.

>> Also read: Reading the mind: the advancement of AI

The companies ElevenLabs or Meta Plateforms, the parent company of Facebook, had also already launched artificial intelligence tools for automatic voice cloning and automatic transcription of speeches in several languages. However, none allows these two functionalities to be combined into one, as HeyGen does.

Read Also:  Just as you learn English or German, an AI learns to translate what... chickens say

In the context of the strikes of Hollywood screenwriters and actors (SAG-AFTRA Strike) fighting for a reform of copyright agreements and regulation of the use of artificial intelligence, the launch of this technology can effectively confirm fears and the need for regulation requested by actors, the film dubbing industry or translators, among others.

Times of National
Times of National
Times of National To give more information about the latest happenings, news related to happenings in the country and abroad a casual understanding of the latest technology products and gadgets, celebrity news and gossip, latest movie news, sports, and cricket scores all you need Always ready to fulfill whatever else is becoming a part of our life nowadays.
Latest news
Related news


Please enter your comment!
Please enter your name here