Translation with AI in Cinema: The End of Voice Actors?

Artificial Intelligence (AI) is revolutionizing the cultural landscape in an unimaginable way. One of the most recent innovations is technology that not only translates words but also synchronizes lip movements to match the desired language. This raises fascinating questions, particularly in the realm of cinema.

First, let’s explore how this technology could impact the film industry. On one hand, it could mark a turning point for voice actors and subtitling companies. If AI can automatically translate and sync an actor’s lip movements, the need for voice actors could significantly diminish. Similarly, subtitles might become less necessary if AI can provide a more immersive viewing experience.

A recent video published by @mrjonfinger on Platform X went viral, demonstrating the capabilities of early versions of translation software. In the test, as described by the user, he recorded a video speaking for over 30 seconds. The platform then generated two versions of the text: one in French and another in German. Remarkably, his lip movements synchronized with each language, adapting gestures to match the sounds produced. Despite being one of the early versions of the software, it exhibited impressive consistency and credibility in both tone of voice and facial movements. If this is the first version of the software, determining…