AMC Theaters, always quick to embrace the latest trends, is debuting a Swedish film using an innovative AI-based dubbing technique that makes it look as though the actors are speaking in English. Unlike traditional dubbing, which simply replaces the voice tracks, Watch the Skies features alterations to the actors’ facial movements, creating the illusion that they are speaking in English.
The original cast of Watch the Skies provides the English-language voice track, which ensures the film complies with SAG-AFTRA regulations designed to protect its members from potential AI exploitation. Hollywood actors have raised concerns about AI potentially replacing them, but because the English dialogue was recorded by the original actors with their consent, no union rules are violated.
The “visual dubbing” technique was developed by Flawless AI. By digitally modifying the film’s images to make it appear as though it was shot in English, the goal is to attract more viewers who typically shy away from dubbed films. This new approach addresses the common issue of mismatched lip sync in translations by directly altering the actors’ mouth movements.
Some may take issue with the new AI-based dubbing technique, viewing it as reinforcing the idea that English is the superior language while erasing other cultures and dialects. This move comes at a time when foreign-language films are gaining popularity in the United States, and audiences have become more comfortable with subtitles. Hollywood’s dominance in the global entertainment industry already raises concerns, and automatically dubbing films into English could be seen as an encroachment, especially when other countries are just beginning to see their local film industries thrive internationally.
Critics may argue that much of the world doesn’t speak English and shouldn’t be expected to conform to American preferences. However, this situation appears to be a smaller-scale case of translating a modest-budget film for theatrical release in English-speaking markets.
There is also concern that something may be lost when a film is not viewed in its original language. Voice acting plays a vital role in any movie, and actors shifting from their native Swedish to English might lose some of the emotional depth or accuracy of the dialogue. However, voice actors have significantly improved their dubbing skills over the years, and supporters of dubbing argue that viewers should be free to enjoy films in whatever format they prefer.
Other companies, beyond AMC, have started using AI-based dubbing to broaden their content’s audience. YouTube creator Mr. Beast made waves a few years ago by dubbing his videos into languages like Spanish and Mandarin, although his approach at the time was more manual and costly. Late last year, YouTube launched a tool that enables creators to automatically generate AI voiceovers in multiple languages.
While the true potential of new AI technology remains uncertain, there is optimism in Hollywood that generative AI could accelerate production and reduce visual effects costs. Companies like Netflix have shaken up the industry by offering large sums for content, only to scale back later, leading to instability and budget cuts. However, the widespread availability of AI could lead to its careless use, as companies may cut corners without thoughtful implementation. Tools like OpenAI’s Sora, which can generate short video clips from text prompts, faced criticism for its subpar quality after release. Other AI tools from companies like Runway and Google have been better received, but studios continue to face significant resistance from actors regarding their use.
