Foreign movies with dubbed audio are easy to watch out for, but only if you can overlook the out-of-sync motion of actors̵
Is this an outrageous and expensive way to avoid reading subtitles? Certainly. But the technology is impressive and could make foreign movies more accessible to people who read arguments on the Internet all day long but can’t sit through 90 minutes of captioning. In demonstration videos made by Flawless AI, you can see that the FreeSync technology does its job well, removing one of the biggest distractions from dubbed movies.
FreeSync isn’t all that different from existing deepfake technology, although it focuses on manipulating actors’ mouths rather than their entire faces. Interestingly, Flawless claims that the FreeSync technology does not change the subject’s facial expressions or emotions, thus preserving the actor’s performance – at least to an extent.
If FreeSync technology ever gets popular, movie fans will argue about it the rest of the time. Subtitle evangelists already claim that dubbed audio erases an actor’s performance, and manipulating the actor’s face to fit into a copy can take things a step too far. But for the average person, FreeSync technology can be the difference between enjoying a movie and not paying attention. It will do more good than harm. Probably.
Source: flawless via Gizmodo