MARZ Unveils LipDub AI to Eliminate Mismatched Lip-Syncing of Dubbed Content for Global Distribution

×

Error message

  • Notice: Undefined property: stdClass::$ds_changed in eval() (line 16 of /var/www/7/modules/php/php.module(80) : eval()'d code).
  • Notice: Undefined property: stdClass::$ss_search_api_url in eval() (line 20 of /var/www/7/modules/php/php.module(80) : eval()'d code).
  • Notice: Undefined property: stdClass::$tm_title in eval() (line 20 of /var/www/7/modules/php/php.module(80) : eval()'d code).
  • Notice: Undefined property: stdClass::$ds_changed in eval() (line 16 of /var/www/7/modules/php/php.module(80) : eval()'d code).
  • Notice: Undefined property: stdClass::$ss_search_api_url in eval() (line 20 of /var/www/7/modules/php/php.module(80) : eval()'d code).
  • Notice: Undefined property: stdClass::$tm_title in eval() (line 20 of /var/www/7/modules/php/php.module(80) : eval()'d code).

Emmy-nominated visual effects (VFX) studio and AI technology startup Monsters Aliens Robots Zombies (MARZ) today unveiled LipDub AI , its second AI for VFX product.

Metadata
Provider: 
Business Wire, Inc.Business Wire, Inc.
Retrieved on: 
Tuesday, August 15, 2023
Information
Tags: 
Entertainment, Technology, TV and Radio, Film & Motion Pictures, Software, Artificial Intelligence, Tel Aviv University, ACM, Visual computing, Lip, Multimedia, Research, Language, Assistant, Vanity, Department of Computer Science of TU Darmstadt, VFX, Simon Fraser University, AI, Computer science, Film industry, Television
Geotags: 
ONTARIO, NORTH AMERICA, CANADA
⚠ generated by AI ↴
Organisation: 
MONSTERS ALIENS ROBOTS ZOMBIES, MARZ
Summary
Key Points: 
  • Emmy-nominated visual effects (VFX) studio and AI technology startup Monsters Aliens Robots Zombies (MARZ) today unveiled LipDub AI , its second AI for VFX product.
  • LipDub AI is a state-of-the-art lip-syncing solution that dramatically improves the quality and appeal of dubbed content, and will transform the entertainment industry's localization sector.
  • View the full release here: https://www.businesswire.com/news/home/20230815078350/en/
    LipDub AI is the world’s first completely automated lip-sync technology to achieve Hollywood-caliber results.
  • Together they successfully conducted the research for Vanity AI , the first AI solution developed by MARZ.


Emmy-nominated visual effects (VFX) studio and AI technology startup Monsters Aliens Robots Zombies (MARZ) today unveiled LipDub AI, its second AI for VFX product. LipDub AI is a state-of-the-art lip-syncing solution that dramatically improves the quality and appeal of dubbed content, and will transform the entertainment industry's localization sector.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20230815078350/en/

LipDub AI is the world’s first completely automated lip-sync technology to achieve Hollywood-caliber results. In addition to delivering market-leading quality of visuals, LipDub is a scalable solution that visually transforms one minute of video footage into any language in seconds and in under 20 minutes of compute time for Hollywood-grade outputs.

The proprietary LipDub AI technology uses deep neural networks to seamlessly sync actors’ on-screen lip movements to any dubbed audio file, providing an elevated viewing experience to audiences worldwide watching non-native content. This groundbreaking approach to dubbing content is expected to help Hollywood studios and advertisers drive meaningful leaps in engagement and viewership. Moreover, it will enable creatives to create globally appealing content that truly transcends borders.

According to the MARZ executive leadership team, Jonathan Bronfman – Chief Executive Officer, Matt Panousis – Chief Operating Officer, and Lon Molnar – Chief Creative Officer, “The current standards for passable localization are far too low. Viewers around the world deserve to watch foreign-made content that looks great, just as studios and advertisers endeavor to create content that has global appeal. LipDub AI represents the next logical step in the evolution of dubbing, and it’s profoundly rewarding for MARZ to be spearheading that change.”

The LipDub research team is led by MARZ Chief Scientist and world-renowned professor at the Department of Computer Science at Tel-Aviv University, Danny Cohen-Or, an ACM fellow and The Isaias Nizri Chair in Visual Computing. He leads the MARZ AI research team alongside longtime collaborator Ali Mahdavi-Amiri, Assistant Professor at Simon Fraser University. Together they successfully conducted the research for Vanity AI, the first AI solution developed by MARZ. Vanity AI was launched in January 2023 and has already been used in over 45 Hollywood productions.

“With LipDub, we have succeeded in leveraging advanced generative AI to create photorealistic, lip-synced videos that are dynamic and temporally consistent,” said Cohen-Or.

For more information about LipDub AI visit lipdub.ai

About MARZ

Founded in August 2018, Monsters Aliens Robots Zombies (MARZ) is an Emmy-nominated VFX studio and AI technology start-up focused on premium entertainment verticals on a mission to help democratize VFX through the use of automated AI solutions. With its first two AI-driven solutions, Vanity AI and LipDub AI, and its world-class roster of clients, including Disney, Marvel, Netflix, Apple, Amazon Prime, HBO, Warner Bros, Showtime, Hulu, Paramount, CBS, and NBC Universal, MARZ continues to shape the future of visual effects and AI-driven creativity. For additional information, visit marzvfx.com.

Copyright: 
Copyright Business Wire 2023