Resemble.ai Launches Localize Localized Voice AI and Announces 150+ Customers

More than 65,000 Users have Cloned 42,000 Voices

Resemble.ai, a leader in generative deep learning voice technology announced that it has created Localize — voice AI technology to localize speech for the first time. Until now, entertainment companies, ad agencies, call centers and companies that needed to translate voices would have to use a different voice in each language. With Resemble.ai, voices can be cloned into any language – so George Clooney sounds like George Clooney, even when a movie has been dubbed into another language.

Resemble.ai clones voices at scale in seconds, as opposed to weeks. It has democratized this previously laborious, expensive process and cloned 42,000 voices for 65,000 users, including two of the largest global telecoms, two of the largest consulting companies, a top global broadcasting co, two of the largest entertainment conglomerates, one of the largest toy makers, and the leader in airport communications systems.

Recommended AI News: American Express to Host Ninth Annual “Business Class LIVE: Summit for Success” for Small Businesses

Localize is able to keep any character’s voice consistent across video games, movies, call centers, company videos, and more as they are translated to and from languages including French, German, Dutch, Italian and Spanish. A majority of the world speaks one of these six languages and the company also has near-term plans to introduce Localize for Korean, Japanese and Mandarin.

Normally, voice talent translation takes an average of two months and can tally hundreds of thousands of dollars. With Resemble.ai, it’s accomplished in a week with maximum creative flexibility and efficiency. For entertainment companies, dubbing a script is logistically challenging and the fidelity of the production is oftentimes lost in translation. Resemble.ai offers a more attractive solution in a fraction of the time using the same talent whom production houses have already paid for.

Resemble Co-founder and CEO Zohaib Ahmed said, “Localize fundamentally changes the way we think about speech. Much like text, video, and other mediums that have gone across borders, speech remains stuck to a single language. With deep learning and custom synthetic AI voices, we’re breaking that barrier down.”

“It’s hard to overstate how important audio has become in recent years — or just how much bigger it’s going to get in an AirPods-first world,” said Peter Rojas, Partner at Betaworks Ventures. “Synthetic voice is going to be key to all this by transforming how audio is created. Demand for localized and translated spoken word content, whether it’s in the form of podcasts or audiobooks, is exploding, and AI-based tools like Localize are the way to satisfy that demand.”

How it works: An audio recording is translated so that it accurately reflects not only the words and their specific meanings, but also colloquialisms and grammatical structures that are particular to that region and language. The service allows anyone to translate and hear it simultaneously – so you can find out immediately “how does Will Smith sound when he says this sentence?” Other examples include:

Gaming – Resemble.ai makes it possible for a character’s voice to sound the same in different languages. It retains the characters’ voices for a different language.

Influencers – YouTubers and TikTok stars can reach non-English speaking audiences and vice versa

Call Centers, which serve scores of markets, can create one universal conversational chatbot with similar voices in numerous languages. Previously they had to hire talent internationally.

Movies can expand internationally faster with the voices they originally intended because dubbing isn’t needed.

Recommended AI News: Polygon.io Announces $6 Million Series A to Fuel the Expansion of Its Financial Data Platform