How to create a successful personalized messaging campaign with Rephrase AI and Resemble AI

Rephrase AI is a generative AI technology company that automates synthetic video creation. They have built a tool which can take any piece of text and create a video of any person speaking that text. This can be used by HR to create training videos, personalizing videos for sales, making characters speak in AR/ VR, giving a face to digital assistants, A/B testing digital ads to increase marketing ROI amongst other applications.

We’ve had the pleasure of working and collaborating with Rephrase on multiple projects. Most recently, that included working on a promotional campaign for a large multinational confectionary company.  This campaign was designed as a way to get customized messages sent to a loved one from a notable Bollywood celebrity, for the Raksha Bandhan/Rakhi festivity in India.

An interesting challenge with this particular campaign was that the voice data received by Resemble was not based on a script that the actor recorded specifically for this project. However, once we got the voice data from the celebrity, we got to work on training and and creating an AI model of the voice. This overall process was completed within a few quick days of work.

“Resemble AI’s support on our projects is great. They are very responsive and make sure that our time sensitive projects are successful and without a hitch” – Ashray Malhotra, CEO Rephrase AI

With the use of Resemble AI’s voice technology, specifically Resemble Fill, we were able to customize the name output in the video greeting to provide a personalized experience for each person who requested a message. What was notable about this project is also our multilingual support for Hindi and English to get the names sounding just right. Our low latency API was also used to support the large scale of video message requests and provide quick outputs.

Rephrase AI also did a phenomenal job at matching the actors lip movements with each name using their generative AI to make it ultra-realistic.

Here’s a quick demo of the output from that campaign as a message sent to our very own co-founder, Saqib.

If the number of videos requested were any indication, it’s clear that customized messages were key in creating a viral marketing campaign for the company.

“We used Resemble Fill to personalize a celebrity’s voice with our videos and we were quite happy with how easy it was to clone and integrate Resemble AI in our pipeline. We’re using it for a lot of similar requests we’ve been getting based on the campaign’s success!” – Shivam Mangla, Co-Founder Rephrase AI

Customized messages can also be used in lead generation and for sales personnel as discussed in Rephrase AI and Resemble AI’s collaborative webinar.

If you are interested in providing a custom experience using Resemble AI’s voice technology, reach out and book a demo with us here

Watch the campaign promotion video here:

More From This Category

NFT Avatars and Voice AI with Alethea AI and Resemble AI

NFT Avatars and Voice AI with Alethea AI and Resemble AI

One of the current emerging technologies, the blockchain, has been making tremendous waves in the collector community for their novel use case as NFTs. You may wonder, what are NFTs? NFTs or Non-fungible tokens are a store of data on a digital ledger, the blockchain....

read more
What are End Tags and Bumpers and how can you use them for Programmatic Advertising?

How to get hyper-personalized audio with Resemble Fill

Virtual Assistants, especially as call centre agents, are becoming a lot more crucial when interacting remotely with customers. 44% of people surveyed in the U.S. still prefer phone or voice as their primary customer service channel. That’s 21% higher than any other...

read more