AI Safety : Deepfake Incident Report
Tune into the deepfake incident report to keep up-to-date with Deepfake AI incidents and trending AI Security breaches affecting our digital world.
Recent Deepfake Incidents
Deepfake Impersonation Targeting Senator Ben Cardin
Date of Incident: Mid-September 2024Target: Senator Ben Cardin, Chair of the Senate Foreign Relations CommitteeNature of Incident: Sophisticated deepfake impersonation of a high-ranking Ukrainian official In mid-September 2024, Senator Ben Cardin was targeted by a...
Justin Bieber AI-Generated Deepfake Song referencing Sean “Diddy” Combs
In April 2024, an AI-generated song purportedly performed by Justin Bieber began circulating widely on social media platforms, particularly TikTok and YouTube. The song, which included lyrics referencing Sean "Diddy" Combs, initially deceived many listeners into...
LeBron James Olympic Team USA Criticism
On August 9th, 2024, a social media post containing an alleged audio clip of NBA star LeBron James criticizing Team USA head coach Steve Kerr went viral. The post, made by Twitter user @RealRobReinhart, claimed to have obtained "locker room audio" of James disparaging...
Malaysian singer Siti Nurhaliza deepfake
Overview Malaysian singer Siti Nurhaliza has warned her fans about a viral scam using AI-generated calls, deepfake videos, and images to deceive people into believing she is offering cash rewards or organizing contests. The scammers have hijacked her voice, likeness,...
Joe Biden call to Kamala Harris
A controversy has emerged regarding the authenticity of Joe Biden’s phone call to Kamala Harris, during her speech to campaign staff members in Delaware. Allegations have circulated that this call was a deepfake, artificially generated using advanced AI technology....
Analysis of the Scarlett Johansson and Open AI Sky AI Voice Controversy
The Scarlett Johansson-Open AI Sky AI voice controversy erupted when OpenAI unveiled its new AI assistant with voice capabilities, featuring a voice called "Sky" that many users found eerily similar to Johansson's voice from the movie "Her." Background In May 2024,...
LastPass CEO Audio Deepfake Incident
LastPass revealed that one of its employees was targeted in a sophisticated voice phishing attack. The attackers used deepfake audio technology to impersonate Karim Toubba, the CEO of LastPass, in an attempt...
Arcads AI Deepfake Video
On March 25, 2024, a Twitter user named Beck (@beckylitv) posted a 46-second video that was created using artificial intelligence (AI) technology, specifically the Arcads.ai platform. The video featured a deepfake of an unidentified woman delivering a script in a car....
Cal Poly AI Voice Cloning Scam Case
A recent incident at Cal Poly has highlighted the growing concern over AI voice cloning and its use in phone scams. A family associated with Cal Poly was targeted by scammers who utilized AI voice cloning technology. This technology allows for the creation of...
Deepfake Leads to $25 Million Loss: Employee Tricked by Deepfake CFO
A finance worker at a multinational firm was defrauded of $25 million in an elaborate scam involving deepfake technology. The employee was tricked into participating in a video call with several individuals he believed to be colleagues, including the company's...
Deepfake Black Celebrities: AI Misinformation on YouTube
Fake news creators on YouTube have been exploiting artificial intelligence (AI) and automated tools to generate and disseminate misinformation targeting Black celebrities, creating a significant challenge in the digital information landscape. This trend of deepfake...
Fake Joe Biden robocall: AI-Generated Election Interference
In a startling incident that underscores the potential misuse of artificial intelligence in politics, a robocall featuring an AI-generated voice resembling President Joe Biden circulated in New Hampshire, causing...
More From Resemble AI
Our Commitment to Consent
Remember when creating a synthetic voice meant hours in a studio, carefully recording every syllable? Now, with a few clicks, you can clone anyone's voice. It's mind-blowing tech. But with great power comes great responsibility. At Resemble, we've always believed that...
Introducing ‘Edit’ by Resemble AI: Say No More Beeps
In audio production, mistakes are inevitable. You’ve wrapped up a recording session, but then you notice a mispronounced word, an awkward pause, or a phrase that just doesn’t flow right. The frustration kicks in—do you re-record the whole segment, or do you spend...
Introducing Resemble Identity & Audio Intelligence
We're excited to unveil two groundbreaking models designed to revolutionize your interaction with audio: Resemble Identity and Resemble Audio Intelligence. These tools enhance speaker recognition, real-time analysis, voice-based authentication, and more. Resemble...