AI Safety
Deepfake Incident Database
A curated database tracking verified incidents where deepfake technology has been used to target specific individuals or organizations. This collection documents cases of AI-generated synthetic media being weaponized for impersonation, manipulation, or deception, providing insights into the real-world impact and evolution of deepfake threats.
Deepfake Incident Database
| Date | Incident | Target | Type | Source |
|---|---|---|---|---|
| Mar 15, 2025 | A deepfake video of Antonio Brown's return to the Pittsburg Steelers alongside Aaron Rodgers was posted on social media by Antonio Brown. The video is not real and is an attempt by Brown to generate attention. | Pittsburgh Steelers, NFL | Video | Newsweek |
| Mar 15, 2025 | AI-generated video depicting various political figures in unusual scenarios (e.g., Warren and Pelosi in MAGA hats, Trump hugging Obama). Shared on Bluesky by Mark Cuban, prompting controversy due to its political implications and low quality. | Elizabeth Warren, Nancy Pelosi, Barack Obama, Donald Trump, Mark Cuban, Jeff Bezos, Mark Zuckerberg, Elon Musk | Video Image | Gizmodo |
| Mar 13, 2025 | Deepfake videos of experts from The Baker Heart and Diabetes Institute promoting a diabetes supplement; deepfake images of Dr. Karl Kruszelnicki used on Facebook to sell pills; TikTok Shop sellers manipulated doctors' videos to falsely endorse products. | The Baker Heart and Diabetes Institute experts, Dr. Karl Kruszelnicki, and other doctors | Image Video Audio | The Conversation |
| Mar 12, 2025 | A Mississippi teacher, Wilson Jones, was arrested for creating AI-generated videos depicting multiple students in sexual activity. The students were unaware of the videos and did not participate willingly. A search warrant executed on March 3 resulted in the seizure of a laptop and thumb drive containing the videos. The case has been handed to the FBI and the U.S. Attorney's Office. | Multiple students | Video | FOX13 Memphis |
| Mar 10, 2025 | Over 75,000 AI-generated deepfakes of Sony Music artists were taken down. Sony Music reported direct commercial harm and opposes the UK government's proposed 'opt-out' system for AI training data. | Sony Music artists | Audio Video | Music Ally |
| Mar 08, 2025 | Actor Shin Ae-ra was the target of a deepfake attack involving false news about her participation in illegal investment activities. The fake news, which included deepfake images or videos, spread on social media. Shin Ae-ra denied the allegations and her agency is considering legal action. | Shin Ae-ra | Image Video | 매일경제 |
| Mar 07, 2025 | AI-generated video linking the Dominican Republic to corruption, parodying "The Island of Temptations", featuring Spanish officials including a shirtless Prime Minister Pedro Sanchez on a beach. The video was viewed over 400,000 times before being deleted by the PP. | Dominican Republic | Video | Reuters |
| Mar 07, 2025 | Deepfake videos and images falsely portraying Singaporean Prime Minister Lawrence Wong promoting scam products and services like cryptocurrency and Permanent Resident application services. Similar incident in June 2024 involving Senior Minister Lee Hsien Loong with deepfake videos commenting on international relations and promoting an investment opportunity linked to Elon Musk. The deepfakes were created using AI. | Singaporean Prime Minister Lawrence Wong, Senior Minister Lee Hsien Loong | Video Image | CNA |
| Mar 06, 2025 | A 15-year-old girl's innocent picture from Instagram was used by a classmate to create a nude deepfake image using an AI app. The image was then distributed throughout her school. | Elliston Berry | Image | Hindustan Times |
| Mar 05, 2025 | A Georgian boiler room operation used deepfakes of celebrities (Ben Fogle, Martin Lewis, and Zoe Ball) to promote fraudulent cryptocurrency investments. Victims were contacted by call centers, initially seeing fake profits before being defrauded of approximately $35 million. A larger network operating from Israel also ran a similar scheme, resulting in an estimated $240 million in losses over three years. | UK and Canada residents | Video Audio | The Guardian |
| Mar 05, 2025 | Scammers used an AI-generated deepfake video of Prime Minister Nikol Pashinyan to promote an investment company promising a monthly income of ֏ 1.8 million ($4,500). Viewers were urged to follow a link and provide personal information. Similar incidents have targeted other Armenian public figures, including RFE/RL and Armenian Public TV anchors and doctors, often to advertise drugs. | Prime Minister Nikol Pashinyan | Video | OC Media |
| Mar 05, 2025 | Investment scams using deepfake technology are targeting investors in the Philippines. Scammers are using AI-generated deepfakes to steal money. The SEC is investigating, tracing bank accounts and digital wallets, and collaborating with online platforms and the DICT to track fraudulent transactions. A fake sponsored post using an old interview of tycoon Ramon Ang is cited as an example. | Investors in the Philippines | Image Video | Fintech News Philippines |
| Mar 05, 2025 | Deepfake videos circulating on social media falsely feature SBI's top management endorsing investment schemes. SBI clarified that neither the bank nor its officials support such schemes. | State Bank of India (SBI) and its customers | Video Audio | The Times of India |
| Mar 05, 2025 | A deepfake video of Queensland Premier Annastacia Palaszczuk garnered 1 million views on social media, falsely claiming the state was in financial trouble. | Annastacia Palaszczuk | Video | The Conversation |
| Mar 04, 2025 | A phishing scam used an AI-generated deepfake video of YouTube CEO Neal Mohan, shared privately, to claim changes to YouTube's monetization policy and steal credentials. Similar scams involved emails and links to malicious files or fake DocuSign sites. One Reddit user reported a deepfake video of Mohan in 2023. | YouTube creators | Video | The Verge |
| Mar 04, 2025 | Europol's Operation Cumberland resulted in the arrest of 24 individuals across 19 countries for their involvement in AI-generated child pornography. A ringleader, operating a website offering AI-created child sexual abuse material (CSAM), was arrested in Denmark in November, initiating the operation. A total of 273 suspects are involved, with 33 house searches conducted and 173 electronic devices seized. The operation highlights the challenges in prosecuting AI-generated CSAM due to a lack of specific national legislation. | children | Image Video | GZERO Media |
| Mar 03, 2025 | A 15-year-old girl, Elliston Berry, was victimized by a classmate who created and spread deepfake nude images of her online using an app. The app has since been removed. | Elliston Berry | Image | The Dallas Morning News |
| Mar 03, 2025 | A 3-minute 33-second deepfake video falsely showed Union finance minister Nirmala Sitharaman endorsing a government investment platform, claiming investors would receive ₹15,00,000 in a month for an investment of ₹21,000. Lip movements were unnatural and out of sync with the speech. Reverse image and voice analysis tools confirmed the video and audio were AI-generated. | Nirmala Sitharaman | Video Audio | Newschecker |
| Mar 03, 2025 | A deepfake video circulating on social media depicts former President Bill Clinton discussing Jeffrey Epstein's client list. The video, shared on X (formerly Twitter), is falsely presented as a recent statement. However, the video originates from a 2020 Bill Clinton speech at the Democratic National Convention. The deepfake video includes text indicating it is satire. A Google Lens search confirmed the source video on NBC News' YouTube channel. AI detection tools showed a 99%+ probability of AI generation, confirming the video as a deepfake. | Bill Clinton | Video | The Quint |
| Mar 03, 2025 | An AI deepfake video of endocrinologist Professor Jonathan Shaw was created calling doctors “idiots” for treating diabetes with metformin. The video was posted on Facebook and was removed only after his employer pointed out a copyright violation. | Professor Jonathan Shaw | Video | Australian Doctor |
| Mar 02, 2025 | AI-generated deepfake videos of Vidya Balan were circulating online. The video showed her greeting viewers. Vidya Balan posted the video on Instagram, warning that it was a scam and that she had not created it. She urged fans to be cautious of misleading AI-generated content. Other celebrities were also targeted by similar deepfakes. | Vidya Balan | Video | Mint |
| Mar 02, 2025 | A young woman, known only as Jodie, was victimized by a deepfake video created by her friend, Alex Woolf, a BBC music prodigy. Woolf used Jodie's images to create a deepfake pornographic video and distributed it online. Jodie discovered the video and identified Woolf by recognizing an image not shared on social media. Woolf pleaded guilty to sending grossly offensive messages, and Jodie's case highlights the challenges in prosecuting such crimes and the lack of adequate legal protection and police response in the UK. | Jodie | Video Image | Daily Mail |
| Mar 02, 2025 | A deepfake video of Indonesian President Prabowo Subianto circulated on Instagram in November. The video showed him asking constituents about their needs, and was used in a scam to swindle Indonesians. | Indonesians | Video | The Caledonian-Record |
| Feb 28, 2025 | An AI-generated video depicting a physical altercation between US President Donald Trump, Vice President JD Vance, and Ukrainian President Volodymyr Zelensky went viral on X. The video shows Zelensky seemingly attacking Trump, with Trump and Vance retaliating. This follows a real-life tense confrontation at the White House where a minerals agreement was not signed. The deepfake video is connected to a real event, but the video itself is fabricated. | Donald Trump, JD Vance, Volodymyr Zelensky | Video | Hindustan Times |
| Feb 28, 2025 | Explicit videos and images of Breeze Liu, some real and some deepfaked, were shared online without her consent in 2020. The content was reportedly filmed when Liu was 17 years old. Some content appeared on Pornhub, and much was stored on Microsoft's Azure cloud servers. Microsoft allegedly failed to respond promptly to Liu's requests for removal, eventually taking down much of the content after a direct confrontation. | Breeze Liu | Image Video | WIRED |
| Feb 27, 2025 | A satirical video falsely claiming Donald Trump would ban Indian customer service representatives in the US was created using Clive AI and shared on January 25th. Contrails AI confirmed the video and audio manipulation. The deepfake was based on a January 10th WAAY 31 News video. | Donald Trump | Video Audio | The Quint |
| Feb 27, 2025 | HYBE is partnering with the Korea’s Northern Gyeonggi Provincial Police Agency to combat deepfake videos targeting its artists. A 2023 study estimated that 53% of individuals in deepfake pornography were South Korean singers or actresses. HYBE's initiative includes a dedicated hotline for reporting deepfake crimes and swift action against offenders. | K-Pop artists (specifically those under HYBE) | Video | MusicRadar |
| Feb 27, 2025 | AI-generated video depicting former President Bill Clinton discussing the anticipated release of Jeffrey Epstein's client list. The video, clearly labeled as satire, shows an AI version of Clinton making statements about the list and includes an AI depiction of Hillary Clinton's voice. While labeled satire, the video has drawn criticism for its potential to spread misinformation. | Bill Clinton | Video Audio | Newsweek |
| Feb 27, 2025 | A fake audio clip of Donald Trump Jr. seemingly supporting Russia's actions in Ukraine was spread across social media. The audio, apparently generated using artificial intelligence, depicts Trump Jr. stating that the U.S. should have sent weapons to Russia instead of Ukraine. A spokesperson for Trump Jr. confirmed that the audio is "100% fake." Deepfake experts analyzed the audio and concluded it was likely AI-generated. The clip was falsely presented as being from a February 25th episode of Trump Jr.'s podcast, "Triggered." The fake audio was shared by accounts including an official Democratic Party account on X (formerly Twitter) before being deleted. | Donald Trump Jr. | Audio | FactCheck.org |
| Feb 27, 2025 | Microsoft sued four developers for creating and selling deepfake nude images of celebrities using compromised accounts and Microsoft AI tools. The developers were part of a cybercrime network called Storm-2139. A website associated with the operation was seized. | celebrities | Image | Gizmodo |
| Feb 26, 2025 | A video depicting Gaza as a futuristic paradise, featuring luxurious buildings, a golden statue of Donald Trump, and scenes of Elon Musk and others. The video includes a song with lyrics about Trump bringing peace and prosperity to Gaza. It was shared by Donald Trump on social media to support his controversial proposal of having Israel take over Gaza. | Palestinians, Hamas, and those opposed to Trump's Gaza plan | Video | The Times of India |
| Feb 26, 2025 | A deepfake video was created using Vijay Kedia's likeness and voice to promote stocks. The deepfake was identified by unnatural aspects such as accent and English fluency, which differed from Kedia's typical speaking style. Kedia warned his followers on social media about this. | Vijay Kedia | Video Audio | The Financial Express |
| Feb 24, 2025 | An AI-generated video depicting President Donald Trump performing oral sex on Elon Musk's feet was displayed on TVs throughout the Department of Housing and Urban Development. The video included the words "LONG LIVE THE REAL KING." Government employees reportedly saw the video playing on a loop Monday morning. Building staff were unable to immediately determine the source. | Department of Housing and Urban Development employees | Video | substack.com |
| Feb 21, 2025 | AI-generated videos falsely depicted a 200-foot tall statue of Jesus being erected on the White House lawn. The videos were shared on Facebook and X. A live White House livestream showed no such construction. An engineering professor noted irregularities in the videos, such as a worker's arm disappearing and equipment distortion affecting the background. The videos originated from a TikTok account known for AI-generated content. Fact-checking organizations debunked the claim. | White House | Video | USA TODAY |
| Feb 21, 2025 | The deepfake pornography app Clothoff creates non-consensual deepfakes, primarily targeting women and minors. The app's connection to ASU Label, an organization with unclear origins and affiliations, is questionable. Clothoff claims to donate to support those affected by AI, but lacks transparency. | women and minors | Image Video | bellingcat |
| Feb 21, 2025 | Two 16-year-old teenagers in Athens were arrested for allegedly creating and sharing AI-generated deepfake nude images of their classmates using photos downloaded from social media without consent. Police confiscated the teenagers' phones and arrested the parents for alleged neglect. | classmates of the perpetrators | Image | Kathimerini English Edition |
| Feb 21, 2025 | Sexually explicit, AI-generated images of female students were circulated online. Two year 11 students have been suspended. Victoria Police are investigating. | Up to 60 female students at Gladstone Park Secondary College in Melbourne, Australia | Image | ABC News |
| Feb 21, 2025 | Three cases filed under the Prevention of Electronic Crimes Act (PECA) 2025 in Lahore, Pakistan, alleging creation and distribution of AI-generated deepfake videos and images depicting Punjab Chief Minister Maryam Nawaz in an immoral light. Additional charges under sections 500, 504, and 505-1 (C) of the Pakistan Penal Code (PPC) were also included. Complaints filed by citizens and businessmen cite uploading on social media, causing reputational harm and spreading misinformation. | Maryam Nawaz | Image Video | DAWN.com |
| Feb 20, 2025 | A deepfake video of CNN's Fareed Zakaria endorsing Kenya's role in Sudan's peace process was shared on X (formerly Twitter) by Kenyan Principal Foreign Affairs Korir Singoei. The video, titled "Kenya steps up: Peacemaking or power play?", presented a positive view of Kenya's actions, but no such video exists on Zakaria's official channels. This caused outrage on social media and questions about Kenya's role in the Sudan crisis. | Fareed Zakaria and potentially Kenya's involvement in Sudan's peace process | Video | The Standard |
| Feb 20, 2025 | A deepfake video showing Zelenskyy's face superimposed onto footage of a person dancing was shared on X by Donald Trump Jr., mocking Zelenskyy. The video was originally posted by another user. This followed Trump's comments calling Zelenskyy a dictator and warning him to end the war quickly. | Volodymyr Zelenskyy | Video | Anadolu Agency | English |
| Feb 20, 2025 | Deepfake videos of Breeze Liu, allegedly filmed without consent when she was 17, appeared on PornHub and other websites in April 2020. The content was hosted on Microsoft's Azure cloud services. Removal of the content was difficult and involved hundreds of images and videos. Microsoft was slow to respond to takedown requests. The National Center for Missing & Exploited Children (NCMEC) could not assist due to uncertainty about Liu's age at the time of filming. Point de Contact, a French victims' aid organization, assisted with takedown requests, leading to some progress by December 2023. | Breeze Liu | Image Video | WIRED |
| Feb 19, 2025 | A new wave of cyberattacks uses AI-generated deepfake videos featuring a synthetic persona ("Thomas Harris" or "Thomas Roberts") to instruct viewers to execute a PowerShell command. This command downloads a malicious script that deploys either Lumma Stealer (to harvest cryptocurrency wallets and browser credentials) or NetSupport RAT (to grant full system control). The deepfakes use procedural details and mimic authentic TradingView workflows. Attackers used compromised YouTube channels with significant subscriber bases and YouTube's sponsored ad system. | Cryptocurrency and financial traders | Video | CybersecurityNews |
| Feb 19, 2025 | Attackers used a deepfake video disguised as a tutorial for unlocking TradingView's developer mode. The video instructed users to execute commands installing malware (NetSupport or Lumma Stealer), granting attackers remote access and enabling data theft. AI-generated personas were used across multiple accounts, with engagement metrics manipulated to enhance credibility. AI tools like ChatGPT were used to create malicious scripts, with attackers adapting C&C domains and using Pasteco to distribute them. The goal was data exfiltration and system compromise, using cryptocurrency as bait. | Users of a compromised YouTube channel (over 110,000 subscribers). The attack also leveraged multiple fraudulent YouTube accounts, some with hundreds of thousands of subscribers. | Video | GBHackers |
| Feb 19, 2025 | Megan Hurley, a massage therapist, was victimized by AI-generated fake nude photos and videos. The bill refers to other victims as well, but does not give specific details. | Megan Hurley and other unspecified individuals | Image Video | MPR News |
| Feb 19, 2025 | Attackers used a deepfake video disguised as a tutorial for unlocking TradingView's developer mode. The video instructed users to execute commands installing malware (NetSupport or Lumma Stealer), granting attackers remote access and enabling data theft. AI-generated personas were used across multiple accounts, with engagement metrics manipulated to enhance credibility. AI tools like ChatGPT were used to create malicious scripts, with attackers adapting C&C domains and using Pasteco to distribute them. The goal was data exfiltration and system compromise, using cryptocurrency as bait. | Users of a compromised YouTube channel (over 110,000 subscribers). The attack also leveraged multiple fraudulent YouTube accounts, some with hundreds of thousands of subscribers. | Video | GBHackers |
| Feb 18, 2025 | AI-generated video of late CM EK Nayanar urging party strengthening was shared on the party's social media. The video, featuring Nayanar in his Kannur dialect, encouraged party members to work towards a third term in the upcoming state elections. This occurred despite the party's previous criticism of AI's potential negative impacts. | Kerala CPI(M) party members | Video | Hindustan Times |
| Feb 18, 2025 | Fraudsters used AI-generated deepfake video calls to impersonate legitimate claim holders, using forged credentials and false addresses. Real claim data, likely obtained from public sources or leaked databases, supported the fake claims. At least $5.6 million was stolen and quickly moved through international exchanges. | Companies purchasing fake FTX liquidation claims | Video | TOKENPOST |
| Feb 18, 2025 | A deepfake video of Sheikh Hasina admitting to creating 'aynaghor' (clandestine detention centers) in Bangladesh is circulating on Facebook. The video is a manipulation of a 2019 BBC News Bangla interview. The deepfake includes a voice clone and lip-sync to match her lip movements to fabricated audio where she claims responsibility for the "aynaghor." Analysis reveals jump cuts and inconsistencies. Reverse image searches confirm the original source is the 2019 interview, where no such admission was made. YouTube has flagged the video as "Altered or Synthetic Media." | Sheikh Hasina | Video Audio | ETV Bharat |
| Feb 18, 2025 | A fraudulent AI-powered ad using Tom Hanks' likeness appeared on YouTube, promoting a fake diabetes cure. The ad manipulated footage from a previous appearance on "Jimmy Kimmel Live!" | Tom Hanks | Video | MediaPost Communications |
| Feb 18, 2025 | Two YouTubers uploaded and broadcasted a deepfake video of President Yoon Suk Yeol and first lady Kim Keon-hee. One YouTuber streamed the video at a rally, and the other posted it multiple times on YouTube. A complaint was filed against the YouTubers for violating the Act on Special Cases Concerning the Punishment of Sexual Crimes. The presidential office requested police to investigate. | President Yoon Suk Yeol and first lady Kim Keon-hee | Video | Anadolu Agency | English |
| Feb 17, 2025 | A five-second AI-generated video falsely depicted the USS Preble firing its HELIOS laser weapon. The video was created from a still image from the Director, Operational Test and Evaluation (DOT&E) 2024 annual report and was not authentic footage. The video's creator admitted to generating it using AI. A Navy spokesperson confirmed the authenticity of the still image but stated that the Navy had not released any videos of the HELIOS system's deployment. | U.S. Navy | Video | Reuters |
| Feb 17, 2025 | Dozens of fraudulent, sexualized deepfake images of female celebrities and athletes were widely shared on Facebook, garnering hundreds of thousands of likes and reshares. Meta removed the images after a CBS News investigation, but many remained publicly available even after being flagged. The deepfakes used AI-generated bodies replacing those of celebrities in real photographs; some used image stitching. | Miranda Cosgrove, Jeanette McCurdy, Ariana Grande, Scarlett Johansson, Maria Sharapova | Image | CBS News |
| Feb 17, 2025 | Georgia Harrison, a reality TV star, was a victim of revenge porn and image-based sexual abuse in 2023. A documentary, ‘Georgia Harrison: Porn, Power, Profit,’ details her experiences and investigation into these issues. | Georgia Harrison | Image Video | Newstalk |
| Feb 17, 2025 | A video showing a girl in a yellow dress falsely claimed to be Monalisa Bhonsale, who went viral selling beads at the Maha Kumbh Mela, is circulating on social media. The Quint fact-checked this video and found it to be a deepfake. The original video is of actor Wamiqa Gabbi, manipulated using face-swap technology to replace Gabbi's face with Bhonsale's. AI detection tools confirmed the video's manipulation, identifying the "FaceSwap technique" with high confidence. This is not the first deepfake incident involving Bhonsale; The Quint previously fact-checked other deepfake videos of her. | Monalisa Bhonsale | Video | The Quint |
| Feb 17, 2025 | A deepfake video showing President Yoon and his wife at a rally was played at a Gwangju rally advocating for the president's impeachment. Police launched an investigation. | President Yoon and his wife | Video | 매일경제 |
| Feb 17, 2025 | A deepfake video showing President Yoon and his wife at a rally was played at a Gwangju rally advocating for the president's impeachment. Police launched an investigation. | President Yoon and his wife | Video | 매일경제 |
| Feb 15, 2025 | Their photos and names were used without consent to create images showing their faces on nude women performing sexual acts. These images were uploaded to a porn site. | 28 North Carolina State University sorority members | Image | Spectrum News |
| Feb 15, 2025 | A YouTube channel, "True Crime Case Files," created over 150 fabricated true crime videos using AI-generated imagery, ChatGPT scripts, and AI voiceovers. One video falsely depicting a crime in Littleton, Colorado, reached 2 million views before being removed for violating YouTube's community guidelines, particularly those concerning child safety. The channel was terminated. | YouTube viewers | Image Video Audio | Forbes |
| Feb 13, 2025 | Louisiana State Police arrested Ryan Glaser (40) and Gregory Duncan Jr. (24) for creating and distributing deepfake pornography. The investigation began in July 2023 after a routine cell phone check on Glaser, a convicted sex offender, revealed child sex abuse material. Duncan is accused of creating and distributing the deepfake material. A new Louisiana law makes creating or distributing non-consensual pornographic deepfakes illegal, carrying a minimum 10-year prison sentence. | unspecified victims of non-consensual pornographic deepfakes | Image Video | WAFB |
| Feb 13, 2025 | Two K-pop fansites, Eudemonic and Sodapop, allegedly created and distributed deepfake content of IVE's Wonyoung. The fansites were blacklisted by Starship Entertainment in September 2024 following a larger deepfake scandal in South Korea. The February 12, 2025 post reignited outrage among fans demanding further clarification from Starship Entertainment. | IVE's Wonyoung | Image Video | PINKVILLA |
| Feb 13, 2025 | In the TV show *Wagle Ki Duniya*, a deepfake video of Vivaan is used by a stalker to abduct Sakhi. Sakhi believes she's meeting Vivaan, but the cab ride is a trap. The stalker used a deepfake video to manipulate and deceive her. Rajesh and Vivaan work together to rescue her. | Sakhi | Video | The Times of India |
| Feb 13, 2025 | Two men in Louisiana were arrested for creating and distributing deepfake child pornography. Ryan Glaser (40) and Gregory Duncan Jr. (24) were arrested on charges related to possession and distribution of unlawful deepfakes. Glaser, a convicted sex offender, was found with the material during a parole visit. Duncan was identified as the creator and distributor. The investigation involved multiple agencies and was based on Louisiana law 73.13, which criminalizes deepfakes depicting minors in sexual situations. At least 37 states have similar laws. | Children | Image Video | News Talk 96.5 KPEL |
| Feb 13, 2025 | A 33-year-old man from Worcester, Jake Klair, lost £600 to a deepfake scam on Tinder. He believed he was communicating with a US soldier and sent the money for a supposed brother's operation. The scammer used AI to create realistic videos and audio. | Jake Klair | Video Audio | Express |
| Feb 12, 2025 | A deepfake video of Donald Trump urging Vladimir Putin to end the war in Ukraine was created by Ukrainian bloggers and shared on Telegram. The video falsely depicted Trump threatening Putin with the fates of former dictators. It was initially presented as genuine by the Russian messaging platform and some news outlets. The Ukrainian bloggers behind the deepfake later admitted to creating the video to demoralize active Russians. | Vladimir Putin | Video | Voice of America |
| Feb 12, 2025 | Deepfake videos of the author and other celebrities endorsing fake products and investment schemes. Court orders were obtained to remove the videos. | Author of the article and other celebrities | Video Audio | India TV News |
| Feb 12, 2025 | A video on social media shows various Jewish celebrities giving Kanye West the middle finger. The video was created using generative AI without the celebrities' consent and spread quickly due to anger at Kanye West's antisemitism. The video depicts celebrities wearing shirts with a middle finger and Star of David, overlaid on the word "KANYE." It ends with a call to action against antisemitism. Some celebrities depicted have publicly opposed antisemitism, while others haven't. One celebrity, Scarlett Johansson, has previously sued to prevent AI-generated likeness use. | Kanye West and various Jewish celebrities | Video | JTA News - Jewish Telegraphic Agency |
| Feb 11, 2025 | Three videos circulating online falsely depicted Monalisa Bhosle. Two videos used footage of Tanu Rawat with Bhosle's face superimposed, and one used footage of Wamiqa Gabbi. The videos were shared on Facebook, Instagram, YouTube, and X. AI detection tools confirmed the videos as deepfakes. | Monalisa Bhosle | Video | NDTV |
| Feb 11, 2025 | Tens of thousands of deepfake porn images are produced weekly, many targeting celebrities and ordinary women. Sharing these images is a criminal offense under the 2023 Online Safety Act, but creating them is not. A private member's bill introduced by Tory peer Charlotte Owen aimed to ban the creation of such images without consent. The government initially promised to incorporate the bill's provisions into the data bill, but significantly weakened the proposed penalties. Instead of prison time, the government proposed only fines for creating deepfake porn, regardless of the number of offenses. They also added a "reasonable excuse" defense, despite no one being able to identify a valid excuse. | celebrities and ordinary women | Image Video | The Guardian |
| Feb 10, 2025 | A deepfake video of Patrick Mahomes making self-deprecating remarks after the Chiefs' Super Bowl LVII loss went viral on TikTok and YouTube, accumulating millions of views. The video, clearly labeled as AI-generated, used Parrot AI. While the creator's intent was comedic, the video's realism highlights the potential for deepfakes to deceive viewers. | Patrick Mahomes | Video | CNET |
| Feb 10, 2025 | A 61-year-old man, John Cairns, lost \u00a33,250 to a deepfake scam using an AI-generated video of Elon Musk promoting an AI trading platform. Cairns, grieving the loss of his father, invested his inheritance after seeing the Facebook advertisement. He was then contacted by an 'account manager' who guided him through transactions on MetaTrader 5, eventually persuading him to invest more money. After initially withdrawing a small profit, he was prevented from withdrawing larger sums. His daughter's skepticism and online research revealed the scam. | John Cairns | Video | Daily Mail |
| Feb 10, 2025 | A deepfake video of President Prabowo Subianto and other officials was used on Instagram (@indoberbagi2025) to defraud victims in a fake social assistance program. Approximately 100 victims across 20 provinces were defrauded of Rp 65 million by December 2024. | President Prabowo Subianto and other officials | Video | Tempo.co English |
| Feb 10, 2025 | Deepfake videos of Monalisa Bhonsale, a 16-year-old who recently went viral, were created and spread online. One video shows a woman dancing in a red dress, and another shows a woman posing for paparazzi. Both were confirmed as deepfakes using AI face-swap technology. The creator of the dancing video admitted to using a face-swap AI feature. | Monalisa Bhonsale | Video Image | The Quint |
| Feb 10, 2025 | A Hong Kong merchant lost approximately US\$18.5 million in a deepfake scam where the perpetrator used AI-generated voice messages via WhatsApp to impersonate a mainland Chinese company's financial manager and convince the victim to transfer funds for cryptocurrency mining equipment. | Hong Kong merchant | Audio | Bangkok Post |
| Feb 10, 2025 | Deepfake allegations arose concerning a video announcement of a new memecoin by the president of the Central African Republic. AI detection tools gave conflicting results regarding the video's authenticity, with some showing high probability of AI generation. The official X account and website were suspended shortly after the announcement, raising concerns about a potential scam. | Central African Republic President Touadéra | Video | crypto.news |
| Feb 09, 2025 | Simone Simms, owner of an art gallery in Nottingham, was scammed out of £30,000 after falling victim to a deepfake of Pierce Brosnan. The scammers used AI to create convincing images and voice notes of Brosnan to arrange a fake exhibition, leading Simms to sell £20,000 in tickets before the scam was revealed. The deepfake was used in video calls and Telegram messages. | Simone Simms | Image Audio | Daily Mail |
| Feb 08, 2025 | A friend, Andrew Hayler, created and shared deepfake pornographic images and videos of Hannah Grundy and approximately 60 other women, primarily from Sydney, on a website titled "The Destruction of Hannah." The images were sourced from victims' private social media. Hayler was charged with using a carriage service to menace, harass, or cause offense. The case set a legal precedent in Australia due to the lack of specific legislation regarding deepfake pornography at the time. | Hannah Grundy and approximately 60 other women | Image Video | BBC.com |
| Feb 07, 2025 | A deepfake audio of Rihanna boasting about her expensive possessions circulated on Instagram. The AI-generated audio made it sound like Rihanna was listing her Beverly Hills mansion, London rental house, and private jet. Rihanna herself commented on the video, calling out the creator. This isn't the first instance of AI-generated audio featuring Rihanna; a fake Rihanna duet with Bad Bunny also circulated online in 2023. The video's creators did not initially disclose the use of AI but confirmed it in the comments after being questioned. | Rihanna | Audio | Billboard |
| Feb 07, 2025 | A deepfake audio of Rihanna boasting about her expensive possessions circulated on Instagram. The AI-generated audio made it sound like Rihanna was listing her Beverly Hills mansion, London rental house, and private jet. Rihanna herself commented on the video, calling out the creator. This isn't the first instance of AI-generated audio featuring Rihanna; a fake Rihanna duet with Bad Bunny also circulated online in 2023. The video's creators did not initially disclose the use of AI but confirmed it in the comments after being questioned. | Rihanna | Audio | Billboard |
| Feb 07, 2025 | A five-second AI-generated video falsely claiming to show the Ethiopian army parading ballistic missiles was shared on Facebook. The video's artificial nature was revealed by unnatural faces on missile carriers, an AI content detector, and tracing it back to a TikTok user who identified it as an AI video with a watermark that was removed in the Facebook post. | Ethiopian Army | Video | Yahoo! Voices |
| Feb 07, 2025 | An Omaha woman's ex-boyfriend allegedly used AI to create nude photos of her. A local non-profit is advocating for legislation. | Omaha woman | Image | Yahoo! Voices |
| Feb 04, 2025 | A deepfake video went viral on social media, showing comedian Samay Raina joking with Amitabh Bachchan on the show Kaun Banega Crorepati (KBC). The joke about Amitabh Bachchan and Rekha did not appear in the actual episode. AI detection tools confirmed the video and audio as deepfakes. | Amitabh Bachchan and Samay Raina | Video Audio | The Quint |
| Feb 04, 2025 | A deepfake video of Cristiano Ronaldo praising Virat Kohli was shared on Instagram by actor R Madhavan before being revealed as AI-generated by Anushka Sharma. | R Madhavan | Video | Hindustan Times |
| Feb 03, 2025 | AI-generated videos of Donald Trump and Elon Musk were used to defraud supporters into buying worthless Golden Eagles coins, promising substantial returns. One victim invested \$2,500 believing he could exchange coins for \$110,000 each. The coins were confirmed to be nickel, not gold. This follows a pattern of Trump supporters losing money on similar schemes. | Supporters of Donald Trump and Elon Musk | Video | The Independent |
| Feb 03, 2025 | A deepfake audio of Donald Trump's message, "make peace or die", was created and shared. This deepfake fooled some Russians and was used by a Russian lawmaker to accuse Trump of using scare tactics to pressure Putin into peace talks with Ukraine. | Vladimir Putin | Audio | VOA Asia |
| Feb 03, 2025 | A deepfake video featuring Senator Raffy Tulfo and Dr. Willie Ong falsely claims a seven-hour cure for diabetes. The video, posted on Facebook, has garnered significant views. Deepware and Resemble Detect, deepfake detection tools, independently flagged both the video and audio as AI-manipulated. The claim that diabetes is caused by a virus contracted from saltwater and that it can be cured in seven hours is false. | Senator Raffy Tulfo and Dr. Willie Ong | Video Audio | Rappler |
| Jan 29, 2025 | A crime syndicate operating on Telegram, using Chinese communication, launched coordinated attacks targeting African fintechs and companies in Germany and Singapore using deepfake videos. These attacks involved impersonating individuals. The attacks were curbed following intervention by the FBI and African law enforcement after being notified by Smile ID. Deepfakes accounted for 7% of global identity fraud attempts, a fourfold increase from 2023, with Africa experiencing one of the largest regional increases after the Middle East. | African fintechs and companies in Germany and Singapore | Video | Semafor |
| Jan 29, 2025 | A deepfake video appeared to show Carín León kissing Espinoza Paz, leading to rumors about León's sexuality. León addressed the rumors humorously, stating he had 'become gay' three days prior and expressing support for the LGBTQ+ community. The deepfake video increased engagement with his music, particularly his song 'De Compas'. | Carín León | Video | EDGE Media Network |
| Jan 29, 2025 | A 3-minute 27-second video shared by the Aam Aadmi Party (AAP) on X (formerly Twitter) on January 27, 2025, falsely claimed to show Prime Minister Narendra Modi's official residence. Analysis revealed the video to be AI-generated, exhibiting unnatural textures, lack of detail, visual anomalies, and a Sora watermark. AI-content detection tools confirmed its likely AI-generation. | Narendra Modi | Video | Newschecker |
| Jan 28, 2025 | Investigative reporter Patrizia Schlosser was targeted with deepfake pornography on the website MrDeepFakes. The site hosts tens of thousands of videos and images, has close to 650,000 members, and receives millions of visits a month. The content has been viewed almost two billion times. The site's administrators have remained anonymous, using methods like cryptocurrency payments and unverifiable PayPal accounts to obscure ownership. The site advertised apps like Deepswap, which allows users to create deepfake photos and videos. Deepswap was linked to companies with connections to Nexgo, a publicly traded Chinese fintech company. Concerns exist about Nexgo's potential involvement due to Chinese laws prohibiting deepfakes and the complex corporate structure used. | Patrizia Schlosser | Image Video | bellingcat |
| Jan 28, 2025 | A deepfake video depicting TXT's Yeonjun in an intimate moment with an unknown woman went viral, causing outrage among fans. The realism of the AI-generated video and the rise of similar incidents targeting K-pop idols are highlighted. | TXT's Yeonjun | Video | ABP Live |
| Jan 28, 2025 | A deepfake video depicting Barron Trump as unusually tall circulated on social media platforms. The video was deemed false, and the actual footage showed Barron Trump's height to be 2.01 meters. | Barron Trump | Video | Fact Crescendo Sri Lanka |
| Jan 28, 2025 | AI-manipulated videos of Monica Geingos were used in investment scams across various social media platforms. The deepfakes were convincingly realistic. | Monica Geingos, former First Lady of Namibia | Video | Forbes Africa |
| Jan 25, 2025 | AI-generated deepfakes targeting Ukrainian refugees in the US and Denmark, altering their statements and images with fabricated voiceovers to portray them negatively. Stolen footage from reputable media was used. Similar tactics were used against Western journalists. One X post with fabricated videos received over 55,000 views. | Ukrainian refugees and Western journalists | Video Audio | VOA Asia |
| Jan 24, 2025 | A scammer impersonated Elon Musk using deepfake technology in video chats and on Threads to convince a woman to send over $60,000 via gift cards. The scammer promised a Tesla and cash but never delivered. Authorities could not recover the funds. | A woman in Lafayette, Louisiana | Video Audio | VnExpress International |
| Jan 24, 2025 | A 54-year-old school teacher from West Bengal was arrested for her alleged involvement in a ₹1.05 crore online scam. She claims she was duped by someone posing as a popular Bollywood musician via a deepfake video call. The fraudster gained her trust and convinced her to hand over her bank account credentials. | Sulapa Mishra | Video Audio | The Hindu |
| Jan 23, 2025 | A Bengaluru-based chartered accountant lost Rs 23.20 lakh in a stock investment scam using deepfake videos of Mukesh Ambani, Narayana Murthy, and Sudha Murty. The victim saw the videos on Facebook on October 2, 2024, submitted personal details through a link, and made several transfers totaling Rs 23.20 lakh before realizing the scam. A police case was registered on January 13, 2025. | B Hari | Video | Deccan Herald |
| Jan 23, 2025 | An AI-generated video depicts Bayern Munich player Thomas Muller playing for rival club RB Leipzig, causing concern among Bayern fans. The video's realism highlights the potential for deepfakes to spread misinformation. | Bayern Munich fans | Video | Yahoo Sports |
| Jan 23, 2025 | A deepfake video depicting Tony Khan criticizing AEW wrestler Britt Baker during a call with TBS executives. The video is AI-generated and intended to be malicious, aiming to capitalize on Baker's absence from AEW television. | Tony Khan and Britt Baker | Video | WhatCulture |
| Jan 20, 2025 | Vicky Pattison, a British television personality, will release a deepfake pornography video of herself as part of a Channel 4 documentary. The video will be used to highlight the issue of deepfakes and their impact on women. The documentary also features interviews with other victims, including Northern Ireland MLA Cara Hunter and Channel 4 News presenter Cathy Newman. | Vicky Pattison | Video | Yahoo! Voices |
| Jan 19, 2025 | A 27-year-old PE teacher, Cheryl Bennett, was targeted by a deepfake video that falsely portrayed her using racial slurs. The video, manipulated from CCTV footage showing her delivering political leaflets, was posted by a local politician. The video resulted in over 800 complaints, forcing her to take leave from her job. Investigations confirmed the video was manipulated. The perpetrator settled with Bennett and paid substantial damages. | Cheryl Bennett | Video Audio | Daily Mail |
| Jan 17, 2025 | Two teenage boys were charged with creating and distributing 347 AI-generated nude images and videos of approximately 60 students, mostly female and under 18, on Discord. The images were allegedly created using readily available AI apps and photos from the school's Instagram page or FaceTime calls. The school's top leadership stepped aside after a lawsuit for failing to report the activity. | Students at Lancaster Country Day School in Pennsylvania | Image Video | youralaskalink |
| Jan 16, 2025 | Fraudsters stole $35 million using forged emails and deepfake audio | a UAE company | Audio | Built In |
| Jan 16, 2025 | A deepfake porn video featuring TikTok influencer Charli D'Amelio was viewed over 8,200 times on a deepfake pornography site. The video's creator, "DeepWorld23," claimed to have used a deepfake model from GitHub. Videos featuring celebrities like Emma Watson and Taylor Swift have also been created using open-source models from GitHub. | Charli D'Amelio, Emma Watson, Taylor Swift | Video | WIRED |
| Jan 16, 2025 | AI-generated images and videos falsely depicting the Hollywood Sign engulfed in flames went viral on social media platforms like Instagram and X. McAfee researchers confirmed these images as deepfakes, tracing many to Google's Gemini AI image generation platform. The deepfakes were easily created and spread rapidly, reaching over a million views within 24 hours. The Hollywood Sign remains undamaged. | Hollywood Sign | Image Video | Times Now |
| Jan 15, 2025 | A deepfake video advertisement featuring Dr. Tony Leachon promoting a fake prostatitis cure circulated on Facebook. The video, mimicking an ANC news format, used footage from a 2019 interview about hypertension. Leachon's voice was cloned and his mouth movements manipulated to promote a fraudulent product and direct viewers to a fake website (AKELAHORMESCLADE.FUN). | Dr. Antonio "Tony" Leachon | Video Audio | VERA Files |
| Jan 15, 2025 | Starship Entertainment, IVE's agency, reposted deepfake content on its official Chinese Weibo account. The deepfake content maliciously edited IVE members Jang Won Young and An Yu Jin, with An Yu Jin being the primary target. Following fan outrage, Starship apologized on January 15th and disciplined the responsible staff member. | IVE’s An Yu Jin and Jang Won Young | Image Video | soompi |
| Jan 14, 2025 | The daughter of deceased French voice actor Alain Dorval objected to the use of AI to recreate his voice in Sylvester Stallone's film *Armor*. She claims that an agreement was broken, stating that the AI-generated voice, created by ElevenLabs, was used without her permission despite only agreeing to a trial. She insists that neither she nor her mother approved the final product, deeming the quality unacceptable and contrary to her father's wishes. | Alain Dorval | Audio | The Times |
| Jan 14, 2025 | A scammer used AI-generated images and videos of Brad Pitt and his mother to convince Anne to transfer \$1.2 million to a Turkish bank account under the false pretense that Pitt needed the money for kidney cancer treatment. The scam was revealed after Anne appeared on French TV, and the program was later pulled due to online backlash. Similar scams have targeted others, and this is not the first such deepfake scam involving Brad Pitt. | Anne, a 53-year-old French interior designer | Image Video | National Post |
| Jan 14, 2025 | A 77-year-old retired lecturer from Edinburgh, Nikki MacLeod, lost £17,000 in a romance scam involving AI-generated deepfake videos of a fictitious woman, "Alla Morgan." The scammer, posing as "Alla Morgan," built trust by sending MacLeod videos, documents, and a fake bank account. The scam involved multiple requests for money, culminating in an attempt to transfer £65,000. MacLeod recovered £7,000 but lost most of the money sent via PayPal. Police Scotland are investigating. | Nikki MacLeod | Image Video | STV News |
| Jan 14, 2025 | A deepfake video depicting Northern Ireland MLA Cara Hunter in pornographic activity was widely shared in April 2022, causing significant distress and impacting her political career. Police were unable to trace the video's origin due to technological limitations. The incident highlighted the disproportionate targeting of women in deepfake abuse and prompted calls for stronger legislation against the creation of sexually explicit deepfake content. | Cara Hunter | Video | Evening Standard |
| Jan 14, 2025 | A deepfake video circulating on social media depicts Taylor Swift blaming the Los Angeles wildfires on divine retribution for US support of Israel's actions in Gaza. BOOM! analyzed the video and confirmed it's a deepfake. The original footage is from Swift's 2021 appearance on *The Tonight Show Starring Jimmy Fallon*, predating both the wildfires and the Gaza conflict. The video's audio shows discrepancies, indicating AI voice cloning. Reverse image searches and comparisons with the original *Tonight Show* footage confirm manipulation. | Taylor Swift | Video Audio | BOOM |
| Jan 14, 2025 | Sharon Lavy, a Jewish flight attendant, sued Delta Airlines for discrimination and harassment, claiming retaliation after reporting antisemitism and support for Hamas among coworkers. Delta allegedly used "ambush tactics," including a deepfake video showing Lavy on a flight she wasn't trained for, along with other false accusations to justify her firing. A colleague, Roey Segev, filed a similar lawsuit. | Sharon Lavy | Video | VINNews |
| Jan 13, 2025 | A deepfake parody video of Vice President Kamala Harris's presidential campaign ad was created by Christopher Kohls and shared on X (formerly Twitter) by Elon Musk. This video was used in a lawsuit challenging Minnesota's deepfake law. The Attorney General's expert witness used AI-generated false information in their testimony, causing the judge to reject the evidence and severely damaging their credibility. | Minnesota Attorney General Keith Ellison | Video | Reuters |
| Jan 13, 2025 | Deepfake videos were used to spread false narratives, tarnish reputations, and harass women in politics and journalism during elections in Ghana (2020), and planned for Namibia and Senegal (2024). | Women in politics and journalism in Africa (Ghana, Namibia, Senegal) | Video | CIO Africa |
| Jan 12, 2025 | Jodie received an anonymous email with links to a pornographic website containing hundreds of her photos and comments. The poster solicited others to create sexually explicit deepfakes using her images from her private Instagram. Hundreds of synthetic images and videos depicting her in non-consensual sexual situations were created and shared online. This is part of a growing trend of synthetic, sexually explicit content being traded online. The UK government is cracking down on this, but soliciting deepfakes isn't currently illegal. | Jodie | Image Video | The Guardian |
| Jan 11, 2025 | Scammers impersonated Johnny Depp using AI deepfakes on social media to extort money from fans. The deepfakes mimicked Depp's voice and appearance to create fake accounts. | Johnny Depp and his fans | Image Video Audio | Yahoo! Voices |
| Jan 11, 2025 | Morphed images of Bollywood celebrities like Rashmika Mandanna, Alia Bhatt, and Katrina Kaif circulated widely on social media. An individual, Sanket (name changed), was blackmailed using deepfake intimate images after clicking on a malicious advertisement. 84% of social media influencers have reportedly fallen victim to deepfake pornography. | Bollywood celebrities and ordinary individuals in India | Image Video | The Indian Express |
| Jan 10, 2025 | AI-generated nude images of high school students were disseminated on social media. | high school students in Westfield, New Jersey | Image | GoErie.com |
| Jan 10, 2025 | The author of the article was deepfaked by their best friend in 2021. The deepfake involved the creation of realistic images or videos making it appear as though the victim was engaging in intimate or sexual acts without their consent. The perpetrator solicited the creation of the deepfakes. This event prompted the author to advocate for stronger legislation to protect victims of deepfake abuse. | Author of the article | Image Video | GLAMOUR UK |
| Jan 10, 2025 | Deepfake images of IVE members Jang Wonyoung and An Yujin with malicious captions were reposted on Starship Entertainment's official Weibo account before being deleted. Starship Entertainment apologized, stating it was an accident during a report of malicious posts. Fans remain unsatisfied and demand further investigation. | IVE members Jang Wonyoung and An Yujin | Image | PINKVILLA |
| Jan 09, 2025 | Deepfake videos of Dr. Naresh Trehan giving medical advice on urology were created using AI, photoshopping, and voice-over techniques. The videos falsely portrayed Dr. Trehan endorsing natural remedies for prostatitis and erectile dysfunction. They were viewed over 1.1 million times before being taken down by court order. | Dr. Naresh Trehan | Video Audio | The Indian Express |
| Jan 09, 2025 | A high school senior in Sydney, Australia allegedly used AI to create deepfake pornography of female students using images from social media. Fake social media profiles were also created. Parents and students were notified. Police launched an investigation on January 6th. The NSW Department of Education is working with police and will take appropriate action. The incident is considered illegal and abhorrent. A similar incident occurred in Victoria in June 2022. | female students at a Sydney high school | Image Video | New York Post |
| Jan 08, 2025 | A deepfake video falsely portrays UK Prime Minister Keir Starmer admitting to knowing about the Jimmy Savile investigation but dismissing claims as frivolous. The video uses AI-generated audio and manipulated video footage. Experts confirmed the video's AI manipulation and inconsistencies. The original video was from a 2012 Guardian video about social media prosecution guidelines. A previous deepfake of Starmer promoting an investment scheme was also cited. | Keir Starmer | Video Audio | Full Fact |
| Jan 07, 2025 | A deepfake porn website targeted over 30 British female politicians, including Deputy Prime Minister Angela Rayner. | Over 30 British female politicians, including Deputy Prime Minister Angela Rayner | Image Video | News Central |
| Jan 07, 2025 | A pornographic deepfake of Northern Irish politician Cara Hunter was shared before an election, leading to harassment and public questioning. | Cara Hunter | Image Video | THE DECODER |
| Jan 07, 2025 | The Guardian article discusses multiple instances of AI-generated deepfake audio. Georgina Findlay, a YouTube presenter, had her voice used in numerous videos by a far-right channel. Other examples include deepfake audio of Sadiq Khan making inflammatory remarks, David Attenborough's voice used in partisan US news, and a voice eerily similar to Scarlett Johansson's created using OpenAI technology. While specific dates aren't provided for each incident, the article highlights the increasing use of this technology for malicious purposes. | Georgina Findlay, Sadiq Khan, David Attenborough, Scarlett Johansson | Audio | The Guardian |
| Jan 07, 2025 | Deepfake pornography featuring the faces or bodies of at least 250 British celebrities superimposed onto explicit images or videos without their consent. Channel 4 News presenter Cathy Newman and former Love Island contestant Cally Jane Beech shared their experiences. The government is introducing a new offense to address this issue. | 250 UK celebrities, including Cathy Newman and Cally Jane Beech | Image Video | Mint |
| Jan 07, 2025 | From the United States to Italy, Britain, and Pakistan, female politicians are increasingly becoming victims of AI-generated deepfake pornography or sexualized images. An online boom in non-consensual deepfakes is outpacing efforts to regulate the technology globally, with cheap AI tools digitally undressing women. This imagery is used to tarnish reputations, jeopardize careers, undermine public trust, and create conditions for blackmail or harassment. In the U.S., the American Sunlight Project (ASP) identified over 35,000 instances of deepfake content depicting 26 members of Congress—25 women. Nearly one in six women in Congress have been victims. ASP did not release names to avoid public searches but privately notified offices. In the UK, Deputy Prime Minister Angela Rayner was among over 30 British female politicians targeted by a deepfake porn website. In Italy, Prime Minister Giorgia Meloni is seeking damages from two men who created deepfake porn videos of her. In Pakistan, a deepfake video of lawmaker Meena Majeed was debunked, and Information Minister Azma Bukhari was targeted by a deepfake video. | Female politicians worldwide | Image Video | The Hindu |
| Jan 07, 2025 | Social media influencer Cally Jane Beech had an AI-generated nude image created from one of her clothed photos and shared online. She found the deepfake incredibly realistic and reported it to the police, but faced difficulties due to the global nature of the hosting site and the police's unfamiliarity with this type of crime. | Cally Jane Beech | Image | Sky News |
| Jan 06, 2025 | Deepfake pornography and sexualized images targeting female politicians are spreading globally. The American Sunlight Project identified over 35,000 instances of deepfake content depicting 26 members of Congress (25 women) on pornographic sites. A Channel 4 investigation revealed that over 30 British female politicians, including Deputy Prime Minister Angela Rayner, were targeted by a deepfake porn website. Prime Minister Giorgia Meloni is suing two men for creating and distributing deepfake porn videos of her. Deepfake videos targeting female politicians have also surfaced in Pakistan, including fabricated videos of lawmaker Meena Majeed and Information Minister Azma Bukhari. | Multiple female politicians across the US, UK, Italy, and Pakistan | Image Video | The Daily Courier |
| Jan 05, 2025 | A Hong Kong deepfake scam group used deepfakes to impersonate wealthy, single women to defraud victims in Taiwan, Singapore, and Malaysia. Recruits were trained to discuss topics such as expensive red wine and golf, and to learn about victims' finances and cryptocurrency investments to build trust. Over HK$34 million in scam proceeds were intercepted by police. | Individuals in Taiwan, Singapore, and Malaysia | Image Video Audio | South China Morning Post |
| Jan 03, 2025 | Dozens of AI-generated videos depicting Donald Trump making various statements have circulated on social media in Kenya and Nigeria. In Kenya, a deepfake video of Trump threatening to withhold U.S. aid went viral on TikTok and X. In Nigeria, videos showed Trump announcing changes to U.S.-Nigeria immigration policy and calling for the release of Nnamdi Kanu, threatening aid withdrawal if Kanu wasn't released by November 31, 2024. Both videos contained inconsistencies like mismatched lip movements, and claims were unsubstantiated. | Kenya and Nigeria | Video | VOA Asia |
| Jan 02, 2025 | A Royal Air Force veteran, Jonathan Bates (54), received a five-year prison sentence for creating and distributing deepfake pornography of his ex-wife and three other women, whom he stalked for years. The images were posted on pornographic websites, including fake profiles advertising sexual services. The victims suffered severe impacts on their personal and professional lives, including fear, humiliation, and job loss. Police recovered thousands of images from his home. Despite efforts to remove the content, prosecutors stated the images would likely remain online indefinitely. Bates pleaded guilty to four counts of stalking and one count of revenge porn against his ex-wife. Each victim received a 10-year restraining order. | ex-wife and three other women | Image Video | New York Post |
| Jan 02, 2025 | During the Delhi assembly elections in late 2024, the Aam Aadmi Party (AAP) and the Bharatiya Janata Party (BJP) used deepfakes from shows like *Panchayat* and *Maharani*. BJP depicted AAP chief Arvind Kejriwal negatively, while AAP retaliated with deepfakes promoting their schemes. A deepfake of Pankaj Tripathi criticizing BJP was also shared. Other incidents involved Ranveer Singh, Kanchan Nagar, and Rajat Sharma. Zomato also faced criticism for using generative AI to create videos featuring celebrities without permission. | Arvind Kejriwal, Atishi Marlena, BJP, AAP, Ranveer Singh, Kanchan Nagar, Rajat Sharma | Video Image | afaqs! |
| Dec 30, 2024 | A 17-year-old girl, Jaylyn Lee, pleaded not guilty to eight counts of promoting an altered sexual depiction of an identifiable person without consent. Lee is accused of distributing AI-generated nude photos of 14 high school girls. The photos were allegedly created by her 18-year-old ex-boyfriend using an AI app. Lee obtained the photos from her ex-boyfriend's phone, kept them for a month, and then sent them to 17 high school students, some of whom were not depicted in the images. Police stated that the creation or possession of AI-generated nude photos isn't illegal, but distributing them is. While the victims' parents want the ex-boyfriend charged, police say he didn't break any laws because he didn't distribute the photos. Lee's next court date is January 30th. | 14 high school girls | Image | Pensacola News Journal |
| Dec 30, 2024 | AI-generated deepfake images of Taylor Swift circulated on social media, causing widespread outrage. Microsoft responded by improving its deepfake prevention tools. | Taylor Swift | Image | Cornwall Live |
| Dec 31, 2024 | AI-generated deepfakes of Indian politicians were used to spread misinformation during elections. Fake videos of politicians making false claims (e.g., Amit Shah on ending reservations, Supriya Sule on Bitcoin fraud) were created and circulated. Deepfake videos of business leaders promoting investment scams also appeared. Similar tactics were used internationally, including in the Israel-Hamas conflict and in Bangladesh. | Multiple political figures in India (Amit Shah, Supriya Sule, etc.) and business leaders (Mukesh Ambani, Sundar Pichai, Elon Musk, etc.) | Video Audio Image | Vishvas News English |
| Dec 30, 2024 | A 17-year-old girl, Jaylyn Lee, pleaded not guilty to eight counts of promoting an altered sexual depiction of an identifiable person without consent. Lee is accused of distributing AI-generated nude photos of 14 high school girls. The photos were allegedly created by her 18-year-old ex-boyfriend using an AI app. Lee obtained the photos from her ex-boyfriend's phone, kept them for a month, and then sent them to 17 high school students, some of whom were not depicted in the images. Police stated that the creation or possession of AI-generated nude photos isn't illegal, but distributing them is. While the victims' parents want the ex-boyfriend charged, police say he didn't break any laws because he didn't distribute the photos. Lee's next court date is January 30th. | 14 high school girls | Image | Pensacola News Journal |
| Dec 30, 2024 | AI-generated deepfake images of Taylor Swift circulated on social media, causing widespread outrage. Microsoft responded by improving its deepfake prevention tools. | Taylor Swift | Image | The Economic Times |
| Dec 28, 2024 | A classmate created deepfake nude images of them using AI. Police declined to press charges due to legal ambiguities and insufficient evidence of distribution. The girls suffered emotional distress. | group of Toronto high school girls | Image | Toronto Star |
| Dec 27, 2024 | The author of a Channel 4 news report, along with numerous other celebrities and public figures, became victims of deepfake pornography. An investigation revealed millions of views across multiple websites. The article highlights the dehumanizing and violating experience for victims, the slow implementation of regulations, and the continued online presence of deepfakes despite notifications to tech companies. The case of Sophie Parrish, a 31-year-old florist, is used to illustrate the severe emotional distress caused by deepfake nudes. | The author of the Channel 4 news report, along with several other celebrities (Taylor Swift, Jenna Ortega, Alexandra Ocasio-Cortez, Georgia Meloni) and other public figures | Video | Channel 4 News |
| Dec 26, 2024 | Deepfake images of Indian actors Deepika Padukone and Ranveer Singh with their infant daughter, and of actors Rashmika Mandanna and Vijay Deverakonda, circulated on Instagram. The images appeared in Instagram search results and garnered numerous likes despite being absent from the actors' official accounts. The origin of the deepfakes is unclear, and the images lacked AI-generated content labels. | Deepika Padukone, Ranveer Singh, Rashmika Mandanna, Vijay Deverakonda | Image | The Hindu |
| Dec 21, 2024 | A deepfake audio of President Biden urging Democrats not to vote in the New Hampshire primary was created by a Democratic political consultant. This resulted in a $6 million FCC fine and criminal charges. | Democratic voters in New Hampshire primary | Audio | NPR |
| Dec 21, 2024 | Multiple deepfake images of Pope Francis have been generated and circulated online. These include images showing him with Madonna, wearing a Balenciaga puffer jacket, holding a Pride flag, on a beach, and with his face merged with that of an alleged murderer. The images were created using both paid platforms like Krea.ai and freely available models like Stable Diffusion. The creator, RickDick, stated that the images were intended as satire. | Pope Francis | Image | The Guardian |
| Dec 19, 2024 | A 77-year-old woman, Nikki MacLeod, was defrauded of £17,000 through a romance scam involving AI-generated deepfake videos. The scammer, posing as a woman named Alla Morgan working on an oil rig, used the videos to build trust and then requested increasing sums of money under various fabricated pretenses. While some funds were recovered, personal payments sent via PayPal were not. A cybersecurity expert confirmed the videos' manipulation. | Nikki MacLeod | Video | BBC.com |
| Dec 18, 2024 | A 15-year-old girl was victimized by AI-generated deepfake pornography. This prompted Congressional action to mandate social media platforms and websites to remove non-consensual, AI-created pornographic images. | 15-year-old girl | Image Video | CBS News |
| Dec 18, 2024 | A classmate used AI to manipulate a picture of 15-year-old Elliston Berry from her Instagram, removing her dress and distributing the altered image on Snapchat. The image circulated for nine months. This incident prompted Elliston Berry to urge Congress to pass the Take It Down Act. | 15-year-old Elliston Berry | Image | CBS News |
| Dec 17, 2024 | A study by the American Sunlight Project (ASP) found that women in the U.S. Congress are 70 times more likely to be victims of deepfake pornography than their male counterparts. The study analyzed 11 websites and found 26 members of Congress (25 women and one man) in deepfake content. Content targeting 14 members was removed within 48 hours of ASP notification. | Women US lawmakers | Image Video | USA TODAY |
| Dec 17, 2024 | Over 35,000 mentions of nonconsensual intimate imagery (NCII) targeting primarily female members of Congress were found on deepfake websites. The American Sunlight Project (ASP) found that women in Congress are 70 times more likely to be targeted than men. While most imagery was quickly removed after researchers contacted the affected lawmakers, the material can be easily re-shared. The impact extends beyond politics, with high school girls also being targeted. The lack of federal legislation poses risks to national security. | 25 female members of Congress and other women in public life | Image Video | South Carolina Daily Gazette |
| Dec 12, 2024 | AI voice generator Lovo allegedly cloned the voices of voice actors Lehrman and Sage using recordings obtained through Fiverr, without their consent. The actors were misled about how their voice recordings would be used and later discovered that their voices were used commercially on Lovo's platform and in a podcast, under pseudonyms. A lawsuit alleging misuse of voice, copyright infringement and other claims has been filed. | Lehrman and Sage | Audio | The National Law Review |
| Dec 11, 2024 | Two teenage boys created and distributed 347 AI-generated deepfake pornographic images and videos of approximately 60 high school girls using photos from their public social media accounts. The images were shared within the school community. The boys were criminally charged with sexual abuse of children and possession of child pornography. This is considered the largest known instance of this crime involving minors in the US. Parents filed lawsuits against the school for negligence. | Approximately 60 high school girls, mostly from Lancaster Country Day School | Image Video | Forbes |
| Dec 10, 2024 | Houston businessman Gary Cunningham lost $20,000 after criminals cloned his voice using AI to impersonate him to his accountant. In November, a fraudulent wire transfer was initiated, diverting funds to a new bank account. His email had been hacked and his voice cloned. A police report has been filed. | Gary Cunningham | Audio | FOX 26 Houston |
| Dec 04, 2024 | Deepfake ads on YouTube featuring celebrities like Arnold Schwarzenegger, Sylvester Stallone, Mike Tyson, Terry Crews, Tom Hanks, Denzel Washington, and Johnny Sins promoting an erectile dysfunction supplement called "Prolong Power". The ads used AI-generated voices and lip syncing on modified existing videos. The ads directed users to websites with a 40-minute presentation making exaggerated and unsubstantiated claims. Google removed the ads and suspended the account. | YouTube users | Video Audio | 404 Media |
| Dec 04, 2024 | Over 1,100 fraudulent loan application attempts and over 1,000 fraudulent accounts were created using AI-generated deepfake images to bypass biometric verification systems, including liveness detection. Attackers obtained victim IDs through illicit channels (malware, social media, dark web), manipulated the images, and used them to deceive the system. Attackers used AI-generated deepfakes to bypass biometric verification and liveness detection. They also employed virtual camera software and app cloning to manipulate biometric data and simulate multiple devices. Potential losses in Indonesia alone are estimated at $138.5 million. | A prominent Indonesian financial institution | Image Video | Forbes |
| Nov 29, 2024 | A BBC journalist used AI-generated voice cloning technology to bypass the voice ID systems of Santander and Halifax banks by using a recording of her AI-cloned voice saying, "My voice is my password." This highlights the vulnerability of current biometric security measures. | Santander and Halifax banks | Audio | CX Today |
| Nov 27, 2024 | A BBC reporter successfully accessed their bank accounts at Santander and Halifax using an AI-generated clone of their voice. A readily available recording of the reporter's voice was used to create the deepfake. Basic audio equipment was sufficient to bypass security measures. | Santander and Halifax bank accounts | Audio | BBC.com |
| Nov 25, 2024 | A scammer created a deepfake video of Amanda Aguilar and used it on Facebook to contact John Pulido. The scammer, posing as Aguilar, attempted to obtain financial information from Pulido. The deepfake video was convincing enough to initially fool Pulido, but he became suspicious due to requests about his income and requested video proof. | Amanda Aguilar | Video | NBC Washington |
| Nov 25, 2024 | A user was able to clone Kamala Harris' voice and generate inappropriate speech using PlayAI's text-to-speech tool, bypassing the platform's safeguards. PlayAI's community portal also contained content with explicit titles. | Kamala Harris | Audio | TechCrunch |
| Nov 25, 2024 | The voices of several public figures, including Sir David Attenborough, Sir Michael Parkinson, and Bill Gates, were cloned and used without their consent in various scenarios, including fraudulent advertisements and scams. A school principal received death threats via a deepfake audio clip. A CEO's voice was cloned in an attempt (unsuccessful) at corporate espionage. | multiple individuals and organizations | Audio | BBC.com |
| Nov 24, 2024 | A convincing fake Microsoft Teams meeting resulted in a $25 million loss to cybercriminals. | Unspecified business | Audio | eWeek |
| Nov 24, 2024 | Deepfakes of Elon Musk were used in cryptocurrency investment scams, resulting in billions of dollars in losses. One victim, Heidi Swan, lost over \$10,000. The FTC and BBB have issued warnings. The ease of creating these deepfakes was demonstrated using readily available AI tools. Deepfake detection websites show varying accuracy. | Elon Musk | Video Image | CBS News |
| Nov 23, 2024 | Des Healey, a Brighton kitchen fitter, lost £76,000 to a deepfake scam using the likenesses and voices of Martin Lewis and Elon Musk in a fake Facebook advert promoting a Bitcoin investment scheme. He invested his life savings and took out multiple loans before his son alerted him to the scam. Two banks have since canceled his loans, but he still owes approximately £26,000. | Des Healey | Image Video Audio | BBC.com |
| Nov 18, 2024 | David Attenborough's voice was cloned and used in AI-generated deepfakes on YouTube videos about the Ukraine-Russia war and Donald Trump. Attenborough expressed concerns about his identity being stolen and used to promote messages he doesn't endorse. One deepfake creator claimed they weren't impersonating him, despite the obvious similarities. | David Attenborough | Audio | Deadline |
| Nov 15, 2024 | Fake audio messages were used in New Hampshire in January to discourage voting. These messages used a deepfake of President Biden's voice. | voters in New Hampshire | Audio | University of Florida |
| Nov 01, 2024 | A fake AI-generated image of an explosion near the Pentagon circulated on social media, causing temporary market disruption. | financial markets | Image | Center for Strategic & International Studies |
| Oct 30, 2024 | The text describes several types of deepfake scams, including investment scams targeting an 82-year-old who lost \$690,000 to a deepfake Elon Musk, romance scams in Hong Kong resulting in over \$46 million in losses, political scams using AI-generated audio of Joe Biden, extortion scams (grandparent scams) resulting in over \$13 million in losses from January 2020 to June 2021, and celebrity endorsement scams featuring Taylor Swift. Specific details about each incident, such as exact dates and victims names are not provided. | Multiple individuals and groups | Image Video Audio | National Council on Aging |
| Oct 29, 2024 | Scammers used AI to clone Sunil Mittal's voice to attempt to defraud him. The attempt was unsuccessful, but others have lost money to similar scams. | Sunil Mittal | Audio | The Indian Express |
| Oct 28, 2024 | Dozens of Wiz employees received a deepfake voice message seemingly from the CEO, Assaf Rappaport. The deepfake used audio of Rappaport from a conference. The attack aimed to obtain employee credentials. The source of the audio was traced, but the perpetrators remain unidentified. | Wiz employees | Audio | TechCrunch |
| Oct 17, 2024 | Anthony was scammed out of $25,000 after fraudsters used AI to replicate his son's voice. The scammers called, claiming his son had been in an accident and needed bail money. Anthony sent money via Uber drivers who were unaware of the scam. Police confirmed the use of AI voice cloning and warned about the scammers' tactics. | Anthony | Audio | ABC7 Los Angeles |
| Oct 15, 2024 | In early 2020, a Telegram bot was discovered that generated over 100,000 explicit AI-generated images, including those of children. A recent investigation revealed at least 50 Telegram bots claiming to create explicit photos and videos with minimal input, boasting over 4 million combined monthly users. These bots are often supported by associated Telegram channels with millions of subscribers, advertising new features, and offering "tokens" for use. Many bots clearly advertise their function—creating nude or sexually explicit images of women. Some require users to pay for tokens to use the service. One bot, with over 300,000 users, deceptively hid its explicit function behind a non-explicit name and landing page. Following WIRED's contact, Telegram removed 75 identified bots and channels; however, additional channels and bots quickly appeared. | Women and children | Image Video | WIRED |
| Oct 15, 2024 | A romance scam using deepfake AI resulted in losses exceeding $46 million. 28 people were arrested for creating realistic online personas of attractive women to build relationships with victims and coerce them into investing in a fake cryptocurrency platform. A training manual detailed methods to manipulate victims' emotions and trust. This followed a similar case where a Hong Kong company lost $25 million. | Men across Asia | Image Video | CNN |
| Oct 04, 2024 | A deepfake audio clip was created making it seem like the principal made racist and antisemitic comments. This led to death threats, administrative leave for the principal, and significant community division. The creator of the deepfake, the school's athletics director, was charged and is awaiting trial. | Eric Eiswert, principal of a high school in Baltimore suburb | Audio | BBC.com |
| Oct 02, 2024 | Scammers used AI to clone Jay Shooster's voice to convince his parents to send $30,000. They falsely claimed Shooster was in a car accident and needed bail money. Only 15 seconds of Shooster's voice from a recent TV appearance were used to create the AI clone. | Jay Shooster's parents | Audio | NDTV |
| Sep 30, 2024 | In early September 2024, Senator Ben Cardin (D-Md.) received a deepfake Zoom call from an imposter posing as Ukrainian Foreign Minister Dymtro Kuleba. The imposter asked politically charged questions, arousing suspicion. The call was ended, and the Department of State confirmed its inauthenticity. Senator Cardin reported the incident, and an investigation is underway. | Senator Ben Cardin | Audio Video | Dark Reading |
| Sep 27, 2024 | A woman received a call from a voice convincingly mimicking her daughter, demanding a $1 million ransom. While she confirmed her daughter's safety, the incident highlights the sophistication of these scams. | woman | Audio | BECU |
| Sep 26, 2024 | An AI-generated deepfake impersonating Dmytro Kuleba, the former Ukrainian Minister of Foreign Affairs, initiated a video call with Senator Ben Cardin. The deepfake was sophisticated enough to fool initial observation, but inconsistencies were detected, and the call was ended. The incident is considered a targeted attack highlighting the increasing sophistication and potential for future deepfake attacks. | Senator Ben Cardin | Video Audio | The Associated Press |
| Sep 25, 2024 | Elecrow, an electronics manufacturer, used AI to clone the voice of YouTuber Jeff Geerling to promote their products in video tutorials. The cloning was discovered by a subscriber and confirmed by Geerling. Elecrow's CEO apologized and offered compensation. The incident was publicized to raise awareness about AI voice cloning. | Jeff Geerling | Audio | Forbes |
| Sep 25, 2024 | An individual impersonating former Ukrainian Foreign Minister Dmytro Kuleba contacted Senator Ben Cardin via Zoom. The impersonator's voice was likely AI-generated, and the conversation involved politically charged questions about supporting long-range missiles into Russia. The incident was reported to the Senate security office and the FBI and is believed to be an attempt to use the conversation for propaganda purposes, potentially by a Russian government actor. | Ben Cardin | Audio Video | Punchbowl News |
| Sep 18, 2024 | In a deepfake incident, Hong Kong police investigated a case where an employee was tricked into transferring HK$200 million ($20 million USD) to fraudsters who used a deepfake video conference call impersonating company officers. The fraudster likely used AI to add fake voices to pre-downloaded videos. | Hong Kong company employee | Audio Video | The Guardian |
| Sep 18, 2024 | Criminals are using AI to clone voices from just three seconds of audio, obtained from publicly available online content. The AI-powered scam involves cloning a victim's voice and then cold-calling their loved ones to request money. Hundreds of cases have been reported by Starling Bank, and data suggests 28% of UK adults have been targeted. | UK adults | Audio | Entrepreneur |
| Sep 03, 2024 | Scammers stole $25 million from British engineering group Arup by impersonating the CFO using deepfake technology. A staff member transferred funds to Hong Kong accounts after a video conference with the fraudulent CFO and other AI-generated employees. | Arup | Video Audio | CFO Dive |
| Aug 31, 2024 | Lovo, a text-to-speech platform, allegedly obtained voice recordings from Paul Skye Lehrman and Linnea Sage through deception on Fiverr, claiming the recordings were for "research into speech synthesis." Lovo then allegedly created AI clones of their voices and sold them without permission or proper compensation. A lawsuit was filed alleging violations of rights of publicity and breach of contract. | Paul Skye Lehrman and Linnea Sage | Audio | BBC.com |
| Aug 29, 2024 | Multiple scam campaigns using deepfake videos of public figures to promote fake investment schemes and government giveaways. The campaigns were conducted in multiple languages and targeted various countries. A significant number of domains were used, and analysis suggests a single threat actor group was responsible. The Quantum AI campaign is highlighted as an example, using videos featuring Elon Musk, Tucker Carlson, Lee Hsien Loong, and Tharman Shanmugaratnam with AI-generated audio and lip-syncing. | Multiple individuals including Elon Musk, Tucker Carlson, Lee Hsien Loong, and Tharman Shanmugaratnam, and various government entities | Video Audio | Unit 42 |
| Aug 21, 2024 | AI-generated robocall impersonating President Biden's voice, urging voters not to vote. Orchestrated by political consultant Steve Kramer, who faces separate penalties. Lingo Telecom, the voice service provider, paid a $1 million fine. | New Hampshire Democratic primary voters | Audio | NBC News |
| Aug 15, 2024 | A robocall featuring an AI-generated voice of President Biden urged Democrats not to vote in the New Hampshire primary. Paul Carpenter created the deepfake and was paid $150 by Steve Kramer, a political consultant who faces charges related to the robocall. The Phillips campaign denied involvement. | Democratic voters in the New Hampshire primary | Audio | CBS Boston |
| Aug 01, 2024 | A manipulated audio and video clip of Kamala Harris was shared by Elon Musk on X, sparking debate about deepfakes and their regulation. The deepfake, viewed over 150 million times, included edited clips and comments on diversity, Biden, and border policies. Similar deepfakes targeting other politicians have also emerged. | Kamala Harris | Audio Video | NBC News |
| Jul 09, 2024 | Robocalls with a deepfake of President Biden's voice discouraged voters in the 2024 New Hampshire presidential primary. The alleged perpetrator was charged with felonies and misdemeanors related to voter suppression and impersonation, and faces a potential $6 million fine from the FCC. | New Hampshire primary voters | Audio | The Fulcrum |
| Jul 03, 2024 | A Baltimore high school principal was falsely depicted making racist and anti-Semitic remarks in a deepfake audio clip shared over 27,000 times. This led to his temporary suspension until the deepfake was proven false, resulting in a teacher's arrest. In February 2023, students in Putnam County, New York, created a deepfake video of their principal making violent threats. While disciplinary action was taken, some parents felt the school's response was insufficient. In October 2023, male students in New Jersey created pornographic deepfakes of female classmates, leading to parental criticism of the school's response. A Seattle-area high school failed to report a similar incident to law enforcement, highlighting the legal obligation to report such cases involving minors. | Baltimore high school principal;Putnam County, New York principal;female students in New Jersey;female classmates in Seattle-area high school | Audio Video | Atkinson, Andelson, Loya, Ruud & Romo |
| Jun 26, 2024 | Two voice actors, Paul Skye Lehrman and Linnea Sage, are suing AI company Lovo for using their voice clips to train an AI voice cloning tool without consent. Their voices were allegedly used in YouTube videos and podcasts. | Paul Skye Lehrman and Linnea Sage | Audio | CBS News |
| Jun 17, 2024 | A deepfake video ad was created by a rival PAC during a Shreveport mayoral race. The ad falsely depicted Perkins as a student being scolded by a principal for failing to keep communities safe and create jobs. Perkins lost his reelection bid and believes the deepfake ad was a significant factor. | Adrian Perkins | Video | PBS NewsHour |
| May 31, 2024 | In January 2024, a deepfake of President Biden's voice, created using ElevenLabs' technology, circulated before the New Hampshire primary. In March 2024, a fabricated recording of a Slovakian presidential candidate falsely boasting about election rigging and price increases went viral, potentially influencing the election results. | President Biden, Rishi Sunak, Ursula von der Leyen, Slovakian presidential candidate | Audio | Oregon Public Broadcasting |
| May 29, 2024 | In January 2024, a Hong Kong firm lost US\$25 million to fraudsters using a deepfake video call to impersonate executives. | A Hong Kong firm | Video | Deloitte |
| May 23, 2024 | AI-generated deepfake robocall impersonating President Biden discouraged voters in New Hampshire's January primary. Political consultant Steve Kramer faces $6 million fine from the FCC and criminal charges for the incident. | Democratic voters in New Hampshire | Audio | NPR |
| May 09, 2024 | Approximately 5,000 New Hampshire voters received a robocall featuring an AI-generated voice of Joe Biden urging them not to vote in the primary, suggesting their votes would benefit Republicans. The software used was from ElevenLabs, requiring only a few hours of voice samples to create a convincing clone. | New Hampshire voters | Audio | The Atlantic |
| Apr 10, 2024 | An AI-generated voice impersonating President Joe Biden was used in a telephone message urging New Hampshire voters to abstain from the presidential primary. Election officials are investigating this incident. | New Hampshire voters | Audio | VOA Learning English |
| Apr 01, 2024 | Imran Khan, Pakistan's jailed former Prime Minister, used AI-generated speeches to reach supporters before the February parliamentary elections. A political operative for Dean Phillips used a robocall impersonating President Joe Biden to discourage voters in the New Hampshire Democratic primary. | Imran Khan, Joe Biden | Audio | Al Jazeera English |
| Mar 11, 2024 | A synthesized version of Will Trapp's voice was used in a phone call scam. The callers, posing as a police officer and then a public defender, instructed Trapp's parents to withdraw $15,000 for his bail after a fake car accident. | Will Trapp's parents | Audio | Mustang News |
| Mar 07, 2024 | A Brooklyn couple, Robin and Steve, were targeted in a deepfake voice scam where the scammers convincingly mimicked the voice of Steve's mother, Mona, to extort money. The scammers demanded money, claiming to hold Mona hostage. After receiving the money via Venmo, they hung up. Mona was unharmed. | Robin and Steve | Audio | The New Yorker |
Deepfake Reports
Deepfake Impersonation Targeting Senator Ben Cardin
Date of Incident: Mid-September 2024Target: Senator Ben Cardin, Chair of the Senate Foreign Relations CommitteeNature of Incident: Sophisticated deepfake impersonation of a high-ranking Ukrainian official In mid-September 2024, Senator Ben Cardin was targeted by a...
Justin Bieber AI-Generated Deepfake Song referencing Sean “Diddy” Combs
In April 2024, an AI-generated song purportedly performed by Justin Bieber began circulating widely on social media platforms, particularly TikTok and YouTube. The song, which included lyrics referencing Sean "Diddy" Combs, initially deceived many listeners into...
LeBron James Olympic Team USA Criticism
On August 9th, 2024, a social media post containing an alleged audio clip of NBA star LeBron James criticizing Team USA head coach Steve Kerr went viral. The post, made by Twitter user @RealRobReinhart, claimed to have obtained "locker room audio" of James disparaging...
Malaysian singer Siti Nurhaliza deepfake
Overview Malaysian singer Siti Nurhaliza has warned her fans about a viral scam using AI-generated calls, deepfake videos, and images to deceive people into believing she is offering cash rewards or organizing contests. The scammers have hijacked her voice, likeness,...
Joe Biden call to Kamala Harris
A controversy has emerged regarding the authenticity of Joe Biden’s phone call to Kamala Harris, during her speech to campaign staff members in Delaware. Allegations have circulated that this call was a deepfake, artificially generated using advanced AI technology....
Analysis of the Scarlett Johansson and Open AI Sky AI Voice Controversy
The Scarlett Johansson-Open AI Sky AI voice controversy erupted when OpenAI unveiled its new AI assistant with voice capabilities, featuring a voice called "Sky" that many users found eerily similar to Johansson's voice from the movie "Her." Background In May 2024,...
LastPass CEO Audio Deepfake Incident
LastPass revealed that one of its employees was targeted in a sophisticated voice phishing attack. The attackers used deepfake audio technology to impersonate Karim Toubba, the CEO of LastPass, in an attempt...
Arcads AI Deepfake Video
On March 25, 2024, a Twitter user named Beck (@beckylitv) posted a 46-second video that was created using artificial intelligence (AI) technology, specifically the Arcads.ai platform. The video featured a deepfake of an unidentified woman delivering a script in a car....
Cal Poly AI Voice Cloning Scam Case
A recent incident at Cal Poly has highlighted the growing concern over AI voice cloning and its use in phone scams. A family associated with Cal Poly was targeted by scammers who utilized AI voice cloning technology. This technology allows for the creation of...
Deepfake Leads to $25 Million Loss: Employee Tricked by Deepfake CFO
A finance worker at a multinational firm was defrauded of $25 million in an elaborate scam involving deepfake technology. The employee was tricked into participating in a video call with several individuals he believed to be colleagues, including the company's...
Deepfake Black Celebrities: AI Misinformation on YouTube
Fake news creators on YouTube have been exploiting artificial intelligence (AI) and automated tools to generate and disseminate misinformation targeting Black celebrities, creating a significant challenge in the digital information landscape. This trend of deepfake...
Fake Joe Biden robocall: AI-Generated Election Interference
In a startling incident that underscores the potential misuse of artificial intelligence in politics, a robocall featuring an AI-generated voice resembling President Joe Biden circulated in New Hampshire, causing...
More From Resemble AI
Rapid Voice Cloning 2.0: New Voice Cloning Model with Unmatched Accuracy
Today, Resemble AI announced its latest breakthrough model, Rapid Voice Clone 2.0, enabling users to generate high-quality voice content with just 20 seconds of audio. This powerful tool allows seamless voice generation, editing, and localization, empowering users to...
Introducing State-of-the-Art in Multimodal Deepfake Detection
Today, we present our research on Multimodal Deepfake Detection, expanding our industry-leading deepfake detection platform to support image and video analysis. Our approach builds on our established audio detection system to deliver comprehensive protection across...
Resemble AI Partners with Carahsoft to Bring Voice AI and Deepfake Detection to the Public Sector
We are thrilled to announce our strategic partnership with Carahsoft Technology Corp., The Trusted Government IT Solutions Provider®. This collaboration marks a significant milestone in our mission to bring cutting-edge voice AI technology and advanced deepfake...