Instagram is facing a surge of AI-generated influencers who are stealing videos from real models and adult content creators. These AI alters use the stolen content, apply AI-generated faces, and monetize through links to various sites and apps. Despite being first reported by 404 Media in April, the issue has grown rapidly, posing a threat to human creators on the platform, who find their ability to earn a living compromised. Our investigation found more than 1, 000 AI influencer accounts, made using readily available AI tools and apps, some hosted on popular app stores. This phenomenon indicates a potential future where AI-generated content could overshadow human contributions on social media. The creators of these accounts openly discuss strategies for creating and profiting from AI models on platforms like Discord. Elaina St James, an adult content creator, reports significant drops in viewership, attributing this partly to the rise of AI rip-offs. Security expert Alexios Mantzarlis compiled about 900 such accounts, believing he could find many more if Instagram hadn’t restricted his access to scrape the platform. These AI accounts, including some using deepfakes, often do not disclose their artificial nature, misleading audiences and monetizing real people's likenesses.

For example, the account "Chloe Johnson" amassed followers with content using face-swapped images stolen from real models. Many such accounts suggest monetization on platforms like Fanvue, a competitor to OnlyFans. Guides like "Instagram Mastery" and "AI Influencer Accelerator" teach people how to create and profit from these AI influencers, framing it as a business tapping into the "loneliness market. " The success of some AI accounts, like "Emily Pellegrini, " conveys the profitability of being an anonymous AI influencer, surmounting the human limitations faced by real creators. Despite being anti-deepfake, certain AI influencer groups still utilize questionable strategies, such as recreating attributes of celebrities or blending real humans into AI models. The industry thrives off tools available in app stores and spreadsheets from PDF and video guides. Apps like HelloFace facilitate easy creation of AI deepfakes. Instagram has been criticized for failing to act against these accounts, which affects genuine creators who struggle with imposters. The platform's policies often leave adult creators vulnerable, as reporting impersonators can backfire, causing their legitimate accounts to be banned. Further scrutiny is necessary, as Instagram benefits from the increased engagement these accounts bring, potentially prioritizing traffic over authenticity. Some experts worry that genuine accounts might become a minority if the trend continues without intervention.