Social Media: Gateway to Deepfake Nude Apps

What Happened?

A study published by the nonprofit organization Graphika and reported by Wired reveals that YouTube and X (formerly Twitter) act as 'gateways' to deepfake nude apps. These apps, known as 'nudify', allow users to upload a photo of a person and generate a synthetic nude version, all for as little as $1 per image. Researchers found that the platforms host promotional content—including tutorials, reviews, and links—that directs users to these services, often bypassing moderation policies.

Graphika's report, titled “Nudify” Apps: The New Frontier of Non-Consensual Intimate Imagery, analyzed over 100 such apps and websites, identifying that many use social media platforms as their primary marketing channel. Researchers documented hundreds of posts on YouTube and X that included direct or shortened links to these apps, sometimes disguised as photo editing tutorials or software reviews. Some of these posts accumulated thousands of views and comments from users seeking more detailed instructions.

The study also notes that these apps often operate in a legal gray area: while most countries have laws against child pornography or non-consensual distribution of intimate images, the creation of sexual deepfakes is not always explicitly criminalized. However, in the United States, the Federal Trade Commission (FTC) has warned that these practices could violate consumer protection laws if apps do not adequately inform users about consent. Additionally, several states including California, New York, and Texas have passed or are considering laws that specifically penalize non-consensual sexual deepfakes.

Why Is This Important?

The problem is not new, but the scale and accessibility are. Just a few years ago, creating a deepfake required technical expertise and powerful hardware. Now, anyone with a few dollars can generate non-consensual sexual material. Victims are primarily women, and the psychological and reputational damage is immense. A 2023 study by the organization Deeptrace estimated that 96% of online deepfakes are non-consensual pornography, and 99% of victims are women. Graphika's study documented that some of these apps have millions of users and generate significant revenue through subscriptions, some up to $30 per month.

The impact goes beyond individuals: companies are also vulnerable. Female executives, celebrities, and public figures have been targeted by these deepfakes, which can damage their reputation and affect their careers. In the corporate sphere, deepfakes can be used for blackmail or defamation, as happened in 2023 when a deepfake of a CEO was used to trick an employee into transferring $25 million. Although that case was financial, the underlying technology is the same.

The FTC has already taken action against companies offering deepfake nude services. In 2022, the agency fined the app FaceApp for deceiving users about the use of their photos, but no specific actions have been taken against nudify apps. However, the U.S. Congress is considering the Preventing Non-Consensual Sexual Deepfakes Act, which would make the creation and distribution of such content a federal crime. Meanwhile, platforms like Meta and TikTok have updated their policies to explicitly ban non-consensual intimate deepfakes, though enforcement remains a challenge.

Consequences and Outlook

This finding pressures platforms to take stricter measures. YouTube, for example, already banned links to these apps, but researchers found that evaders use link shorteners and coded keywords like “nudify” or “undress ai”. X, under Elon Musk's leadership, has reduced its moderation team by 80% since acquiring the platform in 2022, which could exacerbate the problem. According to a 2023 Bloomberg report, X now relies more on automated systems than human moderators, making it easier for harmful content to go unnoticed.

In the long term, regulators are expected to hold platforms accountable for the content they host, similar to copyright laws. The European Union's Digital Services Act (DSA), which came into effect in 2024, imposes stricter obligations on platforms to remove illegal content, including non-consensual deepfakes. In the United States, Section 230 of the Communications Decency Act protects platforms from being held liable for third-party content, but there are growing calls to reform it for cases of sexual abuse.

For users, the lesson is clear: never share intimate photos online and enable strict privacy settings. However, this is not enough, as deepfakes can be created from public social media photos. Tech companies must invest in proactive deepfake detection and quickly remove abusive content. Tools like StopNCII.org allow victims to generate a hash of their images so platforms can block them, but adoption is still limited.

“Social media has become the primary distribution channel for these harmful tools,” the Graphika report states.

What Should Readers Know?

• It's not a marginal problem: The study identified dozens of apps with millions of combined downloads. Some, like Undress.app, report over 10 million downloads on Google Play.
• The cost is minimal: Some offer the first image for free and then charge subscriptions under $10 per month. The low price lowers the barrier for abusers.
• Platforms have policies but don't enforce them: YouTube prohibits non-consensual sexual content, but links slip through via shorteners like Bitly or TinyURL. X also has policies, but reduced moderation allows content to persist.
• Protection tools exist: Services like StopNCII.org allow victims to generate a hash of their images for platforms to block. Browser extensions that detect deepfakes also exist, though accuracy varies.
• Legislation in motion: Countries like the UK and Australia have already criminalized the creation of non-consensual sexual deepfakes. In Spain, the Organic Law on Comprehensive Guarantee of Sexual Freedom could apply to these cases.

Conclusion

Graphika's study is a wake-up call. Social media is not only a showcase for legitimate content but also a vector for abuse. The solution requires cooperation between platforms, regulators, and users. Meanwhile, the threat of non-consensual sexual deepfakes will continue to grow if drastic measures are not taken. Technology advances faster than the law, and every day without coordinated action exposes more potential victims. It's time for platforms to take responsibility and for governments to equip authorities with the legal tools needed to combat this scourge.