Artificial intelligence has revolutionized digital creativity, but critics warn it is also accelerating the spread of harmful content online. Researchers and digital rights groups say platforms such as X (formerly Twitter) and Meta-owned services are increasingly struggling to control the explosion of AI-generated pornographic material and deepfake videos.

The term “Enschittification 2.0”—a concept used by technology critics to describe the gradual decline in platform quality due to profit-driven decisions—is now being used to describe how major social networks may be enabling the spread of synthetic sexual content and manipulated media.

Deepfakes Becoming Easier to Produce and Share

Experts say recent advancements in generative AI tools have made it significantly easier for users to create realistic images or videos that depict individuals in fabricated situations. These tools can generate explicit content featuring celebrities, influencers, or private individuals with minimal technical knowledge.

Once created, such content can spread rapidly through social platforms where algorithms prioritize engagement. Researchers note that the viral nature of these systems often amplifies sensational or controversial posts, making AI-generated explicit content more visible.

Platforms Accused of Slow Enforcement

Critics argue that moderation systems on X and Meta platforms have not kept pace with the surge in AI-generated media. Although both companies maintain policies against non-consensual explicit imagery and manipulated content, enforcement can be inconsistent.

Digital safety advocates claim reporting and removal processes are often slow, allowing harmful material to circulate widely before action is taken. In some cases, victims have reported difficulty having deepfake content removed entirely from the internet.

The Economic Incentive Behind Engagement

Technology analysts suggest that engagement-driven algorithms may unintentionally promote sensational AI content. Posts that generate strong reactions—whether outrage or curiosity—can receive more visibility, helping them spread faster.

This dynamic has led critics to argue that platforms may indirectly benefit from controversial content because it keeps users active and increases advertising opportunities.

Impact on Victims and Public Trust

The rise of AI porn and deepfake videos has raised serious concerns about privacy, consent, and misinformation. Victims of synthetic pornography often face reputational damage, harassment, and emotional distress.

Beyond individual harm, experts warn that widespread deepfakes could undermine trust in digital media. As manipulated videos become harder to distinguish from real footage, the public may become increasingly skeptical of authentic information.

Governments and Regulators Increasing Pressure

Authorities in several countries are beginning to examine how social media companies handle AI-generated content. Some regulators are exploring laws that would require platforms to detect, label, or remove synthetic media more quickly.

Technology policy researchers say stronger regulation could force companies to invest in more advanced detection systems and clearer moderation policies.

The Next Phase of the Platform Economy

The debate around “Enschittification 2.0” highlights growing concerns about the direction of major technology platforms. As AI tools continue to evolve, companies face mounting pressure to balance innovation, user engagement, and digital safety.