Tackling unlawful AI content material on social media

Parliament discusses the growing risks posed by AI-generated deepfakes and sexually exploitative content on social media platforms and calls for stronger and faster enforcement of EU laws to be enforced more effectively to prevent AI tools from creating illegal sexual content.

The debate with the European Council and European Commission follows the latest scandal related to reports the social media platform X is facilitating the creation of sexually explicit images of women and children through its AI chatbot Grok. In recent weeks, the platform has been internationally condemned with several governments banning the platform and others launching investigations into the so-called “pornification” feature putting women and minors at risk of abuse. Parliament is expected to call on the Commission to act more decisively under the EU’s Digital Services Act (DSA) and the Artificial Intelligence Act to tackle the generation of illegal AI content.

In December 2025, the European Commission issued the first fine under the DSA against X for breaching its transparency obligations. Investigations are still ongoing to assess whether X has also breached the DSA in areas related to the dissemination of illegal content and combatting information manipulation. The Commission has condemned X for producing sexualised images and ordered it to retain all documents relating to its AI chatbot, as investigations continue.