The European Union has opened an investigation into Elon Musk’s social media platform X over concerns that its artificial intelligence chatbot, Grok, may have been involved in generating and distributing illegal sexualised content. This action follows widespread public concern after images depicting manipulated, sexualised representations of women and children circulated online, drawing global condemnation. The probe is focused on whether X, under Musk’s ownership, adequately protected users and implemented safeguards against such harmful AI-generated content.
The European Commission, the EU’s executive arm responsible for enforcing regulatory compliance across the bloc’s 27 member states, stated that the investigation will examine how X assessed and mitigated risks associated with Grok’s functionalities. Officials are concerned that the rollout of the AI system in Europe may have overlooked key protections, leaving users vulnerable to illegal and harmful content. While AI-generated images have emerged as a global concern, the EU is emphasizing the need for platforms to proactively ensure compliance with existing laws, particularly the Digital Services Act (DSA), which mandates strict measures to curb the spread of illegal online content.
This investigation comes just weeks after the United Kingdom’s media regulator, Ofcom, launched a separate inquiry into Grok. Ofcom’s review was prompted by reports that the chatbot was producing sexually explicit deepfake images, raising serious ethical and legal concerns. In addition, several Southeast Asian countries, including Indonesia, the Philippines, and Malaysia, temporarily blocked access to Grok after reports of sexually suggestive AI-generated images emerged. Authorities in these countries acted swiftly to protect citizens, highlighting the international dimension of the issue and the growing scrutiny of AI tools worldwide.
Henna Virkkunen, the EU’s technology commissioner, described the situation in stark terms, saying, “Non-consensual sexual deepfakes of women and children are a violent, unacceptable form of degradation.” Her statement underscored the EU’s firm stance against AI-generated sexualised content, particularly when it involves minors or non-consenting adults. The Commission’s position aligns with a broader global outcry over the misuse of AI in creating harmful imagery, reflecting the urgent need for social media platforms to implement robust ethical guidelines and technological safeguards.
X responded by highlighting a January 14 statement issued by its parent company, xAI. The company said that it had introduced restrictions to limit image editing capabilities within Grok and had blocked users in certain jurisdictions from generating images of individuals in revealing clothing where such content is illegal. Although the statement did not specify the countries, it emphasized that additional safety measures were being implemented to prevent the creation and dissemination of inappropriate images. Following these interventions, access to Grok was restored in Malaysia and the Philippines.
Despite these changes, EU officials have indicated that the measures are insufficient to fully address the systemic risks posed by Grok. A senior Commission representative told reporters that X had not conducted a targeted risk assessment when deploying Grok in Europe, suggesting a lack of due diligence in evaluating potential harms before introducing the AI functionality to the market. This highlights a critical regulatory challenge as governments and oversight bodies struggle to keep pace with the rapid development of AI technologies and their real-world impact.
The ongoing investigation also carries geopolitical implications. Regulatory scrutiny from the EU could provoke reactions from the United States, particularly given the complex dynamics between Big Tech companies and government oversight. Previous EU initiatives to regulate technology giants have sometimes been met with criticism from U.S. policymakers and threats of trade countermeasures, reflecting the delicate balance of enforcing digital safety standards while maintaining international business relations. Virkkunen emphasized this dimension, stating, “With this investigation, we will determine whether X has met its legal obligations under the DSA, or whether it treated rights of European citizens—including those of women and children—as collateral damage of its service.”
