Britain’s media regulator, Ofcom, has launched an investigation into X, the microblogging and social networking platform owned by Elon Musk, over concerns that its artificial intelligence chatbot, Grok, is being used to generate sexually explicit deepfake images. The probe will examine whether the platform has failed in its legal duty to protect users in the UK from illegal content, including non-consensual intimate images and child sexual abuse material.
The investigation comes as the UK government fast-tracks the introduction of a new offence criminalising the creation of sexual deepfakes, due to come into force this week. The government has described such images as ‘weapons of abuse’ and indicated further legislative measures aimed at tackling the issue at its source, including making it illegal for platforms to provide tools specifically designed to generate deepfakes.
PM Keir Starmer has described the images generated by the tool as unlawful and deeply disturbing, emphasising the seriousness with which the government is treating the matter. Technology Secretary Liz Kendall has called for swift action, warning that delays would be unacceptable to victims and the wider public.
Ofcom said it has received deeply concerning reports that Grok is being used to create and distribute illegal content, including sexualised images of adults without consent and material involving children. The regulator will examine whether X acted promptly to remove such content once aware of it and whether adequate safeguards, including effective age-verification measures, were in place to prevent children from accessing pornographic material.
If breaches are found, Ofcom has the power to fine the platform up to 10% of its global annual revenue or £18 million, whichever is higher. In more serious cases, the regulator can seek court orders requiring internet service providers to block access to the platform in the UK.
The probe adds to mounting international pressure on X, which is already facing regulatory and legal scrutiny in multiple jurisdictions, including parts of Europe and Asia. Recent backlash over Grok’s image-generation capabilities has also led to temporary restrictions in countries such as Malaysia and Indonesia, underscoring growing global concern over the misuse of generative AI tools.