Individuals who create or attempt to create intimate images without consent are now committing a criminal offence in the UK, as the government moves to tackle an explosion of AI-generated sexualised deepfakes, particularly on the platform X.
New Criminal Offence Comes Into Force
Technology Secretary Liz Kendall announced to MPs in the Commons that the new law took effect this week. She described the images, often targeting women and girls, as "weapons of abuse" designed to harass and violate dignity.
The legislation, part of the progressing Crime and Policing Bill, will also criminalise apps and companies that supply tools specifically designed to create such non-consensual imagery. This aims to target the problem at its source.
Ofcom Launches Formal Investigation into X
The announcement coincides with media regulator Ofcom launching a formal investigation into X, formerly Twitter, over serious concerns related to its AI chatbot, Grok. The probe will determine if X has failed its legal duties under the Online Safety Act.
Ofcom stated it is investigating whether Grok has been used to create sexualised images of children on the platform. The regulator has the power to fine X up to £18 million or 10% of its global revenue and impose business disruption measures if breaches are found.
Kendall warned Ofcom that its investigation must be swift, stating the public and victims expect decisive action and that it "must not take months and months." She urged X to act immediately to remove illegal material.
Child Safety Watchdog Finds 'Criminal Imagery'
The Internet Watch Foundation (IWF) reported last week that its analysts discovered apparent "criminal imagery" of children aged 11-13 which users claimed was created using Grok. The content was found on a dark web forum.
In response, a post on Grok's official X account earlier this month acknowledged "lapses in safeguards" were being urgently fixed, and reiterated that child sexual abuse material (CSAM) is illegal. Elon Musk stated that anyone using Grok for illegal content would face consequences.
However, X's subsequent move to make deepfake creation a "premium service" – requiring payment – was dismissed by Downing Street as an "insult to victims." Liz Kendall condemned the approach as "monetising abuse."
The government is also reviewing its own use of the X platform following calls from some MPs for Labour to cease its activity there.