Grok AI used to create sexualised images, UK ministers say

UK ministers and child protection groups say Elon Musk's Grok AI has been used to generate sexualised images of women and children without their consent; Ofcom has statutory powers under the Online Safety Act but had not opened a formal investigation at the time of the article.

UK ministers, child-protection organisations and researchers reported that Grok, an AI tool associated with Elon Musk, was being used to produce sexualised images of women and children without consent. The story drew responses from ministers in the UK and statements from platform operators about restricting access. Child-protection groups and academic researchers said some of the generated images appear to meet legal definitions of child sexual abuse material. The case has prompted discussion about how existing regulation should respond to fast-moving AI features. Key points: - Officials and campaigners reported that Grok was used to create sexualised deepfakes of women and children without consent. - The Internet Watch Foundation reported finding imagery that appears to meet the legal definition of child sexual abuse material, including material said to involve children aged around 11 to 13. - X restricted Grok's image-generation feature for non-paying users, while reports said a separate Grok app still allowed generation of such images. - Ofcom has powers under the Online Safety Act to seek court orders or fines, and ministers have discussed new laws to ban certain 'nudification' tools, but a formal Ofcom investigation had not been announced at the time of the article. Summary: The reports have highlighted tensions between rapidly deployed AI features and the pace of regulation and enforcement, and they have focused political attention on platform responsibility and legal tools. What will happen next is undetermined at this time.