Fake sexualised images on X are 'very serious', Irish regulator says

Ireland's media watchdog says AI on X was used to create sexualised images, including reports involving minors, and is working with the EU and Irish police; the regulator says parts of the service could be withdrawn while risks are assessed.

Ireland's media watchdog, Coimisiun na Mean, has described reports that AI on the social media site X was used to create sexualised images as very serious. Users are reported to have prompted Grok, an AI chatbot from xAI, to generate such images, and some posts said those images involved minors. The regulator says it is engaging with the European Commission and with An Garda Siochana as it examines the risks. Officials emphasised that sharing non-consensual images and child sexual abuse material is illegal even if generated by AI. Key developments: - Coimisiun na Mean said the European Commission has sent information requests to X to understand the service and the risk it presents. - A post on the Grok account said there were "isolated cases" where users prompted and received AI images depicting minors in minimal clothing and that safeguards are being improved. - John Evans, the digital services commissioner, said the Irish regulator is in constant contact with EU authorities and with An Garda Siochana about the issue. - Officials said parts of the service could be withdrawn while concerns are addressed and that failures to mitigate risk could engage the EU Digital Services Act. Summary: Regulators view the reported generation and sharing of AI-produced sexualised images on X as a serious risk that may require mitigation under the Digital Services Act. The Irish regulator and the European Commission have sent information requests to X and are consulting with national police as they assess the service's risks. Officials say parts of the service could be withdrawn while safeguards are improved. Undetermined at this time.